[PATCH v19 00/20] per memcg lru_lock

[PATCH v19 00/20] per memcg lru_lock

[Alex Shi]

The new version rebased on v5.9-rc6 with line by line review by Hugh Dickins.
Millions thanks! And removed the 4th part from last version which do post
optimization, that we can repost after the main part get merged. About one
year coding and review, now I believe it's ready.

So now this patchset includes 3 parts:
1, some code cleanup and minimum optimization as a preparation. 
2, use TestCleanPageLRU as page isolation's precondition.
3, replace per node lru_lock with per memcg per node lru_lock.

Current lru_lock is one for each of node, pgdat->lru_lock, that guard for
lru lists, but now we had moved the lru lists into memcg for long time. Still
using per node lru_lock is clearly unscalable, pages on each of memcgs have
to compete each others for a whole lru_lock. This patchset try to use per
lruvec/memcg lru_lock to repleace per node lru lock to guard lru lists, make
it scalable for memcgs and get performance gain.

Currently lru_lock still guards both lru list and page's lru bit, that's ok.
but if we want to use specific lruvec lock on the page, we need to pin down
the page's lruvec/memcg during locking. Just taking lruvec lock first may be
undermined by the page's memcg charge/migration. To fix this problem, we could
take out the page's lru bit clear and use it as pin down action to block the
memcg changes. That's the reason for new atomic func TestClearPageLRU.
So now isolating a page need both actions: TestClearPageLRU and hold the
lru_lock.

The typical usage of this is isolate_migratepages_block() in compaction.c
we have to take lru bit before lru lock, that serialized the page isolation
in memcg page charge/migration which will change page's lruvec and new 
lru_lock in it.

The above solution suggested by Johannes Weiner, and based on his new memcg 
charge path, then have this patchset. (Hugh Dickins tested and contributed much
code from compaction fix to general code polish, thanks a lot!).

Daniel Jordan's testing show 62% improvement on modified readtwice case
on his 2P * 10 core * 2 HT broadwell box.
https://lore.kernel.org/lkml/20200915165807.kpp7uhiw7l3loofu@ca-dmjordan1.us.oracle.com/

Thanks Hugh Dickins and Konstantin Khlebnikov, they both brought this
idea 8 years ago, and others who give comments as well: Daniel Jordan, 
Mel Gorman, Shakeel Butt, Matthew Wilcox, Alexander Duyck etc.

Thanks for Testing support from Intel 0day and Rong Chen, Fengguang Wu,
and Yun Wang. Hugh Dickins also shared his kbuild-swap case. Thanks!


Alex Shi (17):
  mm/memcg: warning on !memcg after readahead page charged
  mm/memcg: bail early from swap accounting if memcg disabled
  mm/thp: move lru_add_page_tail func to huge_memory.c
  mm/thp: use head for head page in lru_add_page_tail
  mm/thp: Simplify lru_add_page_tail()
  mm/thp: narrow lru locking
  mm/vmscan: remove unnecessary lruvec adding
  mm/memcg: add debug checking in lock_page_memcg
  mm/swap.c: fold vm event PGROTATED into pagevec_move_tail_fn
  mm/lru: move lock into lru_note_cost
  mm/vmscan: remove lruvec reget in move_pages_to_lru
  mm/mlock: remove lru_lock on TestClearPageMlocked
  mm/mlock: remove __munlock_isolate_lru_page
  mm/lru: introduce TestClearPageLRU
  mm/compaction: do page isolation first in compaction
  mm/swap.c: serialize memcg changes in pagevec_lru_move_fn
  mm/lru: replace pgdat lru_lock with lruvec lock

Alexander Duyck (1):
  mm/lru: introduce the relock_page_lruvec function

Hugh Dickins (2):
  mm: page_idle_get_page() does not need lru_lock
  mm/lru: revise the comments of lru_lock

 Documentation/admin-guide/cgroup-v1/memcg_test.rst |  15 +-
 Documentation/admin-guide/cgroup-v1/memory.rst     |  21 +--
 Documentation/trace/events-kmem.rst                |   2 +-
 Documentation/vm/unevictable-lru.rst               |  22 +--
 include/linux/memcontrol.h                         | 110 +++++++++++
 include/linux/mm_types.h                           |   2 +-
 include/linux/mmdebug.h                            |  13 ++
 include/linux/mmzone.h                             |   6 +-
 include/linux/page-flags.h                         |   1 +
 include/linux/swap.h                               |   4 +-
 mm/compaction.c                                    |  94 +++++++---
 mm/filemap.c                                       |   4 +-
 mm/huge_memory.c                                   |  45 +++--
 mm/memcontrol.c                                    |  85 ++++++++-
 mm/mlock.c                                         |  63 ++-----
 mm/mmzone.c                                        |   1 +
 mm/page_alloc.c                                    |   1 -
 mm/page_idle.c                                     |   4 -
 mm/rmap.c                                          |   4 +-
 mm/swap.c                                          | 199 ++++++++------------
 mm/vmscan.c                                        | 203 +++++++++++----------
 mm/workingset.c                                    |   2 -
 22 files changed, 523 insertions(+), 378 deletions(-)

-- 
1.8.3.1

[PATCH v19 01/20] mm/memcg: warning on !memcg after readahead page charged

[Alex Shi]

Add VM_WARN_ON_ONCE_PAGE() macro.

Since readahead page is charged on memcg too, in theory we don't have to
check this exception now. Before safely remove them all, add a warning
for the unexpected !memcg.

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Michal Hocko <mhocko@suse.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Michal Hocko <mhocko@kernel.org>
Cc: Vladimir Davydov <vdavydov.dev@gmail.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: cgroups@vger.kernel.org
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 include/linux/mmdebug.h | 13 +++++++++++++
 mm/memcontrol.c         | 11 ++++-------
 2 files changed, 17 insertions(+), 7 deletions(-)

diff --git a/include/linux/mmdebug.h b/include/linux/mmdebug.h
index 2ad72d2c8cc5..4ed52879ce55 100644
--- a/include/linux/mmdebug.h
+++ b/include/linux/mmdebug.h
@@ -37,6 +37,18 @@
 			BUG();						\
 		}							\
 	} while (0)
+#define VM_WARN_ON_ONCE_PAGE(cond, page)	({			\
+	static bool __section(.data.once) __warned;			\
+	int __ret_warn_once = !!(cond);					\
+									\
+	if (unlikely(__ret_warn_once && !__warned)) {			\
+		dump_page(page, "VM_WARN_ON_ONCE_PAGE(" __stringify(cond)")");\
+		__warned = true;					\
+		WARN_ON(1);						\
+	}								\
+	unlikely(__ret_warn_once);					\
+})
+
 #define VM_WARN_ON(cond) (void)WARN_ON(cond)
 #define VM_WARN_ON_ONCE(cond) (void)WARN_ON_ONCE(cond)
 #define VM_WARN_ONCE(cond, format...) (void)WARN_ONCE(cond, format)
@@ -48,6 +60,7 @@
 #define VM_BUG_ON_MM(cond, mm) VM_BUG_ON(cond)
 #define VM_WARN_ON(cond) BUILD_BUG_ON_INVALID(cond)
 #define VM_WARN_ON_ONCE(cond) BUILD_BUG_ON_INVALID(cond)
+#define VM_WARN_ON_ONCE_PAGE(cond, page)  BUILD_BUG_ON_INVALID(cond)
 #define VM_WARN_ONCE(cond, format...) BUILD_BUG_ON_INVALID(cond)
 #define VM_WARN(cond, format...) BUILD_BUG_ON_INVALID(cond)
 #endif
diff --git a/mm/memcontrol.c b/mm/memcontrol.c
index cfa6cbad21d5..f7094a04be07 100644
--- a/mm/memcontrol.c
+++ b/mm/memcontrol.c
@@ -1322,10 +1322,7 @@ struct lruvec *mem_cgroup_page_lruvec(struct page *page, struct pglist_data *pgd
 	}
 
 	memcg = page->mem_cgroup;
-	/*
-	 * Swapcache readahead pages are added to the LRU - and
-	 * possibly migrated - before they are charged.
-	 */
+	VM_WARN_ON_ONCE_PAGE(!memcg, page);
 	if (!memcg)
 		memcg = root_mem_cgroup;
 
@@ -6912,8 +6909,8 @@ void mem_cgroup_migrate(struct page *oldpage, struct page *newpage)
 	if (newpage->mem_cgroup)
 		return;
 
-	/* Swapcache readahead pages can get replaced before being charged */
 	memcg = oldpage->mem_cgroup;
+	VM_WARN_ON_ONCE_PAGE(!memcg, oldpage);
 	if (!memcg)
 		return;
 
@@ -7110,7 +7107,7 @@ void mem_cgroup_swapout(struct page *page, swp_entry_t entry)
 
 	memcg = page->mem_cgroup;
 
-	/* Readahead page, never charged */
+	VM_WARN_ON_ONCE_PAGE(!memcg, page);
 	if (!memcg)
 		return;
 
@@ -7174,7 +7171,7 @@ int mem_cgroup_try_charge_swap(struct page *page, swp_entry_t entry)
 
 	memcg = page->mem_cgroup;
 
-	/* Readahead page, never charged */
+	VM_WARN_ON_ONCE_PAGE(!memcg, page);
 	if (!memcg)
 		return 0;
 
-- 
1.8.3.1

[PATCH v19 02/20] mm/memcg: bail early from swap accounting if memcg disabled

[Alex Shi]

If we disabled memcg by cgroup_disable=memory, page->memcg will be NULL
and so the charge is skipped and that will trigger a warning like below.
Let's return from the funcs earlier.

 anon flags:0x5005b48008000d(locked|uptodate|dirty|swapbacked)
 raw: 005005b48008000d dead000000000100 dead000000000122 ffff8897c7c76ad1
 raw: 0000000000000022 0000000000000000 0000000200000000 0000000000000000
 page dumped because: VM_WARN_ON_ONCE_PAGE(!memcg)
...
 RIP: 0010:vprintk_emit+0x1f7/0x260
 Code: 00 84 d2 74 72 0f b6 15 27 58 64 01 48 c7 c0 00 d4 72 82 84 d2 74 09 f3 90 0f b6 10 84 d2 75 f7 e8 de 0d 00 00 4c 89 e7 57 9d <0f> 1f 44 00 00 e9 62 ff ff ff 80 3d 88 c9 3a 01 00 0f 85 54 fe ff
 RSP: 0018:ffffc9000faab358 EFLAGS: 00000202
 RAX: ffffffff8272d400 RBX: 000000000000005e RCX: ffff88afd80d0040
 RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000000202
 RBP: ffffc9000faab3a8 R08: ffffffff8272d440 R09: 0000000000022480
 R10: 00120c77be68bfac R11: 0000000000cd7568 R12: 0000000000000202
 R13: 0057ffffc0080005 R14: ffffffff820a0130 R15: ffffc9000faab3e8
 ? vprintk_emit+0x140/0x260
 vprintk_default+0x1a/0x20
 vprintk_func+0x4f/0xc4
 ? vprintk_func+0x4f/0xc4
 printk+0x53/0x6a
 ? xas_load+0xc/0x80
 __dump_page.cold.6+0xff/0x4ee
 ? xas_init_marks+0x23/0x50
 ? xas_store+0x30/0x40
 ? free_swap_slot+0x43/0xd0
 ? put_swap_page+0x119/0x320
 ? update_load_avg+0x82/0x580
 dump_page+0x9/0xb
 mem_cgroup_try_charge_swap+0x16e/0x1d0
 get_swap_page+0x130/0x210
 add_to_swap+0x41/0xc0
 shrink_page_list+0x99e/0xdf0
 shrink_inactive_list+0x199/0x360
 shrink_lruvec+0x40d/0x650
 ? _cond_resched+0x14/0x30
 ? _cond_resched+0x14/0x30
 shrink_node+0x226/0x6e0
 do_try_to_free_pages+0xd0/0x400
 try_to_free_pages+0xef/0x130
 __alloc_pages_slowpath.constprop.127+0x38d/0xbd0
 ? ___slab_alloc+0x31d/0x6f0
 __alloc_pages_nodemask+0x27f/0x2c0
 alloc_pages_vma+0x75/0x220
 shmem_alloc_page+0x46/0x90
 ? release_pages+0x1ae/0x410
 shmem_alloc_and_acct_page+0x77/0x1c0
 shmem_getpage_gfp+0x162/0x910
 shmem_fault+0x74/0x210
 ? filemap_map_pages+0x29c/0x410
 __do_fault+0x37/0x190
 handle_mm_fault+0x120a/0x1770
 exc_page_fault+0x251/0x450
 ? asm_exc_page_fault+0x8/0x30
 asm_exc_page_fault+0x1e/0x30

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Reviewed-by: Roman Gushchin <guro@fb.com>
Acked-by: Michal Hocko <mhocko@suse.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Michal Hocko <mhocko@kernel.org>
Cc: Vladimir Davydov <vdavydov.dev@gmail.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: cgroups@vger.kernel.org
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/memcontrol.c | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/mm/memcontrol.c b/mm/memcontrol.c
index f7094a04be07..368e6ac644f0 100644
--- a/mm/memcontrol.c
+++ b/mm/memcontrol.c
@@ -7102,6 +7102,9 @@ void mem_cgroup_swapout(struct page *page, swp_entry_t entry)
 	VM_BUG_ON_PAGE(PageLRU(page), page);
 	VM_BUG_ON_PAGE(page_count(page), page);
 
+	if (mem_cgroup_disabled())
+		return;
+
 	if (cgroup_subsys_on_dfl(memory_cgrp_subsys))
 		return;
 
@@ -7166,6 +7169,9 @@ int mem_cgroup_try_charge_swap(struct page *page, swp_entry_t entry)
 	struct mem_cgroup *memcg;
 	unsigned short oldid;
 
+	if (mem_cgroup_disabled())
+		return 0;
+
 	if (!cgroup_subsys_on_dfl(memory_cgrp_subsys))
 		return 0;
 
-- 
1.8.3.1

[PATCH v19 03/20] mm/thp: move lru_add_page_tail func to huge_memory.c

[Alex Shi]

The func is only used in huge_memory.c, defining it in other file with a
CONFIG_TRANSPARENT_HUGEPAGE macro restrict just looks weird.

Let's move it THP. And make it static as Hugh Dickin suggested.

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Reviewed-by: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Hugh Dickins <hughd@google.com>
Cc: linux-kernel@vger.kernel.org
Cc: linux-mm@kvack.org
---
 include/linux/swap.h |  2 --
 mm/huge_memory.c     | 30 ++++++++++++++++++++++++++++++
 mm/swap.c            | 33 ---------------------------------
 3 files changed, 30 insertions(+), 35 deletions(-)

diff --git a/include/linux/swap.h b/include/linux/swap.h
index 661046994db4..43e6b3458f58 100644
--- a/include/linux/swap.h
+++ b/include/linux/swap.h
@@ -338,8 +338,6 @@ extern void lru_note_cost(struct lruvec *lruvec, bool file,
 			  unsigned int nr_pages);
 extern void lru_note_cost_page(struct page *);
 extern void lru_cache_add(struct page *);
-extern void lru_add_page_tail(struct page *page, struct page *page_tail,
-			 struct lruvec *lruvec, struct list_head *head);
 extern void activate_page(struct page *);
 extern void mark_page_accessed(struct page *);
 extern void lru_add_drain(void);
diff --git a/mm/huge_memory.c b/mm/huge_memory.c
index faadc449cca5..211d50f09785 100644
--- a/mm/huge_memory.c
+++ b/mm/huge_memory.c
@@ -2318,6 +2318,36 @@ static void remap_page(struct page *page)
 	}
 }
 
+static void lru_add_page_tail(struct page *page, struct page *page_tail,
+		struct lruvec *lruvec, struct list_head *list)
+{
+	VM_BUG_ON_PAGE(!PageHead(page), page);
+	VM_BUG_ON_PAGE(PageCompound(page_tail), page);
+	VM_BUG_ON_PAGE(PageLRU(page_tail), page);
+	lockdep_assert_held(&lruvec_pgdat(lruvec)->lru_lock);
+
+	if (!list)
+		SetPageLRU(page_tail);
+
+	if (likely(PageLRU(page)))
+		list_add_tail(&page_tail->lru, &page->lru);
+	else if (list) {
+		/* page reclaim is reclaiming a huge page */
+		get_page(page_tail);
+		list_add_tail(&page_tail->lru, list);
+	} else {
+		/*
+		 * Head page has not yet been counted, as an hpage,
+		 * so we must account for each subpage individually.
+		 *
+		 * Put page_tail on the list at the correct position
+		 * so they all end up in order.
+		 */
+		add_page_to_lru_list_tail(page_tail, lruvec,
+					  page_lru(page_tail));
+	}
+}
+
 static void __split_huge_page_tail(struct page *head, int tail,
 		struct lruvec *lruvec, struct list_head *list)
 {
diff --git a/mm/swap.c b/mm/swap.c
index e7bdf094f76a..1bc2fc5d8b7c 100644
--- a/mm/swap.c
+++ b/mm/swap.c
@@ -935,39 +935,6 @@ void __pagevec_release(struct pagevec *pvec)
 }
 EXPORT_SYMBOL(__pagevec_release);
 
-#ifdef CONFIG_TRANSPARENT_HUGEPAGE
-/* used by __split_huge_page_refcount() */
-void lru_add_page_tail(struct page *page, struct page *page_tail,
-		       struct lruvec *lruvec, struct list_head *list)
-{
-	VM_BUG_ON_PAGE(!PageHead(page), page);
-	VM_BUG_ON_PAGE(PageCompound(page_tail), page);
-	VM_BUG_ON_PAGE(PageLRU(page_tail), page);
-	lockdep_assert_held(&lruvec_pgdat(lruvec)->lru_lock);
-
-	if (!list)
-		SetPageLRU(page_tail);
-
-	if (likely(PageLRU(page)))
-		list_add_tail(&page_tail->lru, &page->lru);
-	else if (list) {
-		/* page reclaim is reclaiming a huge page */
-		get_page(page_tail);
-		list_add_tail(&page_tail->lru, list);
-	} else {
-		/*
-		 * Head page has not yet been counted, as an hpage,
-		 * so we must account for each subpage individually.
-		 *
-		 * Put page_tail on the list at the correct position
-		 * so they all end up in order.
-		 */
-		add_page_to_lru_list_tail(page_tail, lruvec,
-					  page_lru(page_tail));
-	}
-}
-#endif /* CONFIG_TRANSPARENT_HUGEPAGE */
-
 static void __pagevec_lru_add_fn(struct page *page, struct lruvec *lruvec,
 				 void *arg)
 {
-- 
1.8.3.1

Re: [PATCH v19 03/20] mm/thp: move lru_add_page_tail func to huge_memory.c

[Alex Shi]

There is a bit conflict when I try to rebase it to today's akpm branch
So update a rebasable one.

Thanks
Alex

From 3aa78f872deac10861aba86ddf362082afef947d Mon Sep 17 00:00:00 2001
From: Alex Shi <alex.shi@linux.alibaba.com>
Date: Tue, 26 May 2020 16:45:09 +0800
Subject: [PATCH v19 03/20] mm/thp: move lru_add_page_tail func to
 huge_memory.c

The func is only used in huge_memory.c, defining it in other file with a
CONFIG_TRANSPARENT_HUGEPAGE macro restrict just looks weird.

Let's move it THP. And make it static as Hugh Dickin suggested.

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Reviewed-by: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Hugh Dickins <hughd@google.com>
Cc: linux-kernel@vger.kernel.org
Cc: linux-mm@kvack.org
---
 include/linux/swap.h |  2 --
 mm/huge_memory.c     | 30 ++++++++++++++++++++++++++++++
 mm/swap.c            | 33 ---------------------------------
 3 files changed, 30 insertions(+), 35 deletions(-)

diff --git a/include/linux/swap.h b/include/linux/swap.h
index 667935c0dbd4..5e1e967c225f 100644
--- a/include/linux/swap.h
+++ b/include/linux/swap.h
@@ -338,8 +338,6 @@ extern void lru_note_cost(struct lruvec *lruvec, bool file,
 			  unsigned int nr_pages);
 extern void lru_note_cost_page(struct page *);
 extern void lru_cache_add(struct page *);
-extern void lru_add_page_tail(struct page *page, struct page *page_tail,
-			 struct lruvec *lruvec, struct list_head *head);
 extern void mark_page_accessed(struct page *);
 extern void lru_add_drain(void);
 extern void lru_add_drain_cpu(int cpu);
diff --git a/mm/huge_memory.c b/mm/huge_memory.c
index 6bb4a7657129..a6d25ceb95ea 100644
--- a/mm/huge_memory.c
+++ b/mm/huge_memory.c
@@ -2320,6 +2320,36 @@ static void remap_page(struct page *page, unsigned int nr)
 	}
 }
 
+static void lru_add_page_tail(struct page *page, struct page *page_tail,
+		struct lruvec *lruvec, struct list_head *list)
+{
+	VM_BUG_ON_PAGE(!PageHead(page), page);
+	VM_BUG_ON_PAGE(PageCompound(page_tail), page);
+	VM_BUG_ON_PAGE(PageLRU(page_tail), page);
+	lockdep_assert_held(&lruvec_pgdat(lruvec)->lru_lock);
+
+	if (!list)
+		SetPageLRU(page_tail);
+
+	if (likely(PageLRU(page)))
+		list_add_tail(&page_tail->lru, &page->lru);
+	else if (list) {
+		/* page reclaim is reclaiming a huge page */
+		get_page(page_tail);
+		list_add_tail(&page_tail->lru, list);
+	} else {
+		/*
+		 * Head page has not yet been counted, as an hpage,
+		 * so we must account for each subpage individually.
+		 *
+		 * Put page_tail on the list at the correct position
+		 * so they all end up in order.
+		 */
+		add_page_to_lru_list_tail(page_tail, lruvec,
+					  page_lru(page_tail));
+	}
+}
+
 static void __split_huge_page_tail(struct page *head, int tail,
 		struct lruvec *lruvec, struct list_head *list)
 {
diff --git a/mm/swap.c b/mm/swap.c
index d8313a389c84..8fd850d97df0 100644
--- a/mm/swap.c
+++ b/mm/swap.c
@@ -976,39 +976,6 @@ void __pagevec_release(struct pagevec *pvec)
 }
 EXPORT_SYMBOL(__pagevec_release);
 
-#ifdef CONFIG_TRANSPARENT_HUGEPAGE
-/* used by __split_huge_page_refcount() */
-void lru_add_page_tail(struct page *page, struct page *page_tail,
-		       struct lruvec *lruvec, struct list_head *list)
-{
-	VM_BUG_ON_PAGE(!PageHead(page), page);
-	VM_BUG_ON_PAGE(PageCompound(page_tail), page);
-	VM_BUG_ON_PAGE(PageLRU(page_tail), page);
-	lockdep_assert_held(&lruvec_pgdat(lruvec)->lru_lock);
-
-	if (!list)
-		SetPageLRU(page_tail);
-
-	if (likely(PageLRU(page)))
-		list_add_tail(&page_tail->lru, &page->lru);
-	else if (list) {
-		/* page reclaim is reclaiming a huge page */
-		get_page(page_tail);
-		list_add_tail(&page_tail->lru, list);
-	} else {
-		/*
-		 * Head page has not yet been counted, as an hpage,
-		 * so we must account for each subpage individually.
-		 *
-		 * Put page_tail on the list at the correct position
-		 * so they all end up in order.
-		 */
-		add_page_to_lru_list_tail(page_tail, lruvec,
-					  page_lru(page_tail));
-	}
-}
-#endif /* CONFIG_TRANSPARENT_HUGEPAGE */
-
 static void __pagevec_lru_add_fn(struct page *page, struct lruvec *lruvec,
 				 void *arg)
 {
-- 
1.8.3.1

[PATCH v19 04/20] mm/thp: use head for head page in lru_add_page_tail

[Alex Shi]

Since the first parameter is only used by head page, it's better to make
it explicit.

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Reviewed-by: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Hugh Dickins <hughd@google.com>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/huge_memory.c | 12 ++++++------
 1 file changed, 6 insertions(+), 6 deletions(-)

diff --git a/mm/huge_memory.c b/mm/huge_memory.c
index 211d50f09785..fa0753229b52 100644
--- a/mm/huge_memory.c
+++ b/mm/huge_memory.c
@@ -2318,19 +2318,19 @@ static void remap_page(struct page *page)
 	}
 }
 
-static void lru_add_page_tail(struct page *page, struct page *page_tail,
+static void lru_add_page_tail(struct page *head, struct page *page_tail,
 		struct lruvec *lruvec, struct list_head *list)
 {
-	VM_BUG_ON_PAGE(!PageHead(page), page);
-	VM_BUG_ON_PAGE(PageCompound(page_tail), page);
-	VM_BUG_ON_PAGE(PageLRU(page_tail), page);
+	VM_BUG_ON_PAGE(!PageHead(head), head);
+	VM_BUG_ON_PAGE(PageCompound(page_tail), head);
+	VM_BUG_ON_PAGE(PageLRU(page_tail), head);
 	lockdep_assert_held(&lruvec_pgdat(lruvec)->lru_lock);
 
 	if (!list)
 		SetPageLRU(page_tail);
 
-	if (likely(PageLRU(page)))
-		list_add_tail(&page_tail->lru, &page->lru);
+	if (likely(PageLRU(head)))
+		list_add_tail(&page_tail->lru, &head->lru);
 	else if (list) {
 		/* page reclaim is reclaiming a huge page */
 		get_page(page_tail);
-- 
1.8.3.1

[PATCH v19 05/20] mm/thp: Simplify lru_add_page_tail()

[Alex Shi]

Simplify lru_add_page_tail(), there are actually only two cases possible:
split_huge_page_to_list(), with list supplied and head isolated from lru
by its caller; or split_huge_page(), with NULL list and head on lru -
because when head is racily isolated from lru, the isolator's reference
will stop the split from getting any further than its page_ref_freeze().

So decide between the two cases by "list", but add VM_WARN_ON()s to
verify that they match our lru expectations.

[Hugh Dickins: rewrite commit log]
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Reviewed-by: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Kirill A. Shutemov <kirill@shutemov.name>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Hugh Dickins <hughd@google.com>
Cc: Mika Penttilä <mika.penttila@nextfour.com>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/huge_memory.c | 21 ++++++---------------
 1 file changed, 6 insertions(+), 15 deletions(-)

diff --git a/mm/huge_memory.c b/mm/huge_memory.c
index fa0753229b52..8b92cd197218 100644
--- a/mm/huge_memory.c
+++ b/mm/huge_memory.c
@@ -2326,25 +2326,16 @@ static void lru_add_page_tail(struct page *head, struct page *page_tail,
 	VM_BUG_ON_PAGE(PageLRU(page_tail), head);
 	lockdep_assert_held(&lruvec_pgdat(lruvec)->lru_lock);
 
-	if (!list)
-		SetPageLRU(page_tail);
-
-	if (likely(PageLRU(head)))
-		list_add_tail(&page_tail->lru, &head->lru);
-	else if (list) {
+	if (list) {
 		/* page reclaim is reclaiming a huge page */
+		VM_WARN_ON(PageLRU(head));
 		get_page(page_tail);
 		list_add_tail(&page_tail->lru, list);
 	} else {
-		/*
-		 * Head page has not yet been counted, as an hpage,
-		 * so we must account for each subpage individually.
-		 *
-		 * Put page_tail on the list at the correct position
-		 * so they all end up in order.
-		 */
-		add_page_to_lru_list_tail(page_tail, lruvec,
-					  page_lru(page_tail));
+		/* head is still on lru (and we have it frozen) */
+		VM_WARN_ON(!PageLRU(head));
+		SetPageLRU(page_tail);
+		list_add_tail(&page_tail->lru, &head->lru);
 	}
 }
 
-- 
1.8.3.1

[PATCH v19 06/20] mm/thp: narrow lru locking

[Alex Shi]

lru_lock and page cache xa_lock have no obvious reason to be taken
one way round or the other: until now, lru_lock has been taken before
page cache xa_lock, when splitting a THP; but nothing else takes them
together.  Reverse that ordering: let's narrow the lru locking - but
leave local_irq_disable to block interrupts throughout, like before.

Hugh Dickins point: split_huge_page_to_list() was already silly, to be
using the _irqsave variant: it's just been taking sleeping locks, so
would already be broken if entered with interrupts enabled.  So we
can save passing flags argument down to __split_huge_page().

Why change the lock ordering here? That was hard to decide. One reason:
when this series reaches per-memcg lru locking, it relies on the THP's
memcg to be stable when taking the lru_lock: that is now done after the
THP's refcount has been frozen, which ensures page memcg cannot change.

Another reason: previously, lock_page_memcg()'s move_lock was presumed
to nest inside lru_lock; but now lru_lock must nest inside (page cache
lock inside) move_lock, so it becomes possible to use lock_page_memcg()
to stabilize page memcg before taking its lru_lock.  That is not the
mechanism used in this series, but it is an option we want to keep open.

[Hugh Dickins: rewrite commit log]
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Reviewed-by: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Hugh Dickins <hughd@google.com>
Cc: Kirill A. Shutemov <kirill@shutemov.name>
Cc: Andrea Arcangeli <aarcange@redhat.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/huge_memory.c | 25 +++++++++++++------------
 1 file changed, 13 insertions(+), 12 deletions(-)

diff --git a/mm/huge_memory.c b/mm/huge_memory.c
index 8b92cd197218..63af7611afaf 100644
--- a/mm/huge_memory.c
+++ b/mm/huge_memory.c
@@ -2402,7 +2402,7 @@ static void __split_huge_page_tail(struct page *head, int tail,
 }
 
 static void __split_huge_page(struct page *page, struct list_head *list,
-		pgoff_t end, unsigned long flags)
+		pgoff_t end)
 {
 	struct page *head = compound_head(page);
 	pg_data_t *pgdat = page_pgdat(head);
@@ -2411,8 +2411,6 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 	unsigned long offset = 0;
 	int i;
 
-	lruvec = mem_cgroup_page_lruvec(head, pgdat);
-
 	/* complete memcg works before add pages to LRU */
 	mem_cgroup_split_huge_fixup(head);
 
@@ -2424,6 +2422,11 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 		xa_lock(&swap_cache->i_pages);
 	}
 
+	/* prevent PageLRU to go away from under us, and freeze lru stats */
+	spin_lock(&pgdat->lru_lock);
+
+	lruvec = mem_cgroup_page_lruvec(head, pgdat);
+
 	for (i = HPAGE_PMD_NR - 1; i >= 1; i--) {
 		__split_huge_page_tail(head, i, lruvec, list);
 		/* Some pages can be beyond i_size: drop them from page cache */
@@ -2443,6 +2446,8 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 	}
 
 	ClearPageCompound(head);
+	spin_unlock(&pgdat->lru_lock);
+	/* Caller disabled irqs, so they are still disabled here */
 
 	split_page_owner(head, HPAGE_PMD_ORDER);
 
@@ -2460,8 +2465,7 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 		page_ref_add(head, 2);
 		xa_unlock(&head->mapping->i_pages);
 	}
-
-	spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+	local_irq_enable();
 
 	remap_page(head);
 
@@ -2600,12 +2604,10 @@ bool can_split_huge_page(struct page *page, int *pextra_pins)
 int split_huge_page_to_list(struct page *page, struct list_head *list)
 {
 	struct page *head = compound_head(page);
-	struct pglist_data *pgdata = NODE_DATA(page_to_nid(head));
 	struct deferred_split *ds_queue = get_deferred_split_queue(head);
 	struct anon_vma *anon_vma = NULL;
 	struct address_space *mapping = NULL;
 	int count, mapcount, extra_pins, ret;
-	unsigned long flags;
 	pgoff_t end;
 
 	VM_BUG_ON_PAGE(is_huge_zero_page(head), head);
@@ -2666,9 +2668,8 @@ int split_huge_page_to_list(struct page *page, struct list_head *list)
 	unmap_page(head);
 	VM_BUG_ON_PAGE(compound_mapcount(head), head);
 
-	/* prevent PageLRU to go away from under us, and freeze lru stats */
-	spin_lock_irqsave(&pgdata->lru_lock, flags);
-
+	/* block interrupt reentry in xa_lock and spinlock */
+	local_irq_disable();
 	if (mapping) {
 		XA_STATE(xas, &mapping->i_pages, page_index(head));
 
@@ -2698,7 +2699,7 @@ int split_huge_page_to_list(struct page *page, struct list_head *list)
 				__dec_node_page_state(head, NR_FILE_THPS);
 		}
 
-		__split_huge_page(page, list, end, flags);
+		__split_huge_page(page, list, end);
 		if (PageSwapCache(head)) {
 			swp_entry_t entry = { .val = page_private(head) };
 
@@ -2717,7 +2718,7 @@ int split_huge_page_to_list(struct page *page, struct list_head *list)
 		spin_unlock(&ds_queue->split_queue_lock);
 fail:		if (mapping)
 			xa_unlock(&mapping->i_pages);
-		spin_unlock_irqrestore(&pgdata->lru_lock, flags);
+		local_irq_enable();
 		remap_page(head);
 		ret = -EBUSY;
 	}
-- 
1.8.3.1

Re: [PATCH v19 06/20] mm/thp: narrow lru locking

[Alex Shi]

Rebased to today's akpm branch.

Thanks
Alex

From f9af3691a7163d8461a140066ddd0eff5d3e44cb Mon Sep 17 00:00:00 2001
From: Alex Shi <alex.shi@linux.alibaba.com>
Date: Mon, 6 Apr 2020 23:43:31 +0800
Subject: [PATCH v19 06/20] mm/thp: narrow lru locking

lru_lock and page cache xa_lock have no obvious reason to be taken
one way round or the other: until now, lru_lock has been taken before
page cache xa_lock, when splitting a THP; but nothing else takes them
together.  Reverse that ordering: let's narrow the lru locking - but
leave local_irq_disable to block interrupts throughout, like before.

Hugh Dickins point: split_huge_page_to_list() was already silly, to be
using the _irqsave variant: it's just been taking sleeping locks, so
would already be broken if entered with interrupts enabled.  So we
can save passing flags argument down to __split_huge_page().

Why change the lock ordering here? That was hard to decide. One reason:
when this series reaches per-memcg lru locking, it relies on the THP's
memcg to be stable when taking the lru_lock: that is now done after the
THP's refcount has been frozen, which ensures page memcg cannot change.

Another reason: previously, lock_page_memcg()'s move_lock was presumed
to nest inside lru_lock; but now lru_lock must nest inside (page cache
lock inside) move_lock, so it becomes possible to use lock_page_memcg()
to stabilize page memcg before taking its lru_lock.  That is not the
mechanism used in this series, but it is an option we want to keep open.

[Hugh Dickins: rewrite commit log]
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Reviewed-by: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Hugh Dickins <hughd@google.com>
Cc: Kirill A. Shutemov <kirill@shutemov.name>
Cc: Andrea Arcangeli <aarcange@redhat.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/huge_memory.c | 25 +++++++++++++------------
 1 file changed, 13 insertions(+), 12 deletions(-)

diff --git a/mm/huge_memory.c b/mm/huge_memory.c
index ba849d0629b7..9a8fcec3239e 100644
--- a/mm/huge_memory.c
+++ b/mm/huge_memory.c
@@ -2407,7 +2407,7 @@ static void __split_huge_page_tail(struct page *head, int tail,
 }
 
 static void __split_huge_page(struct page *page, struct list_head *list,
-		pgoff_t end, unsigned long flags)
+		pgoff_t end)
 {
 	struct page *head = compound_head(page);
 	pg_data_t *pgdat = page_pgdat(head);
@@ -2417,8 +2417,6 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 	unsigned int nr = thp_nr_pages(head);
 	int i;
 
-	lruvec = mem_cgroup_page_lruvec(head, pgdat);
-
 	/* complete memcg works before add pages to LRU */
 	mem_cgroup_split_huge_fixup(head);
 
@@ -2430,6 +2428,11 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 		xa_lock(&swap_cache->i_pages);
 	}
 
+	/* prevent PageLRU to go away from under us, and freeze lru stats */
+	spin_lock(&pgdat->lru_lock);
+
+	lruvec = mem_cgroup_page_lruvec(head, pgdat);
+
 	for (i = nr - 1; i >= 1; i--) {
 		__split_huge_page_tail(head, i, lruvec, list);
 		/* Some pages can be beyond i_size: drop them from page cache */
@@ -2449,6 +2452,8 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 	}
 
 	ClearPageCompound(head);
+	spin_unlock(&pgdat->lru_lock);
+	/* Caller disabled irqs, so they are still disabled here */
 
 	split_page_owner(head, nr);
 
@@ -2466,8 +2471,7 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 		page_ref_add(head, 2);
 		xa_unlock(&head->mapping->i_pages);
 	}
-
-	spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+	local_irq_enable();
 
 	remap_page(head, nr);
 
@@ -2607,12 +2611,10 @@ bool can_split_huge_page(struct page *page, int *pextra_pins)
 int split_huge_page_to_list(struct page *page, struct list_head *list)
 {
 	struct page *head = compound_head(page);
-	struct pglist_data *pgdata = NODE_DATA(page_to_nid(head));
 	struct deferred_split *ds_queue = get_deferred_split_queue(head);
 	struct anon_vma *anon_vma = NULL;
 	struct address_space *mapping = NULL;
 	int count, mapcount, extra_pins, ret;
-	unsigned long flags;
 	pgoff_t end;
 
 	VM_BUG_ON_PAGE(is_huge_zero_page(head), head);
@@ -2673,9 +2675,8 @@ int split_huge_page_to_list(struct page *page, struct list_head *list)
 	unmap_page(head);
 	VM_BUG_ON_PAGE(compound_mapcount(head), head);
 
-	/* prevent PageLRU to go away from under us, and freeze lru stats */
-	spin_lock_irqsave(&pgdata->lru_lock, flags);
-
+	/* block interrupt reentry in xa_lock and spinlock */
+	local_irq_disable();
 	if (mapping) {
 		XA_STATE(xas, &mapping->i_pages, page_index(head));
 
@@ -2705,7 +2706,7 @@ int split_huge_page_to_list(struct page *page, struct list_head *list)
 				__dec_node_page_state(head, NR_FILE_THPS);
 		}
 
-		__split_huge_page(page, list, end, flags);
+		__split_huge_page(page, list, end);
 		if (PageSwapCache(head)) {
 			swp_entry_t entry = { .val = page_private(head) };
 
@@ -2724,7 +2725,7 @@ int split_huge_page_to_list(struct page *page, struct list_head *list)
 		spin_unlock(&ds_queue->split_queue_lock);
 fail:		if (mapping)
 			xa_unlock(&mapping->i_pages);
-		spin_unlock_irqrestore(&pgdata->lru_lock, flags);
+		local_irq_enable();
 		remap_page(head, thp_nr_pages(head));
 		ret = -EBUSY;
 	}
-- 
1.8.3.1

[PATCH v19 07/20] mm/vmscan: remove unnecessary lruvec adding

[Alex Shi]

We don't have to add a freeable page into lru and then remove from it.
This change saves a couple of actions and makes the moving more clear.

The SetPageLRU needs to be kept before put_page_testzero for list
integrity, otherwise:

  #0 move_pages_to_lru             #1 release_pages
  if !put_page_testzero
     			           if (put_page_testzero())
     			              !PageLRU //skip lru_lock
     SetPageLRU()
     list_add(&page->lru,)
                                         list_add(&page->lru,)

[akpm@linux-foundation.org: coding style fixes]
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Tejun Heo <tj@kernel.org>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Hugh Dickins <hughd@google.com>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/vmscan.c | 38 +++++++++++++++++++++++++-------------
 1 file changed, 25 insertions(+), 13 deletions(-)

diff --git a/mm/vmscan.c b/mm/vmscan.c
index 466fc3144fff..32102e5d354d 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -1850,26 +1850,30 @@ static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
 	while (!list_empty(list)) {
 		page = lru_to_page(list);
 		VM_BUG_ON_PAGE(PageLRU(page), page);
+		list_del(&page->lru);
 		if (unlikely(!page_evictable(page))) {
-			list_del(&page->lru);
 			spin_unlock_irq(&pgdat->lru_lock);
 			putback_lru_page(page);
 			spin_lock_irq(&pgdat->lru_lock);
 			continue;
 		}
-		lruvec = mem_cgroup_page_lruvec(page, pgdat);
 
+		/*
+		 * The SetPageLRU needs to be kept here for list integrity.
+		 * Otherwise:
+		 *   #0 move_pages_to_lru             #1 release_pages
+		 *   if !put_page_testzero
+		 *				      if (put_page_testzero())
+		 *				        !PageLRU //skip lru_lock
+		 *     SetPageLRU()
+		 *     list_add(&page->lru,)
+		 *                                        list_add(&page->lru,)
+		 */
 		SetPageLRU(page);
-		lru = page_lru(page);
 
-		nr_pages = thp_nr_pages(page);
-		update_lru_size(lruvec, lru, page_zonenum(page), nr_pages);
-		list_move(&page->lru, &lruvec->lists[lru]);
-
-		if (put_page_testzero(page)) {
+		if (unlikely(put_page_testzero(page))) {
 			__ClearPageLRU(page);
 			__ClearPageActive(page);
-			del_page_from_lru_list(page, lruvec, lru);
 
 			if (unlikely(PageCompound(page))) {
 				spin_unlock_irq(&pgdat->lru_lock);
@@ -1877,11 +1881,19 @@ static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
 				spin_lock_irq(&pgdat->lru_lock);
 			} else
 				list_add(&page->lru, &pages_to_free);
-		} else {
-			nr_moved += nr_pages;
-			if (PageActive(page))
-				workingset_age_nonresident(lruvec, nr_pages);
+
+			continue;
 		}
+
+		lruvec = mem_cgroup_page_lruvec(page, pgdat);
+		lru = page_lru(page);
+		nr_pages = thp_nr_pages(page);
+
+		update_lru_size(lruvec, lru, page_zonenum(page), nr_pages);
+		list_add(&page->lru, &lruvec->lists[lru]);
+		nr_moved += nr_pages;
+		if (PageActive(page))
+			workingset_age_nonresident(lruvec, nr_pages);
 	}
 
 	/*
-- 
1.8.3.1

Re: [PATCH v19 07/20] mm/vmscan: remove unnecessary lruvec adding

[Alex Shi]

This patch has some conflict on akpm. But since Yu Zhao ask for
revert his patch 'mm: use add_page_to_lru_list()/page_lru()/page_off_lru()'
we should not needs for rebase on it.

Thanks
Alex

在 2020/9/24 上午11:28, Alex Shi 写道:
> We don't have to add a freeable page into lru and then remove from it.
> This change saves a couple of actions and makes the moving more clear.
> 
> The SetPageLRU needs to be kept before put_page_testzero for list
> integrity, otherwise:
> 
>   #0 move_pages_to_lru             #1 release_pages
>   if !put_page_testzero
>      			           if (put_page_testzero())
>      			              !PageLRU //skip lru_lock
>      SetPageLRU()
>      list_add(&page->lru,)
>                                          list_add(&page->lru,)
> 
> [akpm@linux-foundation.org: coding style fixes]
> Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
> Acked-by: Hugh Dickins <hughd@google.com>
> Cc: Andrew Morton <akpm@linux-foundation.org>
> Cc: Johannes Weiner <hannes@cmpxchg.org>
> Cc: Tejun Heo <tj@kernel.org>
> Cc: Matthew Wilcox <willy@infradead.org>
> Cc: Hugh Dickins <hughd@google.com>
> Cc: linux-mm@kvack.org
> Cc: linux-kernel@vger.kernel.org
> ---
>  mm/vmscan.c | 38 +++++++++++++++++++++++++-------------
>  1 file changed, 25 insertions(+), 13 deletions(-)
> 
> diff --git a/mm/vmscan.c b/mm/vmscan.c
> index 466fc3144fff..32102e5d354d 100644
> --- a/mm/vmscan.c
> +++ b/mm/vmscan.c
> @@ -1850,26 +1850,30 @@ static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
>  	while (!list_empty(list)) {
>  		page = lru_to_page(list);
>  		VM_BUG_ON_PAGE(PageLRU(page), page);
> +		list_del(&page->lru);
>  		if (unlikely(!page_evictable(page))) {
> -			list_del(&page->lru);
>  			spin_unlock_irq(&pgdat->lru_lock);
>  			putback_lru_page(page);
>  			spin_lock_irq(&pgdat->lru_lock);
>  			continue;
>  		}
> -		lruvec = mem_cgroup_page_lruvec(page, pgdat);
>  
> +		/*
> +		 * The SetPageLRU needs to be kept here for list integrity.
> +		 * Otherwise:
> +		 *   #0 move_pages_to_lru             #1 release_pages
> +		 *   if !put_page_testzero
> +		 *				      if (put_page_testzero())
> +		 *				        !PageLRU //skip lru_lock
> +		 *     SetPageLRU()
> +		 *     list_add(&page->lru,)
> +		 *                                        list_add(&page->lru,)
> +		 */
>  		SetPageLRU(page);
> -		lru = page_lru(page);
>  
> -		nr_pages = thp_nr_pages(page);
> -		update_lru_size(lruvec, lru, page_zonenum(page), nr_pages);
> -		list_move(&page->lru, &lruvec->lists[lru]);
> -
> -		if (put_page_testzero(page)) {
> +		if (unlikely(put_page_testzero(page))) {
>  			__ClearPageLRU(page);
>  			__ClearPageActive(page);
> -			del_page_from_lru_list(page, lruvec, lru);
>  
>  			if (unlikely(PageCompound(page))) {
>  				spin_unlock_irq(&pgdat->lru_lock);
> @@ -1877,11 +1881,19 @@ static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
>  				spin_lock_irq(&pgdat->lru_lock);
>  			} else
>  				list_add(&page->lru, &pages_to_free);
> -		} else {
> -			nr_moved += nr_pages;
> -			if (PageActive(page))
> -				workingset_age_nonresident(lruvec, nr_pages);
> +
> +			continue;
>  		}
> +
> +		lruvec = mem_cgroup_page_lruvec(page, pgdat);
> +		lru = page_lru(page);
> +		nr_pages = thp_nr_pages(page);
> +
> +		update_lru_size(lruvec, lru, page_zonenum(page), nr_pages);
> +		list_add(&page->lru, &lruvec->lists[lru]);
> +		nr_moved += nr_pages;
> +		if (PageActive(page))
> +			workingset_age_nonresident(lruvec, nr_pages);
>  	}
>  
>  	/*
> 

[PATCH v19 08/20] mm: page_idle_get_page() does not need lru_lock

[Alex Shi]

From: Hugh Dickins <hughd@google.com>

It is necessary for page_idle_get_page() to recheck PageLRU() after
get_page_unless_zero(), but holding lru_lock around that serves no
useful purpose, and adds to lru_lock contention: delete it.

See https://lore.kernel.org/lkml/20150504031722.GA2768@blaptop for the
discussion that led to lru_lock there; but __page_set_anon_rmap() now
uses WRITE_ONCE(), and I see no other risk in page_idle_clear_pte_refs()
using rmap_walk() (beyond the risk of racing PageAnon->PageKsm, mostly
but not entirely prevented by page_count() check in ksm.c's
write_protect_page(): that risk being shared with page_referenced() and
not helped by lru_lock).

Signed-off-by: Hugh Dickins <hughd@google.com>
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Vladimir Davydov <vdavydov.dev@gmail.com>
Cc: Vlastimil Babka <vbabka@suse.cz>
Cc: Minchan Kim <minchan@kernel.org>
Cc: Alex Shi <alex.shi@linux.alibaba.com>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/page_idle.c | 4 ----
 1 file changed, 4 deletions(-)

diff --git a/mm/page_idle.c b/mm/page_idle.c
index 057c61df12db..64e5344a992c 100644
--- a/mm/page_idle.c
+++ b/mm/page_idle.c
@@ -32,19 +32,15 @@
 static struct page *page_idle_get_page(unsigned long pfn)
 {
 	struct page *page = pfn_to_online_page(pfn);
-	pg_data_t *pgdat;
 
 	if (!page || !PageLRU(page) ||
 	    !get_page_unless_zero(page))
 		return NULL;
 
-	pgdat = page_pgdat(page);
-	spin_lock_irq(&pgdat->lru_lock);
 	if (unlikely(!PageLRU(page))) {
 		put_page(page);
 		page = NULL;
 	}
-	spin_unlock_irq(&pgdat->lru_lock);
 	return page;
 }
 
-- 
1.8.3.1

[PATCH v19 09/20] mm/memcg: add debug checking in lock_page_memcg

[Alex Shi]

Add a debug checking in lock_page_memcg, then we could get alarm
if anything wrong here.

Suggested-by: Johannes Weiner <hannes@cmpxchg.org>
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Michal Hocko <mhocko@kernel.org>
Cc: Vladimir Davydov <vdavydov.dev@gmail.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: cgroups@vger.kernel.org
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/memcontrol.c | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/mm/memcontrol.c b/mm/memcontrol.c
index 368e6ac644f0..6acc6a60c52b 100644
--- a/mm/memcontrol.c
+++ b/mm/memcontrol.c
@@ -2097,6 +2097,12 @@ struct mem_cgroup *lock_page_memcg(struct page *page)
 	if (unlikely(!memcg))
 		return NULL;
 
+#ifdef CONFIG_PROVE_LOCKING
+	local_irq_save(flags);
+	might_lock(&memcg->move_lock);
+	local_irq_restore(flags);
+#endif
+
 	if (atomic_read(&memcg->moving_account) <= 0)
 		return memcg;
 
-- 
1.8.3.1

[PATCH v19 10/20] mm/swap.c: fold vm event PGROTATED into pagevec_move_tail_fn

[Alex Shi]

Fold the PGROTATED event collection into pagevec_move_tail_fn call back
func like other funcs does in pagevec_lru_move_fn. Thus we could save
func call pagevec_move_tail().
Now all usage of pagevec_lru_move_fn are same and no needs of its 3rd
parameter.

It's just simply the calling. No functional change.

[lkp@intel.com: found a build issue in the original patch, thanks]
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/swap.c | 65 ++++++++++++++++++++++-----------------------------------------
 1 file changed, 23 insertions(+), 42 deletions(-)

diff --git a/mm/swap.c b/mm/swap.c
index 1bc2fc5d8b7c..4e33873975a6 100644
--- a/mm/swap.c
+++ b/mm/swap.c
@@ -204,8 +204,7 @@ int get_kernel_page(unsigned long start, int write, struct page **pages)
 EXPORT_SYMBOL_GPL(get_kernel_page);
 
 static void pagevec_lru_move_fn(struct pagevec *pvec,
-	void (*move_fn)(struct page *page, struct lruvec *lruvec, void *arg),
-	void *arg)
+	void (*move_fn)(struct page *page, struct lruvec *lruvec))
 {
 	int i;
 	struct pglist_data *pgdat = NULL;
@@ -224,7 +223,7 @@ static void pagevec_lru_move_fn(struct pagevec *pvec,
 		}
 
 		lruvec = mem_cgroup_page_lruvec(page, pgdat);
-		(*move_fn)(page, lruvec, arg);
+		(*move_fn)(page, lruvec);
 	}
 	if (pgdat)
 		spin_unlock_irqrestore(&pgdat->lru_lock, flags);
@@ -232,35 +231,22 @@ static void pagevec_lru_move_fn(struct pagevec *pvec,
 	pagevec_reinit(pvec);
 }
 
-static void pagevec_move_tail_fn(struct page *page, struct lruvec *lruvec,
-				 void *arg)
+static void pagevec_move_tail_fn(struct page *page, struct lruvec *lruvec)
 {
-	int *pgmoved = arg;
-
 	if (PageLRU(page) && !PageUnevictable(page)) {
 		del_page_from_lru_list(page, lruvec, page_lru(page));
 		ClearPageActive(page);
 		add_page_to_lru_list_tail(page, lruvec, page_lru(page));
-		(*pgmoved) += thp_nr_pages(page);
+		__count_vm_events(PGROTATED, thp_nr_pages(page));
 	}
 }
 
 /*
- * pagevec_move_tail() must be called with IRQ disabled.
- * Otherwise this may cause nasty races.
- */
-static void pagevec_move_tail(struct pagevec *pvec)
-{
-	int pgmoved = 0;
-
-	pagevec_lru_move_fn(pvec, pagevec_move_tail_fn, &pgmoved);
-	__count_vm_events(PGROTATED, pgmoved);
-}
-
-/*
  * Writeback is about to end against a page which has been marked for immediate
  * reclaim.  If it still appears to be reclaimable, move it to the tail of the
  * inactive list.
+ *
+ * rotate_reclaimable_page() must disable IRQs, to prevent nasty races.
  */
 void rotate_reclaimable_page(struct page *page)
 {
@@ -273,7 +259,7 @@ void rotate_reclaimable_page(struct page *page)
 		local_lock_irqsave(&lru_rotate.lock, flags);
 		pvec = this_cpu_ptr(&lru_rotate.pvec);
 		if (!pagevec_add(pvec, page) || PageCompound(page))
-			pagevec_move_tail(pvec);
+			pagevec_lru_move_fn(pvec, pagevec_move_tail_fn);
 		local_unlock_irqrestore(&lru_rotate.lock, flags);
 	}
 }
@@ -315,8 +301,7 @@ void lru_note_cost_page(struct page *page)
 		      page_is_file_lru(page), thp_nr_pages(page));
 }
 
-static void __activate_page(struct page *page, struct lruvec *lruvec,
-			    void *arg)
+static void __activate_page(struct page *page, struct lruvec *lruvec)
 {
 	if (PageLRU(page) && !PageActive(page) && !PageUnevictable(page)) {
 		int lru = page_lru_base_type(page);
@@ -340,7 +325,7 @@ static void activate_page_drain(int cpu)
 	struct pagevec *pvec = &per_cpu(lru_pvecs.activate_page, cpu);
 
 	if (pagevec_count(pvec))
-		pagevec_lru_move_fn(pvec, __activate_page, NULL);
+		pagevec_lru_move_fn(pvec, __activate_page);
 }
 
 static bool need_activate_page_drain(int cpu)
@@ -358,7 +343,7 @@ void activate_page(struct page *page)
 		pvec = this_cpu_ptr(&lru_pvecs.activate_page);
 		get_page(page);
 		if (!pagevec_add(pvec, page) || PageCompound(page))
-			pagevec_lru_move_fn(pvec, __activate_page, NULL);
+			pagevec_lru_move_fn(pvec, __activate_page);
 		local_unlock(&lru_pvecs.lock);
 	}
 }
@@ -374,7 +359,7 @@ void activate_page(struct page *page)
 
 	page = compound_head(page);
 	spin_lock_irq(&pgdat->lru_lock);
-	__activate_page(page, mem_cgroup_page_lruvec(page, pgdat), NULL);
+	__activate_page(page, mem_cgroup_page_lruvec(page, pgdat));
 	spin_unlock_irq(&pgdat->lru_lock);
 }
 #endif
@@ -527,8 +512,7 @@ void lru_cache_add_inactive_or_unevictable(struct page *page,
  * be write it out by flusher threads as this is much more effective
  * than the single-page writeout from reclaim.
  */
-static void lru_deactivate_file_fn(struct page *page, struct lruvec *lruvec,
-			      void *arg)
+static void lru_deactivate_file_fn(struct page *page, struct lruvec *lruvec)
 {
 	int lru;
 	bool active;
@@ -575,8 +559,7 @@ static void lru_deactivate_file_fn(struct page *page, struct lruvec *lruvec,
 	}
 }
 
-static void lru_deactivate_fn(struct page *page, struct lruvec *lruvec,
-			    void *arg)
+static void lru_deactivate_fn(struct page *page, struct lruvec *lruvec)
 {
 	if (PageLRU(page) && PageActive(page) && !PageUnevictable(page)) {
 		int lru = page_lru_base_type(page);
@@ -593,8 +576,7 @@ static void lru_deactivate_fn(struct page *page, struct lruvec *lruvec,
 	}
 }
 
-static void lru_lazyfree_fn(struct page *page, struct lruvec *lruvec,
-			    void *arg)
+static void lru_lazyfree_fn(struct page *page, struct lruvec *lruvec)
 {
 	if (PageLRU(page) && PageAnon(page) && PageSwapBacked(page) &&
 	    !PageSwapCache(page) && !PageUnevictable(page)) {
@@ -638,21 +620,21 @@ void lru_add_drain_cpu(int cpu)
 
 		/* No harm done if a racing interrupt already did this */
 		local_lock_irqsave(&lru_rotate.lock, flags);
-		pagevec_move_tail(pvec);
+		pagevec_lru_move_fn(pvec, pagevec_move_tail_fn);
 		local_unlock_irqrestore(&lru_rotate.lock, flags);
 	}
 
 	pvec = &per_cpu(lru_pvecs.lru_deactivate_file, cpu);
 	if (pagevec_count(pvec))
-		pagevec_lru_move_fn(pvec, lru_deactivate_file_fn, NULL);
+		pagevec_lru_move_fn(pvec, lru_deactivate_file_fn);
 
 	pvec = &per_cpu(lru_pvecs.lru_deactivate, cpu);
 	if (pagevec_count(pvec))
-		pagevec_lru_move_fn(pvec, lru_deactivate_fn, NULL);
+		pagevec_lru_move_fn(pvec, lru_deactivate_fn);
 
 	pvec = &per_cpu(lru_pvecs.lru_lazyfree, cpu);
 	if (pagevec_count(pvec))
-		pagevec_lru_move_fn(pvec, lru_lazyfree_fn, NULL);
+		pagevec_lru_move_fn(pvec, lru_lazyfree_fn);
 
 	activate_page_drain(cpu);
 }
@@ -681,7 +663,7 @@ void deactivate_file_page(struct page *page)
 		pvec = this_cpu_ptr(&lru_pvecs.lru_deactivate_file);
 
 		if (!pagevec_add(pvec, page) || PageCompound(page))
-			pagevec_lru_move_fn(pvec, lru_deactivate_file_fn, NULL);
+			pagevec_lru_move_fn(pvec, lru_deactivate_file_fn);
 		local_unlock(&lru_pvecs.lock);
 	}
 }
@@ -703,7 +685,7 @@ void deactivate_page(struct page *page)
 		pvec = this_cpu_ptr(&lru_pvecs.lru_deactivate);
 		get_page(page);
 		if (!pagevec_add(pvec, page) || PageCompound(page))
-			pagevec_lru_move_fn(pvec, lru_deactivate_fn, NULL);
+			pagevec_lru_move_fn(pvec, lru_deactivate_fn);
 		local_unlock(&lru_pvecs.lock);
 	}
 }
@@ -725,7 +707,7 @@ void mark_page_lazyfree(struct page *page)
 		pvec = this_cpu_ptr(&lru_pvecs.lru_lazyfree);
 		get_page(page);
 		if (!pagevec_add(pvec, page) || PageCompound(page))
-			pagevec_lru_move_fn(pvec, lru_lazyfree_fn, NULL);
+			pagevec_lru_move_fn(pvec, lru_lazyfree_fn);
 		local_unlock(&lru_pvecs.lock);
 	}
 }
@@ -935,8 +917,7 @@ void __pagevec_release(struct pagevec *pvec)
 }
 EXPORT_SYMBOL(__pagevec_release);
 
-static void __pagevec_lru_add_fn(struct page *page, struct lruvec *lruvec,
-				 void *arg)
+static void __pagevec_lru_add_fn(struct page *page, struct lruvec *lruvec)
 {
 	enum lru_list lru;
 	int was_unevictable = TestClearPageUnevictable(page);
@@ -995,7 +976,7 @@ static void __pagevec_lru_add_fn(struct page *page, struct lruvec *lruvec,
  */
 void __pagevec_lru_add(struct pagevec *pvec)
 {
-	pagevec_lru_move_fn(pvec, __pagevec_lru_add_fn, NULL);
+	pagevec_lru_move_fn(pvec, __pagevec_lru_add_fn);
 }
 
 /**
-- 
1.8.3.1

[PATCH v19 11/20] mm/lru: move lock into lru_note_cost

[Alex Shi]

We have to move lru_lock into lru_note_cost, since it cycle up on memcg
tree, for future per lruvec lru_lock replace. It's a bit ugly and may
cost a bit more locking, but benefit from multiple memcg locking could
cover the lost.

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/swap.c       | 3 +++
 mm/vmscan.c     | 4 +---
 mm/workingset.c | 2 --
 3 files changed, 4 insertions(+), 5 deletions(-)

diff --git a/mm/swap.c b/mm/swap.c
index 4e33873975a6..6a4b00267384 100644
--- a/mm/swap.c
+++ b/mm/swap.c
@@ -268,7 +268,9 @@ void lru_note_cost(struct lruvec *lruvec, bool file, unsigned int nr_pages)
 {
 	do {
 		unsigned long lrusize;
+		struct pglist_data *pgdat = lruvec_pgdat(lruvec);
 
+		spin_lock_irq(&pgdat->lru_lock);
 		/* Record cost event */
 		if (file)
 			lruvec->file_cost += nr_pages;
@@ -292,6 +294,7 @@ void lru_note_cost(struct lruvec *lruvec, bool file, unsigned int nr_pages)
 			lruvec->file_cost /= 2;
 			lruvec->anon_cost /= 2;
 		}
+		spin_unlock_irq(&pgdat->lru_lock);
 	} while ((lruvec = parent_lruvec(lruvec)));
 }
 
diff --git a/mm/vmscan.c b/mm/vmscan.c
index 32102e5d354d..656558bbf399 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -1971,19 +1971,17 @@ static int current_may_throttle(void)
 				&stat, false);
 
 	spin_lock_irq(&pgdat->lru_lock);
-
 	move_pages_to_lru(lruvec, &page_list);
 
 	__mod_node_page_state(pgdat, NR_ISOLATED_ANON + file, -nr_taken);
-	lru_note_cost(lruvec, file, stat.nr_pageout);
 	item = current_is_kswapd() ? PGSTEAL_KSWAPD : PGSTEAL_DIRECT;
 	if (!cgroup_reclaim(sc))
 		__count_vm_events(item, nr_reclaimed);
 	__count_memcg_events(lruvec_memcg(lruvec), item, nr_reclaimed);
 	__count_vm_events(PGSTEAL_ANON + file, nr_reclaimed);
-
 	spin_unlock_irq(&pgdat->lru_lock);
 
+	lru_note_cost(lruvec, file, stat.nr_pageout);
 	mem_cgroup_uncharge_list(&page_list);
 	free_unref_page_list(&page_list);
 
diff --git a/mm/workingset.c b/mm/workingset.c
index 92e66113a577..32e24cda1b4f 100644
--- a/mm/workingset.c
+++ b/mm/workingset.c
@@ -381,9 +381,7 @@ void workingset_refault(struct page *page, void *shadow)
 	if (workingset) {
 		SetPageWorkingset(page);
 		/* XXX: Move to lru_cache_add() when it supports new vs putback */
-		spin_lock_irq(&page_pgdat(page)->lru_lock);
 		lru_note_cost_page(page);
-		spin_unlock_irq(&page_pgdat(page)->lru_lock);
 		inc_lruvec_state(lruvec, WORKINGSET_RESTORE_BASE + file);
 	}
 out:
-- 
1.8.3.1

[PATCH v19 12/20] mm/vmscan: remove lruvec reget in move_pages_to_lru

[Alex Shi]

A isolated page shouldn't be recharged by memcg since the memcg
migration isn't possible at the time.
So remove unnecessary regetting.

Thanks to Alexander Duyck for pointing this out.

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Alexander Duyck <alexander.h.duyck@linux.intel.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Konstantin Khlebnikov <khlebnikov@yandex-team.ru>
Cc: Michal Hocko <mhocko@kernel.org>
Cc: Hugh Dickins <hughd@google.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
Cc: cgroups@vger.kernel.org
---
 mm/vmscan.c | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/mm/vmscan.c b/mm/vmscan.c
index 656558bbf399..953a068b3fc7 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -1885,7 +1885,8 @@ static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
 			continue;
 		}
 
-		lruvec = mem_cgroup_page_lruvec(page, pgdat);
+		VM_BUG_ON_PAGE(mem_cgroup_page_lruvec(page, page_pgdat(page))
+							!= lruvec, page);
 		lru = page_lru(page);
 		nr_pages = thp_nr_pages(page);
 
-- 
1.8.3.1

[PATCH v19 13/20] mm/mlock: remove lru_lock on TestClearPageMlocked

[Alex Shi]

In the func munlock_vma_page, comments mentained lru_lock needed for
serialization with split_huge_pages. But the page must be PageLocked
as well as pages in split_huge_page series funcs. Thus the PageLocked
is enough to serialize both funcs.

Further more, Hugh Dickins pointed: before splitting in
split_huge_page_to_list, the page was unmap_page() to remove pmd/ptes
which protect the page from munlock. Thus, no needs to guard
__split_huge_page_tail for mlock clean, just keep the lru_lock there for
isolation purpose.

LKP found a preempt issue on __mod_zone_page_state which need change
to mod_zone_page_state. Thanks!

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Cc: Vlastimil Babka <vbabka@suse.cz>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/mlock.c | 26 +++++---------------------
 1 file changed, 5 insertions(+), 21 deletions(-)

diff --git a/mm/mlock.c b/mm/mlock.c
index 884b1216da6a..796c726a0407 100644
--- a/mm/mlock.c
+++ b/mm/mlock.c
@@ -187,40 +187,24 @@ static void __munlock_isolation_failed(struct page *page)
 unsigned int munlock_vma_page(struct page *page)
 {
 	int nr_pages;
-	pg_data_t *pgdat = page_pgdat(page);
 
 	/* For try_to_munlock() and to serialize with page migration */
 	BUG_ON(!PageLocked(page));
-
 	VM_BUG_ON_PAGE(PageTail(page), page);
 
-	/*
-	 * Serialize with any parallel __split_huge_page_refcount() which
-	 * might otherwise copy PageMlocked to part of the tail pages before
-	 * we clear it in the head page. It also stabilizes thp_nr_pages().
-	 */
-	spin_lock_irq(&pgdat->lru_lock);
-
 	if (!TestClearPageMlocked(page)) {
 		/* Potentially, PTE-mapped THP: do not skip the rest PTEs */
-		nr_pages = 1;
-		goto unlock_out;
+		return 0;
 	}
 
 	nr_pages = thp_nr_pages(page);
-	__mod_zone_page_state(page_zone(page), NR_MLOCK, -nr_pages);
+	mod_zone_page_state(page_zone(page), NR_MLOCK, -nr_pages);
 
-	if (__munlock_isolate_lru_page(page, true)) {
-		spin_unlock_irq(&pgdat->lru_lock);
+	if (!isolate_lru_page(page))
 		__munlock_isolated_page(page);
-		goto out;
-	}
-	__munlock_isolation_failed(page);
-
-unlock_out:
-	spin_unlock_irq(&pgdat->lru_lock);
+	else
+		__munlock_isolation_failed(page);
 
-out:
 	return nr_pages - 1;
 }
 
-- 
1.8.3.1

[PATCH v19 14/20] mm/mlock: remove __munlock_isolate_lru_page

[Alex Shi]

The func only has one caller, remove it to clean up code and simplify
code.

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Hugh Dickins <hughd@google.com>
Cc: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Cc: Vlastimil Babka <vbabka@suse.cz>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/mlock.c | 31 +++++++++----------------------
 1 file changed, 9 insertions(+), 22 deletions(-)

diff --git a/mm/mlock.c b/mm/mlock.c
index 796c726a0407..d487aa864e86 100644
--- a/mm/mlock.c
+++ b/mm/mlock.c
@@ -106,26 +106,6 @@ void mlock_vma_page(struct page *page)
 }
 
 /*
- * Isolate a page from LRU with optional get_page() pin.
- * Assumes lru_lock already held and page already pinned.
- */
-static bool __munlock_isolate_lru_page(struct page *page, bool getpage)
-{
-	if (PageLRU(page)) {
-		struct lruvec *lruvec;
-
-		lruvec = mem_cgroup_page_lruvec(page, page_pgdat(page));
-		if (getpage)
-			get_page(page);
-		ClearPageLRU(page);
-		del_page_from_lru_list(page, lruvec, page_lru(page));
-		return true;
-	}
-
-	return false;
-}
-
-/*
  * Finish munlock after successful page isolation
  *
  * Page must be locked. This is a wrapper for try_to_munlock()
@@ -296,9 +276,16 @@ static void __munlock_pagevec(struct pagevec *pvec, struct zone *zone)
 			 * We already have pin from follow_page_mask()
 			 * so we can spare the get_page() here.
 			 */
-			if (__munlock_isolate_lru_page(page, false))
+			if (PageLRU(page)) {
+				struct lruvec *lruvec;
+
+				ClearPageLRU(page);
+				lruvec = mem_cgroup_page_lruvec(page,
+							page_pgdat(page));
+				del_page_from_lru_list(page, lruvec,
+							page_lru(page));
 				continue;
-			else
+			} else
 				__munlock_isolation_failed(page);
 		} else {
 			delta_munlocked++;
-- 
1.8.3.1

[PATCH v19 15/20] mm/lru: introduce TestClearPageLRU

[Alex Shi]

Currently lru_lock still guards both lru list and page's lru bit, that's
ok. but if we want to use specific lruvec lock on the page, we need to
pin down the page's lruvec/memcg during locking. Just taking lruvec
lock first may be undermined by the page's memcg charge/migration. To
fix this problem, we could clear the lru bit out of locking and use
it as pin down action to block the page isolation in memcg changing.

So now a standard steps of page isolation is following:
	1, get_page(); 	       #pin the page avoid to be free
	2, TestClearPageLRU(); #block other isolation like memcg change
	3, spin_lock on lru_lock; #serialize lru list access
	4, delete page from lru list;
The step 2 could be optimzed/replaced in scenarios which page is
unlikely be accessed or be moved between memcgs.

This patch start with the first part: TestClearPageLRU, which combines
PageLRU check and ClearPageLRU into a macro func TestClearPageLRU. This
function will be used as page isolation precondition to prevent other
isolations some where else. Then there are may !PageLRU page on lru
list, need to remove BUG() checking accordingly.

There 2 rules for lru bit now:
1, the lru bit still indicate if a page on lru list, just in some
   temporary moment(isolating), the page may have no lru bit when
   it's on lru list.  but the page still must be on lru list when the
   lru bit set.
2, have to remove lru bit before delete it from lru list.

As Andrew Morton mentioned this change would dirty cacheline for page
isn't on LRU. But the lost would be acceptable in Rong Chen
<rong.a.chen@intel.com> report:
https://lore.kernel.org/lkml/20200304090301.GB5972@shao2-debian/

Suggested-by: Johannes Weiner <hannes@cmpxchg.org>
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Hugh Dickins <hughd@google.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Michal Hocko <mhocko@kernel.org>
Cc: Vladimir Davydov <vdavydov.dev@gmail.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-kernel@vger.kernel.org
Cc: cgroups@vger.kernel.org
Cc: linux-mm@kvack.org
---
 include/linux/page-flags.h |  1 +
 mm/mlock.c                 |  3 +--
 mm/vmscan.c                | 39 +++++++++++++++++++--------------------
 3 files changed, 21 insertions(+), 22 deletions(-)

diff --git a/include/linux/page-flags.h b/include/linux/page-flags.h
index 6be1aa559b1e..9554ed1387dc 100644
--- a/include/linux/page-flags.h
+++ b/include/linux/page-flags.h
@@ -326,6 +326,7 @@ static inline void page_init_poison(struct page *page, size_t size)
 PAGEFLAG(Dirty, dirty, PF_HEAD) TESTSCFLAG(Dirty, dirty, PF_HEAD)
 	__CLEARPAGEFLAG(Dirty, dirty, PF_HEAD)
 PAGEFLAG(LRU, lru, PF_HEAD) __CLEARPAGEFLAG(LRU, lru, PF_HEAD)
+	TESTCLEARFLAG(LRU, lru, PF_HEAD)
 PAGEFLAG(Active, active, PF_HEAD) __CLEARPAGEFLAG(Active, active, PF_HEAD)
 	TESTCLEARFLAG(Active, active, PF_HEAD)
 PAGEFLAG(Workingset, workingset, PF_HEAD)
diff --git a/mm/mlock.c b/mm/mlock.c
index d487aa864e86..7b0e6334be6f 100644
--- a/mm/mlock.c
+++ b/mm/mlock.c
@@ -276,10 +276,9 @@ static void __munlock_pagevec(struct pagevec *pvec, struct zone *zone)
 			 * We already have pin from follow_page_mask()
 			 * so we can spare the get_page() here.
 			 */
-			if (PageLRU(page)) {
+			if (TestClearPageLRU(page)) {
 				struct lruvec *lruvec;
 
-				ClearPageLRU(page);
 				lruvec = mem_cgroup_page_lruvec(page,
 							page_pgdat(page));
 				del_page_from_lru_list(page, lruvec,
diff --git a/mm/vmscan.c b/mm/vmscan.c
index 953a068b3fc7..9d06c609c60e 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -1540,7 +1540,7 @@ unsigned int reclaim_clean_pages_from_list(struct zone *zone,
  */
 int __isolate_lru_page(struct page *page, isolate_mode_t mode)
 {
-	int ret = -EINVAL;
+	int ret = -EBUSY;
 
 	/* Only take pages on the LRU. */
 	if (!PageLRU(page))
@@ -1550,8 +1550,6 @@ int __isolate_lru_page(struct page *page, isolate_mode_t mode)
 	if (PageUnevictable(page) && !(mode & ISOLATE_UNEVICTABLE))
 		return ret;
 
-	ret = -EBUSY;
-
 	/*
 	 * To minimise LRU disruption, the caller can indicate that it only
 	 * wants to isolate pages it will be able to operate on without
@@ -1598,8 +1596,10 @@ int __isolate_lru_page(struct page *page, isolate_mode_t mode)
 		 * sure the page is not being freed elsewhere -- the
 		 * page release code relies on it.
 		 */
-		ClearPageLRU(page);
-		ret = 0;
+		if (TestClearPageLRU(page))
+			ret = 0;
+		else
+			put_page(page);
 	}
 
 	return ret;
@@ -1665,8 +1665,6 @@ static unsigned long isolate_lru_pages(unsigned long nr_to_scan,
 		page = lru_to_page(src);
 		prefetchw_prev_lru_page(page, src, flags);
 
-		VM_BUG_ON_PAGE(!PageLRU(page), page);
-
 		nr_pages = compound_nr(page);
 		total_scan += nr_pages;
 
@@ -1763,21 +1761,18 @@ int isolate_lru_page(struct page *page)
 	VM_BUG_ON_PAGE(!page_count(page), page);
 	WARN_RATELIMIT(PageTail(page), "trying to isolate tail page");
 
-	if (PageLRU(page)) {
+	if (TestClearPageLRU(page)) {
 		pg_data_t *pgdat = page_pgdat(page);
 		struct lruvec *lruvec;
 
-		spin_lock_irq(&pgdat->lru_lock);
+		get_page(page);
 		lruvec = mem_cgroup_page_lruvec(page, pgdat);
-		if (PageLRU(page)) {
-			int lru = page_lru(page);
-			get_page(page);
-			ClearPageLRU(page);
-			del_page_from_lru_list(page, lruvec, lru);
-			ret = 0;
-		}
+		spin_lock_irq(&pgdat->lru_lock);
+		del_page_from_lru_list(page, lruvec, page_lru(page));
 		spin_unlock_irq(&pgdat->lru_lock);
+		ret = 0;
 	}
+
 	return ret;
 }
 
@@ -4287,6 +4282,10 @@ void check_move_unevictable_pages(struct pagevec *pvec)
 		nr_pages = thp_nr_pages(page);
 		pgscanned += nr_pages;
 
+		/* block memcg migration during page moving between lru */
+		if (!TestClearPageLRU(page))
+			continue;
+
 		if (pagepgdat != pgdat) {
 			if (pgdat)
 				spin_unlock_irq(&pgdat->lru_lock);
@@ -4295,10 +4294,7 @@ void check_move_unevictable_pages(struct pagevec *pvec)
 		}
 		lruvec = mem_cgroup_page_lruvec(page, pgdat);
 
-		if (!PageLRU(page) || !PageUnevictable(page))
-			continue;
-
-		if (page_evictable(page)) {
+		if (page_evictable(page) && PageUnevictable(page)) {
 			enum lru_list lru = page_lru_base_type(page);
 
 			VM_BUG_ON_PAGE(PageActive(page), page);
@@ -4307,12 +4303,15 @@ void check_move_unevictable_pages(struct pagevec *pvec)
 			add_page_to_lru_list(page, lruvec, lru);
 			pgrescued += nr_pages;
 		}
+		SetPageLRU(page);
 	}
 
 	if (pgdat) {
 		__count_vm_events(UNEVICTABLE_PGRESCUED, pgrescued);
 		__count_vm_events(UNEVICTABLE_PGSCANNED, pgscanned);
 		spin_unlock_irq(&pgdat->lru_lock);
+	} else if (pgscanned) {
+		count_vm_events(UNEVICTABLE_PGSCANNED, pgscanned);
 	}
 }
 EXPORT_SYMBOL_GPL(check_move_unevictable_pages);
-- 
1.8.3.1

[PATCH v19 16/20] mm/compaction: do page isolation first in compaction

[Alex Shi]

Currently, compaction would get the lru_lock and then do page isolation
which works fine with pgdat->lru_lock, since any page isoltion would
compete for the lru_lock. If we want to change to memcg lru_lock, we
have to isolate the page before getting lru_lock, thus isoltion would
block page's memcg change which relay on page isoltion too. Then we
could safely use per memcg lru_lock later.

The new page isolation use previous introduced TestClearPageLRU() +
pgdat lru locking which will be changed to memcg lru lock later.

Hugh Dickins <hughd@google.com> fixed following bugs in this patch's
early version:

Fix lots of crashes under compaction load: isolate_migratepages_block()
must clean up appropriately when rejecting a page, setting PageLRU again
if it had been cleared; and a put_page() after get_page_unless_zero()
cannot safely be done while holding locked_lruvec - it may turn out to
be the final put_page(), which will take an lruvec lock when PageLRU.
And move __isolate_lru_page_prepare back after get_page_unless_zero to
make trylock_page() safe:
trylock_page() is not safe to use at this time: its setting PG_locked
can race with the page being freed or allocated ("Bad page"), and can
also erase flags being set by one of those "sole owners" of a freshly
allocated page who use non-atomic __SetPageFlag().

Suggested-by: Johannes Weiner <hannes@cmpxchg.org>
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: linux-kernel@vger.kernel.org
Cc: linux-mm@kvack.org
---
 include/linux/swap.h |  2 +-
 mm/compaction.c      | 42 +++++++++++++++++++++++++++++++++---------
 mm/vmscan.c          | 43 ++++++++++++++++++++++---------------------
 3 files changed, 56 insertions(+), 31 deletions(-)

diff --git a/include/linux/swap.h b/include/linux/swap.h
index 43e6b3458f58..550fdfdc3506 100644
--- a/include/linux/swap.h
+++ b/include/linux/swap.h
@@ -357,7 +357,7 @@ extern void lru_cache_add_inactive_or_unevictable(struct page *page,
 extern unsigned long zone_reclaimable_pages(struct zone *zone);
 extern unsigned long try_to_free_pages(struct zonelist *zonelist, int order,
 					gfp_t gfp_mask, nodemask_t *mask);
-extern int __isolate_lru_page(struct page *page, isolate_mode_t mode);
+extern int __isolate_lru_page_prepare(struct page *page, isolate_mode_t mode);
 extern unsigned long try_to_free_mem_cgroup_pages(struct mem_cgroup *memcg,
 						  unsigned long nr_pages,
 						  gfp_t gfp_mask,
diff --git a/mm/compaction.c b/mm/compaction.c
index 176dcded298e..16a9f024433d 100644
--- a/mm/compaction.c
+++ b/mm/compaction.c
@@ -887,6 +887,7 @@ static bool too_many_isolated(pg_data_t *pgdat)
 		if (!valid_page && IS_ALIGNED(low_pfn, pageblock_nr_pages)) {
 			if (!cc->ignore_skip_hint && get_pageblock_skip(page)) {
 				low_pfn = end_pfn;
+				page = NULL;
 				goto isolate_abort;
 			}
 			valid_page = page;
@@ -968,6 +969,21 @@ static bool too_many_isolated(pg_data_t *pgdat)
 		if (!(cc->gfp_mask & __GFP_FS) && page_mapping(page))
 			goto isolate_fail;
 
+		/*
+		 * Be careful not to clear PageLRU until after we're
+		 * sure the page is not being freed elsewhere -- the
+		 * page release code relies on it.
+		 */
+		if (unlikely(!get_page_unless_zero(page)))
+			goto isolate_fail;
+
+		if (__isolate_lru_page_prepare(page, isolate_mode) != 0)
+			goto isolate_fail_put;
+
+		/* Try isolate the page */
+		if (!TestClearPageLRU(page))
+			goto isolate_fail_put;
+
 		/* If we already hold the lock, we can skip some rechecking */
 		if (!locked) {
 			locked = compact_lock_irqsave(&pgdat->lru_lock,
@@ -980,10 +996,6 @@ static bool too_many_isolated(pg_data_t *pgdat)
 					goto isolate_abort;
 			}
 
-			/* Recheck PageLRU and PageCompound under lock */
-			if (!PageLRU(page))
-				goto isolate_fail;
-
 			/*
 			 * Page become compound since the non-locked check,
 			 * and it's on LRU. It can only be a THP so the order
@@ -991,16 +1003,13 @@ static bool too_many_isolated(pg_data_t *pgdat)
 			 */
 			if (unlikely(PageCompound(page) && !cc->alloc_contig)) {
 				low_pfn += compound_nr(page) - 1;
-				goto isolate_fail;
+				SetPageLRU(page);
+				goto isolate_fail_put;
 			}
 		}
 
 		lruvec = mem_cgroup_page_lruvec(page, pgdat);
 
-		/* Try isolate the page */
-		if (__isolate_lru_page(page, isolate_mode) != 0)
-			goto isolate_fail;
-
 		/* The whole page is taken off the LRU; skip the tail pages. */
 		if (PageCompound(page))
 			low_pfn += compound_nr(page) - 1;
@@ -1029,6 +1038,15 @@ static bool too_many_isolated(pg_data_t *pgdat)
 		}
 
 		continue;
+
+isolate_fail_put:
+		/* Avoid potential deadlock in freeing page under lru_lock */
+		if (locked) {
+			spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+			locked = false;
+		}
+		put_page(page);
+
 isolate_fail:
 		if (!skip_on_failure)
 			continue;
@@ -1065,9 +1083,15 @@ static bool too_many_isolated(pg_data_t *pgdat)
 	if (unlikely(low_pfn > end_pfn))
 		low_pfn = end_pfn;
 
+	page = NULL;
+
 isolate_abort:
 	if (locked)
 		spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+	if (page) {
+		SetPageLRU(page);
+		put_page(page);
+	}
 
 	/*
 	 * Updated the cached scanner pfn once the pageblock has been scanned
diff --git a/mm/vmscan.c b/mm/vmscan.c
index 9d06c609c60e..e632b8a0c5f5 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -1538,7 +1538,7 @@ unsigned int reclaim_clean_pages_from_list(struct zone *zone,
  *
  * returns 0 on success, -ve errno on failure.
  */
-int __isolate_lru_page(struct page *page, isolate_mode_t mode)
+int __isolate_lru_page_prepare(struct page *page, isolate_mode_t mode)
 {
 	int ret = -EBUSY;
 
@@ -1590,22 +1590,9 @@ int __isolate_lru_page(struct page *page, isolate_mode_t mode)
 	if ((mode & ISOLATE_UNMAPPED) && page_mapped(page))
 		return ret;
 
-	if (likely(get_page_unless_zero(page))) {
-		/*
-		 * Be careful not to clear PageLRU until after we're
-		 * sure the page is not being freed elsewhere -- the
-		 * page release code relies on it.
-		 */
-		if (TestClearPageLRU(page))
-			ret = 0;
-		else
-			put_page(page);
-	}
-
-	return ret;
+	return 0;
 }
 
-
 /*
  * Update LRU sizes after isolating pages. The LRU size updates must
  * be complete before mem_cgroup_update_lru_size due to a sanity check.
@@ -1685,20 +1672,34 @@ static unsigned long isolate_lru_pages(unsigned long nr_to_scan,
 		 * only when the page is being freed somewhere else.
 		 */
 		scan += nr_pages;
-		switch (__isolate_lru_page(page, mode)) {
+		switch (__isolate_lru_page_prepare(page, mode)) {
 		case 0:
+			/*
+			 * Be careful not to clear PageLRU until after we're
+			 * sure the page is not being freed elsewhere -- the
+			 * page release code relies on it.
+			 */
+			if (unlikely(!get_page_unless_zero(page)))
+				goto busy;
+
+			if (!TestClearPageLRU(page)) {
+				/*
+				 * This page may in other isolation path,
+				 * but we still hold lru_lock.
+				 */
+				put_page(page);
+				goto busy;
+			}
+
 			nr_taken += nr_pages;
 			nr_zone_taken[page_zonenum(page)] += nr_pages;
 			list_move(&page->lru, dst);
 			break;
 
-		case -EBUSY:
+		default:
+busy:
 			/* else it is being freed elsewhere */
 			list_move(&page->lru, src);
-			continue;
-
-		default:
-			BUG();
 		}
 	}
 
-- 
1.8.3.1

[PATCH v19 17/20] mm/swap.c: serialize memcg changes in pagevec_lru_move_fn

[Alex Shi]

Hugh Dickins' found a memcg change bug on original version:
If we want to change the pgdat->lru_lock to memcg's lruvec lock, we have
to serialize mem_cgroup_move_account during pagevec_lru_move_fn. The
possible bad scenario would like:

	cpu 0					cpu 1
lruvec = mem_cgroup_page_lruvec()
					if (!isolate_lru_page())
						mem_cgroup_move_account

spin_lock_irqsave(&lruvec->lru_lock <== wrong lock.

So we need TestClearPageLRU to block isolate_lru_page(), that serializes
the memcg change. and then removing the PageLRU check in move_fn callee
as the consequence.

__pagevec_lru_add_fn() is different from the others, because the pages
it deals with are, by definition, not yet on the lru.  TestClearPageLRU
is not needed and would not work, so __pagevec_lru_add() goes its own
way.

Reported-by: Hugh Dickins <hughd@google.com>
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-mm@kvack.org
Cc: linux-kernel@vger.kernel.org
---
 mm/swap.c | 44 +++++++++++++++++++++++++++++++++++---------
 1 file changed, 35 insertions(+), 9 deletions(-)

diff --git a/mm/swap.c b/mm/swap.c
index 6a4b00267384..50418dcc5e24 100644
--- a/mm/swap.c
+++ b/mm/swap.c
@@ -222,8 +222,14 @@ static void pagevec_lru_move_fn(struct pagevec *pvec,
 			spin_lock_irqsave(&pgdat->lru_lock, flags);
 		}
 
+		/* block memcg migration during page moving between lru */
+		if (!TestClearPageLRU(page))
+			continue;
+
 		lruvec = mem_cgroup_page_lruvec(page, pgdat);
 		(*move_fn)(page, lruvec);
+
+		SetPageLRU(page);
 	}
 	if (pgdat)
 		spin_unlock_irqrestore(&pgdat->lru_lock, flags);
@@ -233,7 +239,7 @@ static void pagevec_lru_move_fn(struct pagevec *pvec,
 
 static void pagevec_move_tail_fn(struct page *page, struct lruvec *lruvec)
 {
-	if (PageLRU(page) && !PageUnevictable(page)) {
+	if (!PageUnevictable(page)) {
 		del_page_from_lru_list(page, lruvec, page_lru(page));
 		ClearPageActive(page);
 		add_page_to_lru_list_tail(page, lruvec, page_lru(page));
@@ -306,7 +312,7 @@ void lru_note_cost_page(struct page *page)
 
 static void __activate_page(struct page *page, struct lruvec *lruvec)
 {
-	if (PageLRU(page) && !PageActive(page) && !PageUnevictable(page)) {
+	if (!PageActive(page) && !PageUnevictable(page)) {
 		int lru = page_lru_base_type(page);
 		int nr_pages = thp_nr_pages(page);
 
@@ -362,7 +368,8 @@ void activate_page(struct page *page)
 
 	page = compound_head(page);
 	spin_lock_irq(&pgdat->lru_lock);
-	__activate_page(page, mem_cgroup_page_lruvec(page, pgdat));
+	if (PageLRU(page))
+		__activate_page(page, mem_cgroup_page_lruvec(page, pgdat));
 	spin_unlock_irq(&pgdat->lru_lock);
 }
 #endif
@@ -521,9 +528,6 @@ static void lru_deactivate_file_fn(struct page *page, struct lruvec *lruvec)
 	bool active;
 	int nr_pages = thp_nr_pages(page);
 
-	if (!PageLRU(page))
-		return;
-
 	if (PageUnevictable(page))
 		return;
 
@@ -564,7 +568,7 @@ static void lru_deactivate_file_fn(struct page *page, struct lruvec *lruvec)
 
 static void lru_deactivate_fn(struct page *page, struct lruvec *lruvec)
 {
-	if (PageLRU(page) && PageActive(page) && !PageUnevictable(page)) {
+	if (PageActive(page) && !PageUnevictable(page)) {
 		int lru = page_lru_base_type(page);
 		int nr_pages = thp_nr_pages(page);
 
@@ -581,7 +585,7 @@ static void lru_deactivate_fn(struct page *page, struct lruvec *lruvec)
 
 static void lru_lazyfree_fn(struct page *page, struct lruvec *lruvec)
 {
-	if (PageLRU(page) && PageAnon(page) && PageSwapBacked(page) &&
+	if (PageAnon(page) && PageSwapBacked(page) &&
 	    !PageSwapCache(page) && !PageUnevictable(page)) {
 		bool active = PageActive(page);
 		int nr_pages = thp_nr_pages(page);
@@ -979,7 +983,29 @@ static void __pagevec_lru_add_fn(struct page *page, struct lruvec *lruvec)
  */
 void __pagevec_lru_add(struct pagevec *pvec)
 {
-	pagevec_lru_move_fn(pvec, __pagevec_lru_add_fn);
+	int i;
+	struct pglist_data *pgdat = NULL;
+	struct lruvec *lruvec;
+	unsigned long flags = 0;
+
+	for (i = 0; i < pagevec_count(pvec); i++) {
+		struct page *page = pvec->pages[i];
+		struct pglist_data *pagepgdat = page_pgdat(page);
+
+		if (pagepgdat != pgdat) {
+			if (pgdat)
+				spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+			pgdat = pagepgdat;
+			spin_lock_irqsave(&pgdat->lru_lock, flags);
+		}
+
+		lruvec = mem_cgroup_page_lruvec(page, pgdat);
+		__pagevec_lru_add_fn(page, lruvec);
+	}
+	if (pgdat)
+		spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+	release_pages(pvec->pages, pvec->nr);
+	pagevec_reinit(pvec);
 }
 
 /**
-- 
1.8.3.1

[PATCH v19 18/20] mm/lru: replace pgdat lru_lock with lruvec lock

[Alex Shi]

This patch moves per node lru_lock into lruvec, thus bring a lru_lock for
each of memcg per node. So on a large machine, each of memcg don't
have to suffer from per node pgdat->lru_lock competition. They could go
fast with their self lru_lock.

After move memcg charge before lru inserting, page isolation could
serialize page's memcg, then per memcg lruvec lock is stable and could
replace per node lru lock.

In func isolate_migratepages_block, compact_unlock_should_abort and
lock_page_lruvec_irqsave are open coded to work with compact_control.
Also add a debug func in locking which may give some clues if there are
sth out of hands.

Daniel Jordan's testing show 62% improvement on modified readtwice case
on his 2P * 10 core * 2 HT broadwell box.
https://lore.kernel.org/lkml/20200915165807.kpp7uhiw7l3loofu@ca-dmjordan1.us.oracle.com/

On a large machine with memcg enabled but not used, the page's lruvec
seeking pass a few pointers, that may lead to lru_lock holding time
increase and a bit regression.

Hugh Dickins helped on patch polish, thanks!

Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Michal Hocko <mhocko@kernel.org>
Cc: Vladimir Davydov <vdavydov.dev@gmail.com>
Cc: Yang Shi <yang.shi@linux.alibaba.com>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Konstantin Khlebnikov <khlebnikov@yandex-team.ru>
Cc: Tejun Heo <tj@kernel.org>
Cc: linux-kernel@vger.kernel.org
Cc: linux-mm@kvack.org
Cc: cgroups@vger.kernel.org
---
 include/linux/memcontrol.h |  58 +++++++++++++++++++++++++
 include/linux/mmzone.h     |   3 +-
 mm/compaction.c            |  56 +++++++++++++++---------
 mm/huge_memory.c           |  11 ++---
 mm/memcontrol.c            |  62 ++++++++++++++++++++++++--
 mm/mlock.c                 |  22 +++++++---
 mm/mmzone.c                |   1 +
 mm/page_alloc.c            |   1 -
 mm/swap.c                  | 105 +++++++++++++++++++++------------------------
 mm/vmscan.c                |  55 +++++++++++-------------
 10 files changed, 249 insertions(+), 125 deletions(-)

diff --git a/include/linux/memcontrol.h b/include/linux/memcontrol.h
index d0b036123c6a..7b170e9028b5 100644
--- a/include/linux/memcontrol.h
+++ b/include/linux/memcontrol.h
@@ -494,6 +494,19 @@ static inline struct lruvec *mem_cgroup_lruvec(struct mem_cgroup *memcg,
 
 struct mem_cgroup *get_mem_cgroup_from_page(struct page *page);
 
+struct lruvec *lock_page_lruvec(struct page *page);
+struct lruvec *lock_page_lruvec_irq(struct page *page);
+struct lruvec *lock_page_lruvec_irqsave(struct page *page,
+						unsigned long *flags);
+
+#ifdef CONFIG_DEBUG_VM
+void lruvec_memcg_debug(struct lruvec *lruvec, struct page *page);
+#else
+static inline void lruvec_memcg_debug(struct lruvec *lruvec, struct page *page)
+{
+}
+#endif
+
 static inline
 struct mem_cgroup *mem_cgroup_from_css(struct cgroup_subsys_state *css){
 	return css ? container_of(css, struct mem_cgroup, css) : NULL;
@@ -1035,6 +1048,31 @@ static inline void mem_cgroup_put(struct mem_cgroup *memcg)
 {
 }
 
+static inline struct lruvec *lock_page_lruvec(struct page *page)
+{
+	struct pglist_data *pgdat = page_pgdat(page);
+
+	spin_lock(&pgdat->__lruvec.lru_lock);
+	return &pgdat->__lruvec;
+}
+
+static inline struct lruvec *lock_page_lruvec_irq(struct page *page)
+{
+	struct pglist_data *pgdat = page_pgdat(page);
+
+	spin_lock_irq(&pgdat->__lruvec.lru_lock);
+	return &pgdat->__lruvec;
+}
+
+static inline struct lruvec *lock_page_lruvec_irqsave(struct page *page,
+		unsigned long *flagsp)
+{
+	struct pglist_data *pgdat = page_pgdat(page);
+
+	spin_lock_irqsave(&pgdat->__lruvec.lru_lock, *flagsp);
+	return &pgdat->__lruvec;
+}
+
 static inline struct mem_cgroup *
 mem_cgroup_iter(struct mem_cgroup *root,
 		struct mem_cgroup *prev,
@@ -1282,6 +1320,10 @@ static inline void count_memcg_page_event(struct page *page,
 void count_memcg_event_mm(struct mm_struct *mm, enum vm_event_item idx)
 {
 }
+
+static inline void lruvec_memcg_debug(struct lruvec *lruvec, struct page *page)
+{
+}
 #endif /* CONFIG_MEMCG */
 
 /* idx can be of type enum memcg_stat_item or node_stat_item */
@@ -1411,6 +1453,22 @@ static inline struct lruvec *parent_lruvec(struct lruvec *lruvec)
 	return mem_cgroup_lruvec(memcg, lruvec_pgdat(lruvec));
 }
 
+static inline void unlock_page_lruvec(struct lruvec *lruvec)
+{
+	spin_unlock(&lruvec->lru_lock);
+}
+
+static inline void unlock_page_lruvec_irq(struct lruvec *lruvec)
+{
+	spin_unlock_irq(&lruvec->lru_lock);
+}
+
+static inline void unlock_page_lruvec_irqrestore(struct lruvec *lruvec,
+		unsigned long flags)
+{
+	spin_unlock_irqrestore(&lruvec->lru_lock, flags);
+}
+
 #ifdef CONFIG_CGROUP_WRITEBACK
 
 struct wb_domain *mem_cgroup_wb_domain(struct bdi_writeback *wb);
diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h
index 8379432f4f2f..7727f4c373f7 100644
--- a/include/linux/mmzone.h
+++ b/include/linux/mmzone.h
@@ -273,6 +273,8 @@ enum lruvec_flags {
 };
 
 struct lruvec {
+	/* per lruvec lru_lock for memcg */
+	spinlock_t			lru_lock;
 	struct list_head		lists[NR_LRU_LISTS];
 	/*
 	 * These track the cost of reclaiming one LRU - file or anon -
@@ -757,7 +759,6 @@ struct deferred_split {
 
 	/* Write-intensive fields used by page reclaim */
 	ZONE_PADDING(_pad1_)
-	spinlock_t		lru_lock;
 
 #ifdef CONFIG_DEFERRED_STRUCT_PAGE_INIT
 	/*
diff --git a/mm/compaction.c b/mm/compaction.c
index 16a9f024433d..5ffbadc46bbc 100644
--- a/mm/compaction.c
+++ b/mm/compaction.c
@@ -805,7 +805,7 @@ static bool too_many_isolated(pg_data_t *pgdat)
 	unsigned long nr_scanned = 0, nr_isolated = 0;
 	struct lruvec *lruvec;
 	unsigned long flags = 0;
-	bool locked = false;
+	struct lruvec *locked = NULL;
 	struct page *page = NULL, *valid_page = NULL;
 	unsigned long start_pfn = low_pfn;
 	bool skip_on_failure = false;
@@ -865,11 +865,20 @@ static bool too_many_isolated(pg_data_t *pgdat)
 		 * contention, to give chance to IRQs. Abort completely if
 		 * a fatal signal is pending.
 		 */
-		if (!(low_pfn % SWAP_CLUSTER_MAX)
-		    && compact_unlock_should_abort(&pgdat->lru_lock,
-					    flags, &locked, cc)) {
-			low_pfn = 0;
-			goto fatal_pending;
+		if (!(low_pfn % SWAP_CLUSTER_MAX)) {
+			if (locked) {
+				unlock_page_lruvec_irqrestore(locked, flags);
+				locked = NULL;
+			}
+
+			if (fatal_signal_pending(current)) {
+				cc->contended = true;
+
+				low_pfn = 0;
+				goto fatal_pending;
+			}
+
+			cond_resched();
 		}
 
 		if (!pfn_valid_within(low_pfn))
@@ -941,9 +950,8 @@ static bool too_many_isolated(pg_data_t *pgdat)
 			if (unlikely(__PageMovable(page)) &&
 					!PageIsolated(page)) {
 				if (locked) {
-					spin_unlock_irqrestore(&pgdat->lru_lock,
-									flags);
-					locked = false;
+					unlock_page_lruvec_irqrestore(locked, flags);
+					locked = NULL;
 				}
 
 				if (!isolate_movable_page(page, isolate_mode))
@@ -984,10 +992,19 @@ static bool too_many_isolated(pg_data_t *pgdat)
 		if (!TestClearPageLRU(page))
 			goto isolate_fail_put;
 
+		rcu_read_lock();
+		lruvec = mem_cgroup_page_lruvec(page, pgdat);
+
 		/* If we already hold the lock, we can skip some rechecking */
-		if (!locked) {
-			locked = compact_lock_irqsave(&pgdat->lru_lock,
-								&flags, cc);
+		if (lruvec != locked) {
+			if (locked)
+				unlock_page_lruvec_irqrestore(locked, flags);
+
+			compact_lock_irqsave(&lruvec->lru_lock, &flags, cc);
+			locked = lruvec;
+			rcu_read_unlock();
+
+			lruvec_memcg_debug(lruvec, page);
 
 			/* Try get exclusive access under lock */
 			if (!skip_updated) {
@@ -1006,9 +1023,8 @@ static bool too_many_isolated(pg_data_t *pgdat)
 				SetPageLRU(page);
 				goto isolate_fail_put;
 			}
-		}
-
-		lruvec = mem_cgroup_page_lruvec(page, pgdat);
+		} else
+			rcu_read_unlock();
 
 		/* The whole page is taken off the LRU; skip the tail pages. */
 		if (PageCompound(page))
@@ -1042,8 +1058,8 @@ static bool too_many_isolated(pg_data_t *pgdat)
 isolate_fail_put:
 		/* Avoid potential deadlock in freeing page under lru_lock */
 		if (locked) {
-			spin_unlock_irqrestore(&pgdat->lru_lock, flags);
-			locked = false;
+			unlock_page_lruvec_irqrestore(locked, flags);
+			locked = NULL;
 		}
 		put_page(page);
 
@@ -1058,8 +1074,8 @@ static bool too_many_isolated(pg_data_t *pgdat)
 		 */
 		if (nr_isolated) {
 			if (locked) {
-				spin_unlock_irqrestore(&pgdat->lru_lock, flags);
-				locked = false;
+				unlock_page_lruvec_irqrestore(locked, flags);
+				locked = NULL;
 			}
 			putback_movable_pages(&cc->migratepages);
 			cc->nr_migratepages = 0;
@@ -1087,7 +1103,7 @@ static bool too_many_isolated(pg_data_t *pgdat)
 
 isolate_abort:
 	if (locked)
-		spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+		unlock_page_lruvec_irqrestore(locked, flags);
 	if (page) {
 		SetPageLRU(page);
 		put_page(page);
diff --git a/mm/huge_memory.c b/mm/huge_memory.c
index 63af7611afaf..371600c868bb 100644
--- a/mm/huge_memory.c
+++ b/mm/huge_memory.c
@@ -2324,7 +2324,7 @@ static void lru_add_page_tail(struct page *head, struct page *page_tail,
 	VM_BUG_ON_PAGE(!PageHead(head), head);
 	VM_BUG_ON_PAGE(PageCompound(page_tail), head);
 	VM_BUG_ON_PAGE(PageLRU(page_tail), head);
-	lockdep_assert_held(&lruvec_pgdat(lruvec)->lru_lock);
+	lockdep_assert_held(&lruvec->lru_lock);
 
 	if (list) {
 		/* page reclaim is reclaiming a huge page */
@@ -2405,7 +2405,6 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 		pgoff_t end)
 {
 	struct page *head = compound_head(page);
-	pg_data_t *pgdat = page_pgdat(head);
 	struct lruvec *lruvec;
 	struct address_space *swap_cache = NULL;
 	unsigned long offset = 0;
@@ -2422,10 +2421,8 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 		xa_lock(&swap_cache->i_pages);
 	}
 
-	/* prevent PageLRU to go away from under us, and freeze lru stats */
-	spin_lock(&pgdat->lru_lock);
-
-	lruvec = mem_cgroup_page_lruvec(head, pgdat);
+	/* lock lru list/PageCompound, ref freezed by page_ref_freeze */
+	lruvec = lock_page_lruvec(head);
 
 	for (i = HPAGE_PMD_NR - 1; i >= 1; i--) {
 		__split_huge_page_tail(head, i, lruvec, list);
@@ -2446,7 +2443,7 @@ static void __split_huge_page(struct page *page, struct list_head *list,
 	}
 
 	ClearPageCompound(head);
-	spin_unlock(&pgdat->lru_lock);
+	unlock_page_lruvec(lruvec);
 	/* Caller disabled irqs, so they are still disabled here */
 
 	split_page_owner(head, HPAGE_PMD_ORDER);
diff --git a/mm/memcontrol.c b/mm/memcontrol.c
index 6acc6a60c52b..232635e284f2 100644
--- a/mm/memcontrol.c
+++ b/mm/memcontrol.c
@@ -1302,6 +1302,19 @@ int mem_cgroup_scan_tasks(struct mem_cgroup *memcg,
 	return ret;
 }
 
+#ifdef CONFIG_DEBUG_VM
+void lruvec_memcg_debug(struct lruvec *lruvec, struct page *page)
+{
+	if (mem_cgroup_disabled())
+		return;
+
+	if (!page->mem_cgroup)
+		VM_BUG_ON_PAGE(lruvec_memcg(lruvec) != root_mem_cgroup, page);
+	else
+		VM_BUG_ON_PAGE(lruvec_memcg(lruvec) != page->mem_cgroup, page);
+}
+#endif
+
 /**
  * mem_cgroup_page_lruvec - return lruvec for isolating/putting an LRU page
  * @page: the page
@@ -1339,6 +1352,51 @@ struct lruvec *mem_cgroup_page_lruvec(struct page *page, struct pglist_data *pgd
 	return lruvec;
 }
 
+struct lruvec *lock_page_lruvec(struct page *page)
+{
+	struct lruvec *lruvec;
+	struct pglist_data *pgdat = page_pgdat(page);
+
+	rcu_read_lock();
+	lruvec = mem_cgroup_page_lruvec(page, pgdat);
+	spin_lock(&lruvec->lru_lock);
+	rcu_read_unlock();
+
+	lruvec_memcg_debug(lruvec, page);
+
+	return lruvec;
+}
+
+struct lruvec *lock_page_lruvec_irq(struct page *page)
+{
+	struct lruvec *lruvec;
+	struct pglist_data *pgdat = page_pgdat(page);
+
+	rcu_read_lock();
+	lruvec = mem_cgroup_page_lruvec(page, pgdat);
+	spin_lock_irq(&lruvec->lru_lock);
+	rcu_read_unlock();
+
+	lruvec_memcg_debug(lruvec, page);
+
+	return lruvec;
+}
+
+struct lruvec *lock_page_lruvec_irqsave(struct page *page, unsigned long *flags)
+{
+	struct lruvec *lruvec;
+	struct pglist_data *pgdat = page_pgdat(page);
+
+	rcu_read_lock();
+	lruvec = mem_cgroup_page_lruvec(page, pgdat);
+	spin_lock_irqsave(&lruvec->lru_lock, *flags);
+	rcu_read_unlock();
+
+	lruvec_memcg_debug(lruvec, page);
+
+	return lruvec;
+}
+
 /**
  * mem_cgroup_update_lru_size - account for adding or removing an lru page
  * @lruvec: mem_cgroup per zone lru vector
@@ -3217,10 +3275,8 @@ void obj_cgroup_uncharge(struct obj_cgroup *objcg, size_t size)
 #endif /* CONFIG_MEMCG_KMEM */
 
 #ifdef CONFIG_TRANSPARENT_HUGEPAGE
-
 /*
- * Because tail pages are not marked as "used", set it. We're under
- * pgdat->lru_lock and migration entries setup in all page mappings.
+ * Because page->mem_cgroup is not set on compound tails, set it now.
  */
 void mem_cgroup_split_huge_fixup(struct page *head)
 {
diff --git a/mm/mlock.c b/mm/mlock.c
index 7b0e6334be6f..ab164a675c25 100644
--- a/mm/mlock.c
+++ b/mm/mlock.c
@@ -262,12 +262,12 @@ static void __munlock_pagevec(struct pagevec *pvec, struct zone *zone)
 	int nr = pagevec_count(pvec);
 	int delta_munlocked = -nr;
 	struct pagevec pvec_putback;
+	struct lruvec *lruvec = NULL;
 	int pgrescued = 0;
 
 	pagevec_init(&pvec_putback);
 
 	/* Phase 1: page isolation */
-	spin_lock_irq(&zone->zone_pgdat->lru_lock);
 	for (i = 0; i < nr; i++) {
 		struct page *page = pvec->pages[i];
 
@@ -277,10 +277,16 @@ static void __munlock_pagevec(struct pagevec *pvec, struct zone *zone)
 			 * so we can spare the get_page() here.
 			 */
 			if (TestClearPageLRU(page)) {
-				struct lruvec *lruvec;
+				struct lruvec *new_lruvec;
+
+				new_lruvec = mem_cgroup_page_lruvec(page,
+						page_pgdat(page));
+				if (new_lruvec != lruvec) {
+					if (lruvec)
+						unlock_page_lruvec_irq(lruvec);
+					lruvec = lock_page_lruvec_irq(page);
+				}
 
-				lruvec = mem_cgroup_page_lruvec(page,
-							page_pgdat(page));
 				del_page_from_lru_list(page, lruvec,
 							page_lru(page));
 				continue;
@@ -299,8 +305,12 @@ static void __munlock_pagevec(struct pagevec *pvec, struct zone *zone)
 		pagevec_add(&pvec_putback, pvec->pages[i]);
 		pvec->pages[i] = NULL;
 	}
-	__mod_zone_page_state(zone, NR_MLOCK, delta_munlocked);
-	spin_unlock_irq(&zone->zone_pgdat->lru_lock);
+	if (lruvec) {
+		__mod_zone_page_state(zone, NR_MLOCK, delta_munlocked);
+		unlock_page_lruvec_irq(lruvec);
+	} else if (delta_munlocked) {
+		mod_zone_page_state(zone, NR_MLOCK, delta_munlocked);
+	}
 
 	/* Now we can release pins of pages that we are not munlocking */
 	pagevec_release(&pvec_putback);
diff --git a/mm/mmzone.c b/mm/mmzone.c
index 4686fdc23bb9..3750a90ed4a0 100644
--- a/mm/mmzone.c
+++ b/mm/mmzone.c
@@ -91,6 +91,7 @@ void lruvec_init(struct lruvec *lruvec)
 	enum lru_list lru;
 
 	memset(lruvec, 0, sizeof(struct lruvec));
+	spin_lock_init(&lruvec->lru_lock);
 
 	for_each_lru(lru)
 		INIT_LIST_HEAD(&lruvec->lists[lru]);
diff --git a/mm/page_alloc.c b/mm/page_alloc.c
index fab5e97dc9ca..775120fcc869 100644
--- a/mm/page_alloc.c
+++ b/mm/page_alloc.c
@@ -6733,7 +6733,6 @@ static void __meminit pgdat_init_internals(struct pglist_data *pgdat)
 	init_waitqueue_head(&pgdat->pfmemalloc_wait);
 
 	pgdat_page_ext_init(pgdat);
-	spin_lock_init(&pgdat->lru_lock);
 	lruvec_init(&pgdat->__lruvec);
 }
 
diff --git a/mm/swap.c b/mm/swap.c
index 50418dcc5e24..622218bd18e5 100644
--- a/mm/swap.c
+++ b/mm/swap.c
@@ -79,16 +79,14 @@ static DEFINE_PER_CPU(struct lru_pvecs, lru_pvecs) = {
 static void __page_cache_release(struct page *page)
 {
 	if (PageLRU(page)) {
-		pg_data_t *pgdat = page_pgdat(page);
 		struct lruvec *lruvec;
 		unsigned long flags;
 
-		spin_lock_irqsave(&pgdat->lru_lock, flags);
-		lruvec = mem_cgroup_page_lruvec(page, pgdat);
+		lruvec = lock_page_lruvec_irqsave(page, &flags);
 		VM_BUG_ON_PAGE(!PageLRU(page), page);
 		__ClearPageLRU(page);
 		del_page_from_lru_list(page, lruvec, page_off_lru(page));
-		spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+		unlock_page_lruvec_irqrestore(lruvec, flags);
 	}
 	__ClearPageWaiters(page);
 }
@@ -207,32 +205,30 @@ static void pagevec_lru_move_fn(struct pagevec *pvec,
 	void (*move_fn)(struct page *page, struct lruvec *lruvec))
 {
 	int i;
-	struct pglist_data *pgdat = NULL;
-	struct lruvec *lruvec;
+	struct lruvec *lruvec = NULL;
 	unsigned long flags = 0;
 
 	for (i = 0; i < pagevec_count(pvec); i++) {
 		struct page *page = pvec->pages[i];
-		struct pglist_data *pagepgdat = page_pgdat(page);
-
-		if (pagepgdat != pgdat) {
-			if (pgdat)
-				spin_unlock_irqrestore(&pgdat->lru_lock, flags);
-			pgdat = pagepgdat;
-			spin_lock_irqsave(&pgdat->lru_lock, flags);
-		}
+		struct lruvec *new_lruvec;
 
 		/* block memcg migration during page moving between lru */
 		if (!TestClearPageLRU(page))
 			continue;
 
-		lruvec = mem_cgroup_page_lruvec(page, pgdat);
+		new_lruvec = mem_cgroup_page_lruvec(page, page_pgdat(page));
+		if (lruvec != new_lruvec) {
+			if (lruvec)
+				unlock_page_lruvec_irqrestore(lruvec, flags);
+			lruvec = lock_page_lruvec_irqsave(page, &flags);
+		}
+
 		(*move_fn)(page, lruvec);
 
 		SetPageLRU(page);
 	}
-	if (pgdat)
-		spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+	if (lruvec)
+		unlock_page_lruvec_irqrestore(lruvec, flags);
 	release_pages(pvec->pages, pvec->nr);
 	pagevec_reinit(pvec);
 }
@@ -274,9 +270,8 @@ void lru_note_cost(struct lruvec *lruvec, bool file, unsigned int nr_pages)
 {
 	do {
 		unsigned long lrusize;
-		struct pglist_data *pgdat = lruvec_pgdat(lruvec);
 
-		spin_lock_irq(&pgdat->lru_lock);
+		spin_lock_irq(&lruvec->lru_lock);
 		/* Record cost event */
 		if (file)
 			lruvec->file_cost += nr_pages;
@@ -300,7 +295,7 @@ void lru_note_cost(struct lruvec *lruvec, bool file, unsigned int nr_pages)
 			lruvec->file_cost /= 2;
 			lruvec->anon_cost /= 2;
 		}
-		spin_unlock_irq(&pgdat->lru_lock);
+		spin_unlock_irq(&lruvec->lru_lock);
 	} while ((lruvec = parent_lruvec(lruvec)));
 }
 
@@ -364,13 +359,13 @@ static inline void activate_page_drain(int cpu)
 
 void activate_page(struct page *page)
 {
-	pg_data_t *pgdat = page_pgdat(page);
+	struct lruvec *lruvec;
 
 	page = compound_head(page);
-	spin_lock_irq(&pgdat->lru_lock);
+	lruvec = lock_page_lruvec_irq(page);
 	if (PageLRU(page))
-		__activate_page(page, mem_cgroup_page_lruvec(page, pgdat));
-	spin_unlock_irq(&pgdat->lru_lock);
+		__activate_page(page, lruvec);
+	unlock_page_lruvec_irq(lruvec);
 }
 #endif
 
@@ -819,8 +814,7 @@ void release_pages(struct page **pages, int nr)
 {
 	int i;
 	LIST_HEAD(pages_to_free);
-	struct pglist_data *locked_pgdat = NULL;
-	struct lruvec *lruvec;
+	struct lruvec *lruvec = NULL;
 	unsigned long flags;
 	unsigned int lock_batch;
 
@@ -830,21 +824,20 @@ void release_pages(struct page **pages, int nr)
 		/*
 		 * Make sure the IRQ-safe lock-holding time does not get
 		 * excessive with a continuous string of pages from the
-		 * same pgdat. The lock is held only if pgdat != NULL.
+		 * same lruvec. The lock is held only if lruvec != NULL.
 		 */
-		if (locked_pgdat && ++lock_batch == SWAP_CLUSTER_MAX) {
-			spin_unlock_irqrestore(&locked_pgdat->lru_lock, flags);
-			locked_pgdat = NULL;
+		if (lruvec && ++lock_batch == SWAP_CLUSTER_MAX) {
+			unlock_page_lruvec_irqrestore(lruvec, flags);
+			lruvec = NULL;
 		}
 
 		if (is_huge_zero_page(page))
 			continue;
 
 		if (is_zone_device_page(page)) {
-			if (locked_pgdat) {
-				spin_unlock_irqrestore(&locked_pgdat->lru_lock,
-						       flags);
-				locked_pgdat = NULL;
+			if (lruvec) {
+				unlock_page_lruvec_irqrestore(lruvec, flags);
+				lruvec = NULL;
 			}
 			/*
 			 * ZONE_DEVICE pages that return 'false' from
@@ -863,27 +856,27 @@ void release_pages(struct page **pages, int nr)
 			continue;
 
 		if (PageCompound(page)) {
-			if (locked_pgdat) {
-				spin_unlock_irqrestore(&locked_pgdat->lru_lock, flags);
-				locked_pgdat = NULL;
+			if (lruvec) {
+				unlock_page_lruvec_irqrestore(lruvec, flags);
+				lruvec = NULL;
 			}
 			__put_compound_page(page);
 			continue;
 		}
 
 		if (PageLRU(page)) {
-			struct pglist_data *pgdat = page_pgdat(page);
+			struct lruvec *new_lruvec;
 
-			if (pgdat != locked_pgdat) {
-				if (locked_pgdat)
-					spin_unlock_irqrestore(&locked_pgdat->lru_lock,
+			new_lruvec = mem_cgroup_page_lruvec(page,
+							page_pgdat(page));
+			if (new_lruvec != lruvec) {
+				if (lruvec)
+					unlock_page_lruvec_irqrestore(lruvec,
 									flags);
 				lock_batch = 0;
-				locked_pgdat = pgdat;
-				spin_lock_irqsave(&locked_pgdat->lru_lock, flags);
+				lruvec = lock_page_lruvec_irqsave(page, &flags);
 			}
 
-			lruvec = mem_cgroup_page_lruvec(page, locked_pgdat);
 			VM_BUG_ON_PAGE(!PageLRU(page), page);
 			__ClearPageLRU(page);
 			del_page_from_lru_list(page, lruvec, page_off_lru(page));
@@ -895,8 +888,8 @@ void release_pages(struct page **pages, int nr)
 
 		list_add(&page->lru, &pages_to_free);
 	}
-	if (locked_pgdat)
-		spin_unlock_irqrestore(&locked_pgdat->lru_lock, flags);
+	if (lruvec)
+		unlock_page_lruvec_irqrestore(lruvec, flags);
 
 	mem_cgroup_uncharge_list(&pages_to_free);
 	free_unref_page_list(&pages_to_free);
@@ -984,26 +977,24 @@ static void __pagevec_lru_add_fn(struct page *page, struct lruvec *lruvec)
 void __pagevec_lru_add(struct pagevec *pvec)
 {
 	int i;
-	struct pglist_data *pgdat = NULL;
-	struct lruvec *lruvec;
+	struct lruvec *lruvec = NULL;
 	unsigned long flags = 0;
 
 	for (i = 0; i < pagevec_count(pvec); i++) {
 		struct page *page = pvec->pages[i];
-		struct pglist_data *pagepgdat = page_pgdat(page);
+		struct lruvec *new_lruvec;
 
-		if (pagepgdat != pgdat) {
-			if (pgdat)
-				spin_unlock_irqrestore(&pgdat->lru_lock, flags);
-			pgdat = pagepgdat;
-			spin_lock_irqsave(&pgdat->lru_lock, flags);
+		new_lruvec = mem_cgroup_page_lruvec(page, page_pgdat(page));
+		if (lruvec != new_lruvec) {
+			if (lruvec)
+				unlock_page_lruvec_irqrestore(lruvec, flags);
+			lruvec = lock_page_lruvec_irqsave(page, &flags);
 		}
 
-		lruvec = mem_cgroup_page_lruvec(page, pgdat);
 		__pagevec_lru_add_fn(page, lruvec);
 	}
-	if (pgdat)
-		spin_unlock_irqrestore(&pgdat->lru_lock, flags);
+	if (lruvec)
+		unlock_page_lruvec_irqrestore(lruvec, flags);
 	release_pages(pvec->pages, pvec->nr);
 	pagevec_reinit(pvec);
 }
diff --git a/mm/vmscan.c b/mm/vmscan.c
index e632b8a0c5f5..d789d098e4dd 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -1763,14 +1763,12 @@ int isolate_lru_page(struct page *page)
 	WARN_RATELIMIT(PageTail(page), "trying to isolate tail page");
 
 	if (TestClearPageLRU(page)) {
-		pg_data_t *pgdat = page_pgdat(page);
 		struct lruvec *lruvec;
 
 		get_page(page);
-		lruvec = mem_cgroup_page_lruvec(page, pgdat);
-		spin_lock_irq(&pgdat->lru_lock);
+		lruvec = lock_page_lruvec_irq(page);
 		del_page_from_lru_list(page, lruvec, page_lru(page));
-		spin_unlock_irq(&pgdat->lru_lock);
+		unlock_page_lruvec_irq(lruvec);
 		ret = 0;
 	}
 
@@ -1837,7 +1835,6 @@ static int too_many_isolated(struct pglist_data *pgdat, int file,
 static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
 						     struct list_head *list)
 {
-	struct pglist_data *pgdat = lruvec_pgdat(lruvec);
 	int nr_pages, nr_moved = 0;
 	LIST_HEAD(pages_to_free);
 	struct page *page;
@@ -1848,9 +1845,9 @@ static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
 		VM_BUG_ON_PAGE(PageLRU(page), page);
 		list_del(&page->lru);
 		if (unlikely(!page_evictable(page))) {
-			spin_unlock_irq(&pgdat->lru_lock);
+			spin_unlock_irq(&lruvec->lru_lock);
 			putback_lru_page(page);
-			spin_lock_irq(&pgdat->lru_lock);
+			spin_lock_irq(&lruvec->lru_lock);
 			continue;
 		}
 
@@ -1872,9 +1869,9 @@ static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
 			__ClearPageActive(page);
 
 			if (unlikely(PageCompound(page))) {
-				spin_unlock_irq(&pgdat->lru_lock);
+				spin_unlock_irq(&lruvec->lru_lock);
 				destroy_compound_page(page);
-				spin_lock_irq(&pgdat->lru_lock);
+				spin_lock_irq(&lruvec->lru_lock);
 			} else
 				list_add(&page->lru, &pages_to_free);
 
@@ -1947,7 +1944,7 @@ static int current_may_throttle(void)
 
 	lru_add_drain();
 
-	spin_lock_irq(&pgdat->lru_lock);
+	spin_lock_irq(&lruvec->lru_lock);
 
 	nr_taken = isolate_lru_pages(nr_to_scan, lruvec, &page_list,
 				     &nr_scanned, sc, lru);
@@ -1959,7 +1956,7 @@ static int current_may_throttle(void)
 	__count_memcg_events(lruvec_memcg(lruvec), item, nr_scanned);
 	__count_vm_events(PGSCAN_ANON + file, nr_scanned);
 
-	spin_unlock_irq(&pgdat->lru_lock);
+	spin_unlock_irq(&lruvec->lru_lock);
 
 	if (nr_taken == 0)
 		return 0;
@@ -1967,7 +1964,7 @@ static int current_may_throttle(void)
 	nr_reclaimed = shrink_page_list(&page_list, pgdat, sc, 0,
 				&stat, false);
 
-	spin_lock_irq(&pgdat->lru_lock);
+	spin_lock_irq(&lruvec->lru_lock);
 	move_pages_to_lru(lruvec, &page_list);
 
 	__mod_node_page_state(pgdat, NR_ISOLATED_ANON + file, -nr_taken);
@@ -1976,7 +1973,7 @@ static int current_may_throttle(void)
 		__count_vm_events(item, nr_reclaimed);
 	__count_memcg_events(lruvec_memcg(lruvec), item, nr_reclaimed);
 	__count_vm_events(PGSTEAL_ANON + file, nr_reclaimed);
-	spin_unlock_irq(&pgdat->lru_lock);
+	spin_unlock_irq(&lruvec->lru_lock);
 
 	lru_note_cost(lruvec, file, stat.nr_pageout);
 	mem_cgroup_uncharge_list(&page_list);
@@ -2029,7 +2026,7 @@ static void shrink_active_list(unsigned long nr_to_scan,
 
 	lru_add_drain();
 
-	spin_lock_irq(&pgdat->lru_lock);
+	spin_lock_irq(&lruvec->lru_lock);
 
 	nr_taken = isolate_lru_pages(nr_to_scan, lruvec, &l_hold,
 				     &nr_scanned, sc, lru);
@@ -2040,7 +2037,7 @@ static void shrink_active_list(unsigned long nr_to_scan,
 		__count_vm_events(PGREFILL, nr_scanned);
 	__count_memcg_events(lruvec_memcg(lruvec), PGREFILL, nr_scanned);
 
-	spin_unlock_irq(&pgdat->lru_lock);
+	spin_unlock_irq(&lruvec->lru_lock);
 
 	while (!list_empty(&l_hold)) {
 		cond_resched();
@@ -2086,7 +2083,7 @@ static void shrink_active_list(unsigned long nr_to_scan,
 	/*
 	 * Move pages back to the lru list.
 	 */
-	spin_lock_irq(&pgdat->lru_lock);
+	spin_lock_irq(&lruvec->lru_lock);
 
 	nr_activate = move_pages_to_lru(lruvec, &l_active);
 	nr_deactivate = move_pages_to_lru(lruvec, &l_inactive);
@@ -2097,7 +2094,7 @@ static void shrink_active_list(unsigned long nr_to_scan,
 	__count_memcg_events(lruvec_memcg(lruvec), PGDEACTIVATE, nr_deactivate);
 
 	__mod_node_page_state(pgdat, NR_ISOLATED_ANON + file, -nr_taken);
-	spin_unlock_irq(&pgdat->lru_lock);
+	spin_unlock_irq(&lruvec->lru_lock);
 
 	mem_cgroup_uncharge_list(&l_active);
 	free_unref_page_list(&l_active);
@@ -2687,10 +2684,10 @@ static void shrink_node(pg_data_t *pgdat, struct scan_control *sc)
 	/*
 	 * Determine the scan balance between anon and file LRUs.
 	 */
-	spin_lock_irq(&pgdat->lru_lock);
+	spin_lock_irq(&target_lruvec->lru_lock);
 	sc->anon_cost = target_lruvec->anon_cost;
 	sc->file_cost = target_lruvec->file_cost;
-	spin_unlock_irq(&pgdat->lru_lock);
+	spin_unlock_irq(&target_lruvec->lru_lock);
 
 	/*
 	 * Target desirable inactive:active list ratios for the anon
@@ -4266,16 +4263,15 @@ int node_reclaim(struct pglist_data *pgdat, gfp_t gfp_mask, unsigned int order)
  */
 void check_move_unevictable_pages(struct pagevec *pvec)
 {
-	struct lruvec *lruvec;
-	struct pglist_data *pgdat = NULL;
+	struct lruvec *lruvec = NULL;
 	int pgscanned = 0;
 	int pgrescued = 0;
 	int i;
 
 	for (i = 0; i < pvec->nr; i++) {
 		struct page *page = pvec->pages[i];
-		struct pglist_data *pagepgdat = page_pgdat(page);
 		int nr_pages;
+		struct lruvec *new_lruvec;
 
 		if (PageTransTail(page))
 			continue;
@@ -4287,13 +4283,12 @@ void check_move_unevictable_pages(struct pagevec *pvec)
 		if (!TestClearPageLRU(page))
 			continue;
 
-		if (pagepgdat != pgdat) {
-			if (pgdat)
-				spin_unlock_irq(&pgdat->lru_lock);
-			pgdat = pagepgdat;
-			spin_lock_irq(&pgdat->lru_lock);
+		new_lruvec = mem_cgroup_page_lruvec(page, page_pgdat(page));
+		if (lruvec != new_lruvec) {
+			if (lruvec)
+				unlock_page_lruvec_irq(lruvec);
+			lruvec = lock_page_lruvec_irq(page);
 		}
-		lruvec = mem_cgroup_page_lruvec(page, pgdat);
 
 		if (page_evictable(page) && PageUnevictable(page)) {
 			enum lru_list lru = page_lru_base_type(page);
@@ -4307,10 +4302,10 @@ void check_move_unevictable_pages(struct pagevec *pvec)
 		SetPageLRU(page);
 	}
 
-	if (pgdat) {
+	if (lruvec) {
 		__count_vm_events(UNEVICTABLE_PGRESCUED, pgrescued);
 		__count_vm_events(UNEVICTABLE_PGSCANNED, pgscanned);
-		spin_unlock_irq(&pgdat->lru_lock);
+		unlock_page_lruvec_irq(lruvec);
 	} else if (pgscanned) {
 		count_vm_events(UNEVICTABLE_PGSCANNED, pgscanned);
 	}
-- 
1.8.3.1

Re: [PATCH v19 18/20] mm/lru: replace pgdat lru_lock with lruvec lock

[Alex Shi]

[-- Attachment #1: Type: text/plain, Size: 1480 bytes --]


在 2020/9/24 上午11:28, Alex Shi 写道:
> --- a/include/linux/mmzone.h
> +++ b/include/linux/mmzone.h
> @@ -273,6 +273,8 @@ enum lruvec_flags {
>  };
>  
>  struct lruvec {
> +	/* per lruvec lru_lock for memcg */
> +	spinlock_t			lru_lock;
>  	struct list_head		lists[NR_LRU_LISTS];
>  	/*
>  	 * These track the cost of reclaiming one LRU - file or anon -

Hi All,

Intel Rong Chen, LKP, report a big regression on this patch, about 12 ~ 32% performance drop on fio.read_iops and case-lru-file-mmap-read case on wide Intel machine with attached kernel config. Hugh Dickins pointed it's a false sharing issue on the lru_lock. And that could be fixed by move the lru_lock out of busy lists[] cacheline, like the following patch:

diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h
index a75e6d0effcb..58b21bffef95 100644
--- a/include/linux/mmzone.h
+++ b/include/linux/mmzone.h
@@ -272,9 +272,9 @@ enum lruvec_flags {
 };

 struct lruvec {
+       struct list_head                lists[NR_LRU_LISTS];
        /* per lruvec lru_lock for memcg */
        spinlock_t                      lru_lock;
-       struct list_head                lists[NR_LRU_LISTS];
        /*
         * These track the cost of reclaiming one LRU - file or anon -
         * over the other. As the observed cost of reclaiming one LRU

Although the problem fixed， But I still no idea of the reasons and the gut problem. Any comments for this?


Thanks
Alex

[-- Attachment #2: config-5.9.0-rc5-00174-g872102b4f76574 --]
[-- Type: text/plain, Size: 170148 bytes --]

#
# Automatically generated file; DO NOT EDIT.
# Linux/x86_64 5.9.0-rc5 Kernel Configuration
#
CONFIG_CC_VERSION_TEXT="gcc-9 (Debian 9.3.0-15) 9.3.0"
CONFIG_CC_IS_GCC=y
CONFIG_GCC_VERSION=90300
CONFIG_LD_VERSION=235000000
CONFIG_CLANG_VERSION=0
CONFIG_CC_CAN_LINK=y
CONFIG_CC_CAN_LINK_STATIC=y
CONFIG_CC_HAS_ASM_GOTO=y
CONFIG_CC_HAS_ASM_INLINE=y
CONFIG_IRQ_WORK=y
CONFIG_BUILDTIME_TABLE_SORT=y
CONFIG_THREAD_INFO_IN_TASK=y

#
# General setup
#
CONFIG_INIT_ENV_ARG_LIMIT=32
# CONFIG_COMPILE_TEST is not set
CONFIG_LOCALVERSION=""
CONFIG_LOCALVERSION_AUTO=y
CONFIG_BUILD_SALT=""
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_HAVE_KERNEL_XZ=y
CONFIG_HAVE_KERNEL_LZO=y
CONFIG_HAVE_KERNEL_LZ4=y
CONFIG_HAVE_KERNEL_ZSTD=y
CONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_BZIP2 is not set
# CONFIG_KERNEL_LZMA is not set
# CONFIG_KERNEL_XZ is not set
# CONFIG_KERNEL_LZO is not set
# CONFIG_KERNEL_LZ4 is not set
# CONFIG_KERNEL_ZSTD is not set
CONFIG_DEFAULT_INIT=""
CONFIG_DEFAULT_HOSTNAME="(none)"
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_SYSVIPC_SYSCTL=y
CONFIG_POSIX_MQUEUE=y
CONFIG_POSIX_MQUEUE_SYSCTL=y
# CONFIG_WATCH_QUEUE is not set
CONFIG_CROSS_MEMORY_ATTACH=y
# CONFIG_USELIB is not set
CONFIG_AUDIT=y
CONFIG_HAVE_ARCH_AUDITSYSCALL=y
CONFIG_AUDITSYSCALL=y

#
# IRQ subsystem
#
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_GENERIC_IRQ_SHOW=y
CONFIG_GENERIC_IRQ_EFFECTIVE_AFF_MASK=y
CONFIG_GENERIC_PENDING_IRQ=y
CONFIG_GENERIC_IRQ_MIGRATION=y
CONFIG_GENERIC_IRQ_INJECTION=y
CONFIG_HARDIRQS_SW_RESEND=y
CONFIG_IRQ_DOMAIN=y
CONFIG_IRQ_DOMAIN_HIERARCHY=y
CONFIG_GENERIC_MSI_IRQ=y
CONFIG_GENERIC_MSI_IRQ_DOMAIN=y
CONFIG_IRQ_MSI_IOMMU=y
CONFIG_GENERIC_IRQ_MATRIX_ALLOCATOR=y
CONFIG_GENERIC_IRQ_RESERVATION_MODE=y
CONFIG_IRQ_FORCED_THREADING=y
CONFIG_SPARSE_IRQ=y
# CONFIG_GENERIC_IRQ_DEBUGFS is not set
# end of IRQ subsystem

CONFIG_CLOCKSOURCE_WATCHDOG=y
CONFIG_ARCH_CLOCKSOURCE_INIT=y
CONFIG_CLOCKSOURCE_VALIDATE_LAST_CYCLE=y
CONFIG_GENERIC_TIME_VSYSCALL=y
CONFIG_GENERIC_CLOCKEVENTS=y
CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
CONFIG_GENERIC_CMOS_UPDATE=y
CONFIG_HAVE_POSIX_CPU_TIMERS_TASK_WORK=y
CONFIG_POSIX_CPU_TIMERS_TASK_WORK=y

#
# Timers subsystem
#
CONFIG_TICK_ONESHOT=y
CONFIG_NO_HZ_COMMON=y
# CONFIG_HZ_PERIODIC is not set
# CONFIG_NO_HZ_IDLE is not set
CONFIG_NO_HZ_FULL=y
CONFIG_CONTEXT_TRACKING=y
# CONFIG_CONTEXT_TRACKING_FORCE is not set
CONFIG_NO_HZ=y
CONFIG_HIGH_RES_TIMERS=y
# end of Timers subsystem

# CONFIG_PREEMPT_NONE is not set
CONFIG_PREEMPT_VOLUNTARY=y
# CONFIG_PREEMPT is not set
CONFIG_PREEMPT_COUNT=y

#
# CPU/Task time and stats accounting
#
CONFIG_VIRT_CPU_ACCOUNTING=y
CONFIG_VIRT_CPU_ACCOUNTING_GEN=y
CONFIG_IRQ_TIME_ACCOUNTING=y
CONFIG_HAVE_SCHED_AVG_IRQ=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_BSD_PROCESS_ACCT_V3=y
CONFIG_TASKSTATS=y
CONFIG_TASK_DELAY_ACCT=y
CONFIG_TASK_XACCT=y
CONFIG_TASK_IO_ACCOUNTING=y
# CONFIG_PSI is not set
# end of CPU/Task time and stats accounting

CONFIG_CPU_ISOLATION=y

#
# RCU Subsystem
#
CONFIG_TREE_RCU=y
# CONFIG_RCU_EXPERT is not set
CONFIG_SRCU=y
CONFIG_TREE_SRCU=y
CONFIG_TASKS_RCU_GENERIC=y
CONFIG_TASKS_RCU=y
CONFIG_TASKS_RUDE_RCU=y
CONFIG_TASKS_TRACE_RCU=y
CONFIG_RCU_STALL_COMMON=y
CONFIG_RCU_NEED_SEGCBLIST=y
CONFIG_RCU_NOCB_CPU=y
# end of RCU Subsystem

CONFIG_BUILD_BIN2C=y
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
# CONFIG_IKHEADERS is not set
CONFIG_LOG_BUF_SHIFT=20
CONFIG_LOG_CPU_MAX_BUF_SHIFT=12
CONFIG_PRINTK_SAFE_LOG_BUF_SHIFT=13
CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y

#
# Scheduler features
#
# CONFIG_UCLAMP_TASK is not set
# end of Scheduler features

CONFIG_ARCH_SUPPORTS_NUMA_BALANCING=y
CONFIG_ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH=y
CONFIG_CC_HAS_INT128=y
CONFIG_ARCH_SUPPORTS_INT128=y
CONFIG_NUMA_BALANCING=y
CONFIG_NUMA_BALANCING_DEFAULT_ENABLED=y
CONFIG_CGROUPS=y
CONFIG_PAGE_COUNTER=y
CONFIG_MEMCG=y
CONFIG_MEMCG_SWAP=y
CONFIG_MEMCG_KMEM=y
CONFIG_BLK_CGROUP=y
CONFIG_CGROUP_WRITEBACK=y
CONFIG_CGROUP_SCHED=y
CONFIG_FAIR_GROUP_SCHED=y
CONFIG_CFS_BANDWIDTH=y
CONFIG_RT_GROUP_SCHED=y
CONFIG_CGROUP_PIDS=y
CONFIG_CGROUP_RDMA=y
CONFIG_CGROUP_FREEZER=y
CONFIG_CGROUP_HUGETLB=y
CONFIG_CPUSETS=y
CONFIG_PROC_PID_CPUSET=y
CONFIG_CGROUP_DEVICE=y
CONFIG_CGROUP_CPUACCT=y
CONFIG_CGROUP_PERF=y
CONFIG_CGROUP_BPF=y
# CONFIG_CGROUP_DEBUG is not set
CONFIG_SOCK_CGROUP_DATA=y
CONFIG_NAMESPACES=y
CONFIG_UTS_NS=y
CONFIG_TIME_NS=y
CONFIG_IPC_NS=y
CONFIG_USER_NS=y
CONFIG_PID_NS=y
CONFIG_NET_NS=y
# CONFIG_CHECKPOINT_RESTORE is not set
CONFIG_SCHED_AUTOGROUP=y
# CONFIG_SYSFS_DEPRECATED is not set
CONFIG_RELAY=y
CONFIG_BLK_DEV_INITRD=y
CONFIG_INITRAMFS_SOURCE=""
CONFIG_RD_GZIP=y
CONFIG_RD_BZIP2=y
CONFIG_RD_LZMA=y
CONFIG_RD_XZ=y
CONFIG_RD_LZO=y
CONFIG_RD_LZ4=y
CONFIG_RD_ZSTD=y
# CONFIG_BOOT_CONFIG is not set
CONFIG_CC_OPTIMIZE_FOR_PERFORMANCE=y
# CONFIG_CC_OPTIMIZE_FOR_SIZE is not set
CONFIG_SYSCTL=y
CONFIG_HAVE_UID16=y
CONFIG_SYSCTL_EXCEPTION_TRACE=y
CONFIG_HAVE_PCSPKR_PLATFORM=y
CONFIG_BPF=y
# CONFIG_EXPERT is not set
CONFIG_UID16=y
CONFIG_MULTIUSER=y
CONFIG_SGETMASK_SYSCALL=y
CONFIG_SYSFS_SYSCALL=y
CONFIG_FHANDLE=y
CONFIG_POSIX_TIMERS=y
CONFIG_PRINTK=y
CONFIG_PRINTK_NMI=y
CONFIG_BUG=y
CONFIG_ELF_CORE=y
CONFIG_PCSPKR_PLATFORM=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_FUTEX_PI=y
CONFIG_EPOLL=y
CONFIG_SIGNALFD=y
CONFIG_TIMERFD=y
CONFIG_EVENTFD=y
CONFIG_SHMEM=y
CONFIG_AIO=y
CONFIG_IO_URING=y
CONFIG_ADVISE_SYSCALLS=y
CONFIG_HAVE_ARCH_USERFAULTFD_WP=y
CONFIG_MEMBARRIER=y
CONFIG_KALLSYMS=y
CONFIG_KALLSYMS_ALL=y
CONFIG_KALLSYMS_ABSOLUTE_PERCPU=y
CONFIG_KALLSYMS_BASE_RELATIVE=y
# CONFIG_BPF_LSM is not set
CONFIG_BPF_SYSCALL=y
CONFIG_ARCH_WANT_DEFAULT_BPF_JIT=y
CONFIG_BPF_JIT_ALWAYS_ON=y
CONFIG_BPF_JIT_DEFAULT_ON=y
CONFIG_USERFAULTFD=y
CONFIG_ARCH_HAS_MEMBARRIER_SYNC_CORE=y
CONFIG_RSEQ=y
# CONFIG_EMBEDDED is not set
CONFIG_HAVE_PERF_EVENTS=y

#
# Kernel Performance Events And Counters
#
CONFIG_PERF_EVENTS=y
# CONFIG_DEBUG_PERF_USE_VMALLOC is not set
# end of Kernel Performance Events And Counters

CONFIG_VM_EVENT_COUNTERS=y
CONFIG_SLUB_DEBUG=y
# CONFIG_COMPAT_BRK is not set
# CONFIG_SLAB is not set
CONFIG_SLUB=y
CONFIG_SLAB_MERGE_DEFAULT=y
CONFIG_SLAB_FREELIST_RANDOM=y
# CONFIG_SLAB_FREELIST_HARDENED is not set
CONFIG_SHUFFLE_PAGE_ALLOCATOR=y
CONFIG_SLUB_CPU_PARTIAL=y
CONFIG_SYSTEM_DATA_VERIFICATION=y
CONFIG_PROFILING=y
CONFIG_TRACEPOINTS=y
# end of General setup

CONFIG_64BIT=y
CONFIG_X86_64=y
CONFIG_X86=y
CONFIG_INSTRUCTION_DECODER=y
CONFIG_OUTPUT_FORMAT="elf64-x86-64"
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_MMU=y
CONFIG_ARCH_MMAP_RND_BITS_MIN=28
CONFIG_ARCH_MMAP_RND_BITS_MAX=32
CONFIG_ARCH_MMAP_RND_COMPAT_BITS_MIN=8
CONFIG_ARCH_MMAP_RND_COMPAT_BITS_MAX=16
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_BUG=y
CONFIG_GENERIC_BUG_RELATIVE_POINTERS=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_ARCH_HAS_CPU_RELAX=y
CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
CONFIG_ARCH_HAS_FILTER_PGPROT=y
CONFIG_HAVE_SETUP_PER_CPU_AREA=y
CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_ARCH_SUSPEND_POSSIBLE=y
CONFIG_ARCH_WANT_GENERAL_HUGETLB=y
CONFIG_ZONE_DMA32=y
CONFIG_AUDIT_ARCH=y
CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_HAVE_INTEL_TXT=y
CONFIG_X86_64_SMP=y
CONFIG_ARCH_SUPPORTS_UPROBES=y
CONFIG_FIX_EARLYCON_MEM=y
CONFIG_DYNAMIC_PHYSICAL_MASK=y
CONFIG_PGTABLE_LEVELS=5
CONFIG_CC_HAS_SANE_STACKPROTECTOR=y

#
# Processor type and features
#
CONFIG_ZONE_DMA=y
CONFIG_SMP=y
CONFIG_X86_FEATURE_NAMES=y
CONFIG_X86_X2APIC=y
CONFIG_X86_MPPARSE=y
# CONFIG_GOLDFISH is not set
CONFIG_RETPOLINE=y
CONFIG_X86_CPU_RESCTRL=y
CONFIG_X86_EXTENDED_PLATFORM=y
# CONFIG_X86_NUMACHIP is not set
# CONFIG_X86_VSMP is not set
CONFIG_X86_UV=y
# CONFIG_X86_GOLDFISH is not set
# CONFIG_X86_INTEL_MID is not set
CONFIG_X86_INTEL_LPSS=y
CONFIG_X86_AMD_PLATFORM_DEVICE=y
CONFIG_IOSF_MBI=y
# CONFIG_IOSF_MBI_DEBUG is not set
CONFIG_X86_SUPPORTS_MEMORY_FAILURE=y
# CONFIG_SCHED_OMIT_FRAME_POINTER is not set
CONFIG_HYPERVISOR_GUEST=y
CONFIG_PARAVIRT=y
# CONFIG_PARAVIRT_DEBUG is not set
CONFIG_PARAVIRT_SPINLOCKS=y
CONFIG_X86_HV_CALLBACK_VECTOR=y
CONFIG_XEN=y
# CONFIG_XEN_PV is not set
CONFIG_XEN_PVHVM=y
CONFIG_XEN_PVHVM_SMP=y
CONFIG_XEN_SAVE_RESTORE=y
# CONFIG_XEN_DEBUG_FS is not set
# CONFIG_XEN_PVH is not set
CONFIG_KVM_GUEST=y
CONFIG_ARCH_CPUIDLE_HALTPOLL=y
# CONFIG_PVH is not set
CONFIG_PARAVIRT_TIME_ACCOUNTING=y
CONFIG_PARAVIRT_CLOCK=y
# CONFIG_JAILHOUSE_GUEST is not set
# CONFIG_ACRN_GUEST is not set
# CONFIG_MK8 is not set
# CONFIG_MPSC is not set
# CONFIG_MCORE2 is not set
# CONFIG_MATOM is not set
CONFIG_GENERIC_CPU=y
CONFIG_X86_INTERNODE_CACHE_SHIFT=6
CONFIG_X86_L1_CACHE_SHIFT=6
CONFIG_X86_TSC=y
CONFIG_X86_CMPXCHG64=y
CONFIG_X86_CMOV=y
CONFIG_X86_MINIMUM_CPU_FAMILY=64
CONFIG_X86_DEBUGCTLMSR=y
CONFIG_IA32_FEAT_CTL=y
CONFIG_X86_VMX_FEATURE_NAMES=y
CONFIG_CPU_SUP_INTEL=y
CONFIG_CPU_SUP_AMD=y
CONFIG_CPU_SUP_HYGON=y
CONFIG_CPU_SUP_CENTAUR=y
CONFIG_CPU_SUP_ZHAOXIN=y
CONFIG_HPET_TIMER=y
CONFIG_HPET_EMULATE_RTC=y
CONFIG_DMI=y
# CONFIG_GART_IOMMU is not set
CONFIG_MAXSMP=y
CONFIG_NR_CPUS_RANGE_BEGIN=8192
CONFIG_NR_CPUS_RANGE_END=8192
CONFIG_NR_CPUS_DEFAULT=8192
CONFIG_NR_CPUS=8192
CONFIG_SCHED_SMT=y
CONFIG_SCHED_MC=y
CONFIG_SCHED_MC_PRIO=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS=y
CONFIG_X86_MCE=y
CONFIG_X86_MCELOG_LEGACY=y
CONFIG_X86_MCE_INTEL=y
CONFIG_X86_MCE_AMD=y
CONFIG_X86_MCE_THRESHOLD=y
CONFIG_X86_MCE_INJECT=m
CONFIG_X86_THERMAL_VECTOR=y

#
# Performance monitoring
#
CONFIG_PERF_EVENTS_INTEL_UNCORE=m
CONFIG_PERF_EVENTS_INTEL_RAPL=m
CONFIG_PERF_EVENTS_INTEL_CSTATE=m
CONFIG_PERF_EVENTS_AMD_POWER=m
# end of Performance monitoring

CONFIG_X86_16BIT=y
CONFIG_X86_ESPFIX64=y
CONFIG_X86_VSYSCALL_EMULATION=y
CONFIG_X86_IOPL_IOPERM=y
CONFIG_I8K=m
CONFIG_MICROCODE=y
CONFIG_MICROCODE_INTEL=y
CONFIG_MICROCODE_AMD=y
CONFIG_MICROCODE_OLD_INTERFACE=y
CONFIG_X86_MSR=y
CONFIG_X86_CPUID=y
CONFIG_X86_5LEVEL=y
CONFIG_X86_DIRECT_GBPAGES=y
# CONFIG_X86_CPA_STATISTICS is not set
CONFIG_AMD_MEM_ENCRYPT=y
# CONFIG_AMD_MEM_ENCRYPT_ACTIVE_BY_DEFAULT is not set
CONFIG_NUMA=y
CONFIG_AMD_NUMA=y
CONFIG_X86_64_ACPI_NUMA=y
CONFIG_NUMA_EMU=y
CONFIG_NODES_SHIFT=10
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_SPARSEMEM_DEFAULT=y
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
# CONFIG_ARCH_MEMORY_PROBE is not set
CONFIG_ARCH_PROC_KCORE_TEXT=y
CONFIG_ILLEGAL_POINTER_VALUE=0xdead000000000000
CONFIG_X86_PMEM_LEGACY_DEVICE=y
CONFIG_X86_PMEM_LEGACY=m
CONFIG_X86_CHECK_BIOS_CORRUPTION=y
# CONFIG_X86_BOOTPARAM_MEMORY_CORRUPTION_CHECK is not set
CONFIG_X86_RESERVE_LOW=64
CONFIG_MTRR=y
CONFIG_MTRR_SANITIZER=y
CONFIG_MTRR_SANITIZER_ENABLE_DEFAULT=1
CONFIG_MTRR_SANITIZER_SPARE_REG_NR_DEFAULT=1
CONFIG_X86_PAT=y
CONFIG_ARCH_USES_PG_UNCACHED=y
CONFIG_ARCH_RANDOM=y
CONFIG_X86_SMAP=y
CONFIG_X86_UMIP=y
CONFIG_X86_INTEL_MEMORY_PROTECTION_KEYS=y
CONFIG_X86_INTEL_TSX_MODE_OFF=y
# CONFIG_X86_INTEL_TSX_MODE_ON is not set
# CONFIG_X86_INTEL_TSX_MODE_AUTO is not set
CONFIG_EFI=y
CONFIG_EFI_STUB=y
CONFIG_EFI_MIXED=y
CONFIG_SECCOMP=y
# CONFIG_HZ_100 is not set
# CONFIG_HZ_250 is not set
# CONFIG_HZ_300 is not set
CONFIG_HZ_1000=y
CONFIG_HZ=1000
CONFIG_SCHED_HRTICK=y
CONFIG_KEXEC=y
CONFIG_KEXEC_FILE=y
CONFIG_ARCH_HAS_KEXEC_PURGATORY=y
# CONFIG_KEXEC_SIG is not set
CONFIG_CRASH_DUMP=y
CONFIG_KEXEC_JUMP=y
CONFIG_PHYSICAL_START=0x1000000
CONFIG_RELOCATABLE=y
CONFIG_RANDOMIZE_BASE=y
CONFIG_X86_NEED_RELOCS=y
CONFIG_PHYSICAL_ALIGN=0x200000
CONFIG_DYNAMIC_MEMORY_LAYOUT=y
CONFIG_RANDOMIZE_MEMORY=y
CONFIG_RANDOMIZE_MEMORY_PHYSICAL_PADDING=0xa
CONFIG_HOTPLUG_CPU=y
CONFIG_BOOTPARAM_HOTPLUG_CPU0=y
# CONFIG_DEBUG_HOTPLUG_CPU0 is not set
# CONFIG_COMPAT_VDSO is not set
CONFIG_LEGACY_VSYSCALL_EMULATE=y
# CONFIG_LEGACY_VSYSCALL_XONLY is not set
# CONFIG_LEGACY_VSYSCALL_NONE is not set
# CONFIG_CMDLINE_BOOL is not set
CONFIG_MODIFY_LDT_SYSCALL=y
CONFIG_HAVE_LIVEPATCH=y
CONFIG_LIVEPATCH=y
# end of Processor type and features

CONFIG_ARCH_HAS_ADD_PAGES=y
CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y
CONFIG_ARCH_ENABLE_MEMORY_HOTREMOVE=y
CONFIG_USE_PERCPU_NUMA_NODE_ID=y
CONFIG_ARCH_ENABLE_SPLIT_PMD_PTLOCK=y
CONFIG_ARCH_ENABLE_HUGEPAGE_MIGRATION=y
CONFIG_ARCH_ENABLE_THP_MIGRATION=y

#
# Power management and ACPI options
#
CONFIG_ARCH_HIBERNATION_HEADER=y
CONFIG_SUSPEND=y
CONFIG_SUSPEND_FREEZER=y
CONFIG_HIBERNATE_CALLBACKS=y
CONFIG_HIBERNATION=y
CONFIG_HIBERNATION_SNAPSHOT_DEV=y
CONFIG_PM_STD_PARTITION=""
CONFIG_PM_SLEEP=y
CONFIG_PM_SLEEP_SMP=y
# CONFIG_PM_AUTOSLEEP is not set
# CONFIG_PM_WAKELOCKS is not set
CONFIG_PM=y
CONFIG_PM_DEBUG=y
# CONFIG_PM_ADVANCED_DEBUG is not set
# CONFIG_PM_TEST_SUSPEND is not set
CONFIG_PM_SLEEP_DEBUG=y
# CONFIG_PM_TRACE_RTC is not set
CONFIG_PM_CLK=y
# CONFIG_WQ_POWER_EFFICIENT_DEFAULT is not set
# CONFIG_ENERGY_MODEL is not set
CONFIG_ARCH_SUPPORTS_ACPI=y
CONFIG_ACPI=y
CONFIG_ACPI_LEGACY_TABLES_LOOKUP=y
CONFIG_ARCH_MIGHT_HAVE_ACPI_PDC=y
CONFIG_ACPI_SYSTEM_POWER_STATES_SUPPORT=y
# CONFIG_ACPI_DEBUGGER is not set
CONFIG_ACPI_SPCR_TABLE=y
CONFIG_ACPI_LPIT=y
CONFIG_ACPI_SLEEP=y
CONFIG_ACPI_REV_OVERRIDE_POSSIBLE=y
CONFIG_ACPI_EC_DEBUGFS=m
CONFIG_ACPI_AC=y
CONFIG_ACPI_BATTERY=y
CONFIG_ACPI_BUTTON=y
CONFIG_ACPI_VIDEO=m
CONFIG_ACPI_FAN=y
CONFIG_ACPI_TAD=m
CONFIG_ACPI_DOCK=y
CONFIG_ACPI_CPU_FREQ_PSS=y
CONFIG_ACPI_PROCESSOR_CSTATE=y
CONFIG_ACPI_PROCESSOR_IDLE=y
CONFIG_ACPI_CPPC_LIB=y
CONFIG_ACPI_PROCESSOR=y
CONFIG_ACPI_IPMI=m
CONFIG_ACPI_HOTPLUG_CPU=y
CONFIG_ACPI_PROCESSOR_AGGREGATOR=m
CONFIG_ACPI_THERMAL=y
CONFIG_ARCH_HAS_ACPI_TABLE_UPGRADE=y
CONFIG_ACPI_TABLE_UPGRADE=y
# CONFIG_ACPI_DEBUG is not set
CONFIG_ACPI_PCI_SLOT=y
CONFIG_ACPI_CONTAINER=y
CONFIG_ACPI_HOTPLUG_MEMORY=y
CONFIG_ACPI_HOTPLUG_IOAPIC=y
CONFIG_ACPI_SBS=m
CONFIG_ACPI_HED=y
# CONFIG_ACPI_CUSTOM_METHOD is not set
CONFIG_ACPI_BGRT=y
CONFIG_ACPI_NFIT=m
# CONFIG_NFIT_SECURITY_DEBUG is not set
CONFIG_ACPI_NUMA=y
# CONFIG_ACPI_HMAT is not set
CONFIG_HAVE_ACPI_APEI=y
CONFIG_HAVE_ACPI_APEI_NMI=y
CONFIG_ACPI_APEI=y
CONFIG_ACPI_APEI_GHES=y
CONFIG_ACPI_APEI_PCIEAER=y
CONFIG_ACPI_APEI_MEMORY_FAILURE=y
CONFIG_ACPI_APEI_EINJ=m
CONFIG_ACPI_APEI_ERST_DEBUG=y
CONFIG_DPTF_POWER=m
CONFIG_ACPI_WATCHDOG=y
CONFIG_ACPI_EXTLOG=m
CONFIG_ACPI_ADXL=y
CONFIG_PMIC_OPREGION=y
# CONFIG_ACPI_CONFIGFS is not set
CONFIG_X86_PM_TIMER=y
CONFIG_SFI=y

#
# CPU Frequency scaling
#
CONFIG_CPU_FREQ=y
CONFIG_CPU_FREQ_GOV_ATTR_SET=y
CONFIG_CPU_FREQ_GOV_COMMON=y
CONFIG_CPU_FREQ_STAT=y
CONFIG_CPU_FREQ_DEFAULT_GOV_PERFORMANCE=y
# CONFIG_CPU_FREQ_DEFAULT_GOV_POWERSAVE is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_USERSPACE is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_ONDEMAND is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_CONSERVATIVE is not set
# CONFIG_CPU_FREQ_DEFAULT_GOV_SCHEDUTIL is not set
CONFIG_CPU_FREQ_GOV_PERFORMANCE=y
CONFIG_CPU_FREQ_GOV_POWERSAVE=y
CONFIG_CPU_FREQ_GOV_USERSPACE=y
CONFIG_CPU_FREQ_GOV_ONDEMAND=y
CONFIG_CPU_FREQ_GOV_CONSERVATIVE=y
CONFIG_CPU_FREQ_GOV_SCHEDUTIL=y

#
# CPU frequency scaling drivers
#
CONFIG_X86_INTEL_PSTATE=y
# CONFIG_X86_PCC_CPUFREQ is not set
CONFIG_X86_ACPI_CPUFREQ=m
CONFIG_X86_ACPI_CPUFREQ_CPB=y
CONFIG_X86_POWERNOW_K8=m
CONFIG_X86_AMD_FREQ_SENSITIVITY=m
# CONFIG_X86_SPEEDSTEP_CENTRINO is not set
CONFIG_X86_P4_CLOCKMOD=m

#
# shared options
#
CONFIG_X86_SPEEDSTEP_LIB=m
# end of CPU Frequency scaling

#
# CPU Idle
#
CONFIG_CPU_IDLE=y
# CONFIG_CPU_IDLE_GOV_LADDER is not set
CONFIG_CPU_IDLE_GOV_MENU=y
# CONFIG_CPU_IDLE_GOV_TEO is not set
# CONFIG_CPU_IDLE_GOV_HALTPOLL is not set
CONFIG_HALTPOLL_CPUIDLE=y
# end of CPU Idle

CONFIG_INTEL_IDLE=y
# end of Power management and ACPI options

#
# Bus options (PCI etc.)
#
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
CONFIG_PCI_XEN=y
CONFIG_MMCONF_FAM10H=y
CONFIG_ISA_DMA_API=y
CONFIG_AMD_NB=y
# CONFIG_X86_SYSFB is not set
# end of Bus options (PCI etc.)

#
# Binary Emulations
#
CONFIG_IA32_EMULATION=y
# CONFIG_X86_X32 is not set
CONFIG_COMPAT_32=y
CONFIG_COMPAT=y
CONFIG_COMPAT_FOR_U64_ALIGNMENT=y
CONFIG_SYSVIPC_COMPAT=y
# end of Binary Emulations

#
# Firmware Drivers
#
CONFIG_EDD=m
# CONFIG_EDD_OFF is not set
CONFIG_FIRMWARE_MEMMAP=y
CONFIG_DMIID=y
CONFIG_DMI_SYSFS=y
CONFIG_DMI_SCAN_MACHINE_NON_EFI_FALLBACK=y
# CONFIG_ISCSI_IBFT is not set
CONFIG_FW_CFG_SYSFS=y
# CONFIG_FW_CFG_SYSFS_CMDLINE is not set
# CONFIG_GOOGLE_FIRMWARE is not set

#
# EFI (Extensible Firmware Interface) Support
#
CONFIG_EFI_VARS=y
CONFIG_EFI_ESRT=y
CONFIG_EFI_VARS_PSTORE=y
CONFIG_EFI_VARS_PSTORE_DEFAULT_DISABLE=y
CONFIG_EFI_RUNTIME_MAP=y
# CONFIG_EFI_FAKE_MEMMAP is not set
CONFIG_EFI_RUNTIME_WRAPPERS=y
CONFIG_EFI_GENERIC_STUB_INITRD_CMDLINE_LOADER=y
# CONFIG_EFI_BOOTLOADER_CONTROL is not set
# CONFIG_EFI_CAPSULE_LOADER is not set
# CONFIG_EFI_TEST is not set
CONFIG_APPLE_PROPERTIES=y
# CONFIG_RESET_ATTACK_MITIGATION is not set
# CONFIG_EFI_RCI2_TABLE is not set
# CONFIG_EFI_DISABLE_PCI_DMA is not set
# end of EFI (Extensible Firmware Interface) Support

CONFIG_UEFI_CPER=y
CONFIG_UEFI_CPER_X86=y
CONFIG_EFI_DEV_PATH_PARSER=y
CONFIG_EFI_EARLYCON=y
CONFIG_EFI_CUSTOM_SSDT_OVERLAYS=y

#
# Tegra firmware driver
#
# end of Tegra firmware driver
# end of Firmware Drivers

CONFIG_HAVE_KVM=y
CONFIG_HAVE_KVM_IRQCHIP=y
CONFIG_HAVE_KVM_IRQFD=y
CONFIG_HAVE_KVM_IRQ_ROUTING=y
CONFIG_HAVE_KVM_EVENTFD=y
CONFIG_KVM_MMIO=y
CONFIG_KVM_ASYNC_PF=y
CONFIG_HAVE_KVM_MSI=y
CONFIG_HAVE_KVM_CPU_RELAX_INTERCEPT=y
CONFIG_KVM_VFIO=y
CONFIG_KVM_GENERIC_DIRTYLOG_READ_PROTECT=y
CONFIG_KVM_COMPAT=y
CONFIG_HAVE_KVM_IRQ_BYPASS=y
CONFIG_HAVE_KVM_NO_POLL=y
CONFIG_KVM_XFER_TO_GUEST_WORK=y
CONFIG_VIRTUALIZATION=y
CONFIG_KVM=m
CONFIG_KVM_INTEL=m
CONFIG_KVM_AMD=m
CONFIG_KVM_AMD_SEV=y
CONFIG_KVM_MMU_AUDIT=y
CONFIG_AS_AVX512=y
CONFIG_AS_SHA1_NI=y
CONFIG_AS_SHA256_NI=y
CONFIG_AS_TPAUSE=y

#
# General architecture-dependent options
#
CONFIG_CRASH_CORE=y
CONFIG_KEXEC_CORE=y
CONFIG_HOTPLUG_SMT=y
CONFIG_GENERIC_ENTRY=y
CONFIG_OPROFILE=m
CONFIG_OPROFILE_EVENT_MULTIPLEX=y
CONFIG_HAVE_OPROFILE=y
CONFIG_OPROFILE_NMI_TIMER=y
CONFIG_KPROBES=y
CONFIG_JUMP_LABEL=y
# CONFIG_STATIC_KEYS_SELFTEST is not set
CONFIG_OPTPROBES=y
CONFIG_KPROBES_ON_FTRACE=y
CONFIG_UPROBES=y
CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_ARCH_USE_BUILTIN_BSWAP=y
CONFIG_KRETPROBES=y
CONFIG_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_IOREMAP_PROT=y
CONFIG_HAVE_KPROBES=y
CONFIG_HAVE_KRETPROBES=y
CONFIG_HAVE_OPTPROBES=y
CONFIG_HAVE_KPROBES_ON_FTRACE=y
CONFIG_HAVE_FUNCTION_ERROR_INJECTION=y
CONFIG_HAVE_NMI=y
CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_HAVE_DMA_CONTIGUOUS=y
CONFIG_GENERIC_SMP_IDLE_THREAD=y
CONFIG_ARCH_HAS_FORTIFY_SOURCE=y
CONFIG_ARCH_HAS_SET_MEMORY=y
CONFIG_ARCH_HAS_SET_DIRECT_MAP=y
CONFIG_HAVE_ARCH_THREAD_STRUCT_WHITELIST=y
CONFIG_ARCH_WANTS_DYNAMIC_TASK_STRUCT=y
CONFIG_HAVE_ASM_MODVERSIONS=y
CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
CONFIG_HAVE_RSEQ=y
CONFIG_HAVE_FUNCTION_ARG_ACCESS_API=y
CONFIG_HAVE_HW_BREAKPOINT=y
CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
CONFIG_HAVE_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_PERF_EVENTS_NMI=y
CONFIG_HAVE_HARDLOCKUP_DETECTOR_PERF=y
CONFIG_HAVE_PERF_REGS=y
CONFIG_HAVE_PERF_USER_STACK_DUMP=y
CONFIG_HAVE_ARCH_JUMP_LABEL=y
CONFIG_HAVE_ARCH_JUMP_LABEL_RELATIVE=y
CONFIG_MMU_GATHER_TABLE_FREE=y
CONFIG_MMU_GATHER_RCU_TABLE_FREE=y
CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
CONFIG_HAVE_ALIGNED_STRUCT_PAGE=y
CONFIG_HAVE_CMPXCHG_LOCAL=y
CONFIG_HAVE_CMPXCHG_DOUBLE=y
CONFIG_ARCH_WANT_COMPAT_IPC_PARSE_VERSION=y
CONFIG_ARCH_WANT_OLD_COMPAT_IPC=y
CONFIG_HAVE_ARCH_SECCOMP_FILTER=y
CONFIG_SECCOMP_FILTER=y
CONFIG_HAVE_ARCH_STACKLEAK=y
CONFIG_HAVE_STACKPROTECTOR=y
CONFIG_STACKPROTECTOR=y
CONFIG_STACKPROTECTOR_STRONG=y
CONFIG_HAVE_ARCH_WITHIN_STACK_FRAMES=y
CONFIG_HAVE_CONTEXT_TRACKING=y
CONFIG_HAVE_VIRT_CPU_ACCOUNTING_GEN=y
CONFIG_HAVE_IRQ_TIME_ACCOUNTING=y
CONFIG_HAVE_MOVE_PMD=y
CONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE=y
CONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE_PUD=y
CONFIG_HAVE_ARCH_HUGE_VMAP=y
CONFIG_ARCH_WANT_HUGE_PMD_SHARE=y
CONFIG_HAVE_ARCH_SOFT_DIRTY=y
CONFIG_HAVE_MOD_ARCH_SPECIFIC=y
CONFIG_MODULES_USE_ELF_RELA=y
CONFIG_ARCH_HAS_ELF_RANDOMIZE=y
CONFIG_HAVE_ARCH_MMAP_RND_BITS=y
CONFIG_HAVE_EXIT_THREAD=y
CONFIG_ARCH_MMAP_RND_BITS=28
CONFIG_HAVE_ARCH_MMAP_RND_COMPAT_BITS=y
CONFIG_ARCH_MMAP_RND_COMPAT_BITS=8
CONFIG_HAVE_ARCH_COMPAT_MMAP_BASES=y
CONFIG_HAVE_STACK_VALIDATION=y
CONFIG_HAVE_RELIABLE_STACKTRACE=y
CONFIG_OLD_SIGSUSPEND3=y
CONFIG_COMPAT_OLD_SIGACTION=y
CONFIG_COMPAT_32BIT_TIME=y
CONFIG_HAVE_ARCH_VMAP_STACK=y
CONFIG_VMAP_STACK=y
CONFIG_ARCH_HAS_STRICT_KERNEL_RWX=y
CONFIG_STRICT_KERNEL_RWX=y
CONFIG_ARCH_HAS_STRICT_MODULE_RWX=y
CONFIG_STRICT_MODULE_RWX=y
CONFIG_HAVE_ARCH_PREL32_RELOCATIONS=y
CONFIG_ARCH_USE_MEMREMAP_PROT=y
# CONFIG_LOCK_EVENT_COUNTS is not set
CONFIG_ARCH_HAS_MEM_ENCRYPT=y

#
# GCOV-based kernel profiling
#
# CONFIG_GCOV_KERNEL is not set
CONFIG_ARCH_HAS_GCOV_PROFILE_ALL=y
# end of GCOV-based kernel profiling

CONFIG_HAVE_GCC_PLUGINS=y
# end of General architecture-dependent options

CONFIG_RT_MUTEXES=y
CONFIG_BASE_SMALL=0
CONFIG_MODULE_SIG_FORMAT=y
CONFIG_MODULES=y
CONFIG_MODULE_FORCE_LOAD=y
CONFIG_MODULE_UNLOAD=y
# CONFIG_MODULE_FORCE_UNLOAD is not set
# CONFIG_MODVERSIONS is not set
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_MODULE_SIG=y
# CONFIG_MODULE_SIG_FORCE is not set
CONFIG_MODULE_SIG_ALL=y
# CONFIG_MODULE_SIG_SHA1 is not set
# CONFIG_MODULE_SIG_SHA224 is not set
CONFIG_MODULE_SIG_SHA256=y
# CONFIG_MODULE_SIG_SHA384 is not set
# CONFIG_MODULE_SIG_SHA512 is not set
CONFIG_MODULE_SIG_HASH="sha256"
# CONFIG_MODULE_COMPRESS is not set
# CONFIG_MODULE_ALLOW_MISSING_NAMESPACE_IMPORTS is not set
# CONFIG_UNUSED_SYMBOLS is not set
# CONFIG_TRIM_UNUSED_KSYMS is not set
CONFIG_MODULES_TREE_LOOKUP=y
CONFIG_BLOCK=y
CONFIG_BLK_SCSI_REQUEST=y
CONFIG_BLK_CGROUP_RWSTAT=y
CONFIG_BLK_DEV_BSG=y
CONFIG_BLK_DEV_BSGLIB=y
CONFIG_BLK_DEV_INTEGRITY=y
CONFIG_BLK_DEV_INTEGRITY_T10=m
CONFIG_BLK_DEV_ZONED=y
CONFIG_BLK_DEV_THROTTLING=y
# CONFIG_BLK_DEV_THROTTLING_LOW is not set
# CONFIG_BLK_CMDLINE_PARSER is not set
CONFIG_BLK_WBT=y
# CONFIG_BLK_CGROUP_IOLATENCY is not set
# CONFIG_BLK_CGROUP_IOCOST is not set
CONFIG_BLK_WBT_MQ=y
CONFIG_BLK_DEBUG_FS=y
CONFIG_BLK_DEBUG_FS_ZONED=y
# CONFIG_BLK_SED_OPAL is not set
# CONFIG_BLK_INLINE_ENCRYPTION is not set

#
# Partition Types
#
CONFIG_PARTITION_ADVANCED=y
# CONFIG_ACORN_PARTITION is not set
# CONFIG_AIX_PARTITION is not set
CONFIG_OSF_PARTITION=y
CONFIG_AMIGA_PARTITION=y
# CONFIG_ATARI_PARTITION is not set
CONFIG_MAC_PARTITION=y
CONFIG_MSDOS_PARTITION=y
CONFIG_BSD_DISKLABEL=y
CONFIG_MINIX_SUBPARTITION=y
CONFIG_SOLARIS_X86_PARTITION=y
CONFIG_UNIXWARE_DISKLABEL=y
# CONFIG_LDM_PARTITION is not set
CONFIG_SGI_PARTITION=y
# CONFIG_ULTRIX_PARTITION is not set
CONFIG_SUN_PARTITION=y
CONFIG_KARMA_PARTITION=y
CONFIG_EFI_PARTITION=y
# CONFIG_SYSV68_PARTITION is not set
# CONFIG_CMDLINE_PARTITION is not set
# end of Partition Types

CONFIG_BLOCK_COMPAT=y
CONFIG_BLK_MQ_PCI=y
CONFIG_BLK_MQ_VIRTIO=y
CONFIG_BLK_MQ_RDMA=y
CONFIG_BLK_PM=y

#
# IO Schedulers
#
CONFIG_MQ_IOSCHED_DEADLINE=y
CONFIG_MQ_IOSCHED_KYBER=y
CONFIG_IOSCHED_BFQ=y
CONFIG_BFQ_GROUP_IOSCHED=y
# CONFIG_BFQ_CGROUP_DEBUG is not set
# end of IO Schedulers

CONFIG_PREEMPT_NOTIFIERS=y
CONFIG_PADATA=y
CONFIG_ASN1=y
CONFIG_INLINE_SPIN_UNLOCK_IRQ=y
CONFIG_INLINE_READ_UNLOCK=y
CONFIG_INLINE_READ_UNLOCK_IRQ=y
CONFIG_INLINE_WRITE_UNLOCK=y
CONFIG_INLINE_WRITE_UNLOCK_IRQ=y
CONFIG_ARCH_SUPPORTS_ATOMIC_RMW=y
CONFIG_MUTEX_SPIN_ON_OWNER=y
CONFIG_RWSEM_SPIN_ON_OWNER=y
CONFIG_LOCK_SPIN_ON_OWNER=y
CONFIG_ARCH_USE_QUEUED_SPINLOCKS=y
CONFIG_QUEUED_SPINLOCKS=y
CONFIG_ARCH_USE_QUEUED_RWLOCKS=y
CONFIG_QUEUED_RWLOCKS=y
CONFIG_ARCH_HAS_NON_OVERLAPPING_ADDRESS_SPACE=y
CONFIG_ARCH_HAS_SYNC_CORE_BEFORE_USERMODE=y
CONFIG_ARCH_HAS_SYSCALL_WRAPPER=y
CONFIG_FREEZER=y

#
# Executable file formats
#
CONFIG_BINFMT_ELF=y
CONFIG_COMPAT_BINFMT_ELF=y
CONFIG_ELFCORE=y
CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=y
CONFIG_BINFMT_SCRIPT=y
CONFIG_BINFMT_MISC=m
CONFIG_COREDUMP=y
# end of Executable file formats

#
# Memory Management options
#
CONFIG_SELECT_MEMORY_MODEL=y
CONFIG_SPARSEMEM_MANUAL=y
CONFIG_SPARSEMEM=y
CONFIG_NEED_MULTIPLE_NODES=y
CONFIG_SPARSEMEM_EXTREME=y
CONFIG_SPARSEMEM_VMEMMAP_ENABLE=y
CONFIG_SPARSEMEM_VMEMMAP=y
CONFIG_HAVE_FAST_GUP=y
CONFIG_NUMA_KEEP_MEMINFO=y
CONFIG_MEMORY_ISOLATION=y
CONFIG_HAVE_BOOTMEM_INFO_NODE=y
CONFIG_MEMORY_HOTPLUG=y
CONFIG_MEMORY_HOTPLUG_SPARSE=y
# CONFIG_MEMORY_HOTPLUG_DEFAULT_ONLINE is not set
CONFIG_MEMORY_HOTREMOVE=y
CONFIG_SPLIT_PTLOCK_CPUS=4
CONFIG_MEMORY_BALLOON=y
CONFIG_BALLOON_COMPACTION=y
CONFIG_COMPACTION=y
CONFIG_PAGE_REPORTING=y
CONFIG_MIGRATION=y
CONFIG_CONTIG_ALLOC=y
CONFIG_PHYS_ADDR_T_64BIT=y
CONFIG_BOUNCE=y
CONFIG_VIRT_TO_BUS=y
CONFIG_MMU_NOTIFIER=y
CONFIG_KSM=y
CONFIG_DEFAULT_MMAP_MIN_ADDR=4096
CONFIG_ARCH_SUPPORTS_MEMORY_FAILURE=y
CONFIG_MEMORY_FAILURE=y
CONFIG_HWPOISON_INJECT=m
CONFIG_TRANSPARENT_HUGEPAGE=y
CONFIG_TRANSPARENT_HUGEPAGE_ALWAYS=y
# CONFIG_TRANSPARENT_HUGEPAGE_MADVISE is not set
CONFIG_ARCH_WANTS_THP_SWAP=y
CONFIG_THP_SWAP=y
CONFIG_CLEANCACHE=y
CONFIG_FRONTSWAP=y
CONFIG_CMA=y
# CONFIG_CMA_DEBUG is not set
# CONFIG_CMA_DEBUGFS is not set
CONFIG_CMA_AREAS=7
CONFIG_ZSWAP=y
# CONFIG_ZSWAP_COMPRESSOR_DEFAULT_DEFLATE is not set
CONFIG_ZSWAP_COMPRESSOR_DEFAULT_LZO=y
# CONFIG_ZSWAP_COMPRESSOR_DEFAULT_842 is not set
# CONFIG_ZSWAP_COMPRESSOR_DEFAULT_LZ4 is not set
# CONFIG_ZSWAP_COMPRESSOR_DEFAULT_LZ4HC is not set
# CONFIG_ZSWAP_COMPRESSOR_DEFAULT_ZSTD is not set
CONFIG_ZSWAP_COMPRESSOR_DEFAULT="lzo"
CONFIG_ZSWAP_ZPOOL_DEFAULT_ZBUD=y
# CONFIG_ZSWAP_ZPOOL_DEFAULT_Z3FOLD is not set
# CONFIG_ZSWAP_ZPOOL_DEFAULT_ZSMALLOC is not set
CONFIG_ZSWAP_ZPOOL_DEFAULT="zbud"
# CONFIG_ZSWAP_DEFAULT_ON is not set
CONFIG_ZPOOL=y
CONFIG_ZBUD=y
# CONFIG_Z3FOLD is not set
CONFIG_ZSMALLOC=y
# CONFIG_ZSMALLOC_PGTABLE_MAPPING is not set
CONFIG_ZSMALLOC_STAT=y
CONFIG_GENERIC_EARLY_IOREMAP=y
CONFIG_DEFERRED_STRUCT_PAGE_INIT=y
CONFIG_IDLE_PAGE_TRACKING=y
CONFIG_ARCH_HAS_PTE_DEVMAP=y
CONFIG_ZONE_DEVICE=y
CONFIG_DEV_PAGEMAP_OPS=y
CONFIG_DEVICE_PRIVATE=y
CONFIG_FRAME_VECTOR=y
CONFIG_ARCH_USES_HIGH_VMA_FLAGS=y
CONFIG_ARCH_HAS_PKEYS=y
# CONFIG_PERCPU_STATS is not set
# CONFIG_GUP_BENCHMARK is not set
# CONFIG_READ_ONLY_THP_FOR_FS is not set
CONFIG_ARCH_HAS_PTE_SPECIAL=y
CONFIG_MAPPING_DIRTY_HELPERS=y
# end of Memory Management options

CONFIG_NET=y
CONFIG_COMPAT_NETLINK_MESSAGES=y
CONFIG_NET_INGRESS=y
CONFIG_NET_EGRESS=y
CONFIG_SKB_EXTENSIONS=y

#
# Networking options
#
CONFIG_PACKET=y
CONFIG_PACKET_DIAG=m
CONFIG_UNIX=y
CONFIG_UNIX_SCM=y
CONFIG_UNIX_DIAG=m
CONFIG_TLS=m
CONFIG_TLS_DEVICE=y
# CONFIG_TLS_TOE is not set
CONFIG_XFRM=y
CONFIG_XFRM_OFFLOAD=y
CONFIG_XFRM_ALGO=y
CONFIG_XFRM_USER=y
# CONFIG_XFRM_INTERFACE is not set
CONFIG_XFRM_SUB_POLICY=y
CONFIG_XFRM_MIGRATE=y
CONFIG_XFRM_STATISTICS=y
CONFIG_XFRM_AH=m
CONFIG_XFRM_ESP=m
CONFIG_XFRM_IPCOMP=m
CONFIG_NET_KEY=m
CONFIG_NET_KEY_MIGRATE=y
# CONFIG_SMC is not set
CONFIG_XDP_SOCKETS=y
# CONFIG_XDP_SOCKETS_DIAG is not set
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_ADVANCED_ROUTER=y
CONFIG_IP_FIB_TRIE_STATS=y
CONFIG_IP_MULTIPLE_TABLES=y
CONFIG_IP_ROUTE_MULTIPATH=y
CONFIG_IP_ROUTE_VERBOSE=y
CONFIG_IP_ROUTE_CLASSID=y
CONFIG_IP_PNP=y
CONFIG_IP_PNP_DHCP=y
# CONFIG_IP_PNP_BOOTP is not set
# CONFIG_IP_PNP_RARP is not set
CONFIG_NET_IPIP=m
CONFIG_NET_IPGRE_DEMUX=m
CONFIG_NET_IP_TUNNEL=m
CONFIG_NET_IPGRE=m
CONFIG_NET_IPGRE_BROADCAST=y
CONFIG_IP_MROUTE_COMMON=y
CONFIG_IP_MROUTE=y
CONFIG_IP_MROUTE_MULTIPLE_TABLES=y
CONFIG_IP_PIMSM_V1=y
CONFIG_IP_PIMSM_V2=y
CONFIG_SYN_COOKIES=y
CONFIG_NET_IPVTI=m
CONFIG_NET_UDP_TUNNEL=m
# CONFIG_NET_FOU is not set
# CONFIG_NET_FOU_IP_TUNNELS is not set
CONFIG_INET_AH=m
CONFIG_INET_ESP=m
CONFIG_INET_ESP_OFFLOAD=m
# CONFIG_INET_ESPINTCP is not set
CONFIG_INET_IPCOMP=m
CONFIG_INET_XFRM_TUNNEL=m
CONFIG_INET_TUNNEL=m
CONFIG_INET_DIAG=m
CONFIG_INET_TCP_DIAG=m
CONFIG_INET_UDP_DIAG=m
CONFIG_INET_RAW_DIAG=m
# CONFIG_INET_DIAG_DESTROY is not set
CONFIG_TCP_CONG_ADVANCED=y
CONFIG_TCP_CONG_BIC=m
CONFIG_TCP_CONG_CUBIC=y
CONFIG_TCP_CONG_WESTWOOD=m
CONFIG_TCP_CONG_HTCP=m
CONFIG_TCP_CONG_HSTCP=m
CONFIG_TCP_CONG_HYBLA=m
CONFIG_TCP_CONG_VEGAS=m
CONFIG_TCP_CONG_NV=m
CONFIG_TCP_CONG_SCALABLE=m
CONFIG_TCP_CONG_LP=m
CONFIG_TCP_CONG_VENO=m
CONFIG_TCP_CONG_YEAH=m
CONFIG_TCP_CONG_ILLINOIS=m
CONFIG_TCP_CONG_DCTCP=m
# CONFIG_TCP_CONG_CDG is not set
CONFIG_TCP_CONG_BBR=m
CONFIG_DEFAULT_CUBIC=y
# CONFIG_DEFAULT_RENO is not set
CONFIG_DEFAULT_TCP_CONG="cubic"
CONFIG_TCP_MD5SIG=y
CONFIG_IPV6=y
CONFIG_IPV6_ROUTER_PREF=y
CONFIG_IPV6_ROUTE_INFO=y
CONFIG_IPV6_OPTIMISTIC_DAD=y
CONFIG_INET6_AH=m
CONFIG_INET6_ESP=m
CONFIG_INET6_ESP_OFFLOAD=m
# CONFIG_INET6_ESPINTCP is not set
CONFIG_INET6_IPCOMP=m
CONFIG_IPV6_MIP6=m
# CONFIG_IPV6_ILA is not set
CONFIG_INET6_XFRM_TUNNEL=m
CONFIG_INET6_TUNNEL=m
CONFIG_IPV6_VTI=m
CONFIG_IPV6_SIT=m
CONFIG_IPV6_SIT_6RD=y
CONFIG_IPV6_NDISC_NODETYPE=y
CONFIG_IPV6_TUNNEL=m
CONFIG_IPV6_GRE=m
CONFIG_IPV6_MULTIPLE_TABLES=y
# CONFIG_IPV6_SUBTREES is not set
CONFIG_IPV6_MROUTE=y
CONFIG_IPV6_MROUTE_MULTIPLE_TABLES=y
CONFIG_IPV6_PIMSM_V2=y
# CONFIG_IPV6_SEG6_LWTUNNEL is not set
# CONFIG_IPV6_SEG6_HMAC is not set
# CONFIG_IPV6_RPL_LWTUNNEL is not set
CONFIG_NETLABEL=y
# CONFIG_MPTCP is not set
# CONFIG_MPTCP_KUNIT_TESTS is not set
CONFIG_NETWORK_SECMARK=y
CONFIG_NET_PTP_CLASSIFY=y
CONFIG_NETWORK_PHY_TIMESTAMPING=y
CONFIG_NETFILTER=y
CONFIG_NETFILTER_ADVANCED=y
CONFIG_BRIDGE_NETFILTER=m

#
# Core Netfilter Configuration
#
CONFIG_NETFILTER_INGRESS=y
CONFIG_NETFILTER_NETLINK=m
CONFIG_NETFILTER_FAMILY_BRIDGE=y
CONFIG_NETFILTER_FAMILY_ARP=y
# CONFIG_NETFILTER_NETLINK_ACCT is not set
CONFIG_NETFILTER_NETLINK_QUEUE=m
CONFIG_NETFILTER_NETLINK_LOG=m
CONFIG_NETFILTER_NETLINK_OSF=m
CONFIG_NF_CONNTRACK=m
CONFIG_NF_LOG_COMMON=m
CONFIG_NF_LOG_NETDEV=m
CONFIG_NETFILTER_CONNCOUNT=m
CONFIG_NF_CONNTRACK_MARK=y
CONFIG_NF_CONNTRACK_SECMARK=y
CONFIG_NF_CONNTRACK_ZONES=y
CONFIG_NF_CONNTRACK_PROCFS=y
CONFIG_NF_CONNTRACK_EVENTS=y
CONFIG_NF_CONNTRACK_TIMEOUT=y
CONFIG_NF_CONNTRACK_TIMESTAMP=y
CONFIG_NF_CONNTRACK_LABELS=y
CONFIG_NF_CT_PROTO_DCCP=y
CONFIG_NF_CT_PROTO_GRE=y
CONFIG_NF_CT_PROTO_SCTP=y
CONFIG_NF_CT_PROTO_UDPLITE=y
CONFIG_NF_CONNTRACK_AMANDA=m
CONFIG_NF_CONNTRACK_FTP=m
CONFIG_NF_CONNTRACK_H323=m
CONFIG_NF_CONNTRACK_IRC=m
CONFIG_NF_CONNTRACK_BROADCAST=m
CONFIG_NF_CONNTRACK_NETBIOS_NS=m
CONFIG_NF_CONNTRACK_SNMP=m
CONFIG_NF_CONNTRACK_PPTP=m
CONFIG_NF_CONNTRACK_SANE=m
CONFIG_NF_CONNTRACK_SIP=m
CONFIG_NF_CONNTRACK_TFTP=m
CONFIG_NF_CT_NETLINK=m
CONFIG_NF_CT_NETLINK_TIMEOUT=m
CONFIG_NF_CT_NETLINK_HELPER=m
CONFIG_NETFILTER_NETLINK_GLUE_CT=y
CONFIG_NF_NAT=m
CONFIG_NF_NAT_AMANDA=m
CONFIG_NF_NAT_FTP=m
CONFIG_NF_NAT_IRC=m
CONFIG_NF_NAT_SIP=m
CONFIG_NF_NAT_TFTP=m
CONFIG_NF_NAT_REDIRECT=y
CONFIG_NF_NAT_MASQUERADE=y
CONFIG_NETFILTER_SYNPROXY=m
CONFIG_NF_TABLES=m
CONFIG_NF_TABLES_INET=y
CONFIG_NF_TABLES_NETDEV=y
CONFIG_NFT_NUMGEN=m
CONFIG_NFT_CT=m
CONFIG_NFT_COUNTER=m
CONFIG_NFT_CONNLIMIT=m
CONFIG_NFT_LOG=m
CONFIG_NFT_LIMIT=m
CONFIG_NFT_MASQ=m
CONFIG_NFT_REDIR=m
CONFIG_NFT_NAT=m
# CONFIG_NFT_TUNNEL is not set
CONFIG_NFT_OBJREF=m
CONFIG_NFT_QUEUE=m
CONFIG_NFT_QUOTA=m
CONFIG_NFT_REJECT=m
CONFIG_NFT_REJECT_INET=m
CONFIG_NFT_COMPAT=m
CONFIG_NFT_HASH=m
CONFIG_NFT_FIB=m
CONFIG_NFT_FIB_INET=m
# CONFIG_NFT_XFRM is not set
CONFIG_NFT_SOCKET=m
# CONFIG_NFT_OSF is not set
# CONFIG_NFT_TPROXY is not set
# CONFIG_NFT_SYNPROXY is not set
CONFIG_NF_DUP_NETDEV=m
CONFIG_NFT_DUP_NETDEV=m
CONFIG_NFT_FWD_NETDEV=m
CONFIG_NFT_FIB_NETDEV=m
# CONFIG_NF_FLOW_TABLE is not set
CONFIG_NETFILTER_XTABLES=y

#
# Xtables combined modules
#
CONFIG_NETFILTER_XT_MARK=m
CONFIG_NETFILTER_XT_CONNMARK=m
CONFIG_NETFILTER_XT_SET=m

#
# Xtables targets
#
CONFIG_NETFILTER_XT_TARGET_AUDIT=m
CONFIG_NETFILTER_XT_TARGET_CHECKSUM=m
CONFIG_NETFILTER_XT_TARGET_CLASSIFY=m
CONFIG_NETFILTER_XT_TARGET_CONNMARK=m
CONFIG_NETFILTER_XT_TARGET_CONNSECMARK=m
CONFIG_NETFILTER_XT_TARGET_CT=m
CONFIG_NETFILTER_XT_TARGET_DSCP=m
CONFIG_NETFILTER_XT_TARGET_HL=m
CONFIG_NETFILTER_XT_TARGET_HMARK=m
CONFIG_NETFILTER_XT_TARGET_IDLETIMER=m
# CONFIG_NETFILTER_XT_TARGET_LED is not set
CONFIG_NETFILTER_XT_TARGET_LOG=m
CONFIG_NETFILTER_XT_TARGET_MARK=m
CONFIG_NETFILTER_XT_NAT=m
CONFIG_NETFILTER_XT_TARGET_NETMAP=m
CONFIG_NETFILTER_XT_TARGET_NFLOG=m
CONFIG_NETFILTER_XT_TARGET_NFQUEUE=m
CONFIG_NETFILTER_XT_TARGET_NOTRACK=m
CONFIG_NETFILTER_XT_TARGET_RATEEST=m
CONFIG_NETFILTER_XT_TARGET_REDIRECT=m
CONFIG_NETFILTER_XT_TARGET_MASQUERADE=m
CONFIG_NETFILTER_XT_TARGET_TEE=m
CONFIG_NETFILTER_XT_TARGET_TPROXY=m
CONFIG_NETFILTER_XT_TARGET_TRACE=m
CONFIG_NETFILTER_XT_TARGET_SECMARK=m
CONFIG_NETFILTER_XT_TARGET_TCPMSS=m
CONFIG_NETFILTER_XT_TARGET_TCPOPTSTRIP=m

#
# Xtables matches
#
CONFIG_NETFILTER_XT_MATCH_ADDRTYPE=m
CONFIG_NETFILTER_XT_MATCH_BPF=m
CONFIG_NETFILTER_XT_MATCH_CGROUP=m
CONFIG_NETFILTER_XT_MATCH_CLUSTER=m
CONFIG_NETFILTER_XT_MATCH_COMMENT=m
CONFIG_NETFILTER_XT_MATCH_CONNBYTES=m
CONFIG_NETFILTER_XT_MATCH_CONNLABEL=m
CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=m
CONFIG_NETFILTER_XT_MATCH_CONNMARK=m
CONFIG_NETFILTER_XT_MATCH_CONNTRACK=m
CONFIG_NETFILTER_XT_MATCH_CPU=m
CONFIG_NETFILTER_XT_MATCH_DCCP=m
CONFIG_NETFILTER_XT_MATCH_DEVGROUP=m
CONFIG_NETFILTER_XT_MATCH_DSCP=m
CONFIG_NETFILTER_XT_MATCH_ECN=m
CONFIG_NETFILTER_XT_MATCH_ESP=m
CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=m
CONFIG_NETFILTER_XT_MATCH_HELPER=m
CONFIG_NETFILTER_XT_MATCH_HL=m
# CONFIG_NETFILTER_XT_MATCH_IPCOMP is not set
CONFIG_NETFILTER_XT_MATCH_IPRANGE=m
CONFIG_NETFILTER_XT_MATCH_IPVS=m
# CONFIG_NETFILTER_XT_MATCH_L2TP is not set
CONFIG_NETFILTER_XT_MATCH_LENGTH=m
CONFIG_NETFILTER_XT_MATCH_LIMIT=m
CONFIG_NETFILTER_XT_MATCH_MAC=m
CONFIG_NETFILTER_XT_MATCH_MARK=m
CONFIG_NETFILTER_XT_MATCH_MULTIPORT=m
# CONFIG_NETFILTER_XT_MATCH_NFACCT is not set
CONFIG_NETFILTER_XT_MATCH_OSF=m
CONFIG_NETFILTER_XT_MATCH_OWNER=m
CONFIG_NETFILTER_XT_MATCH_POLICY=m
CONFIG_NETFILTER_XT_MATCH_PHYSDEV=m
CONFIG_NETFILTER_XT_MATCH_PKTTYPE=m
CONFIG_NETFILTER_XT_MATCH_QUOTA=m
CONFIG_NETFILTER_XT_MATCH_RATEEST=m
CONFIG_NETFILTER_XT_MATCH_REALM=m
CONFIG_NETFILTER_XT_MATCH_RECENT=m
CONFIG_NETFILTER_XT_MATCH_SCTP=m
CONFIG_NETFILTER_XT_MATCH_SOCKET=m
CONFIG_NETFILTER_XT_MATCH_STATE=m
CONFIG_NETFILTER_XT_MATCH_STATISTIC=m
CONFIG_NETFILTER_XT_MATCH_STRING=m
CONFIG_NETFILTER_XT_MATCH_TCPMSS=m
# CONFIG_NETFILTER_XT_MATCH_TIME is not set
# CONFIG_NETFILTER_XT_MATCH_U32 is not set
# end of Core Netfilter Configuration

CONFIG_IP_SET=m
CONFIG_IP_SET_MAX=256
CONFIG_IP_SET_BITMAP_IP=m
CONFIG_IP_SET_BITMAP_IPMAC=m
CONFIG_IP_SET_BITMAP_PORT=m
CONFIG_IP_SET_HASH_IP=m
CONFIG_IP_SET_HASH_IPMARK=m
CONFIG_IP_SET_HASH_IPPORT=m
CONFIG_IP_SET_HASH_IPPORTIP=m
CONFIG_IP_SET_HASH_IPPORTNET=m
CONFIG_IP_SET_HASH_IPMAC=m
CONFIG_IP_SET_HASH_MAC=m
CONFIG_IP_SET_HASH_NETPORTNET=m
CONFIG_IP_SET_HASH_NET=m
CONFIG_IP_SET_HASH_NETNET=m
CONFIG_IP_SET_HASH_NETPORT=m
CONFIG_IP_SET_HASH_NETIFACE=m
CONFIG_IP_SET_LIST_SET=m
CONFIG_IP_VS=m
CONFIG_IP_VS_IPV6=y
# CONFIG_IP_VS_DEBUG is not set
CONFIG_IP_VS_TAB_BITS=12

#
# IPVS transport protocol load balancing support
#
CONFIG_IP_VS_PROTO_TCP=y
CONFIG_IP_VS_PROTO_UDP=y
CONFIG_IP_VS_PROTO_AH_ESP=y
CONFIG_IP_VS_PROTO_ESP=y
CONFIG_IP_VS_PROTO_AH=y
CONFIG_IP_VS_PROTO_SCTP=y

#
# IPVS scheduler
#
CONFIG_IP_VS_RR=m
CONFIG_IP_VS_WRR=m
CONFIG_IP_VS_LC=m
CONFIG_IP_VS_WLC=m
CONFIG_IP_VS_FO=m
CONFIG_IP_VS_OVF=m
CONFIG_IP_VS_LBLC=m
CONFIG_IP_VS_LBLCR=m
CONFIG_IP_VS_DH=m
CONFIG_IP_VS_SH=m
# CONFIG_IP_VS_MH is not set
CONFIG_IP_VS_SED=m
CONFIG_IP_VS_NQ=m

#
# IPVS SH scheduler
#
CONFIG_IP_VS_SH_TAB_BITS=8

#
# IPVS MH scheduler
#
CONFIG_IP_VS_MH_TAB_INDEX=12

#
# IPVS application helper
#
CONFIG_IP_VS_FTP=m
CONFIG_IP_VS_NFCT=y
CONFIG_IP_VS_PE_SIP=m

#
# IP: Netfilter Configuration
#
CONFIG_NF_DEFRAG_IPV4=m
CONFIG_NF_SOCKET_IPV4=m
CONFIG_NF_TPROXY_IPV4=m
CONFIG_NF_TABLES_IPV4=y
CONFIG_NFT_REJECT_IPV4=m
CONFIG_NFT_DUP_IPV4=m
CONFIG_NFT_FIB_IPV4=m
CONFIG_NF_TABLES_ARP=y
CONFIG_NF_DUP_IPV4=m
CONFIG_NF_LOG_ARP=m
CONFIG_NF_LOG_IPV4=m
CONFIG_NF_REJECT_IPV4=m
CONFIG_NF_NAT_SNMP_BASIC=m
CONFIG_NF_NAT_PPTP=m
CONFIG_NF_NAT_H323=m
CONFIG_IP_NF_IPTABLES=m
CONFIG_IP_NF_MATCH_AH=m
CONFIG_IP_NF_MATCH_ECN=m
CONFIG_IP_NF_MATCH_RPFILTER=m
CONFIG_IP_NF_MATCH_TTL=m
CONFIG_IP_NF_FILTER=m
CONFIG_IP_NF_TARGET_REJECT=m
CONFIG_IP_NF_TARGET_SYNPROXY=m
CONFIG_IP_NF_NAT=m
CONFIG_IP_NF_TARGET_MASQUERADE=m
CONFIG_IP_NF_TARGET_NETMAP=m
CONFIG_IP_NF_TARGET_REDIRECT=m
CONFIG_IP_NF_MANGLE=m
# CONFIG_IP_NF_TARGET_CLUSTERIP is not set
CONFIG_IP_NF_TARGET_ECN=m
CONFIG_IP_NF_TARGET_TTL=m
CONFIG_IP_NF_RAW=m
CONFIG_IP_NF_SECURITY=m
CONFIG_IP_NF_ARPTABLES=m
CONFIG_IP_NF_ARPFILTER=m
CONFIG_IP_NF_ARP_MANGLE=m
# end of IP: Netfilter Configuration

#
# IPv6: Netfilter Configuration
#
CONFIG_NF_SOCKET_IPV6=m
CONFIG_NF_TPROXY_IPV6=m
CONFIG_NF_TABLES_IPV6=y
CONFIG_NFT_REJECT_IPV6=m
CONFIG_NFT_DUP_IPV6=m
CONFIG_NFT_FIB_IPV6=m
CONFIG_NF_DUP_IPV6=m
CONFIG_NF_REJECT_IPV6=m
CONFIG_NF_LOG_IPV6=m
CONFIG_IP6_NF_IPTABLES=m
CONFIG_IP6_NF_MATCH_AH=m
CONFIG_IP6_NF_MATCH_EUI64=m
CONFIG_IP6_NF_MATCH_FRAG=m
CONFIG_IP6_NF_MATCH_OPTS=m
CONFIG_IP6_NF_MATCH_HL=m
CONFIG_IP6_NF_MATCH_IPV6HEADER=m
CONFIG_IP6_NF_MATCH_MH=m
CONFIG_IP6_NF_MATCH_RPFILTER=m
CONFIG_IP6_NF_MATCH_RT=m
# CONFIG_IP6_NF_MATCH_SRH is not set
# CONFIG_IP6_NF_TARGET_HL is not set
CONFIG_IP6_NF_FILTER=m
CONFIG_IP6_NF_TARGET_REJECT=m
CONFIG_IP6_NF_TARGET_SYNPROXY=m
CONFIG_IP6_NF_MANGLE=m
CONFIG_IP6_NF_RAW=m
CONFIG_IP6_NF_SECURITY=m
CONFIG_IP6_NF_NAT=m
CONFIG_IP6_NF_TARGET_MASQUERADE=m
CONFIG_IP6_NF_TARGET_NPT=m
# end of IPv6: Netfilter Configuration

CONFIG_NF_DEFRAG_IPV6=m
CONFIG_NF_TABLES_BRIDGE=m
# CONFIG_NFT_BRIDGE_META is not set
CONFIG_NFT_BRIDGE_REJECT=m
CONFIG_NF_LOG_BRIDGE=m
# CONFIG_NF_CONNTRACK_BRIDGE is not set
CONFIG_BRIDGE_NF_EBTABLES=m
CONFIG_BRIDGE_EBT_BROUTE=m
CONFIG_BRIDGE_EBT_T_FILTER=m
CONFIG_BRIDGE_EBT_T_NAT=m
CONFIG_BRIDGE_EBT_802_3=m
CONFIG_BRIDGE_EBT_AMONG=m
CONFIG_BRIDGE_EBT_ARP=m
CONFIG_BRIDGE_EBT_IP=m
CONFIG_BRIDGE_EBT_IP6=m
CONFIG_BRIDGE_EBT_LIMIT=m
CONFIG_BRIDGE_EBT_MARK=m
CONFIG_BRIDGE_EBT_PKTTYPE=m
CONFIG_BRIDGE_EBT_STP=m
CONFIG_BRIDGE_EBT_VLAN=m
CONFIG_BRIDGE_EBT_ARPREPLY=m
CONFIG_BRIDGE_EBT_DNAT=m
CONFIG_BRIDGE_EBT_MARK_T=m
CONFIG_BRIDGE_EBT_REDIRECT=m
CONFIG_BRIDGE_EBT_SNAT=m
CONFIG_BRIDGE_EBT_LOG=m
CONFIG_BRIDGE_EBT_NFLOG=m
# CONFIG_BPFILTER is not set
# CONFIG_IP_DCCP is not set
CONFIG_IP_SCTP=m
# CONFIG_SCTP_DBG_OBJCNT is not set
# CONFIG_SCTP_DEFAULT_COOKIE_HMAC_MD5 is not set
CONFIG_SCTP_DEFAULT_COOKIE_HMAC_SHA1=y
# CONFIG_SCTP_DEFAULT_COOKIE_HMAC_NONE is not set
CONFIG_SCTP_COOKIE_HMAC_MD5=y
CONFIG_SCTP_COOKIE_HMAC_SHA1=y
CONFIG_INET_SCTP_DIAG=m
# CONFIG_RDS is not set
CONFIG_TIPC=m
# CONFIG_TIPC_MEDIA_IB is not set
CONFIG_TIPC_MEDIA_UDP=y
CONFIG_TIPC_CRYPTO=y
CONFIG_TIPC_DIAG=m
CONFIG_ATM=m
CONFIG_ATM_CLIP=m
# CONFIG_ATM_CLIP_NO_ICMP is not set
CONFIG_ATM_LANE=m
# CONFIG_ATM_MPOA is not set
CONFIG_ATM_BR2684=m
# CONFIG_ATM_BR2684_IPFILTER is not set
CONFIG_L2TP=m
CONFIG_L2TP_DEBUGFS=m
CONFIG_L2TP_V3=y
CONFIG_L2TP_IP=m
CONFIG_L2TP_ETH=m
CONFIG_STP=m
CONFIG_GARP=m
CONFIG_MRP=m
CONFIG_BRIDGE=m
CONFIG_BRIDGE_IGMP_SNOOPING=y
CONFIG_BRIDGE_VLAN_FILTERING=y
# CONFIG_BRIDGE_MRP is not set
CONFIG_HAVE_NET_DSA=y
# CONFIG_NET_DSA is not set
CONFIG_VLAN_8021Q=m
CONFIG_VLAN_8021Q_GVRP=y
CONFIG_VLAN_8021Q_MVRP=y
# CONFIG_DECNET is not set
CONFIG_LLC=m
# CONFIG_LLC2 is not set
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_PHONET is not set
CONFIG_6LOWPAN=m
# CONFIG_6LOWPAN_DEBUGFS is not set
# CONFIG_6LOWPAN_NHC is not set
CONFIG_IEEE802154=m
# CONFIG_IEEE802154_NL802154_EXPERIMENTAL is not set
CONFIG_IEEE802154_SOCKET=m
CONFIG_IEEE802154_6LOWPAN=m
CONFIG_MAC802154=m
CONFIG_NET_SCHED=y

#
# Queueing/Scheduling
#
CONFIG_NET_SCH_CBQ=m
CONFIG_NET_SCH_HTB=m
CONFIG_NET_SCH_HFSC=m
CONFIG_NET_SCH_ATM=m
CONFIG_NET_SCH_PRIO=m
CONFIG_NET_SCH_MULTIQ=m
CONFIG_NET_SCH_RED=m
CONFIG_NET_SCH_SFB=m
CONFIG_NET_SCH_SFQ=m
CONFIG_NET_SCH_TEQL=m
CONFIG_NET_SCH_TBF=m
# CONFIG_NET_SCH_CBS is not set
# CONFIG_NET_SCH_ETF is not set
# CONFIG_NET_SCH_TAPRIO is not set
CONFIG_NET_SCH_GRED=m
CONFIG_NET_SCH_DSMARK=m
CONFIG_NET_SCH_NETEM=m
CONFIG_NET_SCH_DRR=m
CONFIG_NET_SCH_MQPRIO=m
# CONFIG_NET_SCH_SKBPRIO is not set
CONFIG_NET_SCH_CHOKE=m
CONFIG_NET_SCH_QFQ=m
CONFIG_NET_SCH_CODEL=m
CONFIG_NET_SCH_FQ_CODEL=y
# CONFIG_NET_SCH_CAKE is not set
CONFIG_NET_SCH_FQ=m
CONFIG_NET_SCH_HHF=m
CONFIG_NET_SCH_PIE=m
# CONFIG_NET_SCH_FQ_PIE is not set
CONFIG_NET_SCH_INGRESS=m
CONFIG_NET_SCH_PLUG=m
# CONFIG_NET_SCH_ETS is not set
CONFIG_NET_SCH_DEFAULT=y
# CONFIG_DEFAULT_FQ is not set
# CONFIG_DEFAULT_CODEL is not set
CONFIG_DEFAULT_FQ_CODEL=y
# CONFIG_DEFAULT_SFQ is not set
# CONFIG_DEFAULT_PFIFO_FAST is not set
CONFIG_DEFAULT_NET_SCH="fq_codel"

#
# Classification
#
CONFIG_NET_CLS=y
CONFIG_NET_CLS_BASIC=m
CONFIG_NET_CLS_TCINDEX=m
CONFIG_NET_CLS_ROUTE4=m
CONFIG_NET_CLS_FW=m
CONFIG_NET_CLS_U32=m
CONFIG_CLS_U32_PERF=y
CONFIG_CLS_U32_MARK=y
CONFIG_NET_CLS_RSVP=m
CONFIG_NET_CLS_RSVP6=m
CONFIG_NET_CLS_FLOW=m
CONFIG_NET_CLS_CGROUP=y
CONFIG_NET_CLS_BPF=m
CONFIG_NET_CLS_FLOWER=m
CONFIG_NET_CLS_MATCHALL=m
CONFIG_NET_EMATCH=y
CONFIG_NET_EMATCH_STACK=32
CONFIG_NET_EMATCH_CMP=m
CONFIG_NET_EMATCH_NBYTE=m
CONFIG_NET_EMATCH_U32=m
CONFIG_NET_EMATCH_META=m
CONFIG_NET_EMATCH_TEXT=m
# CONFIG_NET_EMATCH_CANID is not set
CONFIG_NET_EMATCH_IPSET=m
# CONFIG_NET_EMATCH_IPT is not set
CONFIG_NET_CLS_ACT=y
CONFIG_NET_ACT_POLICE=m
CONFIG_NET_ACT_GACT=m
CONFIG_GACT_PROB=y
CONFIG_NET_ACT_MIRRED=m
CONFIG_NET_ACT_SAMPLE=m
# CONFIG_NET_ACT_IPT is not set
CONFIG_NET_ACT_NAT=m
CONFIG_NET_ACT_PEDIT=m
CONFIG_NET_ACT_SIMP=m
CONFIG_NET_ACT_SKBEDIT=m
CONFIG_NET_ACT_CSUM=m
# CONFIG_NET_ACT_MPLS is not set
CONFIG_NET_ACT_VLAN=m
CONFIG_NET_ACT_BPF=m
# CONFIG_NET_ACT_CONNMARK is not set
# CONFIG_NET_ACT_CTINFO is not set
CONFIG_NET_ACT_SKBMOD=m
# CONFIG_NET_ACT_IFE is not set
CONFIG_NET_ACT_TUNNEL_KEY=m
# CONFIG_NET_ACT_GATE is not set
# CONFIG_NET_TC_SKB_EXT is not set
CONFIG_NET_SCH_FIFO=y
CONFIG_DCB=y
CONFIG_DNS_RESOLVER=m
# CONFIG_BATMAN_ADV is not set
CONFIG_OPENVSWITCH=m
CONFIG_OPENVSWITCH_GRE=m
CONFIG_VSOCKETS=m
CONFIG_VSOCKETS_DIAG=m
CONFIG_VSOCKETS_LOOPBACK=m
CONFIG_VMWARE_VMCI_VSOCKETS=m
CONFIG_VIRTIO_VSOCKETS=m
CONFIG_VIRTIO_VSOCKETS_COMMON=m
CONFIG_HYPERV_VSOCKETS=m
CONFIG_NETLINK_DIAG=m
CONFIG_MPLS=y
CONFIG_NET_MPLS_GSO=y
CONFIG_MPLS_ROUTING=m
CONFIG_MPLS_IPTUNNEL=m
CONFIG_NET_NSH=y
# CONFIG_HSR is not set
CONFIG_NET_SWITCHDEV=y
CONFIG_NET_L3_MASTER_DEV=y
# CONFIG_QRTR is not set
# CONFIG_NET_NCSI is not set
CONFIG_RPS=y
CONFIG_RFS_ACCEL=y
CONFIG_XPS=y
CONFIG_CGROUP_NET_PRIO=y
CONFIG_CGROUP_NET_CLASSID=y
CONFIG_NET_RX_BUSY_POLL=y
CONFIG_BQL=y
CONFIG_BPF_JIT=y
CONFIG_BPF_STREAM_PARSER=y
CONFIG_NET_FLOW_LIMIT=y

#
# Network testing
#
CONFIG_NET_PKTGEN=m
CONFIG_NET_DROP_MONITOR=y
# end of Network testing
# end of Networking options

# CONFIG_HAMRADIO is not set
CONFIG_CAN=m
CONFIG_CAN_RAW=m
CONFIG_CAN_BCM=m
CONFIG_CAN_GW=m
# CONFIG_CAN_J1939 is not set

#
# CAN Device Drivers
#
CONFIG_CAN_VCAN=m
# CONFIG_CAN_VXCAN is not set
CONFIG_CAN_SLCAN=m
CONFIG_CAN_DEV=m
CONFIG_CAN_CALC_BITTIMING=y
# CONFIG_CAN_KVASER_PCIEFD is not set
CONFIG_CAN_C_CAN=m
CONFIG_CAN_C_CAN_PLATFORM=m
CONFIG_CAN_C_CAN_PCI=m
CONFIG_CAN_CC770=m
# CONFIG_CAN_CC770_ISA is not set
CONFIG_CAN_CC770_PLATFORM=m
# CONFIG_CAN_IFI_CANFD is not set
# CONFIG_CAN_M_CAN is not set
# CONFIG_CAN_PEAK_PCIEFD is not set
CONFIG_CAN_SJA1000=m
CONFIG_CAN_EMS_PCI=m
# CONFIG_CAN_F81601 is not set
CONFIG_CAN_KVASER_PCI=m
CONFIG_CAN_PEAK_PCI=m
CONFIG_CAN_PEAK_PCIEC=y
CONFIG_CAN_PLX_PCI=m
# CONFIG_CAN_SJA1000_ISA is not set
CONFIG_CAN_SJA1000_PLATFORM=m
CONFIG_CAN_SOFTING=m

#
# CAN SPI interfaces
#
# CONFIG_CAN_HI311X is not set
# CONFIG_CAN_MCP251X is not set
# end of CAN SPI interfaces

#
# CAN USB interfaces
#
# CONFIG_CAN_8DEV_USB is not set
# CONFIG_CAN_EMS_USB is not set
# CONFIG_CAN_ESD_USB2 is not set
# CONFIG_CAN_GS_USB is not set
# CONFIG_CAN_KVASER_USB is not set
# CONFIG_CAN_MCBA_USB is not set
# CONFIG_CAN_PEAK_USB is not set
# CONFIG_CAN_UCAN is not set
# end of CAN USB interfaces

# CONFIG_CAN_DEBUG_DEVICES is not set
# end of CAN Device Drivers

CONFIG_BT=m
CONFIG_BT_BREDR=y
CONFIG_BT_RFCOMM=m
CONFIG_BT_RFCOMM_TTY=y
CONFIG_BT_BNEP=m
CONFIG_BT_BNEP_MC_FILTER=y
CONFIG_BT_BNEP_PROTO_FILTER=y
CONFIG_BT_HIDP=m
CONFIG_BT_HS=y
CONFIG_BT_LE=y
# CONFIG_BT_6LOWPAN is not set
# CONFIG_BT_LEDS is not set
# CONFIG_BT_MSFTEXT is not set
CONFIG_BT_DEBUGFS=y
# CONFIG_BT_SELFTEST is not set

#
# Bluetooth device drivers
#
# CONFIG_BT_HCIBTUSB is not set
# CONFIG_BT_HCIBTSDIO is not set
CONFIG_BT_HCIUART=m
CONFIG_BT_HCIUART_H4=y
CONFIG_BT_HCIUART_BCSP=y
CONFIG_BT_HCIUART_ATH3K=y
# CONFIG_BT_HCIUART_INTEL is not set
# CONFIG_BT_HCIUART_AG6XX is not set
# CONFIG_BT_HCIBCM203X is not set
# CONFIG_BT_HCIBPA10X is not set
# CONFIG_BT_HCIBFUSB is not set
CONFIG_BT_HCIVHCI=m
CONFIG_BT_MRVL=m
# CONFIG_BT_MRVL_SDIO is not set
# CONFIG_BT_MTKSDIO is not set
# end of Bluetooth device drivers

# CONFIG_AF_RXRPC is not set
# CONFIG_AF_KCM is not set
CONFIG_STREAM_PARSER=y
CONFIG_FIB_RULES=y
CONFIG_WIRELESS=y
CONFIG_WEXT_CORE=y
CONFIG_WEXT_PROC=y
CONFIG_CFG80211=m
# CONFIG_NL80211_TESTMODE is not set
# CONFIG_CFG80211_DEVELOPER_WARNINGS is not set
CONFIG_CFG80211_REQUIRE_SIGNED_REGDB=y
CONFIG_CFG80211_USE_KERNEL_REGDB_KEYS=y
CONFIG_CFG80211_DEFAULT_PS=y
# CONFIG_CFG80211_DEBUGFS is not set
CONFIG_CFG80211_CRDA_SUPPORT=y
CONFIG_CFG80211_WEXT=y
CONFIG_MAC80211=m
CONFIG_MAC80211_HAS_RC=y
CONFIG_MAC80211_RC_MINSTREL=y
CONFIG_MAC80211_RC_DEFAULT_MINSTREL=y
CONFIG_MAC80211_RC_DEFAULT="minstrel_ht"
CONFIG_MAC80211_MESH=y
CONFIG_MAC80211_LEDS=y
CONFIG_MAC80211_DEBUGFS=y
# CONFIG_MAC80211_MESSAGE_TRACING is not set
# CONFIG_MAC80211_DEBUG_MENU is not set
CONFIG_MAC80211_STA_HASH_MAX_SIZE=0
# CONFIG_WIMAX is not set
CONFIG_RFKILL=m
CONFIG_RFKILL_LEDS=y
CONFIG_RFKILL_INPUT=y
# CONFIG_RFKILL_GPIO is not set
CONFIG_NET_9P=y
CONFIG_NET_9P_VIRTIO=y
# CONFIG_NET_9P_XEN is not set
# CONFIG_NET_9P_RDMA is not set
# CONFIG_NET_9P_DEBUG is not set
# CONFIG_CAIF is not set
CONFIG_CEPH_LIB=m
# CONFIG_CEPH_LIB_PRETTYDEBUG is not set
CONFIG_CEPH_LIB_USE_DNS_RESOLVER=y
# CONFIG_NFC is not set
CONFIG_PSAMPLE=m
# CONFIG_NET_IFE is not set
CONFIG_LWTUNNEL=y
CONFIG_LWTUNNEL_BPF=y
CONFIG_DST_CACHE=y
CONFIG_GRO_CELLS=y
CONFIG_SOCK_VALIDATE_XMIT=y
CONFIG_NET_SOCK_MSG=y
CONFIG_NET_DEVLINK=y
CONFIG_PAGE_POOL=y
CONFIG_FAILOVER=m
CONFIG_ETHTOOL_NETLINK=y
CONFIG_HAVE_EBPF_JIT=y

#
# Device Drivers
#
CONFIG_HAVE_EISA=y
# CONFIG_EISA is not set
CONFIG_HAVE_PCI=y
CONFIG_PCI=y
CONFIG_PCI_DOMAINS=y
CONFIG_PCIEPORTBUS=y
CONFIG_HOTPLUG_PCI_PCIE=y
CONFIG_PCIEAER=y
CONFIG_PCIEAER_INJECT=m
CONFIG_PCIE_ECRC=y
CONFIG_PCIEASPM=y
CONFIG_PCIEASPM_DEFAULT=y
# CONFIG_PCIEASPM_POWERSAVE is not set
# CONFIG_PCIEASPM_POWER_SUPERSAVE is not set
# CONFIG_PCIEASPM_PERFORMANCE is not set
CONFIG_PCIE_PME=y
CONFIG_PCIE_DPC=y
# CONFIG_PCIE_PTM is not set
# CONFIG_PCIE_BW is not set
# CONFIG_PCIE_EDR is not set
CONFIG_PCI_MSI=y
CONFIG_PCI_MSI_IRQ_DOMAIN=y
CONFIG_PCI_QUIRKS=y
# CONFIG_PCI_DEBUG is not set
# CONFIG_PCI_REALLOC_ENABLE_AUTO is not set
CONFIG_PCI_STUB=y
CONFIG_PCI_PF_STUB=m
# CONFIG_XEN_PCIDEV_FRONTEND is not set
CONFIG_PCI_ATS=y
CONFIG_PCI_LOCKLESS_CONFIG=y
CONFIG_PCI_IOV=y
CONFIG_PCI_PRI=y
CONFIG_PCI_PASID=y
# CONFIG_PCI_P2PDMA is not set
CONFIG_PCI_LABEL=y
CONFIG_PCI_HYPERV=m
CONFIG_HOTPLUG_PCI=y
CONFIG_HOTPLUG_PCI_ACPI=y
CONFIG_HOTPLUG_PCI_ACPI_IBM=m
# CONFIG_HOTPLUG_PCI_CPCI is not set
CONFIG_HOTPLUG_PCI_SHPC=y

#
# PCI controller drivers
#
CONFIG_VMD=y
CONFIG_PCI_HYPERV_INTERFACE=m

#
# DesignWare PCI Core Support
#
# CONFIG_PCIE_DW_PLAT_HOST is not set
# CONFIG_PCI_MESON is not set
# end of DesignWare PCI Core Support

#
# Mobiveil PCIe Core Support
#
# end of Mobiveil PCIe Core Support

#
# Cadence PCIe controllers support
#
# end of Cadence PCIe controllers support
# end of PCI controller drivers

#
# PCI Endpoint
#
# CONFIG_PCI_ENDPOINT is not set
# end of PCI Endpoint

#
# PCI switch controller drivers
#
# CONFIG_PCI_SW_SWITCHTEC is not set
# end of PCI switch controller drivers

# CONFIG_PCCARD is not set
# CONFIG_RAPIDIO is not set

#
# Generic Driver Options
#
# CONFIG_UEVENT_HELPER is not set
CONFIG_DEVTMPFS=y
CONFIG_DEVTMPFS_MOUNT=y
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y

#
# Firmware loader
#
CONFIG_FW_LOADER=y
CONFIG_FW_LOADER_PAGED_BUF=y
CONFIG_EXTRA_FIRMWARE=""
CONFIG_FW_LOADER_USER_HELPER=y
# CONFIG_FW_LOADER_USER_HELPER_FALLBACK is not set
# CONFIG_FW_LOADER_COMPRESS is not set
CONFIG_FW_CACHE=y
# end of Firmware loader

CONFIG_ALLOW_DEV_COREDUMP=y
# CONFIG_DEBUG_DRIVER is not set
# CONFIG_DEBUG_DEVRES is not set
# CONFIG_DEBUG_TEST_DRIVER_REMOVE is not set
# CONFIG_PM_QOS_KUNIT_TEST is not set
# CONFIG_TEST_ASYNC_DRIVER_PROBE is not set
CONFIG_KUNIT_DRIVER_PE_TEST=y
CONFIG_SYS_HYPERVISOR=y
CONFIG_GENERIC_CPU_AUTOPROBE=y
CONFIG_GENERIC_CPU_VULNERABILITIES=y
CONFIG_REGMAP=y
CONFIG_REGMAP_I2C=m
CONFIG_REGMAP_SPI=m
CONFIG_DMA_SHARED_BUFFER=y
# CONFIG_DMA_FENCE_TRACE is not set
# end of Generic Driver Options

#
# Bus devices
#
# CONFIG_MHI_BUS is not set
# end of Bus devices

CONFIG_CONNECTOR=y
CONFIG_PROC_EVENTS=y
# CONFIG_GNSS is not set
# CONFIG_MTD is not set
# CONFIG_OF is not set
CONFIG_ARCH_MIGHT_HAVE_PC_PARPORT=y
CONFIG_PARPORT=m
CONFIG_PARPORT_PC=m
CONFIG_PARPORT_SERIAL=m
# CONFIG_PARPORT_PC_FIFO is not set
# CONFIG_PARPORT_PC_SUPERIO is not set
# CONFIG_PARPORT_AX88796 is not set
CONFIG_PARPORT_1284=y
CONFIG_PNP=y
# CONFIG_PNP_DEBUG_MESSAGES is not set

#
# Protocols
#
CONFIG_PNPACPI=y
CONFIG_BLK_DEV=y
CONFIG_BLK_DEV_NULL_BLK=m
CONFIG_BLK_DEV_NULL_BLK_FAULT_INJECTION=y
# CONFIG_BLK_DEV_FD is not set
CONFIG_CDROM=m
# CONFIG_PARIDE is not set
# CONFIG_BLK_DEV_PCIESSD_MTIP32XX is not set
# CONFIG_ZRAM is not set
# CONFIG_BLK_DEV_UMEM is not set
CONFIG_BLK_DEV_LOOP=m
CONFIG_BLK_DEV_LOOP_MIN_COUNT=0
# CONFIG_BLK_DEV_CRYPTOLOOP is not set
# CONFIG_BLK_DEV_DRBD is not set
CONFIG_BLK_DEV_NBD=m
# CONFIG_BLK_DEV_SKD is not set
# CONFIG_BLK_DEV_SX8 is not set
CONFIG_BLK_DEV_RAM=m
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=16384
CONFIG_CDROM_PKTCDVD=m
CONFIG_CDROM_PKTCDVD_BUFFERS=8
# CONFIG_CDROM_PKTCDVD_WCACHE is not set
# CONFIG_ATA_OVER_ETH is not set
CONFIG_XEN_BLKDEV_FRONTEND=m
CONFIG_VIRTIO_BLK=y
CONFIG_BLK_DEV_RBD=m
# CONFIG_BLK_DEV_RSXX is not set

#
# NVME Support
#
CONFIG_NVME_CORE=m
CONFIG_BLK_DEV_NVME=m
CONFIG_NVME_MULTIPATH=y
# CONFIG_NVME_HWMON is not set
CONFIG_NVME_FABRICS=m
# CONFIG_NVME_RDMA is not set
CONFIG_NVME_FC=m
# CONFIG_NVME_TCP is not set
CONFIG_NVME_TARGET=m
# CONFIG_NVME_TARGET_PASSTHRU is not set
CONFIG_NVME_TARGET_LOOP=m
# CONFIG_NVME_TARGET_RDMA is not set
CONFIG_NVME_TARGET_FC=m
CONFIG_NVME_TARGET_FCLOOP=m
# CONFIG_NVME_TARGET_TCP is not set
# end of NVME Support

#
# Misc devices
#
CONFIG_SENSORS_LIS3LV02D=m
# CONFIG_AD525X_DPOT is not set
# CONFIG_DUMMY_IRQ is not set
# CONFIG_IBM_ASM is not set
# CONFIG_PHANTOM is not set
CONFIG_TIFM_CORE=m
CONFIG_TIFM_7XX1=m
# CONFIG_ICS932S401 is not set
CONFIG_ENCLOSURE_SERVICES=m
CONFIG_SGI_XP=m
CONFIG_HP_ILO=m
CONFIG_SGI_GRU=m
# CONFIG_SGI_GRU_DEBUG is not set
CONFIG_APDS9802ALS=m
CONFIG_ISL29003=m
CONFIG_ISL29020=m
CONFIG_SENSORS_TSL2550=m
CONFIG_SENSORS_BH1770=m
CONFIG_SENSORS_APDS990X=m
# CONFIG_HMC6352 is not set
# CONFIG_DS1682 is not set
CONFIG_VMWARE_BALLOON=m
# CONFIG_LATTICE_ECP3_CONFIG is not set
# CONFIG_SRAM is not set
# CONFIG_PCI_ENDPOINT_TEST is not set
# CONFIG_XILINX_SDFEC is not set
CONFIG_MISC_RTSX=m
CONFIG_PVPANIC=y
# CONFIG_C2PORT is not set

#
# EEPROM support
#
# CONFIG_EEPROM_AT24 is not set
# CONFIG_EEPROM_AT25 is not set
CONFIG_EEPROM_LEGACY=m
CONFIG_EEPROM_MAX6875=m
CONFIG_EEPROM_93CX6=m
# CONFIG_EEPROM_93XX46 is not set
# CONFIG_EEPROM_IDT_89HPESX is not set
# CONFIG_EEPROM_EE1004 is not set
# end of EEPROM support

CONFIG_CB710_CORE=m
# CONFIG_CB710_DEBUG is not set
CONFIG_CB710_DEBUG_ASSUMPTIONS=y

#
# Texas Instruments shared transport line discipline
#
# CONFIG_TI_ST is not set
# end of Texas Instruments shared transport line discipline

CONFIG_SENSORS_LIS3_I2C=m
CONFIG_ALTERA_STAPL=m
CONFIG_INTEL_MEI=m
CONFIG_INTEL_MEI_ME=m
# CONFIG_INTEL_MEI_TXE is not set
# CONFIG_INTEL_MEI_HDCP is not set
CONFIG_VMWARE_VMCI=m

#
# Intel MIC & related support
#
# CONFIG_INTEL_MIC_BUS is not set
# CONFIG_SCIF_BUS is not set
# CONFIG_VOP_BUS is not set
# end of Intel MIC & related support

# CONFIG_GENWQE is not set
# CONFIG_ECHO is not set
# CONFIG_MISC_ALCOR_PCI is not set
CONFIG_MISC_RTSX_PCI=m
# CONFIG_MISC_RTSX_USB is not set
# CONFIG_HABANA_AI is not set
# CONFIG_UACCE is not set
# end of Misc devices

CONFIG_HAVE_IDE=y
# CONFIG_IDE is not set

#
# SCSI device support
#
CONFIG_SCSI_MOD=y
CONFIG_RAID_ATTRS=m
CONFIG_SCSI=y
CONFIG_SCSI_DMA=y
CONFIG_SCSI_NETLINK=y
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=m
CONFIG_CHR_DEV_ST=m
CONFIG_BLK_DEV_SR=m
CONFIG_CHR_DEV_SG=m
CONFIG_CHR_DEV_SCH=m
CONFIG_SCSI_ENCLOSURE=m
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_LOGGING=y
CONFIG_SCSI_SCAN_ASYNC=y

#
# SCSI Transports
#
CONFIG_SCSI_SPI_ATTRS=m
CONFIG_SCSI_FC_ATTRS=m
CONFIG_SCSI_ISCSI_ATTRS=m
CONFIG_SCSI_SAS_ATTRS=m
CONFIG_SCSI_SAS_LIBSAS=m
# CONFIG_SCSI_SAS_ATA is not set
CONFIG_SCSI_SAS_HOST_SMP=y
CONFIG_SCSI_SRP_ATTRS=m
# end of SCSI Transports

CONFIG_SCSI_LOWLEVEL=y
# CONFIG_ISCSI_TCP is not set
# CONFIG_ISCSI_BOOT_SYSFS is not set
# CONFIG_SCSI_CXGB3_ISCSI is not set
# CONFIG_SCSI_CXGB4_ISCSI is not set
# CONFIG_SCSI_BNX2_ISCSI is not set
# CONFIG_BE2ISCSI is not set
# CONFIG_BLK_DEV_3W_XXXX_RAID is not set
# CONFIG_SCSI_HPSA is not set
# CONFIG_SCSI_3W_9XXX is not set
# CONFIG_SCSI_3W_SAS is not set
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC79XX is not set
# CONFIG_SCSI_AIC94XX is not set
# CONFIG_SCSI_MVSAS is not set
# CONFIG_SCSI_MVUMI is not set
# CONFIG_SCSI_DPT_I2O is not set
# CONFIG_SCSI_ADVANSYS is not set
# CONFIG_SCSI_ARCMSR is not set
# CONFIG_SCSI_ESAS2R is not set
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
# CONFIG_MEGARAID_SAS is not set
CONFIG_SCSI_MPT3SAS=m
CONFIG_SCSI_MPT2SAS_MAX_SGE=128
CONFIG_SCSI_MPT3SAS_MAX_SGE=128
# CONFIG_SCSI_MPT2SAS is not set
# CONFIG_SCSI_SMARTPQI is not set
# CONFIG_SCSI_UFSHCD is not set
# CONFIG_SCSI_HPTIOP is not set
# CONFIG_SCSI_BUSLOGIC is not set
# CONFIG_SCSI_MYRB is not set
# CONFIG_SCSI_MYRS is not set
# CONFIG_VMWARE_PVSCSI is not set
# CONFIG_XEN_SCSI_FRONTEND is not set
CONFIG_HYPERV_STORAGE=m
# CONFIG_LIBFC is not set
# CONFIG_SCSI_SNIC is not set
# CONFIG_SCSI_DMX3191D is not set
# CONFIG_SCSI_FDOMAIN_PCI is not set
# CONFIG_SCSI_GDTH is not set
# CONFIG_SCSI_ISCI is not set
# CONFIG_SCSI_IPS is not set
# CONFIG_SCSI_INITIO is not set
# CONFIG_SCSI_INIA100 is not set
# CONFIG_SCSI_PPA is not set
# CONFIG_SCSI_IMM is not set
# CONFIG_SCSI_STEX is not set
# CONFIG_SCSI_SYM53C8XX_2 is not set
# CONFIG_SCSI_IPR is not set
# CONFIG_SCSI_QLOGIC_1280 is not set
# CONFIG_SCSI_QLA_FC is not set
# CONFIG_SCSI_QLA_ISCSI is not set
# CONFIG_SCSI_LPFC is not set
# CONFIG_SCSI_DC395x is not set
# CONFIG_SCSI_AM53C974 is not set
# CONFIG_SCSI_WD719X is not set
CONFIG_SCSI_DEBUG=m
# CONFIG_SCSI_PMCRAID is not set
# CONFIG_SCSI_PM8001 is not set
# CONFIG_SCSI_BFA_FC is not set
# CONFIG_SCSI_VIRTIO is not set
# CONFIG_SCSI_CHELSIO_FCOE is not set
CONFIG_SCSI_DH=y
CONFIG_SCSI_DH_RDAC=y
CONFIG_SCSI_DH_HP_SW=y
CONFIG_SCSI_DH_EMC=y
CONFIG_SCSI_DH_ALUA=y
# end of SCSI device support

CONFIG_ATA=m
CONFIG_SATA_HOST=y
CONFIG_PATA_TIMINGS=y
CONFIG_ATA_VERBOSE_ERROR=y
CONFIG_ATA_FORCE=y
CONFIG_ATA_ACPI=y
# CONFIG_SATA_ZPODD is not set
CONFIG_SATA_PMP=y

#
# Controllers with non-SFF native interface
#
CONFIG_SATA_AHCI=m
CONFIG_SATA_MOBILE_LPM_POLICY=0
CONFIG_SATA_AHCI_PLATFORM=m
# CONFIG_SATA_INIC162X is not set
# CONFIG_SATA_ACARD_AHCI is not set
# CONFIG_SATA_SIL24 is not set
CONFIG_ATA_SFF=y

#
# SFF controllers with custom DMA interface
#
# CONFIG_PDC_ADMA is not set
# CONFIG_SATA_QSTOR is not set
# CONFIG_SATA_SX4 is not set
CONFIG_ATA_BMDMA=y

#
# SATA SFF controllers with BMDMA
#
CONFIG_ATA_PIIX=m
# CONFIG_SATA_DWC is not set
# CONFIG_SATA_MV is not set
# CONFIG_SATA_NV is not set
# CONFIG_SATA_PROMISE is not set
# CONFIG_SATA_SIL is not set
# CONFIG_SATA_SIS is not set
# CONFIG_SATA_SVW is not set
# CONFIG_SATA_ULI is not set
# CONFIG_SATA_VIA is not set
# CONFIG_SATA_VITESSE is not set

#
# PATA SFF controllers with BMDMA
#
# CONFIG_PATA_ALI is not set
# CONFIG_PATA_AMD is not set
# CONFIG_PATA_ARTOP is not set
# CONFIG_PATA_ATIIXP is not set
# CONFIG_PATA_ATP867X is not set
# CONFIG_PATA_CMD64X is not set
# CONFIG_PATA_CYPRESS is not set
# CONFIG_PATA_EFAR is not set
# CONFIG_PATA_HPT366 is not set
# CONFIG_PATA_HPT37X is not set
# CONFIG_PATA_HPT3X2N is not set
# CONFIG_PATA_HPT3X3 is not set
# CONFIG_PATA_IT8213 is not set
# CONFIG_PATA_IT821X is not set
# CONFIG_PATA_JMICRON is not set
# CONFIG_PATA_MARVELL is not set
# CONFIG_PATA_NETCELL is not set
# CONFIG_PATA_NINJA32 is not set
# CONFIG_PATA_NS87415 is not set
# CONFIG_PATA_OLDPIIX is not set
# CONFIG_PATA_OPTIDMA is not set
# CONFIG_PATA_PDC2027X is not set
# CONFIG_PATA_PDC_OLD is not set
# CONFIG_PATA_RADISYS is not set
# CONFIG_PATA_RDC is not set
# CONFIG_PATA_SCH is not set
# CONFIG_PATA_SERVERWORKS is not set
# CONFIG_PATA_SIL680 is not set
# CONFIG_PATA_SIS is not set
# CONFIG_PATA_TOSHIBA is not set
# CONFIG_PATA_TRIFLEX is not set
# CONFIG_PATA_VIA is not set
# CONFIG_PATA_WINBOND is not set

#
# PIO-only SFF controllers
#
# CONFIG_PATA_CMD640_PCI is not set
# CONFIG_PATA_MPIIX is not set
# CONFIG_PATA_NS87410 is not set
# CONFIG_PATA_OPTI is not set
# CONFIG_PATA_RZ1000 is not set

#
# Generic fallback / legacy drivers
#
# CONFIG_PATA_ACPI is not set
CONFIG_ATA_GENERIC=m
# CONFIG_PATA_LEGACY is not set
CONFIG_MD=y
CONFIG_BLK_DEV_MD=y
CONFIG_MD_AUTODETECT=y
CONFIG_MD_LINEAR=m
CONFIG_MD_RAID0=m
CONFIG_MD_RAID1=m
CONFIG_MD_RAID10=m
CONFIG_MD_RAID456=m
CONFIG_MD_MULTIPATH=m
CONFIG_MD_FAULTY=m
CONFIG_MD_CLUSTER=m
# CONFIG_BCACHE is not set
CONFIG_BLK_DEV_DM_BUILTIN=y
CONFIG_BLK_DEV_DM=m
CONFIG_DM_DEBUG=y
CONFIG_DM_BUFIO=m
# CONFIG_DM_DEBUG_BLOCK_MANAGER_LOCKING is not set
CONFIG_DM_BIO_PRISON=m
CONFIG_DM_PERSISTENT_DATA=m
# CONFIG_DM_UNSTRIPED is not set
CONFIG_DM_CRYPT=m
CONFIG_DM_SNAPSHOT=m
CONFIG_DM_THIN_PROVISIONING=m
CONFIG_DM_CACHE=m
CONFIG_DM_CACHE_SMQ=m
CONFIG_DM_WRITECACHE=m
# CONFIG_DM_EBS is not set
CONFIG_DM_ERA=m
# CONFIG_DM_CLONE is not set
CONFIG_DM_MIRROR=m
CONFIG_DM_LOG_USERSPACE=m
CONFIG_DM_RAID=m
CONFIG_DM_ZERO=m
CONFIG_DM_MULTIPATH=m
CONFIG_DM_MULTIPATH_QL=m
CONFIG_DM_MULTIPATH_ST=m
# CONFIG_DM_MULTIPATH_HST is not set
CONFIG_DM_DELAY=m
# CONFIG_DM_DUST is not set
CONFIG_DM_UEVENT=y
CONFIG_DM_FLAKEY=m
CONFIG_DM_VERITY=m
# CONFIG_DM_VERITY_VERIFY_ROOTHASH_SIG is not set
# CONFIG_DM_VERITY_FEC is not set
CONFIG_DM_SWITCH=m
CONFIG_DM_LOG_WRITES=m
CONFIG_DM_INTEGRITY=m
# CONFIG_DM_ZONED is not set
CONFIG_TARGET_CORE=m
CONFIG_TCM_IBLOCK=m
CONFIG_TCM_FILEIO=m
CONFIG_TCM_PSCSI=m
CONFIG_TCM_USER2=m
CONFIG_LOOPBACK_TARGET=m
CONFIG_ISCSI_TARGET=m
# CONFIG_SBP_TARGET is not set
# CONFIG_FUSION is not set

#
# IEEE 1394 (FireWire) support
#
CONFIG_FIREWIRE=m
CONFIG_FIREWIRE_OHCI=m
CONFIG_FIREWIRE_SBP2=m
CONFIG_FIREWIRE_NET=m
# CONFIG_FIREWIRE_NOSY is not set
# end of IEEE 1394 (FireWire) support

CONFIG_MACINTOSH_DRIVERS=y
CONFIG_MAC_EMUMOUSEBTN=y
CONFIG_NETDEVICES=y
CONFIG_MII=y
CONFIG_NET_CORE=y
# CONFIG_BONDING is not set
# CONFIG_DUMMY is not set
# CONFIG_WIREGUARD is not set
# CONFIG_EQUALIZER is not set
# CONFIG_NET_FC is not set
# CONFIG_IFB is not set
# CONFIG_NET_TEAM is not set
# CONFIG_MACVLAN is not set
# CONFIG_IPVLAN is not set
# CONFIG_VXLAN is not set
# CONFIG_GENEVE is not set
# CONFIG_BAREUDP is not set
# CONFIG_GTP is not set
# CONFIG_MACSEC is not set
CONFIG_NETCONSOLE=m
CONFIG_NETCONSOLE_DYNAMIC=y
CONFIG_NETPOLL=y
CONFIG_NET_POLL_CONTROLLER=y
# CONFIG_TUN is not set
# CONFIG_TUN_VNET_CROSS_LE is not set
CONFIG_VETH=m
CONFIG_VIRTIO_NET=m
# CONFIG_NLMON is not set
# CONFIG_NET_VRF is not set
# CONFIG_VSOCKMON is not set
# CONFIG_ARCNET is not set
CONFIG_ATM_DRIVERS=y
# CONFIG_ATM_DUMMY is not set
# CONFIG_ATM_TCP is not set
# CONFIG_ATM_LANAI is not set
# CONFIG_ATM_ENI is not set
# CONFIG_ATM_FIRESTREAM is not set
# CONFIG_ATM_ZATM is not set
# CONFIG_ATM_NICSTAR is not set
# CONFIG_ATM_IDT77252 is not set
# CONFIG_ATM_AMBASSADOR is not set
# CONFIG_ATM_HORIZON is not set
# CONFIG_ATM_IA is not set
# CONFIG_ATM_FORE200E is not set
# CONFIG_ATM_HE is not set
# CONFIG_ATM_SOLOS is not set

#
# Distributed Switch Architecture drivers
#
# end of Distributed Switch Architecture drivers

CONFIG_ETHERNET=y
CONFIG_MDIO=y
CONFIG_NET_VENDOR_3COM=y
# CONFIG_VORTEX is not set
# CONFIG_TYPHOON is not set
CONFIG_NET_VENDOR_ADAPTEC=y
# CONFIG_ADAPTEC_STARFIRE is not set
CONFIG_NET_VENDOR_AGERE=y
# CONFIG_ET131X is not set
CONFIG_NET_VENDOR_ALACRITECH=y
# CONFIG_SLICOSS is not set
CONFIG_NET_VENDOR_ALTEON=y
# CONFIG_ACENIC is not set
# CONFIG_ALTERA_TSE is not set
CONFIG_NET_VENDOR_AMAZON=y
# CONFIG_ENA_ETHERNET is not set
CONFIG_NET_VENDOR_AMD=y
# CONFIG_AMD8111_ETH is not set
# CONFIG_PCNET32 is not set
# CONFIG_AMD_XGBE is not set
CONFIG_NET_VENDOR_AQUANTIA=y
# CONFIG_AQTION is not set
CONFIG_NET_VENDOR_ARC=y
CONFIG_NET_VENDOR_ATHEROS=y
# CONFIG_ATL2 is not set
# CONFIG_ATL1 is not set
# CONFIG_ATL1E is not set
# CONFIG_ATL1C is not set
# CONFIG_ALX is not set
# CONFIG_NET_VENDOR_AURORA is not set
CONFIG_NET_VENDOR_BROADCOM=y
# CONFIG_B44 is not set
# CONFIG_BCMGENET is not set
# CONFIG_BNX2 is not set
# CONFIG_CNIC is not set
CONFIG_TIGON3=y
CONFIG_TIGON3_HWMON=y
# CONFIG_BNX2X is not set
# CONFIG_SYSTEMPORT is not set
# CONFIG_BNXT is not set
CONFIG_NET_VENDOR_BROCADE=y
# CONFIG_BNA is not set
CONFIG_NET_VENDOR_CADENCE=y
# CONFIG_MACB is not set
CONFIG_NET_VENDOR_CAVIUM=y
# CONFIG_THUNDER_NIC_PF is not set
# CONFIG_THUNDER_NIC_VF is not set
# CONFIG_THUNDER_NIC_BGX is not set
# CONFIG_THUNDER_NIC_RGX is not set
CONFIG_CAVIUM_PTP=y
# CONFIG_LIQUIDIO is not set
# CONFIG_LIQUIDIO_VF is not set
CONFIG_NET_VENDOR_CHELSIO=y
# CONFIG_CHELSIO_T1 is not set
# CONFIG_CHELSIO_T3 is not set
# CONFIG_CHELSIO_T4 is not set
# CONFIG_CHELSIO_T4VF is not set
CONFIG_NET_VENDOR_CISCO=y
# CONFIG_ENIC is not set
CONFIG_NET_VENDOR_CORTINA=y
# CONFIG_CX_ECAT is not set
# CONFIG_DNET is not set
CONFIG_NET_VENDOR_DEC=y
# CONFIG_NET_TULIP is not set
CONFIG_NET_VENDOR_DLINK=y
# CONFIG_DL2K is not set
# CONFIG_SUNDANCE is not set
CONFIG_NET_VENDOR_EMULEX=y
# CONFIG_BE2NET is not set
CONFIG_NET_VENDOR_EZCHIP=y
CONFIG_NET_VENDOR_GOOGLE=y
# CONFIG_GVE is not set
CONFIG_NET_VENDOR_HUAWEI=y
# CONFIG_HINIC is not set
CONFIG_NET_VENDOR_I825XX=y
CONFIG_NET_VENDOR_INTEL=y
# CONFIG_E100 is not set
CONFIG_E1000=y
CONFIG_E1000E=y
CONFIG_E1000E_HWTS=y
CONFIG_IGB=y
CONFIG_IGB_HWMON=y
# CONFIG_IGBVF is not set
# CONFIG_IXGB is not set
CONFIG_IXGBE=y
CONFIG_IXGBE_HWMON=y
# CONFIG_IXGBE_DCB is not set
CONFIG_IXGBE_IPSEC=y
# CONFIG_IXGBEVF is not set
CONFIG_I40E=y
# CONFIG_I40E_DCB is not set
# CONFIG_I40EVF is not set
# CONFIG_ICE is not set
# CONFIG_FM10K is not set
# CONFIG_IGC is not set
# CONFIG_JME is not set
CONFIG_NET_VENDOR_MARVELL=y
# CONFIG_MVMDIO is not set
CONFIG_SKGE=y
# CONFIG_SKGE_DEBUG is not set
# CONFIG_SKGE_GENESIS is not set
# CONFIG_SKY2 is not set
CONFIG_NET_VENDOR_MELLANOX=y
# CONFIG_MLX4_EN is not set
# CONFIG_MLX5_CORE is not set
# CONFIG_MLXSW_CORE is not set
# CONFIG_MLXFW is not set
CONFIG_NET_VENDOR_MICREL=y
# CONFIG_KS8842 is not set
# CONFIG_KS8851 is not set
# CONFIG_KS8851_MLL is not set
# CONFIG_KSZ884X_PCI is not set
CONFIG_NET_VENDOR_MICROCHIP=y
# CONFIG_ENC28J60 is not set
# CONFIG_ENCX24J600 is not set
# CONFIG_LAN743X is not set
CONFIG_NET_VENDOR_MICROSEMI=y
CONFIG_NET_VENDOR_MYRI=y
# CONFIG_MYRI10GE is not set
# CONFIG_FEALNX is not set
CONFIG_NET_VENDOR_NATSEMI=y
# CONFIG_NATSEMI is not set
# CONFIG_NS83820 is not set
CONFIG_NET_VENDOR_NETERION=y
# CONFIG_S2IO is not set
# CONFIG_VXGE is not set
CONFIG_NET_VENDOR_NETRONOME=y
# CONFIG_NFP is not set
CONFIG_NET_VENDOR_NI=y
# CONFIG_NI_XGE_MANAGEMENT_ENET is not set
CONFIG_NET_VENDOR_8390=y
# CONFIG_NE2K_PCI is not set
CONFIG_NET_VENDOR_NVIDIA=y
# CONFIG_FORCEDETH is not set
CONFIG_NET_VENDOR_OKI=y
# CONFIG_ETHOC is not set
CONFIG_NET_VENDOR_PACKET_ENGINES=y
# CONFIG_HAMACHI is not set
CONFIG_YELLOWFIN=m
CONFIG_NET_VENDOR_PENSANDO=y
# CONFIG_IONIC is not set
CONFIG_NET_VENDOR_QLOGIC=y
# CONFIG_QLA3XXX is not set
# CONFIG_QLCNIC is not set
# CONFIG_NETXEN_NIC is not set
# CONFIG_QED is not set
CONFIG_NET_VENDOR_QUALCOMM=y
# CONFIG_QCOM_EMAC is not set
# CONFIG_RMNET is not set
CONFIG_NET_VENDOR_RDC=y
# CONFIG_R6040 is not set
CONFIG_NET_VENDOR_REALTEK=y
# CONFIG_ATP is not set
CONFIG_8139CP=y
CONFIG_8139TOO=y
CONFIG_8139TOO_PIO=y
# CONFIG_8139TOO_TUNE_TWISTER is not set
# CONFIG_8139TOO_8129 is not set
# CONFIG_8139_OLD_RX_RESET is not set
CONFIG_R8169=y
CONFIG_NET_VENDOR_RENESAS=y
CONFIG_NET_VENDOR_ROCKER=y
# CONFIG_ROCKER is not set
CONFIG_NET_VENDOR_SAMSUNG=y
# CONFIG_SXGBE_ETH is not set
CONFIG_NET_VENDOR_SEEQ=y
CONFIG_NET_VENDOR_SOLARFLARE=y
# CONFIG_SFC is not set
# CONFIG_SFC_FALCON is not set
CONFIG_NET_VENDOR_SILAN=y
# CONFIG_SC92031 is not set
CONFIG_NET_VENDOR_SIS=y
# CONFIG_SIS900 is not set
# CONFIG_SIS190 is not set
CONFIG_NET_VENDOR_SMSC=y
# CONFIG_EPIC100 is not set
# CONFIG_SMSC911X is not set
# CONFIG_SMSC9420 is not set
CONFIG_NET_VENDOR_SOCIONEXT=y
CONFIG_NET_VENDOR_STMICRO=y
# CONFIG_STMMAC_ETH is not set
CONFIG_NET_VENDOR_SUN=y
# CONFIG_HAPPYMEAL is not set
# CONFIG_SUNGEM is not set
# CONFIG_CASSINI is not set
# CONFIG_NIU is not set
CONFIG_NET_VENDOR_SYNOPSYS=y
# CONFIG_DWC_XLGMAC is not set
CONFIG_NET_VENDOR_TEHUTI=y
# CONFIG_TEHUTI is not set
CONFIG_NET_VENDOR_TI=y
# CONFIG_TI_CPSW_PHY_SEL is not set
# CONFIG_TLAN is not set
CONFIG_NET_VENDOR_VIA=y
# CONFIG_VIA_RHINE is not set
# CONFIG_VIA_VELOCITY is not set
CONFIG_NET_VENDOR_WIZNET=y
# CONFIG_WIZNET_W5100 is not set
# CONFIG_WIZNET_W5300 is not set
CONFIG_NET_VENDOR_XILINX=y
# CONFIG_XILINX_AXI_EMAC is not set
# CONFIG_XILINX_LL_TEMAC is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
# CONFIG_NET_SB1000 is not set
CONFIG_MDIO_DEVICE=y
CONFIG_MDIO_BUS=y
CONFIG_MDIO_DEVRES=y
# CONFIG_MDIO_BCM_UNIMAC is not set
# CONFIG_MDIO_BITBANG is not set
# CONFIG_MDIO_MSCC_MIIM is not set
# CONFIG_MDIO_MVUSB is not set
# CONFIG_MDIO_THUNDER is not set
# CONFIG_MDIO_XPCS is not set
CONFIG_PHYLIB=y
# CONFIG_LED_TRIGGER_PHY is not set

#
# MII PHY device drivers
#
# CONFIG_ADIN_PHY is not set
# CONFIG_AMD_PHY is not set
# CONFIG_AQUANTIA_PHY is not set
# CONFIG_AX88796B_PHY is not set
# CONFIG_BCM7XXX_PHY is not set
# CONFIG_BCM87XX_PHY is not set
# CONFIG_BROADCOM_PHY is not set
# CONFIG_BCM54140_PHY is not set
# CONFIG_BCM84881_PHY is not set
# CONFIG_CICADA_PHY is not set
# CONFIG_CORTINA_PHY is not set
# CONFIG_DAVICOM_PHY is not set
# CONFIG_DP83822_PHY is not set
# CONFIG_DP83TC811_PHY is not set
# CONFIG_DP83848_PHY is not set
# CONFIG_DP83867_PHY is not set
# CONFIG_DP83869_PHY is not set
# CONFIG_FIXED_PHY is not set
# CONFIG_ICPLUS_PHY is not set
# CONFIG_INTEL_XWAY_PHY is not set
# CONFIG_LSI_ET1011C_PHY is not set
# CONFIG_LXT_PHY is not set
# CONFIG_MARVELL_PHY is not set
# CONFIG_MARVELL_10G_PHY is not set
# CONFIG_MICREL_PHY is not set
# CONFIG_MICROCHIP_PHY is not set
# CONFIG_MICROCHIP_T1_PHY is not set
# CONFIG_MICROSEMI_PHY is not set
# CONFIG_NATIONAL_PHY is not set
# CONFIG_NXP_TJA11XX_PHY is not set
# CONFIG_QSEMI_PHY is not set
CONFIG_REALTEK_PHY=y
# CONFIG_RENESAS_PHY is not set
# CONFIG_ROCKCHIP_PHY is not set
# CONFIG_SMSC_PHY is not set
# CONFIG_STE10XP is not set
# CONFIG_TERANETICS_PHY is not set
# CONFIG_VITESSE_PHY is not set
# CONFIG_XILINX_GMII2RGMII is not set
# CONFIG_MICREL_KS8995MA is not set
# CONFIG_PLIP is not set
# CONFIG_PPP is not set
# CONFIG_SLIP is not set
CONFIG_USB_NET_DRIVERS=y
CONFIG_USB_CATC=y
CONFIG_USB_KAWETH=y
CONFIG_USB_PEGASUS=y
CONFIG_USB_RTL8150=y
# CONFIG_USB_RTL8152 is not set
# CONFIG_USB_LAN78XX is not set
CONFIG_USB_USBNET=y
CONFIG_USB_NET_AX8817X=y
CONFIG_USB_NET_AX88179_178A=y
CONFIG_USB_NET_CDCETHER=y
CONFIG_USB_NET_CDC_EEM=y
CONFIG_USB_NET_CDC_NCM=y
# CONFIG_USB_NET_HUAWEI_CDC_NCM is not set
# CONFIG_USB_NET_CDC_MBIM is not set
CONFIG_USB_NET_DM9601=y
# CONFIG_USB_NET_SR9700 is not set
# CONFIG_USB_NET_SR9800 is not set
CONFIG_USB_NET_SMSC75XX=y
CONFIG_USB_NET_SMSC95XX=y
CONFIG_USB_NET_GL620A=y
CONFIG_USB_NET_NET1080=y
CONFIG_USB_NET_PLUSB=y
CONFIG_USB_NET_MCS7830=y
CONFIG_USB_NET_RNDIS_HOST=y
CONFIG_USB_NET_CDC_SUBSET_ENABLE=y
CONFIG_USB_NET_CDC_SUBSET=y
# CONFIG_USB_ALI_M5632 is not set
# CONFIG_USB_AN2720 is not set
CONFIG_USB_BELKIN=y
CONFIG_USB_ARMLINUX=y
# CONFIG_USB_EPSON2888 is not set
# CONFIG_USB_KC2190 is not set
CONFIG_USB_NET_ZAURUS=y
# CONFIG_USB_NET_CX82310_ETH is not set
# CONFIG_USB_NET_KALMIA is not set
# CONFIG_USB_NET_QMI_WWAN is not set
# CONFIG_USB_HSO is not set
CONFIG_USB_NET_INT51X1=y
CONFIG_USB_IPHETH=y
CONFIG_USB_SIERRA_NET=y
# CONFIG_USB_VL600 is not set
# CONFIG_USB_NET_CH9200 is not set
# CONFIG_USB_NET_AQC111 is not set
CONFIG_WLAN=y
CONFIG_WLAN_VENDOR_ADMTEK=y
# CONFIG_ADM8211 is not set
CONFIG_WLAN_VENDOR_ATH=y
# CONFIG_ATH_DEBUG is not set
# CONFIG_ATH5K is not set
# CONFIG_ATH5K_PCI is not set
# CONFIG_ATH9K is not set
# CONFIG_ATH9K_HTC is not set
# CONFIG_CARL9170 is not set
# CONFIG_ATH6KL is not set
# CONFIG_AR5523 is not set
# CONFIG_WIL6210 is not set
# CONFIG_ATH10K is not set
# CONFIG_WCN36XX is not set
CONFIG_WLAN_VENDOR_ATMEL=y
# CONFIG_ATMEL is not set
# CONFIG_AT76C50X_USB is not set
CONFIG_WLAN_VENDOR_BROADCOM=y
# CONFIG_B43 is not set
# CONFIG_B43LEGACY is not set
# CONFIG_BRCMSMAC is not set
# CONFIG_BRCMFMAC is not set
CONFIG_WLAN_VENDOR_CISCO=y
# CONFIG_AIRO is not set
CONFIG_WLAN_VENDOR_INTEL=y
# CONFIG_IPW2100 is not set
# CONFIG_IPW2200 is not set
# CONFIG_IWL4965 is not set
# CONFIG_IWL3945 is not set
# CONFIG_IWLWIFI is not set
CONFIG_WLAN_VENDOR_INTERSIL=y
# CONFIG_HOSTAP is not set
# CONFIG_HERMES is not set
# CONFIG_P54_COMMON is not set
# CONFIG_PRISM54 is not set
CONFIG_WLAN_VENDOR_MARVELL=y
# CONFIG_LIBERTAS is not set
# CONFIG_LIBERTAS_THINFIRM is not set
# CONFIG_MWIFIEX is not set
# CONFIG_MWL8K is not set
CONFIG_WLAN_VENDOR_MEDIATEK=y
# CONFIG_MT7601U is not set
# CONFIG_MT76x0U is not set
# CONFIG_MT76x0E is not set
# CONFIG_MT76x2E is not set
# CONFIG_MT76x2U is not set
# CONFIG_MT7603E is not set
# CONFIG_MT7615E is not set
# CONFIG_MT7663U is not set
# CONFIG_MT7663S is not set
# CONFIG_MT7915E is not set
CONFIG_WLAN_VENDOR_MICROCHIP=y
# CONFIG_WILC1000_SDIO is not set
# CONFIG_WILC1000_SPI is not set
CONFIG_WLAN_VENDOR_RALINK=y
# CONFIG_RT2X00 is not set
CONFIG_WLAN_VENDOR_REALTEK=y
# CONFIG_RTL8180 is not set
# CONFIG_RTL8187 is not set
CONFIG_RTL_CARDS=m
# CONFIG_RTL8192CE is not set
# CONFIG_RTL8192SE is not set
# CONFIG_RTL8192DE is not set
# CONFIG_RTL8723AE is not set
# CONFIG_RTL8723BE is not set
# CONFIG_RTL8188EE is not set
# CONFIG_RTL8192EE is not set
# CONFIG_RTL8821AE is not set
# CONFIG_RTL8192CU is not set
# CONFIG_RTL8XXXU is not set
# CONFIG_RTW88 is not set
CONFIG_WLAN_VENDOR_RSI=y
# CONFIG_RSI_91X is not set
CONFIG_WLAN_VENDOR_ST=y
# CONFIG_CW1200 is not set
CONFIG_WLAN_VENDOR_TI=y
# CONFIG_WL1251 is not set
# CONFIG_WL12XX is not set
# CONFIG_WL18XX is not set
# CONFIG_WLCORE is not set
CONFIG_WLAN_VENDOR_ZYDAS=y
# CONFIG_USB_ZD1201 is not set
# CONFIG_ZD1211RW is not set
CONFIG_WLAN_VENDOR_QUANTENNA=y
# CONFIG_QTNFMAC_PCIE is not set
CONFIG_MAC80211_HWSIM=m
# CONFIG_USB_NET_RNDIS_WLAN is not set
# CONFIG_VIRT_WIFI is not set

#
# Enable WiMAX (Networking options) to see the WiMAX drivers
#
# CONFIG_WAN is not set
CONFIG_IEEE802154_DRIVERS=m
# CONFIG_IEEE802154_FAKELB is not set
# CONFIG_IEEE802154_AT86RF230 is not set
# CONFIG_IEEE802154_MRF24J40 is not set
# CONFIG_IEEE802154_CC2520 is not set
# CONFIG_IEEE802154_ATUSB is not set
# CONFIG_IEEE802154_ADF7242 is not set
# CONFIG_IEEE802154_CA8210 is not set
# CONFIG_IEEE802154_MCR20A is not set
# CONFIG_IEEE802154_HWSIM is not set
CONFIG_XEN_NETDEV_FRONTEND=y
# CONFIG_VMXNET3 is not set
# CONFIG_FUJITSU_ES is not set
# CONFIG_HYPERV_NET is not set
CONFIG_NETDEVSIM=m
CONFIG_NET_FAILOVER=m
# CONFIG_ISDN is not set
CONFIG_NVM=y
# CONFIG_NVM_PBLK is not set

#
# Input device support
#
CONFIG_INPUT=y
CONFIG_INPUT_LEDS=y
CONFIG_INPUT_FF_MEMLESS=m
CONFIG_INPUT_POLLDEV=m
CONFIG_INPUT_SPARSEKMAP=m
# CONFIG_INPUT_MATRIXKMAP is not set

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
# CONFIG_INPUT_MOUSEDEV_PSAUX is not set
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
CONFIG_INPUT_JOYDEV=m
CONFIG_INPUT_EVDEV=y
# CONFIG_INPUT_EVBUG is not set

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
# CONFIG_KEYBOARD_ADP5588 is not set
# CONFIG_KEYBOARD_ADP5589 is not set
# CONFIG_KEYBOARD_APPLESPI is not set
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_QT1050 is not set
# CONFIG_KEYBOARD_QT1070 is not set
# CONFIG_KEYBOARD_QT2160 is not set
# CONFIG_KEYBOARD_DLINK_DIR685 is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_GPIO is not set
# CONFIG_KEYBOARD_GPIO_POLLED is not set
# CONFIG_KEYBOARD_TCA6416 is not set
# CONFIG_KEYBOARD_TCA8418 is not set
# CONFIG_KEYBOARD_MATRIX is not set
# CONFIG_KEYBOARD_LM8323 is not set
# CONFIG_KEYBOARD_LM8333 is not set
# CONFIG_KEYBOARD_MAX7359 is not set
# CONFIG_KEYBOARD_MCS is not set
# CONFIG_KEYBOARD_MPR121 is not set
# CONFIG_KEYBOARD_NEWTON is not set
# CONFIG_KEYBOARD_OPENCORES is not set
# CONFIG_KEYBOARD_SAMSUNG is not set
# CONFIG_KEYBOARD_STOWAWAY is not set
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_TM2_TOUCHKEY is not set
# CONFIG_KEYBOARD_XTKBD is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
CONFIG_MOUSE_PS2_ALPS=y
CONFIG_MOUSE_PS2_BYD=y
CONFIG_MOUSE_PS2_LOGIPS2PP=y
CONFIG_MOUSE_PS2_SYNAPTICS=y
CONFIG_MOUSE_PS2_SYNAPTICS_SMBUS=y
CONFIG_MOUSE_PS2_CYPRESS=y
CONFIG_MOUSE_PS2_LIFEBOOK=y
CONFIG_MOUSE_PS2_TRACKPOINT=y
CONFIG_MOUSE_PS2_ELANTECH=y
CONFIG_MOUSE_PS2_ELANTECH_SMBUS=y
CONFIG_MOUSE_PS2_SENTELIC=y
# CONFIG_MOUSE_PS2_TOUCHKIT is not set
CONFIG_MOUSE_PS2_FOCALTECH=y
CONFIG_MOUSE_PS2_VMMOUSE=y
CONFIG_MOUSE_PS2_SMBUS=y
CONFIG_MOUSE_SERIAL=m
# CONFIG_MOUSE_APPLETOUCH is not set
# CONFIG_MOUSE_BCM5974 is not set
CONFIG_MOUSE_CYAPA=m
CONFIG_MOUSE_ELAN_I2C=m
CONFIG_MOUSE_ELAN_I2C_I2C=y
CONFIG_MOUSE_ELAN_I2C_SMBUS=y
CONFIG_MOUSE_VSXXXAA=m
# CONFIG_MOUSE_GPIO is not set
CONFIG_MOUSE_SYNAPTICS_I2C=m
# CONFIG_MOUSE_SYNAPTICS_USB is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TABLET is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
# CONFIG_INPUT_MISC is not set
CONFIG_RMI4_CORE=m
CONFIG_RMI4_I2C=m
CONFIG_RMI4_SPI=m
CONFIG_RMI4_SMB=m
CONFIG_RMI4_F03=y
CONFIG_RMI4_F03_SERIO=m
CONFIG_RMI4_2D_SENSOR=y
CONFIG_RMI4_F11=y
CONFIG_RMI4_F12=y
CONFIG_RMI4_F30=y
CONFIG_RMI4_F34=y
# CONFIG_RMI4_F54 is not set
CONFIG_RMI4_F55=y

#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_ARCH_MIGHT_HAVE_PC_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_SERIO_SERPORT=y
# CONFIG_SERIO_CT82C710 is not set
# CONFIG_SERIO_PARKBD is not set
# CONFIG_SERIO_PCIPS2 is not set
CONFIG_SERIO_LIBPS2=y
CONFIG_SERIO_RAW=m
CONFIG_SERIO_ALTERA_PS2=m
# CONFIG_SERIO_PS2MULT is not set
CONFIG_SERIO_ARC_PS2=m
CONFIG_HYPERV_KEYBOARD=m
# CONFIG_SERIO_GPIO_PS2 is not set
# CONFIG_USERIO is not set
# CONFIG_GAMEPORT is not set
# end of Hardware I/O ports
# end of Input device support

#
# Character devices
#
CONFIG_TTY=y
CONFIG_VT=y
CONFIG_CONSOLE_TRANSLATIONS=y
CONFIG_VT_CONSOLE=y
CONFIG_VT_CONSOLE_SLEEP=y
CONFIG_HW_CONSOLE=y
CONFIG_VT_HW_CONSOLE_BINDING=y
CONFIG_UNIX98_PTYS=y
# CONFIG_LEGACY_PTYS is not set
CONFIG_LDISC_AUTOLOAD=y

#
# Serial drivers
#
CONFIG_SERIAL_EARLYCON=y
CONFIG_SERIAL_8250=y
# CONFIG_SERIAL_8250_DEPRECATED_OPTIONS is not set
CONFIG_SERIAL_8250_PNP=y
# CONFIG_SERIAL_8250_16550A_VARIANTS is not set
# CONFIG_SERIAL_8250_FINTEK is not set
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_SERIAL_8250_DMA=y
CONFIG_SERIAL_8250_PCI=y
CONFIG_SERIAL_8250_EXAR=y
CONFIG_SERIAL_8250_NR_UARTS=64
CONFIG_SERIAL_8250_RUNTIME_UARTS=4
CONFIG_SERIAL_8250_EXTENDED=y
CONFIG_SERIAL_8250_MANY_PORTS=y
CONFIG_SERIAL_8250_SHARE_IRQ=y
# CONFIG_SERIAL_8250_DETECT_IRQ is not set
CONFIG_SERIAL_8250_RSA=y
CONFIG_SERIAL_8250_DWLIB=y
CONFIG_SERIAL_8250_DW=y
# CONFIG_SERIAL_8250_RT288X is not set
CONFIG_SERIAL_8250_LPSS=y
CONFIG_SERIAL_8250_MID=y

#
# Non-8250 serial port support
#
# CONFIG_SERIAL_MAX3100 is not set
# CONFIG_SERIAL_MAX310X is not set
# CONFIG_SERIAL_UARTLITE is not set
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
CONFIG_SERIAL_JSM=m
# CONFIG_SERIAL_LANTIQ is not set
# CONFIG_SERIAL_SCCNXP is not set
# CONFIG_SERIAL_SC16IS7XX is not set
# CONFIG_SERIAL_ALTERA_JTAGUART is not set
# CONFIG_SERIAL_ALTERA_UART is not set
# CONFIG_SERIAL_IFX6X60 is not set
CONFIG_SERIAL_ARC=m
CONFIG_SERIAL_ARC_NR_PORTS=1
# CONFIG_SERIAL_RP2 is not set
# CONFIG_SERIAL_FSL_LPUART is not set
# CONFIG_SERIAL_FSL_LINFLEXUART is not set
# CONFIG_SERIAL_SPRD is not set
# end of Serial drivers

CONFIG_SERIAL_MCTRL_GPIO=y
CONFIG_SERIAL_NONSTANDARD=y
# CONFIG_ROCKETPORT is not set
CONFIG_CYCLADES=m
# CONFIG_CYZ_INTR is not set
# CONFIG_MOXA_INTELLIO is not set
# CONFIG_MOXA_SMARTIO is not set
CONFIG_SYNCLINK=m
CONFIG_SYNCLINKMP=m
CONFIG_SYNCLINK_GT=m
# CONFIG_ISI is not set
CONFIG_N_HDLC=m
CONFIG_N_GSM=m
CONFIG_NOZOMI=m
# CONFIG_NULL_TTY is not set
# CONFIG_TRACE_SINK is not set
CONFIG_HVC_DRIVER=y
CONFIG_HVC_IRQ=y
CONFIG_HVC_XEN=y
CONFIG_HVC_XEN_FRONTEND=y
# CONFIG_SERIAL_DEV_BUS is not set
CONFIG_PRINTER=m
# CONFIG_LP_CONSOLE is not set
CONFIG_PPDEV=m
CONFIG_VIRTIO_CONSOLE=y
CONFIG_IPMI_HANDLER=m
CONFIG_IPMI_DMI_DECODE=y
CONFIG_IPMI_PLAT_DATA=y
CONFIG_IPMI_PANIC_EVENT=y
CONFIG_IPMI_PANIC_STRING=y
CONFIG_IPMI_DEVICE_INTERFACE=m
CONFIG_IPMI_SI=m
CONFIG_IPMI_SSIF=m
CONFIG_IPMI_WATCHDOG=m
CONFIG_IPMI_POWEROFF=m
CONFIG_HW_RANDOM=y
CONFIG_HW_RANDOM_TIMERIOMEM=m
CONFIG_HW_RANDOM_INTEL=m
CONFIG_HW_RANDOM_AMD=m
# CONFIG_HW_RANDOM_BA431 is not set
CONFIG_HW_RANDOM_VIA=m
CONFIG_HW_RANDOM_VIRTIO=y
# CONFIG_APPLICOM is not set
# CONFIG_MWAVE is not set
CONFIG_DEVMEM=y
# CONFIG_DEVKMEM is not set
CONFIG_NVRAM=y
CONFIG_RAW_DRIVER=y
CONFIG_MAX_RAW_DEVS=8192
CONFIG_DEVPORT=y
CONFIG_HPET=y
CONFIG_HPET_MMAP=y
# CONFIG_HPET_MMAP_DEFAULT is not set
CONFIG_HANGCHECK_TIMER=m
CONFIG_UV_MMTIMER=m
CONFIG_TCG_TPM=y
CONFIG_HW_RANDOM_TPM=y
CONFIG_TCG_TIS_CORE=y
CONFIG_TCG_TIS=y
# CONFIG_TCG_TIS_SPI is not set
CONFIG_TCG_TIS_I2C_ATMEL=m
CONFIG_TCG_TIS_I2C_INFINEON=m
CONFIG_TCG_TIS_I2C_NUVOTON=m
CONFIG_TCG_NSC=m
CONFIG_TCG_ATMEL=m
CONFIG_TCG_INFINEON=m
# CONFIG_TCG_XEN is not set
CONFIG_TCG_CRB=y
# CONFIG_TCG_VTPM_PROXY is not set
CONFIG_TCG_TIS_ST33ZP24=m
CONFIG_TCG_TIS_ST33ZP24_I2C=m
# CONFIG_TCG_TIS_ST33ZP24_SPI is not set
CONFIG_TELCLOCK=m
# CONFIG_XILLYBUS is not set
# end of Character devices

# CONFIG_RANDOM_TRUST_CPU is not set
# CONFIG_RANDOM_TRUST_BOOTLOADER is not set

#
# I2C support
#
CONFIG_I2C=y
CONFIG_ACPI_I2C_OPREGION=y
CONFIG_I2C_BOARDINFO=y
CONFIG_I2C_COMPAT=y
CONFIG_I2C_CHARDEV=m
CONFIG_I2C_MUX=m

#
# Multiplexer I2C Chip support
#
# CONFIG_I2C_MUX_GPIO is not set
# CONFIG_I2C_MUX_LTC4306 is not set
# CONFIG_I2C_MUX_PCA9541 is not set
# CONFIG_I2C_MUX_PCA954x is not set
# CONFIG_I2C_MUX_REG is not set
CONFIG_I2C_MUX_MLXCPLD=m
# end of Multiplexer I2C Chip support

CONFIG_I2C_HELPER_AUTO=y
CONFIG_I2C_SMBUS=y
CONFIG_I2C_ALGOBIT=y
CONFIG_I2C_ALGOPCA=m

#
# I2C Hardware Bus support
#

#
# PC SMBus host controller drivers
#
# CONFIG_I2C_ALI1535 is not set
# CONFIG_I2C_ALI1563 is not set
# CONFIG_I2C_ALI15X3 is not set
CONFIG_I2C_AMD756=m
CONFIG_I2C_AMD756_S4882=m
CONFIG_I2C_AMD8111=m
# CONFIG_I2C_AMD_MP2 is not set
CONFIG_I2C_I801=y
CONFIG_I2C_ISCH=m
CONFIG_I2C_ISMT=m
CONFIG_I2C_PIIX4=m
CONFIG_I2C_NFORCE2=m
CONFIG_I2C_NFORCE2_S4985=m
# CONFIG_I2C_NVIDIA_GPU is not set
# CONFIG_I2C_SIS5595 is not set
# CONFIG_I2C_SIS630 is not set
CONFIG_I2C_SIS96X=m
CONFIG_I2C_VIA=m
CONFIG_I2C_VIAPRO=m

#
# ACPI drivers
#
CONFIG_I2C_SCMI=m

#
# I2C system bus drivers (mostly embedded / system-on-chip)
#
# CONFIG_I2C_CBUS_GPIO is not set
CONFIG_I2C_DESIGNWARE_CORE=m
# CONFIG_I2C_DESIGNWARE_SLAVE is not set
CONFIG_I2C_DESIGNWARE_PLATFORM=m
CONFIG_I2C_DESIGNWARE_BAYTRAIL=y
# CONFIG_I2C_DESIGNWARE_PCI is not set
# CONFIG_I2C_EMEV2 is not set
# CONFIG_I2C_GPIO is not set
# CONFIG_I2C_OCORES is not set
CONFIG_I2C_PCA_PLATFORM=m
CONFIG_I2C_SIMTEC=m
# CONFIG_I2C_XILINX is not set

#
# External I2C/SMBus adapter drivers
#
# CONFIG_I2C_DIOLAN_U2C is not set
CONFIG_I2C_PARPORT=m
# CONFIG_I2C_ROBOTFUZZ_OSIF is not set
# CONFIG_I2C_TAOS_EVM is not set
# CONFIG_I2C_TINY_USB is not set

#
# Other I2C/SMBus bus drivers
#
CONFIG_I2C_MLXCPLD=m
# end of I2C Hardware Bus support

CONFIG_I2C_STUB=m
# CONFIG_I2C_SLAVE is not set
# CONFIG_I2C_DEBUG_CORE is not set
# CONFIG_I2C_DEBUG_ALGO is not set
# CONFIG_I2C_DEBUG_BUS is not set
# end of I2C support

# CONFIG_I3C is not set
CONFIG_SPI=y
# CONFIG_SPI_DEBUG is not set
CONFIG_SPI_MASTER=y
# CONFIG_SPI_MEM is not set

#
# SPI Master Controller Drivers
#
# CONFIG_SPI_ALTERA is not set
# CONFIG_SPI_AXI_SPI_ENGINE is not set
# CONFIG_SPI_BITBANG is not set
# CONFIG_SPI_BUTTERFLY is not set
# CONFIG_SPI_CADENCE is not set
# CONFIG_SPI_DESIGNWARE is not set
# CONFIG_SPI_NXP_FLEXSPI is not set
# CONFIG_SPI_GPIO is not set
# CONFIG_SPI_LM70_LLP is not set
# CONFIG_SPI_LANTIQ_SSC is not set
# CONFIG_SPI_OC_TINY is not set
# CONFIG_SPI_PXA2XX is not set
# CONFIG_SPI_ROCKCHIP is not set
# CONFIG_SPI_SC18IS602 is not set
# CONFIG_SPI_SIFIVE is not set
# CONFIG_SPI_MXIC is not set
# CONFIG_SPI_XCOMM is not set
# CONFIG_SPI_XILINX is not set
# CONFIG_SPI_ZYNQMP_GQSPI is not set
# CONFIG_SPI_AMD is not set

#
# SPI Multiplexer support
#
# CONFIG_SPI_MUX is not set

#
# SPI Protocol Masters
#
# CONFIG_SPI_SPIDEV is not set
# CONFIG_SPI_LOOPBACK_TEST is not set
# CONFIG_SPI_TLE62X0 is not set
# CONFIG_SPI_SLAVE is not set
CONFIG_SPI_DYNAMIC=y
# CONFIG_SPMI is not set
# CONFIG_HSI is not set
CONFIG_PPS=y
# CONFIG_PPS_DEBUG is not set

#
# PPS clients support
#
# CONFIG_PPS_CLIENT_KTIMER is not set
CONFIG_PPS_CLIENT_LDISC=m
CONFIG_PPS_CLIENT_PARPORT=m
CONFIG_PPS_CLIENT_GPIO=m

#
# PPS generators support
#

#
# PTP clock support
#
CONFIG_PTP_1588_CLOCK=y
# CONFIG_DP83640_PHY is not set
# CONFIG_PTP_1588_CLOCK_INES is not set
CONFIG_PTP_1588_CLOCK_KVM=m
# CONFIG_PTP_1588_CLOCK_IDT82P33 is not set
# CONFIG_PTP_1588_CLOCK_IDTCM is not set
# CONFIG_PTP_1588_CLOCK_VMW is not set
# end of PTP clock support

CONFIG_PINCTRL=y
CONFIG_PINMUX=y
CONFIG_PINCONF=y
CONFIG_GENERIC_PINCONF=y
# CONFIG_DEBUG_PINCTRL is not set
CONFIG_PINCTRL_AMD=m
# CONFIG_PINCTRL_MCP23S08 is not set
# CONFIG_PINCTRL_SX150X is not set
CONFIG_PINCTRL_BAYTRAIL=y
# CONFIG_PINCTRL_CHERRYVIEW is not set
# CONFIG_PINCTRL_LYNXPOINT is not set
CONFIG_PINCTRL_INTEL=m
CONFIG_PINCTRL_BROXTON=m
CONFIG_PINCTRL_CANNONLAKE=m
CONFIG_PINCTRL_CEDARFORK=m
CONFIG_PINCTRL_DENVERTON=m
# CONFIG_PINCTRL_EMMITSBURG is not set
CONFIG_PINCTRL_GEMINILAKE=m
# CONFIG_PINCTRL_ICELAKE is not set
# CONFIG_PINCTRL_JASPERLAKE is not set
CONFIG_PINCTRL_LEWISBURG=m
CONFIG_PINCTRL_SUNRISEPOINT=m
# CONFIG_PINCTRL_TIGERLAKE is not set
CONFIG_GPIOLIB=y
CONFIG_GPIOLIB_FASTPATH_LIMIT=512
CONFIG_GPIO_ACPI=y
CONFIG_GPIOLIB_IRQCHIP=y
# CONFIG_DEBUG_GPIO is not set
CONFIG_GPIO_SYSFS=y
CONFIG_GPIO_GENERIC=m

#
# Memory mapped GPIO drivers
#
CONFIG_GPIO_AMDPT=m
# CONFIG_GPIO_DWAPB is not set
# CONFIG_GPIO_EXAR is not set
# CONFIG_GPIO_GENERIC_PLATFORM is not set
CONFIG_GPIO_ICH=m
# CONFIG_GPIO_MB86S7X is not set
# CONFIG_GPIO_VX855 is not set
# CONFIG_GPIO_XILINX is not set
# CONFIG_GPIO_AMD_FCH is not set
# end of Memory mapped GPIO drivers

#
# Port-mapped I/O GPIO drivers
#
# CONFIG_GPIO_F7188X is not set
# CONFIG_GPIO_IT87 is not set
# CONFIG_GPIO_SCH is not set
# CONFIG_GPIO_SCH311X is not set
# CONFIG_GPIO_WINBOND is not set
# CONFIG_GPIO_WS16C48 is not set
# end of Port-mapped I/O GPIO drivers

#
# I2C GPIO expanders
#
# CONFIG_GPIO_ADP5588 is not set
# CONFIG_GPIO_MAX7300 is not set
# CONFIG_GPIO_MAX732X is not set
# CONFIG_GPIO_PCA953X is not set
# CONFIG_GPIO_PCA9570 is not set
# CONFIG_GPIO_PCF857X is not set
# CONFIG_GPIO_TPIC2810 is not set
# end of I2C GPIO expanders

#
# MFD GPIO expanders
#
# end of MFD GPIO expanders

#
# PCI GPIO expanders
#
# CONFIG_GPIO_AMD8111 is not set
# CONFIG_GPIO_BT8XX is not set
# CONFIG_GPIO_ML_IOH is not set
# CONFIG_GPIO_PCI_IDIO_16 is not set
# CONFIG_GPIO_PCIE_IDIO_24 is not set
# CONFIG_GPIO_RDC321X is not set
# end of PCI GPIO expanders

#
# SPI GPIO expanders
#
# CONFIG_GPIO_MAX3191X is not set
# CONFIG_GPIO_MAX7301 is not set
# CONFIG_GPIO_MC33880 is not set
# CONFIG_GPIO_PISOSR is not set
# CONFIG_GPIO_XRA1403 is not set
# end of SPI GPIO expanders

#
# USB GPIO expanders
#
# end of USB GPIO expanders

# CONFIG_GPIO_AGGREGATOR is not set
# CONFIG_GPIO_MOCKUP is not set
# CONFIG_W1 is not set
# CONFIG_POWER_AVS is not set
CONFIG_POWER_RESET=y
# CONFIG_POWER_RESET_RESTART is not set
CONFIG_POWER_SUPPLY=y
# CONFIG_POWER_SUPPLY_DEBUG is not set
CONFIG_POWER_SUPPLY_HWMON=y
# CONFIG_PDA_POWER is not set
# CONFIG_TEST_POWER is not set
# CONFIG_CHARGER_ADP5061 is not set
# CONFIG_BATTERY_CW2015 is not set
# CONFIG_BATTERY_DS2780 is not set
# CONFIG_BATTERY_DS2781 is not set
# CONFIG_BATTERY_DS2782 is not set
# CONFIG_BATTERY_SBS is not set
# CONFIG_CHARGER_SBS is not set
# CONFIG_MANAGER_SBS is not set
# CONFIG_BATTERY_BQ27XXX is not set
# CONFIG_BATTERY_MAX17040 is not set
# CONFIG_BATTERY_MAX17042 is not set
# CONFIG_CHARGER_MAX8903 is not set
# CONFIG_CHARGER_LP8727 is not set
# CONFIG_CHARGER_GPIO is not set
# CONFIG_CHARGER_LT3651 is not set
# CONFIG_CHARGER_BQ2415X is not set
# CONFIG_CHARGER_BQ24257 is not set
# CONFIG_CHARGER_BQ24735 is not set
# CONFIG_CHARGER_BQ2515X is not set
# CONFIG_CHARGER_BQ25890 is not set
CONFIG_CHARGER_SMB347=m
# CONFIG_BATTERY_GAUGE_LTC2941 is not set
# CONFIG_CHARGER_RT9455 is not set
# CONFIG_CHARGER_BD99954 is not set
CONFIG_HWMON=y
CONFIG_HWMON_VID=m
# CONFIG_HWMON_DEBUG_CHIP is not set

#
# Native drivers
#
CONFIG_SENSORS_ABITUGURU=m
CONFIG_SENSORS_ABITUGURU3=m
# CONFIG_SENSORS_AD7314 is not set
CONFIG_SENSORS_AD7414=m
CONFIG_SENSORS_AD7418=m
CONFIG_SENSORS_ADM1021=m
CONFIG_SENSORS_ADM1025=m
CONFIG_SENSORS_ADM1026=m
CONFIG_SENSORS_ADM1029=m
CONFIG_SENSORS_ADM1031=m
# CONFIG_SENSORS_ADM1177 is not set
CONFIG_SENSORS_ADM9240=m
CONFIG_SENSORS_ADT7X10=m
# CONFIG_SENSORS_ADT7310 is not set
CONFIG_SENSORS_ADT7410=m
CONFIG_SENSORS_ADT7411=m
CONFIG_SENSORS_ADT7462=m
CONFIG_SENSORS_ADT7470=m
CONFIG_SENSORS_ADT7475=m
# CONFIG_SENSORS_AS370 is not set
CONFIG_SENSORS_ASC7621=m
# CONFIG_SENSORS_AXI_FAN_CONTROL is not set
CONFIG_SENSORS_K8TEMP=m
CONFIG_SENSORS_K10TEMP=m
CONFIG_SENSORS_FAM15H_POWER=m
# CONFIG_SENSORS_AMD_ENERGY is not set
CONFIG_SENSORS_APPLESMC=m
CONFIG_SENSORS_ASB100=m
# CONFIG_SENSORS_ASPEED is not set
CONFIG_SENSORS_ATXP1=m
# CONFIG_SENSORS_CORSAIR_CPRO is not set
# CONFIG_SENSORS_DRIVETEMP is not set
CONFIG_SENSORS_DS620=m
CONFIG_SENSORS_DS1621=m
CONFIG_SENSORS_DELL_SMM=m
CONFIG_SENSORS_I5K_AMB=m
CONFIG_SENSORS_F71805F=m
CONFIG_SENSORS_F71882FG=m
CONFIG_SENSORS_F75375S=m
CONFIG_SENSORS_FSCHMD=m
# CONFIG_SENSORS_FTSTEUTATES is not set
CONFIG_SENSORS_GL518SM=m
CONFIG_SENSORS_GL520SM=m
CONFIG_SENSORS_G760A=m
# CONFIG_SENSORS_G762 is not set
# CONFIG_SENSORS_HIH6130 is not set
CONFIG_SENSORS_IBMAEM=m
CONFIG_SENSORS_IBMPEX=m
CONFIG_SENSORS_I5500=m
CONFIG_SENSORS_CORETEMP=m
CONFIG_SENSORS_IT87=m
CONFIG_SENSORS_JC42=m
# CONFIG_SENSORS_POWR1220 is not set
CONFIG_SENSORS_LINEAGE=m
# CONFIG_SENSORS_LTC2945 is not set
# CONFIG_SENSORS_LTC2947_I2C is not set
# CONFIG_SENSORS_LTC2947_SPI is not set
# CONFIG_SENSORS_LTC2990 is not set
CONFIG_SENSORS_LTC4151=m
CONFIG_SENSORS_LTC4215=m
# CONFIG_SENSORS_LTC4222 is not set
CONFIG_SENSORS_LTC4245=m
# CONFIG_SENSORS_LTC4260 is not set
CONFIG_SENSORS_LTC4261=m
# CONFIG_SENSORS_MAX1111 is not set
CONFIG_SENSORS_MAX16065=m
CONFIG_SENSORS_MAX1619=m
CONFIG_SENSORS_MAX1668=m
CONFIG_SENSORS_MAX197=m
# CONFIG_SENSORS_MAX31722 is not set
# CONFIG_SENSORS_MAX31730 is not set
# CONFIG_SENSORS_MAX6621 is not set
CONFIG_SENSORS_MAX6639=m
CONFIG_SENSORS_MAX6642=m
CONFIG_SENSORS_MAX6650=m
CONFIG_SENSORS_MAX6697=m
# CONFIG_SENSORS_MAX31790 is not set
CONFIG_SENSORS_MCP3021=m
# CONFIG_SENSORS_MLXREG_FAN is not set
# CONFIG_SENSORS_TC654 is not set
# CONFIG_SENSORS_ADCXX is not set
CONFIG_SENSORS_LM63=m
# CONFIG_SENSORS_LM70 is not set
CONFIG_SENSORS_LM73=m
CONFIG_SENSORS_LM75=m
CONFIG_SENSORS_LM77=m
CONFIG_SENSORS_LM78=m
CONFIG_SENSORS_LM80=m
CONFIG_SENSORS_LM83=m
CONFIG_SENSORS_LM85=m
CONFIG_SENSORS_LM87=m
CONFIG_SENSORS_LM90=m
CONFIG_SENSORS_LM92=m
CONFIG_SENSORS_LM93=m
CONFIG_SENSORS_LM95234=m
CONFIG_SENSORS_LM95241=m
CONFIG_SENSORS_LM95245=m
CONFIG_SENSORS_PC87360=m
CONFIG_SENSORS_PC87427=m
CONFIG_SENSORS_NTC_THERMISTOR=m
# CONFIG_SENSORS_NCT6683 is not set
CONFIG_SENSORS_NCT6775=m
# CONFIG_SENSORS_NCT7802 is not set
# CONFIG_SENSORS_NCT7904 is not set
# CONFIG_SENSORS_NPCM7XX is not set
CONFIG_SENSORS_PCF8591=m
CONFIG_PMBUS=m
CONFIG_SENSORS_PMBUS=m
CONFIG_SENSORS_ADM1275=m
# CONFIG_SENSORS_BEL_PFE is not set
# CONFIG_SENSORS_IBM_CFFPS is not set
# CONFIG_SENSORS_INSPUR_IPSPS is not set
# CONFIG_SENSORS_IR35221 is not set
# CONFIG_SENSORS_IR38064 is not set
# CONFIG_SENSORS_IRPS5401 is not set
# CONFIG_SENSORS_ISL68137 is not set
CONFIG_SENSORS_LM25066=m
CONFIG_SENSORS_LTC2978=m
# CONFIG_SENSORS_LTC3815 is not set
CONFIG_SENSORS_MAX16064=m
# CONFIG_SENSORS_MAX16601 is not set
# CONFIG_SENSORS_MAX20730 is not set
# CONFIG_SENSORS_MAX20751 is not set
# CONFIG_SENSORS_MAX31785 is not set
CONFIG_SENSORS_MAX34440=m
CONFIG_SENSORS_MAX8688=m
# CONFIG_SENSORS_PXE1610 is not set
# CONFIG_SENSORS_TPS40422 is not set
# CONFIG_SENSORS_TPS53679 is not set
CONFIG_SENSORS_UCD9000=m
CONFIG_SENSORS_UCD9200=m
# CONFIG_SENSORS_XDPE122 is not set
CONFIG_SENSORS_ZL6100=m
CONFIG_SENSORS_SHT15=m
CONFIG_SENSORS_SHT21=m
# CONFIG_SENSORS_SHT3x is not set
# CONFIG_SENSORS_SHTC1 is not set
CONFIG_SENSORS_SIS5595=m
CONFIG_SENSORS_DME1737=m
CONFIG_SENSORS_EMC1403=m
# CONFIG_SENSORS_EMC2103 is not set
CONFIG_SENSORS_EMC6W201=m
CONFIG_SENSORS_SMSC47M1=m
CONFIG_SENSORS_SMSC47M192=m
CONFIG_SENSORS_SMSC47B397=m
CONFIG_SENSORS_SCH56XX_COMMON=m
CONFIG_SENSORS_SCH5627=m
CONFIG_SENSORS_SCH5636=m
# CONFIG_SENSORS_STTS751 is not set
# CONFIG_SENSORS_SMM665 is not set
# CONFIG_SENSORS_ADC128D818 is not set
CONFIG_SENSORS_ADS7828=m
# CONFIG_SENSORS_ADS7871 is not set
CONFIG_SENSORS_AMC6821=m
CONFIG_SENSORS_INA209=m
CONFIG_SENSORS_INA2XX=m
# CONFIG_SENSORS_INA3221 is not set
# CONFIG_SENSORS_TC74 is not set
CONFIG_SENSORS_THMC50=m
CONFIG_SENSORS_TMP102=m
# CONFIG_SENSORS_TMP103 is not set
# CONFIG_SENSORS_TMP108 is not set
CONFIG_SENSORS_TMP401=m
CONFIG_SENSORS_TMP421=m
# CONFIG_SENSORS_TMP513 is not set
CONFIG_SENSORS_VIA_CPUTEMP=m
CONFIG_SENSORS_VIA686A=m
CONFIG_SENSORS_VT1211=m
CONFIG_SENSORS_VT8231=m
# CONFIG_SENSORS_W83773G is not set
CONFIG_SENSORS_W83781D=m
CONFIG_SENSORS_W83791D=m
CONFIG_SENSORS_W83792D=m
CONFIG_SENSORS_W83793=m
CONFIG_SENSORS_W83795=m
# CONFIG_SENSORS_W83795_FANCTRL is not set
CONFIG_SENSORS_W83L785TS=m
CONFIG_SENSORS_W83L786NG=m
CONFIG_SENSORS_W83627HF=m
CONFIG_SENSORS_W83627EHF=m
# CONFIG_SENSORS_XGENE is not set

#
# ACPI drivers
#
CONFIG_SENSORS_ACPI_POWER=m
CONFIG_SENSORS_ATK0110=m
CONFIG_THERMAL=y
# CONFIG_THERMAL_NETLINK is not set
# CONFIG_THERMAL_STATISTICS is not set
CONFIG_THERMAL_EMERGENCY_POWEROFF_DELAY_MS=0
CONFIG_THERMAL_HWMON=y
CONFIG_THERMAL_WRITABLE_TRIPS=y
CONFIG_THERMAL_DEFAULT_GOV_STEP_WISE=y
# CONFIG_THERMAL_DEFAULT_GOV_FAIR_SHARE is not set
# CONFIG_THERMAL_DEFAULT_GOV_USER_SPACE is not set
CONFIG_THERMAL_GOV_FAIR_SHARE=y
CONFIG_THERMAL_GOV_STEP_WISE=y
CONFIG_THERMAL_GOV_BANG_BANG=y
CONFIG_THERMAL_GOV_USER_SPACE=y
# CONFIG_THERMAL_EMULATION is not set

#
# Intel thermal drivers
#
CONFIG_INTEL_POWERCLAMP=m
CONFIG_X86_PKG_TEMP_THERMAL=m
CONFIG_INTEL_SOC_DTS_IOSF_CORE=m
# CONFIG_INTEL_SOC_DTS_THERMAL is not set

#
# ACPI INT340X thermal drivers
#
CONFIG_INT340X_THERMAL=m
CONFIG_ACPI_THERMAL_REL=m
# CONFIG_INT3406_THERMAL is not set
CONFIG_PROC_THERMAL_MMIO_RAPL=y
# end of ACPI INT340X thermal drivers

CONFIG_INTEL_PCH_THERMAL=m
# end of Intel thermal drivers

CONFIG_WATCHDOG=y
CONFIG_WATCHDOG_CORE=y
# CONFIG_WATCHDOG_NOWAYOUT is not set
CONFIG_WATCHDOG_HANDLE_BOOT_ENABLED=y
CONFIG_WATCHDOG_OPEN_TIMEOUT=0
CONFIG_WATCHDOG_SYSFS=y

#
# Watchdog Pretimeout Governors
#
# CONFIG_WATCHDOG_PRETIMEOUT_GOV is not set

#
# Watchdog Device Drivers
#
CONFIG_SOFT_WATCHDOG=m
CONFIG_WDAT_WDT=m
# CONFIG_XILINX_WATCHDOG is not set
# CONFIG_ZIIRAVE_WATCHDOG is not set
# CONFIG_MLX_WDT is not set
# CONFIG_CADENCE_WATCHDOG is not set
# CONFIG_DW_WATCHDOG is not set
# CONFIG_MAX63XX_WATCHDOG is not set
# CONFIG_ACQUIRE_WDT is not set
# CONFIG_ADVANTECH_WDT is not set
CONFIG_ALIM1535_WDT=m
CONFIG_ALIM7101_WDT=m
# CONFIG_EBC_C384_WDT is not set
CONFIG_F71808E_WDT=m
CONFIG_SP5100_TCO=m
CONFIG_SBC_FITPC2_WATCHDOG=m
# CONFIG_EUROTECH_WDT is not set
CONFIG_IB700_WDT=m
CONFIG_IBMASR=m
# CONFIG_WAFER_WDT is not set
CONFIG_I6300ESB_WDT=y
CONFIG_IE6XX_WDT=m
CONFIG_ITCO_WDT=y
CONFIG_ITCO_VENDOR_SUPPORT=y
CONFIG_IT8712F_WDT=m
CONFIG_IT87_WDT=m
CONFIG_HP_WATCHDOG=m
CONFIG_HPWDT_NMI_DECODING=y
# CONFIG_SC1200_WDT is not set
# CONFIG_PC87413_WDT is not set
CONFIG_NV_TCO=m
# CONFIG_60XX_WDT is not set
# CONFIG_CPU5_WDT is not set
CONFIG_SMSC_SCH311X_WDT=m
# CONFIG_SMSC37B787_WDT is not set
# CONFIG_TQMX86_WDT is not set
CONFIG_VIA_WDT=m
CONFIG_W83627HF_WDT=m
CONFIG_W83877F_WDT=m
CONFIG_W83977F_WDT=m
CONFIG_MACHZ_WDT=m
# CONFIG_SBC_EPX_C3_WATCHDOG is not set
CONFIG_INTEL_MEI_WDT=m
# CONFIG_NI903X_WDT is not set
# CONFIG_NIC7018_WDT is not set
# CONFIG_MEN_A21_WDT is not set
CONFIG_XEN_WDT=m

#
# PCI-based Watchdog Cards
#
CONFIG_PCIPCWATCHDOG=m
CONFIG_WDTPCI=m

#
# USB-based Watchdog Cards
#
# CONFIG_USBPCWATCHDOG is not set
CONFIG_SSB_POSSIBLE=y
# CONFIG_SSB is not set
CONFIG_BCMA_POSSIBLE=y
CONFIG_BCMA=m
CONFIG_BCMA_HOST_PCI_POSSIBLE=y
CONFIG_BCMA_HOST_PCI=y
# CONFIG_BCMA_HOST_SOC is not set
CONFIG_BCMA_DRIVER_PCI=y
CONFIG_BCMA_DRIVER_GMAC_CMN=y
CONFIG_BCMA_DRIVER_GPIO=y
# CONFIG_BCMA_DEBUG is not set

#
# Multifunction device drivers
#
CONFIG_MFD_CORE=y
# CONFIG_MFD_AS3711 is not set
# CONFIG_PMIC_ADP5520 is not set
# CONFIG_MFD_AAT2870_CORE is not set
# CONFIG_MFD_BCM590XX is not set
# CONFIG_MFD_BD9571MWV is not set
# CONFIG_MFD_AXP20X_I2C is not set
# CONFIG_MFD_MADERA is not set
# CONFIG_PMIC_DA903X is not set
# CONFIG_MFD_DA9052_SPI is not set
# CONFIG_MFD_DA9052_I2C is not set
# CONFIG_MFD_DA9055 is not set
# CONFIG_MFD_DA9062 is not set
# CONFIG_MFD_DA9063 is not set
# CONFIG_MFD_DA9150 is not set
# CONFIG_MFD_DLN2 is not set
# CONFIG_MFD_MC13XXX_SPI is not set
# CONFIG_MFD_MC13XXX_I2C is not set
# CONFIG_MFD_MP2629 is not set
# CONFIG_HTC_PASIC3 is not set
# CONFIG_HTC_I2CPLD is not set
# CONFIG_MFD_INTEL_QUARK_I2C_GPIO is not set
CONFIG_LPC_ICH=y
CONFIG_LPC_SCH=m
# CONFIG_INTEL_SOC_PMIC_CHTDC_TI is not set
CONFIG_MFD_INTEL_LPSS=y
CONFIG_MFD_INTEL_LPSS_ACPI=y
CONFIG_MFD_INTEL_LPSS_PCI=y
# CONFIG_MFD_INTEL_PMC_BXT is not set
# CONFIG_MFD_IQS62X is not set
# CONFIG_MFD_JANZ_CMODIO is not set
# CONFIG_MFD_KEMPLD is not set
# CONFIG_MFD_88PM800 is not set
# CONFIG_MFD_88PM805 is not set
# CONFIG_MFD_88PM860X is not set
# CONFIG_MFD_MAX14577 is not set
# CONFIG_MFD_MAX77693 is not set
# CONFIG_MFD_MAX77843 is not set
# CONFIG_MFD_MAX8907 is not set
# CONFIG_MFD_MAX8925 is not set
# CONFIG_MFD_MAX8997 is not set
# CONFIG_MFD_MAX8998 is not set
# CONFIG_MFD_MT6360 is not set
# CONFIG_MFD_MT6397 is not set
# CONFIG_MFD_MENF21BMC is not set
# CONFIG_EZX_PCAP is not set
# CONFIG_MFD_VIPERBOARD is not set
# CONFIG_MFD_RETU is not set
# CONFIG_MFD_PCF50633 is not set
# CONFIG_MFD_RDC321X is not set
# CONFIG_MFD_RT5033 is not set
# CONFIG_MFD_RC5T583 is not set
# CONFIG_MFD_SEC_CORE is not set
# CONFIG_MFD_SI476X_CORE is not set
CONFIG_MFD_SM501=m
CONFIG_MFD_SM501_GPIO=y
# CONFIG_MFD_SKY81452 is not set
# CONFIG_ABX500_CORE is not set
# CONFIG_MFD_SYSCON is not set
# CONFIG_MFD_TI_AM335X_TSCADC is not set
# CONFIG_MFD_LP3943 is not set
# CONFIG_MFD_LP8788 is not set
# CONFIG_MFD_TI_LMU is not set
# CONFIG_MFD_PALMAS is not set
# CONFIG_TPS6105X is not set
# CONFIG_TPS65010 is not set
# CONFIG_TPS6507X is not set
# CONFIG_MFD_TPS65086 is not set
# CONFIG_MFD_TPS65090 is not set
# CONFIG_MFD_TI_LP873X is not set
# CONFIG_MFD_TPS6586X is not set
# CONFIG_MFD_TPS65910 is not set
# CONFIG_MFD_TPS65912_I2C is not set
# CONFIG_MFD_TPS65912_SPI is not set
# CONFIG_MFD_TPS80031 is not set
# CONFIG_TWL4030_CORE is not set
# CONFIG_TWL6040_CORE is not set
# CONFIG_MFD_WL1273_CORE is not set
# CONFIG_MFD_LM3533 is not set
# CONFIG_MFD_TQMX86 is not set
CONFIG_MFD_VX855=m
# CONFIG_MFD_ARIZONA_I2C is not set
# CONFIG_MFD_ARIZONA_SPI is not set
# CONFIG_MFD_WM8400 is not set
# CONFIG_MFD_WM831X_I2C is not set
# CONFIG_MFD_WM831X_SPI is not set
# CONFIG_MFD_WM8350_I2C is not set
# CONFIG_MFD_WM8994 is not set
# end of Multifunction device drivers

# CONFIG_REGULATOR is not set
CONFIG_RC_CORE=m
CONFIG_RC_MAP=m
CONFIG_LIRC=y
CONFIG_RC_DECODERS=y
CONFIG_IR_NEC_DECODER=m
CONFIG_IR_RC5_DECODER=m
CONFIG_IR_RC6_DECODER=m
CONFIG_IR_JVC_DECODER=m
CONFIG_IR_SONY_DECODER=m
CONFIG_IR_SANYO_DECODER=m
# CONFIG_IR_SHARP_DECODER is not set
CONFIG_IR_MCE_KBD_DECODER=m
# CONFIG_IR_XMP_DECODER is not set
CONFIG_IR_IMON_DECODER=m
# CONFIG_IR_RCMM_DECODER is not set
CONFIG_RC_DEVICES=y
# CONFIG_RC_ATI_REMOTE is not set
CONFIG_IR_ENE=m
# CONFIG_IR_IMON is not set
# CONFIG_IR_IMON_RAW is not set
# CONFIG_IR_MCEUSB is not set
CONFIG_IR_ITE_CIR=m
CONFIG_IR_FINTEK=m
CONFIG_IR_NUVOTON=m
# CONFIG_IR_REDRAT3 is not set
# CONFIG_IR_STREAMZAP is not set
CONFIG_IR_WINBOND_CIR=m
# CONFIG_IR_IGORPLUGUSB is not set
# CONFIG_IR_IGUANA is not set
# CONFIG_IR_TTUSBIR is not set
# CONFIG_RC_LOOPBACK is not set
CONFIG_IR_SERIAL=m
CONFIG_IR_SERIAL_TRANSMITTER=y
CONFIG_IR_SIR=m
# CONFIG_RC_XBOX_DVD is not set
# CONFIG_IR_TOY is not set
CONFIG_MEDIA_CEC_SUPPORT=y
# CONFIG_CEC_CH7322 is not set
# CONFIG_CEC_SECO is not set
# CONFIG_USB_PULSE8_CEC is not set
# CONFIG_USB_RAINSHADOW_CEC is not set
CONFIG_MEDIA_SUPPORT=m
# CONFIG_MEDIA_SUPPORT_FILTER is not set
# CONFIG_MEDIA_SUBDRV_AUTOSELECT is not set

#
# Media device types
#
CONFIG_MEDIA_CAMERA_SUPPORT=y
CONFIG_MEDIA_ANALOG_TV_SUPPORT=y
CONFIG_MEDIA_DIGITAL_TV_SUPPORT=y
CONFIG_MEDIA_RADIO_SUPPORT=y
CONFIG_MEDIA_SDR_SUPPORT=y
CONFIG_MEDIA_PLATFORM_SUPPORT=y
CONFIG_MEDIA_TEST_SUPPORT=y
# end of Media device types

#
# Media core support
#
CONFIG_VIDEO_DEV=m
CONFIG_MEDIA_CONTROLLER=y
CONFIG_DVB_CORE=m
# end of Media core support

#
# Video4Linux options
#
CONFIG_VIDEO_V4L2=m
CONFIG_VIDEO_V4L2_I2C=y
CONFIG_VIDEO_V4L2_SUBDEV_API=y
# CONFIG_VIDEO_ADV_DEBUG is not set
# CONFIG_VIDEO_FIXED_MINOR_RANGES is not set
# end of Video4Linux options

#
# Media controller options
#
# CONFIG_MEDIA_CONTROLLER_DVB is not set
# end of Media controller options

#
# Digital TV options
#
# CONFIG_DVB_MMAP is not set
CONFIG_DVB_NET=y
CONFIG_DVB_MAX_ADAPTERS=16
CONFIG_DVB_DYNAMIC_MINORS=y
# CONFIG_DVB_DEMUX_SECTION_LOSS_LOG is not set
# CONFIG_DVB_ULE_DEBUG is not set
# end of Digital TV options

#
# Media drivers
#
# CONFIG_MEDIA_USB_SUPPORT is not set
# CONFIG_MEDIA_PCI_SUPPORT is not set
CONFIG_RADIO_ADAPTERS=y
# CONFIG_RADIO_SI470X is not set
# CONFIG_RADIO_SI4713 is not set
# CONFIG_USB_MR800 is not set
# CONFIG_USB_DSBR is not set
# CONFIG_RADIO_MAXIRADIO is not set
# CONFIG_RADIO_SHARK is not set
# CONFIG_RADIO_SHARK2 is not set
# CONFIG_USB_KEENE is not set
# CONFIG_USB_RAREMONO is not set
# CONFIG_USB_MA901 is not set
# CONFIG_RADIO_TEA5764 is not set
# CONFIG_RADIO_SAA7706H is not set
# CONFIG_RADIO_TEF6862 is not set
# CONFIG_RADIO_WL1273 is not set
CONFIG_VIDEOBUF2_CORE=m
CONFIG_VIDEOBUF2_V4L2=m
CONFIG_VIDEOBUF2_MEMOPS=m
CONFIG_VIDEOBUF2_VMALLOC=m
# CONFIG_V4L_PLATFORM_DRIVERS is not set
# CONFIG_V4L_MEM2MEM_DRIVERS is not set
# CONFIG_DVB_PLATFORM_DRIVERS is not set
# CONFIG_SDR_PLATFORM_DRIVERS is not set

#
# MMC/SDIO DVB adapters
#
# CONFIG_SMS_SDIO_DRV is not set
# CONFIG_V4L_TEST_DRIVERS is not set

#
# FireWire (IEEE 1394) Adapters
#
# CONFIG_DVB_FIREDTV is not set
# end of Media drivers

#
# Media ancillary drivers
#
CONFIG_MEDIA_ATTACH=y
CONFIG_VIDEO_IR_I2C=m

#
# Audio decoders, processors and mixers
#
# CONFIG_VIDEO_TVAUDIO is not set
# CONFIG_VIDEO_TDA7432 is not set
# CONFIG_VIDEO_TDA9840 is not set
# CONFIG_VIDEO_TEA6415C is not set
# CONFIG_VIDEO_TEA6420 is not set
# CONFIG_VIDEO_MSP3400 is not set
# CONFIG_VIDEO_CS3308 is not set
# CONFIG_VIDEO_CS5345 is not set
# CONFIG_VIDEO_CS53L32A is not set
# CONFIG_VIDEO_TLV320AIC23B is not set
# CONFIG_VIDEO_UDA1342 is not set
# CONFIG_VIDEO_WM8775 is not set
# CONFIG_VIDEO_WM8739 is not set
# CONFIG_VIDEO_VP27SMPX is not set
# CONFIG_VIDEO_SONY_BTF_MPX is not set
# end of Audio decoders, processors and mixers

#
# RDS decoders
#
# CONFIG_VIDEO_SAA6588 is not set
# end of RDS decoders

#
# Video decoders
#
# CONFIG_VIDEO_ADV7180 is not set
# CONFIG_VIDEO_ADV7183 is not set
# CONFIG_VIDEO_ADV7604 is not set
# CONFIG_VIDEO_ADV7842 is not set
# CONFIG_VIDEO_BT819 is not set
# CONFIG_VIDEO_BT856 is not set
# CONFIG_VIDEO_BT866 is not set
# CONFIG_VIDEO_KS0127 is not set
# CONFIG_VIDEO_ML86V7667 is not set
# CONFIG_VIDEO_SAA7110 is not set
# CONFIG_VIDEO_SAA711X is not set
# CONFIG_VIDEO_TC358743 is not set
# CONFIG_VIDEO_TVP514X is not set
# CONFIG_VIDEO_TVP5150 is not set
# CONFIG_VIDEO_TVP7002 is not set
# CONFIG_VIDEO_TW2804 is not set
# CONFIG_VIDEO_TW9903 is not set
# CONFIG_VIDEO_TW9906 is not set
# CONFIG_VIDEO_TW9910 is not set
# CONFIG_VIDEO_VPX3220 is not set

#
# Video and audio decoders
#
# CONFIG_VIDEO_SAA717X is not set
# CONFIG_VIDEO_CX25840 is not set
# end of Video decoders

#
# Video encoders
#
# CONFIG_VIDEO_SAA7127 is not set
# CONFIG_VIDEO_SAA7185 is not set
# CONFIG_VIDEO_ADV7170 is not set
# CONFIG_VIDEO_ADV7175 is not set
# CONFIG_VIDEO_ADV7343 is not set
# CONFIG_VIDEO_ADV7393 is not set
# CONFIG_VIDEO_ADV7511 is not set
# CONFIG_VIDEO_AD9389B is not set
# CONFIG_VIDEO_AK881X is not set
# CONFIG_VIDEO_THS8200 is not set
# end of Video encoders

#
# Video improvement chips
#
# CONFIG_VIDEO_UPD64031A is not set
# CONFIG_VIDEO_UPD64083 is not set
# end of Video improvement chips

#
# Audio/Video compression chips
#
# CONFIG_VIDEO_SAA6752HS is not set
# end of Audio/Video compression chips

#
# SDR tuner chips
#
# CONFIG_SDR_MAX2175 is not set
# end of SDR tuner chips

#
# Miscellaneous helper chips
#
# CONFIG_VIDEO_THS7303 is not set
# CONFIG_VIDEO_M52790 is not set
# CONFIG_VIDEO_I2C is not set
# CONFIG_VIDEO_ST_MIPID02 is not set
# end of Miscellaneous helper chips

#
# Camera sensor devices
#
# CONFIG_VIDEO_HI556 is not set
# CONFIG_VIDEO_IMX214 is not set
# CONFIG_VIDEO_IMX219 is not set
# CONFIG_VIDEO_IMX258 is not set
# CONFIG_VIDEO_IMX274 is not set
# CONFIG_VIDEO_IMX290 is not set
# CONFIG_VIDEO_IMX319 is not set
# CONFIG_VIDEO_IMX355 is not set
# CONFIG_VIDEO_OV2640 is not set
# CONFIG_VIDEO_OV2659 is not set
# CONFIG_VIDEO_OV2680 is not set
# CONFIG_VIDEO_OV2685 is not set
# CONFIG_VIDEO_OV2740 is not set
# CONFIG_VIDEO_OV5647 is not set
# CONFIG_VIDEO_OV6650 is not set
# CONFIG_VIDEO_OV5670 is not set
# CONFIG_VIDEO_OV5675 is not set
# CONFIG_VIDEO_OV5695 is not set
# CONFIG_VIDEO_OV7251 is not set
# CONFIG_VIDEO_OV772X is not set
# CONFIG_VIDEO_OV7640 is not set
# CONFIG_VIDEO_OV7670 is not set
# CONFIG_VIDEO_OV7740 is not set
# CONFIG_VIDEO_OV8856 is not set
# CONFIG_VIDEO_OV9640 is not set
# CONFIG_VIDEO_OV9650 is not set
# CONFIG_VIDEO_OV13858 is not set
# CONFIG_VIDEO_VS6624 is not set
# CONFIG_VIDEO_MT9M001 is not set
# CONFIG_VIDEO_MT9M032 is not set
# CONFIG_VIDEO_MT9M111 is not set
# CONFIG_VIDEO_MT9P031 is not set
# CONFIG_VIDEO_MT9T001 is not set
# CONFIG_VIDEO_MT9T112 is not set
# CONFIG_VIDEO_MT9V011 is not set
# CONFIG_VIDEO_MT9V032 is not set
# CONFIG_VIDEO_MT9V111 is not set
# CONFIG_VIDEO_SR030PC30 is not set
# CONFIG_VIDEO_NOON010PC30 is not set
# CONFIG_VIDEO_M5MOLS is not set
# CONFIG_VIDEO_RDACM20 is not set
# CONFIG_VIDEO_RJ54N1 is not set
# CONFIG_VIDEO_S5K6AA is not set
# CONFIG_VIDEO_S5K6A3 is not set
# CONFIG_VIDEO_S5K4ECGX is not set
# CONFIG_VIDEO_S5K5BAF is not set
# CONFIG_VIDEO_SMIAPP is not set
# CONFIG_VIDEO_ET8EK8 is not set
# CONFIG_VIDEO_S5C73M3 is not set
# end of Camera sensor devices

#
# Lens drivers
#
# CONFIG_VIDEO_AD5820 is not set
# CONFIG_VIDEO_AK7375 is not set
# CONFIG_VIDEO_DW9714 is not set
# CONFIG_VIDEO_DW9768 is not set
# CONFIG_VIDEO_DW9807_VCM is not set
# end of Lens drivers

#
# Flash devices
#
# CONFIG_VIDEO_ADP1653 is not set
# CONFIG_VIDEO_LM3560 is not set
# CONFIG_VIDEO_LM3646 is not set
# end of Flash devices

#
# SPI helper chips
#
# CONFIG_VIDEO_GS1662 is not set
# end of SPI helper chips

#
# Media SPI Adapters
#
CONFIG_CXD2880_SPI_DRV=m
# end of Media SPI Adapters

CONFIG_MEDIA_TUNER=m

#
# Customize TV tuners
#
CONFIG_MEDIA_TUNER_SIMPLE=m
CONFIG_MEDIA_TUNER_TDA18250=m
CONFIG_MEDIA_TUNER_TDA8290=m
CONFIG_MEDIA_TUNER_TDA827X=m
CONFIG_MEDIA_TUNER_TDA18271=m
CONFIG_MEDIA_TUNER_TDA9887=m
CONFIG_MEDIA_TUNER_TEA5761=m
CONFIG_MEDIA_TUNER_TEA5767=m
CONFIG_MEDIA_TUNER_MSI001=m
CONFIG_MEDIA_TUNER_MT20XX=m
CONFIG_MEDIA_TUNER_MT2060=m
CONFIG_MEDIA_TUNER_MT2063=m
CONFIG_MEDIA_TUNER_MT2266=m
CONFIG_MEDIA_TUNER_MT2131=m
CONFIG_MEDIA_TUNER_QT1010=m
CONFIG_MEDIA_TUNER_XC2028=m
CONFIG_MEDIA_TUNER_XC5000=m
CONFIG_MEDIA_TUNER_XC4000=m
CONFIG_MEDIA_TUNER_MXL5005S=m
CONFIG_MEDIA_TUNER_MXL5007T=m
CONFIG_MEDIA_TUNER_MC44S803=m
CONFIG_MEDIA_TUNER_MAX2165=m
CONFIG_MEDIA_TUNER_TDA18218=m
CONFIG_MEDIA_TUNER_FC0011=m
CONFIG_MEDIA_TUNER_FC0012=m
CONFIG_MEDIA_TUNER_FC0013=m
CONFIG_MEDIA_TUNER_TDA18212=m
CONFIG_MEDIA_TUNER_E4000=m
CONFIG_MEDIA_TUNER_FC2580=m
CONFIG_MEDIA_TUNER_M88RS6000T=m
CONFIG_MEDIA_TUNER_TUA9001=m
CONFIG_MEDIA_TUNER_SI2157=m
CONFIG_MEDIA_TUNER_IT913X=m
CONFIG_MEDIA_TUNER_R820T=m
CONFIG_MEDIA_TUNER_MXL301RF=m
CONFIG_MEDIA_TUNER_QM1D1C0042=m
CONFIG_MEDIA_TUNER_QM1D1B0004=m
# end of Customize TV tuners

#
# Customise DVB Frontends
#

#
# Multistandard (satellite) frontends
#
CONFIG_DVB_STB0899=m
CONFIG_DVB_STB6100=m
CONFIG_DVB_STV090x=m
CONFIG_DVB_STV0910=m
CONFIG_DVB_STV6110x=m
CONFIG_DVB_STV6111=m
CONFIG_DVB_MXL5XX=m
CONFIG_DVB_M88DS3103=m

#
# Multistandard (cable + terrestrial) frontends
#
CONFIG_DVB_DRXK=m
CONFIG_DVB_TDA18271C2DD=m
CONFIG_DVB_SI2165=m
CONFIG_DVB_MN88472=m
CONFIG_DVB_MN88473=m

#
# DVB-S (satellite) frontends
#
CONFIG_DVB_CX24110=m
CONFIG_DVB_CX24123=m
CONFIG_DVB_MT312=m
CONFIG_DVB_ZL10036=m
CONFIG_DVB_ZL10039=m
CONFIG_DVB_S5H1420=m
CONFIG_DVB_STV0288=m
CONFIG_DVB_STB6000=m
CONFIG_DVB_STV0299=m
CONFIG_DVB_STV6110=m
CONFIG_DVB_STV0900=m
CONFIG_DVB_TDA8083=m
CONFIG_DVB_TDA10086=m
CONFIG_DVB_TDA8261=m
CONFIG_DVB_VES1X93=m
CONFIG_DVB_TUNER_ITD1000=m
CONFIG_DVB_TUNER_CX24113=m
CONFIG_DVB_TDA826X=m
CONFIG_DVB_TUA6100=m
CONFIG_DVB_CX24116=m
CONFIG_DVB_CX24117=m
CONFIG_DVB_CX24120=m
CONFIG_DVB_SI21XX=m
CONFIG_DVB_TS2020=m
CONFIG_DVB_DS3000=m
CONFIG_DVB_MB86A16=m
CONFIG_DVB_TDA10071=m

#
# DVB-T (terrestrial) frontends
#
CONFIG_DVB_SP8870=m
CONFIG_DVB_SP887X=m
CONFIG_DVB_CX22700=m
CONFIG_DVB_CX22702=m
CONFIG_DVB_S5H1432=m
CONFIG_DVB_DRXD=m
CONFIG_DVB_L64781=m
CONFIG_DVB_TDA1004X=m
CONFIG_DVB_NXT6000=m
CONFIG_DVB_MT352=m
CONFIG_DVB_ZL10353=m
CONFIG_DVB_DIB3000MB=m
CONFIG_DVB_DIB3000MC=m
CONFIG_DVB_DIB7000M=m
CONFIG_DVB_DIB7000P=m
CONFIG_DVB_DIB9000=m
CONFIG_DVB_TDA10048=m
CONFIG_DVB_AF9013=m
CONFIG_DVB_EC100=m
CONFIG_DVB_STV0367=m
CONFIG_DVB_CXD2820R=m
CONFIG_DVB_CXD2841ER=m
CONFIG_DVB_RTL2830=m
CONFIG_DVB_RTL2832=m
CONFIG_DVB_RTL2832_SDR=m
CONFIG_DVB_SI2168=m
CONFIG_DVB_ZD1301_DEMOD=m
CONFIG_DVB_CXD2880=m

#
# DVB-C (cable) frontends
#
CONFIG_DVB_VES1820=m
CONFIG_DVB_TDA10021=m
CONFIG_DVB_TDA10023=m
CONFIG_DVB_STV0297=m

#
# ATSC (North American/Korean Terrestrial/Cable DTV) frontends
#
CONFIG_DVB_NXT200X=m
CONFIG_DVB_OR51211=m
CONFIG_DVB_OR51132=m
CONFIG_DVB_BCM3510=m
CONFIG_DVB_LGDT330X=m
CONFIG_DVB_LGDT3305=m
CONFIG_DVB_LGDT3306A=m
CONFIG_DVB_LG2160=m
CONFIG_DVB_S5H1409=m
CONFIG_DVB_AU8522=m
CONFIG_DVB_AU8522_DTV=m
CONFIG_DVB_AU8522_V4L=m
CONFIG_DVB_S5H1411=m

#
# ISDB-T (terrestrial) frontends
#
CONFIG_DVB_S921=m
CONFIG_DVB_DIB8000=m
CONFIG_DVB_MB86A20S=m

#
# ISDB-S (satellite) & ISDB-T (terrestrial) frontends
#
CONFIG_DVB_TC90522=m
CONFIG_DVB_MN88443X=m

#
# Digital terrestrial only tuners/PLL
#
CONFIG_DVB_PLL=m
CONFIG_DVB_TUNER_DIB0070=m
CONFIG_DVB_TUNER_DIB0090=m

#
# SEC control devices for DVB-S
#
CONFIG_DVB_DRX39XYJ=m
CONFIG_DVB_LNBH25=m
CONFIG_DVB_LNBH29=m
CONFIG_DVB_LNBP21=m
CONFIG_DVB_LNBP22=m
CONFIG_DVB_ISL6405=m
CONFIG_DVB_ISL6421=m
CONFIG_DVB_ISL6423=m
CONFIG_DVB_A8293=m
CONFIG_DVB_LGS8GL5=m
CONFIG_DVB_LGS8GXX=m
CONFIG_DVB_ATBM8830=m
CONFIG_DVB_TDA665x=m
CONFIG_DVB_IX2505V=m
CONFIG_DVB_M88RS2000=m
CONFIG_DVB_AF9033=m
CONFIG_DVB_HORUS3A=m
CONFIG_DVB_ASCOT2E=m
CONFIG_DVB_HELENE=m

#
# Common Interface (EN50221) controller drivers
#
CONFIG_DVB_CXD2099=m
CONFIG_DVB_SP2=m
# end of Customise DVB Frontends

#
# Tools to develop new frontends
#
# CONFIG_DVB_DUMMY_FE is not set
# end of Media ancillary drivers

#
# Graphics support
#
# CONFIG_AGP is not set
CONFIG_INTEL_GTT=m
CONFIG_VGA_ARB=y
CONFIG_VGA_ARB_MAX_GPUS=64
CONFIG_VGA_SWITCHEROO=y
CONFIG_DRM=m
CONFIG_DRM_MIPI_DSI=y
CONFIG_DRM_DP_AUX_CHARDEV=y
# CONFIG_DRM_DEBUG_SELFTEST is not set
CONFIG_DRM_KMS_HELPER=m
CONFIG_DRM_KMS_FB_HELPER=y
CONFIG_DRM_FBDEV_EMULATION=y
CONFIG_DRM_FBDEV_OVERALLOC=100
CONFIG_DRM_LOAD_EDID_FIRMWARE=y
# CONFIG_DRM_DP_CEC is not set
CONFIG_DRM_TTM=m
CONFIG_DRM_TTM_DMA_PAGE_POOL=y
CONFIG_DRM_VRAM_HELPER=m
CONFIG_DRM_TTM_HELPER=m
CONFIG_DRM_GEM_SHMEM_HELPER=y

#
# I2C encoder or helper chips
#
CONFIG_DRM_I2C_CH7006=m
CONFIG_DRM_I2C_SIL164=m
# CONFIG_DRM_I2C_NXP_TDA998X is not set
# CONFIG_DRM_I2C_NXP_TDA9950 is not set
# end of I2C encoder or helper chips

#
# ARM devices
#
# end of ARM devices

# CONFIG_DRM_RADEON is not set
# CONFIG_DRM_AMDGPU is not set
# CONFIG_DRM_NOUVEAU is not set
CONFIG_DRM_I915=m
CONFIG_DRM_I915_FORCE_PROBE=""
CONFIG_DRM_I915_CAPTURE_ERROR=y
CONFIG_DRM_I915_COMPRESS_ERROR=y
CONFIG_DRM_I915_USERPTR=y
CONFIG_DRM_I915_GVT=y
CONFIG_DRM_I915_GVT_KVMGT=m
CONFIG_DRM_I915_FENCE_TIMEOUT=10000
CONFIG_DRM_I915_USERFAULT_AUTOSUSPEND=250
CONFIG_DRM_I915_HEARTBEAT_INTERVAL=2500
CONFIG_DRM_I915_PREEMPT_TIMEOUT=640
CONFIG_DRM_I915_MAX_REQUEST_BUSYWAIT=8000
CONFIG_DRM_I915_STOP_TIMEOUT=100
CONFIG_DRM_I915_TIMESLICE_DURATION=1
CONFIG_DRM_VGEM=m
# CONFIG_DRM_VKMS is not set
CONFIG_DRM_VMWGFX=m
CONFIG_DRM_VMWGFX_FBCON=y
CONFIG_DRM_GMA500=m
CONFIG_DRM_GMA600=y
CONFIG_DRM_GMA3600=y
# CONFIG_DRM_UDL is not set
CONFIG_DRM_AST=m
CONFIG_DRM_MGAG200=m
CONFIG_DRM_QXL=m
CONFIG_DRM_BOCHS=m
CONFIG_DRM_VIRTIO_GPU=m
CONFIG_DRM_PANEL=y

#
# Display Panels
#
# CONFIG_DRM_PANEL_RASPBERRYPI_TOUCHSCREEN is not set
# end of Display Panels

CONFIG_DRM_BRIDGE=y
CONFIG_DRM_PANEL_BRIDGE=y

#
# Display Interface Bridges
#
# CONFIG_DRM_ANALOGIX_ANX78XX is not set
# end of Display Interface Bridges

# CONFIG_DRM_ETNAVIV is not set
CONFIG_DRM_CIRRUS_QEMU=m
# CONFIG_DRM_GM12U320 is not set
# CONFIG_TINYDRM_HX8357D is not set
# CONFIG_TINYDRM_ILI9225 is not set
# CONFIG_TINYDRM_ILI9341 is not set
# CONFIG_TINYDRM_ILI9486 is not set
# CONFIG_TINYDRM_MI0283QT is not set
# CONFIG_TINYDRM_REPAPER is not set
# CONFIG_TINYDRM_ST7586 is not set
# CONFIG_TINYDRM_ST7735R is not set
# CONFIG_DRM_XEN is not set
# CONFIG_DRM_VBOXVIDEO is not set
# CONFIG_DRM_LEGACY is not set
CONFIG_DRM_PANEL_ORIENTATION_QUIRKS=y

#
# Frame buffer Devices
#
CONFIG_FB_CMDLINE=y
CONFIG_FB_NOTIFY=y
CONFIG_FB=y
# CONFIG_FIRMWARE_EDID is not set
CONFIG_FB_BOOT_VESA_SUPPORT=y
CONFIG_FB_CFB_FILLRECT=y
CONFIG_FB_CFB_COPYAREA=y
CONFIG_FB_CFB_IMAGEBLIT=y
CONFIG_FB_SYS_FILLRECT=m
CONFIG_FB_SYS_COPYAREA=m
CONFIG_FB_SYS_IMAGEBLIT=m
# CONFIG_FB_FOREIGN_ENDIAN is not set
CONFIG_FB_SYS_FOPS=m
CONFIG_FB_DEFERRED_IO=y
# CONFIG_FB_MODE_HELPERS is not set
CONFIG_FB_TILEBLITTING=y

#
# Frame buffer hardware drivers
#
# CONFIG_FB_CIRRUS is not set
# CONFIG_FB_PM2 is not set
# CONFIG_FB_CYBER2000 is not set
# CONFIG_FB_ARC is not set
# CONFIG_FB_ASILIANT is not set
# CONFIG_FB_IMSTT is not set
# CONFIG_FB_VGA16 is not set
# CONFIG_FB_UVESA is not set
CONFIG_FB_VESA=y
CONFIG_FB_EFI=y
# CONFIG_FB_N411 is not set
# CONFIG_FB_HGA is not set
# CONFIG_FB_OPENCORES is not set
# CONFIG_FB_S1D13XXX is not set
# CONFIG_FB_NVIDIA is not set
# CONFIG_FB_RIVA is not set
# CONFIG_FB_I740 is not set
# CONFIG_FB_LE80578 is not set
# CONFIG_FB_MATROX is not set
# CONFIG_FB_RADEON is not set
# CONFIG_FB_ATY128 is not set
# CONFIG_FB_ATY is not set
# CONFIG_FB_S3 is not set
# CONFIG_FB_SAVAGE is not set
# CONFIG_FB_SIS is not set
# CONFIG_FB_VIA is not set
# CONFIG_FB_NEOMAGIC is not set
# CONFIG_FB_KYRO is not set
# CONFIG_FB_3DFX is not set
# CONFIG_FB_VOODOO1 is not set
# CONFIG_FB_VT8623 is not set
# CONFIG_FB_TRIDENT is not set
# CONFIG_FB_ARK is not set
# CONFIG_FB_PM3 is not set
# CONFIG_FB_CARMINE is not set
# CONFIG_FB_SM501 is not set
# CONFIG_FB_SMSCUFX is not set
# CONFIG_FB_UDL is not set
# CONFIG_FB_IBM_GXT4500 is not set
# CONFIG_FB_VIRTUAL is not set
# CONFIG_XEN_FBDEV_FRONTEND is not set
# CONFIG_FB_METRONOME is not set
# CONFIG_FB_MB862XX is not set
CONFIG_FB_HYPERV=m
# CONFIG_FB_SIMPLE is not set
# CONFIG_FB_SM712 is not set
# end of Frame buffer Devices

#
# Backlight & LCD device support
#
CONFIG_LCD_CLASS_DEVICE=m
# CONFIG_LCD_L4F00242T03 is not set
# CONFIG_LCD_LMS283GF05 is not set
# CONFIG_LCD_LTV350QV is not set
# CONFIG_LCD_ILI922X is not set
# CONFIG_LCD_ILI9320 is not set
# CONFIG_LCD_TDO24M is not set
# CONFIG_LCD_VGG2432A4 is not set
CONFIG_LCD_PLATFORM=m
# CONFIG_LCD_AMS369FG06 is not set
# CONFIG_LCD_LMS501KF03 is not set
# CONFIG_LCD_HX8357 is not set
# CONFIG_LCD_OTM3225A is not set
CONFIG_BACKLIGHT_CLASS_DEVICE=y
# CONFIG_BACKLIGHT_PWM is not set
CONFIG_BACKLIGHT_APPLE=m
# CONFIG_BACKLIGHT_QCOM_WLED is not set
# CONFIG_BACKLIGHT_SAHARA is not set
# CONFIG_BACKLIGHT_ADP8860 is not set
# CONFIG_BACKLIGHT_ADP8870 is not set
# CONFIG_BACKLIGHT_LM3630A is not set
# CONFIG_BACKLIGHT_LM3639 is not set
CONFIG_BACKLIGHT_LP855X=m
# CONFIG_BACKLIGHT_GPIO is not set
# CONFIG_BACKLIGHT_LV5207LP is not set
# CONFIG_BACKLIGHT_BD6107 is not set
# CONFIG_BACKLIGHT_ARCXCNN is not set
# end of Backlight & LCD device support

CONFIG_HDMI=y

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
CONFIG_DUMMY_CONSOLE=y
CONFIG_DUMMY_CONSOLE_COLUMNS=80
CONFIG_DUMMY_CONSOLE_ROWS=25
CONFIG_FRAMEBUFFER_CONSOLE=y
CONFIG_FRAMEBUFFER_CONSOLE_DETECT_PRIMARY=y
CONFIG_FRAMEBUFFER_CONSOLE_ROTATION=y
# CONFIG_FRAMEBUFFER_CONSOLE_DEFERRED_TAKEOVER is not set
# end of Console display driver support

CONFIG_LOGO=y
# CONFIG_LOGO_LINUX_MONO is not set
# CONFIG_LOGO_LINUX_VGA16 is not set
CONFIG_LOGO_LINUX_CLUT224=y
# end of Graphics support

# CONFIG_SOUND is not set

#
# HID support
#
CONFIG_HID=y
CONFIG_HID_BATTERY_STRENGTH=y
CONFIG_HIDRAW=y
CONFIG_UHID=m
CONFIG_HID_GENERIC=y

#
# Special HID drivers
#
CONFIG_HID_A4TECH=m
# CONFIG_HID_ACCUTOUCH is not set
CONFIG_HID_ACRUX=m
# CONFIG_HID_ACRUX_FF is not set
CONFIG_HID_APPLE=m
# CONFIG_HID_APPLEIR is not set
CONFIG_HID_ASUS=m
CONFIG_HID_AUREAL=m
CONFIG_HID_BELKIN=m
# CONFIG_HID_BETOP_FF is not set
# CONFIG_HID_BIGBEN_FF is not set
CONFIG_HID_CHERRY=m
CONFIG_HID_CHICONY=m
# CONFIG_HID_CORSAIR is not set
# CONFIG_HID_COUGAR is not set
# CONFIG_HID_MACALLY is not set
CONFIG_HID_CMEDIA=m
# CONFIG_HID_CP2112 is not set
# CONFIG_HID_CREATIVE_SB0540 is not set
CONFIG_HID_CYPRESS=m
CONFIG_HID_DRAGONRISE=m
# CONFIG_DRAGONRISE_FF is not set
# CONFIG_HID_EMS_FF is not set
# CONFIG_HID_ELAN is not set
CONFIG_HID_ELECOM=m
# CONFIG_HID_ELO is not set
CONFIG_HID_EZKEY=m
CONFIG_HID_GEMBIRD=m
CONFIG_HID_GFRM=m
# CONFIG_HID_GLORIOUS is not set
# CONFIG_HID_HOLTEK is not set
# CONFIG_HID_GT683R is not set
CONFIG_HID_KEYTOUCH=m
CONFIG_HID_KYE=m
# CONFIG_HID_UCLOGIC is not set
CONFIG_HID_WALTOP=m
# CONFIG_HID_VIEWSONIC is not set
CONFIG_HID_GYRATION=m
CONFIG_HID_ICADE=m
CONFIG_HID_ITE=m
CONFIG_HID_JABRA=m
CONFIG_HID_TWINHAN=m
CONFIG_HID_KENSINGTON=m
CONFIG_HID_LCPOWER=m
CONFIG_HID_LED=m
CONFIG_HID_LENOVO=m
CONFIG_HID_LOGITECH=m
CONFIG_HID_LOGITECH_DJ=m
CONFIG_HID_LOGITECH_HIDPP=m
# CONFIG_LOGITECH_FF is not set
# CONFIG_LOGIRUMBLEPAD2_FF is not set
# CONFIG_LOGIG940_FF is not set
# CONFIG_LOGIWHEELS_FF is not set
CONFIG_HID_MAGICMOUSE=y
# CONFIG_HID_MALTRON is not set
# CONFIG_HID_MAYFLASH is not set
# CONFIG_HID_REDRAGON is not set
CONFIG_HID_MICROSOFT=m
CONFIG_HID_MONTEREY=m
CONFIG_HID_MULTITOUCH=m
CONFIG_HID_NTI=m
# CONFIG_HID_NTRIG is not set
CONFIG_HID_ORTEK=m
CONFIG_HID_PANTHERLORD=m
# CONFIG_PANTHERLORD_FF is not set
# CONFIG_HID_PENMOUNT is not set
CONFIG_HID_PETALYNX=m
CONFIG_HID_PICOLCD=m
CONFIG_HID_PICOLCD_FB=y
CONFIG_HID_PICOLCD_BACKLIGHT=y
CONFIG_HID_PICOLCD_LCD=y
CONFIG_HID_PICOLCD_LEDS=y
CONFIG_HID_PICOLCD_CIR=y
CONFIG_HID_PLANTRONICS=m
CONFIG_HID_PRIMAX=m
# CONFIG_HID_RETRODE is not set
# CONFIG_HID_ROCCAT is not set
CONFIG_HID_SAITEK=m
CONFIG_HID_SAMSUNG=m
# CONFIG_HID_SONY is not set
CONFIG_HID_SPEEDLINK=m
# CONFIG_HID_STEAM is not set
CONFIG_HID_STEELSERIES=m
CONFIG_HID_SUNPLUS=m
CONFIG_HID_RMI=m
CONFIG_HID_GREENASIA=m
# CONFIG_GREENASIA_FF is not set
CONFIG_HID_HYPERV_MOUSE=m
CONFIG_HID_SMARTJOYPLUS=m
# CONFIG_SMARTJOYPLUS_FF is not set
CONFIG_HID_TIVO=m
CONFIG_HID_TOPSEED=m
CONFIG_HID_THINGM=m
CONFIG_HID_THRUSTMASTER=m
# CONFIG_THRUSTMASTER_FF is not set
# CONFIG_HID_UDRAW_PS3 is not set
# CONFIG_HID_U2FZERO is not set
# CONFIG_HID_WACOM is not set
CONFIG_HID_WIIMOTE=m
CONFIG_HID_XINMO=m
CONFIG_HID_ZEROPLUS=m
# CONFIG_ZEROPLUS_FF is not set
CONFIG_HID_ZYDACRON=m
CONFIG_HID_SENSOR_HUB=y
CONFIG_HID_SENSOR_CUSTOM_SENSOR=m
CONFIG_HID_ALPS=m
# CONFIG_HID_MCP2221 is not set
# end of Special HID drivers

#
# USB HID support
#
CONFIG_USB_HID=y
# CONFIG_HID_PID is not set
# CONFIG_USB_HIDDEV is not set
# end of USB HID support

#
# I2C HID support
#
CONFIG_I2C_HID=m
# end of I2C HID support

#
# Intel ISH HID support
#
CONFIG_INTEL_ISH_HID=m
# CONFIG_INTEL_ISH_FIRMWARE_DOWNLOADER is not set
# end of Intel ISH HID support
# end of HID support

CONFIG_USB_OHCI_LITTLE_ENDIAN=y
CONFIG_USB_SUPPORT=y
CONFIG_USB_COMMON=y
# CONFIG_USB_LED_TRIG is not set
# CONFIG_USB_ULPI_BUS is not set
# CONFIG_USB_CONN_GPIO is not set
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB=y
CONFIG_USB_PCI=y
CONFIG_USB_ANNOUNCE_NEW_DEVICES=y

#
# Miscellaneous USB options
#
CONFIG_USB_DEFAULT_PERSIST=y
# CONFIG_USB_DYNAMIC_MINORS is not set
# CONFIG_USB_OTG is not set
# CONFIG_USB_OTG_PRODUCTLIST is not set
CONFIG_USB_LEDS_TRIGGER_USBPORT=y
CONFIG_USB_AUTOSUSPEND_DELAY=2
CONFIG_USB_MON=y

#
# USB Host Controller Drivers
#
# CONFIG_USB_C67X00_HCD is not set
CONFIG_USB_XHCI_HCD=y
# CONFIG_USB_XHCI_DBGCAP is not set
CONFIG_USB_XHCI_PCI=y
# CONFIG_USB_XHCI_PCI_RENESAS is not set
# CONFIG_USB_XHCI_PLATFORM is not set
CONFIG_USB_EHCI_HCD=y
CONFIG_USB_EHCI_ROOT_HUB_TT=y
CONFIG_USB_EHCI_TT_NEWSCHED=y
CONFIG_USB_EHCI_PCI=y
# CONFIG_USB_EHCI_FSL is not set
# CONFIG_USB_EHCI_HCD_PLATFORM is not set
# CONFIG_USB_OXU210HP_HCD is not set
# CONFIG_USB_ISP116X_HCD is not set
# CONFIG_USB_FOTG210_HCD is not set
# CONFIG_USB_MAX3421_HCD is not set
CONFIG_USB_OHCI_HCD=y
CONFIG_USB_OHCI_HCD_PCI=y
# CONFIG_USB_OHCI_HCD_PLATFORM is not set
CONFIG_USB_UHCI_HCD=y
# CONFIG_USB_SL811_HCD is not set
# CONFIG_USB_R8A66597_HCD is not set
# CONFIG_USB_HCD_BCMA is not set
# CONFIG_USB_HCD_TEST_MODE is not set

#
# USB Device Class drivers
#
# CONFIG_USB_ACM is not set
# CONFIG_USB_PRINTER is not set
# CONFIG_USB_WDM is not set
# CONFIG_USB_TMC is not set

#
# NOTE: USB_STORAGE depends on SCSI but BLK_DEV_SD may
#

#
# also be needed; see USB_STORAGE Help for more info
#
CONFIG_USB_STORAGE=m
# CONFIG_USB_STORAGE_DEBUG is not set
# CONFIG_USB_STORAGE_REALTEK is not set
# CONFIG_USB_STORAGE_DATAFAB is not set
# CONFIG_USB_STORAGE_FREECOM is not set
# CONFIG_USB_STORAGE_ISD200 is not set
# CONFIG_USB_STORAGE_USBAT is not set
# CONFIG_USB_STORAGE_SDDR09 is not set
# CONFIG_USB_STORAGE_SDDR55 is not set
# CONFIG_USB_STORAGE_JUMPSHOT is not set
# CONFIG_USB_STORAGE_ALAUDA is not set
# CONFIG_USB_STORAGE_ONETOUCH is not set
# CONFIG_USB_STORAGE_KARMA is not set
# CONFIG_USB_STORAGE_CYPRESS_ATACB is not set
# CONFIG_USB_STORAGE_ENE_UB6250 is not set
# CONFIG_USB_UAS is not set

#
# USB Imaging devices
#
# CONFIG_USB_MDC800 is not set
# CONFIG_USB_MICROTEK is not set
# CONFIG_USBIP_CORE is not set
# CONFIG_USB_CDNS3 is not set
# CONFIG_USB_MUSB_HDRC is not set
# CONFIG_USB_DWC3 is not set
# CONFIG_USB_DWC2 is not set
# CONFIG_USB_CHIPIDEA is not set
# CONFIG_USB_ISP1760 is not set

#
# USB port drivers
#
# CONFIG_USB_USS720 is not set
CONFIG_USB_SERIAL=m
CONFIG_USB_SERIAL_GENERIC=y
# CONFIG_USB_SERIAL_SIMPLE is not set
# CONFIG_USB_SERIAL_AIRCABLE is not set
# CONFIG_USB_SERIAL_ARK3116 is not set
# CONFIG_USB_SERIAL_BELKIN is not set
# CONFIG_USB_SERIAL_CH341 is not set
# CONFIG_USB_SERIAL_WHITEHEAT is not set
# CONFIG_USB_SERIAL_DIGI_ACCELEPORT is not set
# CONFIG_USB_SERIAL_CP210X is not set
# CONFIG_USB_SERIAL_CYPRESS_M8 is not set
# CONFIG_USB_SERIAL_EMPEG is not set
# CONFIG_USB_SERIAL_FTDI_SIO is not set
# CONFIG_USB_SERIAL_VISOR is not set
# CONFIG_USB_SERIAL_IPAQ is not set
# CONFIG_USB_SERIAL_IR is not set
# CONFIG_USB_SERIAL_EDGEPORT is not set
# CONFIG_USB_SERIAL_EDGEPORT_TI is not set
# CONFIG_USB_SERIAL_F81232 is not set
# CONFIG_USB_SERIAL_F8153X is not set
# CONFIG_USB_SERIAL_GARMIN is not set
# CONFIG_USB_SERIAL_IPW is not set
# CONFIG_USB_SERIAL_IUU is not set
# CONFIG_USB_SERIAL_KEYSPAN_PDA is not set
# CONFIG_USB_SERIAL_KEYSPAN is not set
# CONFIG_USB_SERIAL_KLSI is not set
# CONFIG_USB_SERIAL_KOBIL_SCT is not set
# CONFIG_USB_SERIAL_MCT_U232 is not set
# CONFIG_USB_SERIAL_METRO is not set
# CONFIG_USB_SERIAL_MOS7720 is not set
# CONFIG_USB_SERIAL_MOS7840 is not set
# CONFIG_USB_SERIAL_MXUPORT is not set
# CONFIG_USB_SERIAL_NAVMAN is not set
# CONFIG_USB_SERIAL_PL2303 is not set
# CONFIG_USB_SERIAL_OTI6858 is not set
# CONFIG_USB_SERIAL_QCAUX is not set
# CONFIG_USB_SERIAL_QUALCOMM is not set
# CONFIG_USB_SERIAL_SPCP8X5 is not set
# CONFIG_USB_SERIAL_SAFE is not set
# CONFIG_USB_SERIAL_SIERRAWIRELESS is not set
# CONFIG_USB_SERIAL_SYMBOL is not set
# CONFIG_USB_SERIAL_TI is not set
# CONFIG_USB_SERIAL_CYBERJACK is not set
# CONFIG_USB_SERIAL_XIRCOM is not set
# CONFIG_USB_SERIAL_OPTION is not set
# CONFIG_USB_SERIAL_OMNINET is not set
# CONFIG_USB_SERIAL_OPTICON is not set
# CONFIG_USB_SERIAL_XSENS_MT is not set
# CONFIG_USB_SERIAL_WISHBONE is not set
# CONFIG_USB_SERIAL_SSU100 is not set
# CONFIG_USB_SERIAL_QT2 is not set
# CONFIG_USB_SERIAL_UPD78F0730 is not set
CONFIG_USB_SERIAL_DEBUG=m

#
# USB Miscellaneous drivers
#
# CONFIG_USB_EMI62 is not set
# CONFIG_USB_EMI26 is not set
# CONFIG_USB_ADUTUX is not set
# CONFIG_USB_SEVSEG is not set
# CONFIG_USB_LEGOTOWER is not set
# CONFIG_USB_LCD is not set
# CONFIG_USB_CYPRESS_CY7C63 is not set
# CONFIG_USB_CYTHERM is not set
# CONFIG_USB_IDMOUSE is not set
# CONFIG_USB_FTDI_ELAN is not set
# CONFIG_USB_APPLEDISPLAY is not set
# CONFIG_APPLE_MFI_FASTCHARGE is not set
# CONFIG_USB_SISUSBVGA is not set
# CONFIG_USB_LD is not set
# CONFIG_USB_TRANCEVIBRATOR is not set
# CONFIG_USB_IOWARRIOR is not set
# CONFIG_USB_TEST is not set
# CONFIG_USB_EHSET_TEST_FIXTURE is not set
# CONFIG_USB_ISIGHTFW is not set
# CONFIG_USB_YUREX is not set
# CONFIG_USB_EZUSB_FX2 is not set
# CONFIG_USB_HUB_USB251XB is not set
# CONFIG_USB_HSIC_USB3503 is not set
# CONFIG_USB_HSIC_USB4604 is not set
# CONFIG_USB_LINK_LAYER_TEST is not set
# CONFIG_USB_CHAOSKEY is not set
# CONFIG_USB_ATM is not set

#
# USB Physical Layer drivers
#
# CONFIG_NOP_USB_XCEIV is not set
# CONFIG_USB_GPIO_VBUS is not set
# CONFIG_USB_ISP1301 is not set
# end of USB Physical Layer drivers

# CONFIG_USB_GADGET is not set
CONFIG_TYPEC=y
# CONFIG_TYPEC_TCPM is not set
CONFIG_TYPEC_UCSI=y
# CONFIG_UCSI_CCG is not set
CONFIG_UCSI_ACPI=y
# CONFIG_TYPEC_TPS6598X is not set

#
# USB Type-C Multiplexer/DeMultiplexer Switch support
#
# CONFIG_TYPEC_MUX_PI3USB30532 is not set
# end of USB Type-C Multiplexer/DeMultiplexer Switch support

#
# USB Type-C Alternate Mode drivers
#
# CONFIG_TYPEC_DP_ALTMODE is not set
# end of USB Type-C Alternate Mode drivers

# CONFIG_USB_ROLE_SWITCH is not set
CONFIG_MMC=m
CONFIG_MMC_BLOCK=m
CONFIG_MMC_BLOCK_MINORS=8
CONFIG_SDIO_UART=m
# CONFIG_MMC_TEST is not set

#
# MMC/SD/SDIO Host Controller Drivers
#
# CONFIG_MMC_DEBUG is not set
CONFIG_MMC_SDHCI=m
CONFIG_MMC_SDHCI_IO_ACCESSORS=y
CONFIG_MMC_SDHCI_PCI=m
CONFIG_MMC_RICOH_MMC=y
CONFIG_MMC_SDHCI_ACPI=m
CONFIG_MMC_SDHCI_PLTFM=m
# CONFIG_MMC_SDHCI_F_SDH30 is not set
# CONFIG_MMC_WBSD is not set
# CONFIG_MMC_TIFM_SD is not set
# CONFIG_MMC_SPI is not set
# CONFIG_MMC_CB710 is not set
# CONFIG_MMC_VIA_SDMMC is not set
# CONFIG_MMC_VUB300 is not set
# CONFIG_MMC_USHC is not set
# CONFIG_MMC_USDHI6ROL0 is not set
# CONFIG_MMC_REALTEK_PCI is not set
CONFIG_MMC_CQHCI=m
# CONFIG_MMC_HSQ is not set
# CONFIG_MMC_TOSHIBA_PCI is not set
# CONFIG_MMC_MTK is not set
# CONFIG_MMC_SDHCI_XENON is not set
# CONFIG_MEMSTICK is not set
CONFIG_NEW_LEDS=y
CONFIG_LEDS_CLASS=y
# CONFIG_LEDS_CLASS_FLASH is not set
# CONFIG_LEDS_CLASS_MULTICOLOR is not set
# CONFIG_LEDS_BRIGHTNESS_HW_CHANGED is not set

#
# LED drivers
#
# CONFIG_LEDS_APU is not set
CONFIG_LEDS_LM3530=m
# CONFIG_LEDS_LM3532 is not set
# CONFIG_LEDS_LM3642 is not set
# CONFIG_LEDS_PCA9532 is not set
# CONFIG_LEDS_GPIO is not set
CONFIG_LEDS_LP3944=m
# CONFIG_LEDS_LP3952 is not set
CONFIG_LEDS_CLEVO_MAIL=m
# CONFIG_LEDS_PCA955X is not set
# CONFIG_LEDS_PCA963X is not set
# CONFIG_LEDS_DAC124S085 is not set
# CONFIG_LEDS_PWM is not set
# CONFIG_LEDS_BD2802 is not set
CONFIG_LEDS_INTEL_SS4200=m
# CONFIG_LEDS_TCA6507 is not set
# CONFIG_LEDS_TLC591XX is not set
# CONFIG_LEDS_LM355x is not set

#
# LED driver for blink(1) USB RGB LED is under Special HID drivers (HID_THINGM)
#
CONFIG_LEDS_BLINKM=m
CONFIG_LEDS_MLXCPLD=m
# CONFIG_LEDS_MLXREG is not set
# CONFIG_LEDS_USER is not set
# CONFIG_LEDS_NIC78BX is not set
# CONFIG_LEDS_TI_LMU_COMMON is not set

#
# LED Triggers
#
CONFIG_LEDS_TRIGGERS=y
CONFIG_LEDS_TRIGGER_TIMER=m
CONFIG_LEDS_TRIGGER_ONESHOT=m
# CONFIG_LEDS_TRIGGER_DISK is not set
CONFIG_LEDS_TRIGGER_HEARTBEAT=m
CONFIG_LEDS_TRIGGER_BACKLIGHT=m
# CONFIG_LEDS_TRIGGER_CPU is not set
# CONFIG_LEDS_TRIGGER_ACTIVITY is not set
CONFIG_LEDS_TRIGGER_GPIO=m
CONFIG_LEDS_TRIGGER_DEFAULT_ON=m

#
# iptables trigger is under Netfilter config (LED target)
#
CONFIG_LEDS_TRIGGER_TRANSIENT=m
CONFIG_LEDS_TRIGGER_CAMERA=m
# CONFIG_LEDS_TRIGGER_PANIC is not set
# CONFIG_LEDS_TRIGGER_NETDEV is not set
# CONFIG_LEDS_TRIGGER_PATTERN is not set
CONFIG_LEDS_TRIGGER_AUDIO=m
# CONFIG_ACCESSIBILITY is not set
CONFIG_INFINIBAND=m
CONFIG_INFINIBAND_USER_MAD=m
CONFIG_INFINIBAND_USER_ACCESS=m
CONFIG_INFINIBAND_USER_MEM=y
CONFIG_INFINIBAND_ON_DEMAND_PAGING=y
CONFIG_INFINIBAND_ADDR_TRANS=y
CONFIG_INFINIBAND_ADDR_TRANS_CONFIGFS=y
# CONFIG_INFINIBAND_MTHCA is not set
# CONFIG_INFINIBAND_EFA is not set
# CONFIG_INFINIBAND_I40IW is not set
# CONFIG_MLX4_INFINIBAND is not set
# CONFIG_INFINIBAND_OCRDMA is not set
# CONFIG_INFINIBAND_USNIC is not set
# CONFIG_INFINIBAND_BNXT_RE is not set
# CONFIG_INFINIBAND_RDMAVT is not set
CONFIG_RDMA_RXE=m
CONFIG_RDMA_SIW=m
CONFIG_INFINIBAND_IPOIB=m
# CONFIG_INFINIBAND_IPOIB_CM is not set
CONFIG_INFINIBAND_IPOIB_DEBUG=y
# CONFIG_INFINIBAND_IPOIB_DEBUG_DATA is not set
CONFIG_INFINIBAND_SRP=m
CONFIG_INFINIBAND_SRPT=m
# CONFIG_INFINIBAND_ISER is not set
# CONFIG_INFINIBAND_ISERT is not set
# CONFIG_INFINIBAND_RTRS_CLIENT is not set
# CONFIG_INFINIBAND_RTRS_SERVER is not set
# CONFIG_INFINIBAND_OPA_VNIC is not set
CONFIG_EDAC_ATOMIC_SCRUB=y
CONFIG_EDAC_SUPPORT=y
CONFIG_EDAC=y
CONFIG_EDAC_LEGACY_SYSFS=y
# CONFIG_EDAC_DEBUG is not set
CONFIG_EDAC_DECODE_MCE=m
CONFIG_EDAC_GHES=y
CONFIG_EDAC_AMD64=m
# CONFIG_EDAC_AMD64_ERROR_INJECTION is not set
CONFIG_EDAC_E752X=m
CONFIG_EDAC_I82975X=m
CONFIG_EDAC_I3000=m
CONFIG_EDAC_I3200=m
CONFIG_EDAC_IE31200=m
CONFIG_EDAC_X38=m
CONFIG_EDAC_I5400=m
CONFIG_EDAC_I7CORE=m
CONFIG_EDAC_I5000=m
CONFIG_EDAC_I5100=m
CONFIG_EDAC_I7300=m
CONFIG_EDAC_SBRIDGE=m
CONFIG_EDAC_SKX=m
# CONFIG_EDAC_I10NM is not set
CONFIG_EDAC_PND2=m
CONFIG_RTC_LIB=y
CONFIG_RTC_MC146818_LIB=y
CONFIG_RTC_CLASS=y
CONFIG_RTC_HCTOSYS=y
CONFIG_RTC_HCTOSYS_DEVICE="rtc0"
# CONFIG_RTC_SYSTOHC is not set
# CONFIG_RTC_DEBUG is not set
CONFIG_RTC_NVMEM=y

#
# RTC interfaces
#
CONFIG_RTC_INTF_SYSFS=y
CONFIG_RTC_INTF_PROC=y
CONFIG_RTC_INTF_DEV=y
# CONFIG_RTC_INTF_DEV_UIE_EMUL is not set
# CONFIG_RTC_DRV_TEST is not set

#
# I2C RTC drivers
#
# CONFIG_RTC_DRV_ABB5ZES3 is not set
# CONFIG_RTC_DRV_ABEOZ9 is not set
# CONFIG_RTC_DRV_ABX80X is not set
CONFIG_RTC_DRV_DS1307=m
# CONFIG_RTC_DRV_DS1307_CENTURY is not set
CONFIG_RTC_DRV_DS1374=m
# CONFIG_RTC_DRV_DS1374_WDT is not set
CONFIG_RTC_DRV_DS1672=m
CONFIG_RTC_DRV_MAX6900=m
CONFIG_RTC_DRV_RS5C372=m
CONFIG_RTC_DRV_ISL1208=m
CONFIG_RTC_DRV_ISL12022=m
CONFIG_RTC_DRV_X1205=m
CONFIG_RTC_DRV_PCF8523=m
# CONFIG_RTC_DRV_PCF85063 is not set
# CONFIG_RTC_DRV_PCF85363 is not set
CONFIG_RTC_DRV_PCF8563=m
CONFIG_RTC_DRV_PCF8583=m
CONFIG_RTC_DRV_M41T80=m
CONFIG_RTC_DRV_M41T80_WDT=y
CONFIG_RTC_DRV_BQ32K=m
# CONFIG_RTC_DRV_S35390A is not set
CONFIG_RTC_DRV_FM3130=m
# CONFIG_RTC_DRV_RX8010 is not set
CONFIG_RTC_DRV_RX8581=m
CONFIG_RTC_DRV_RX8025=m
CONFIG_RTC_DRV_EM3027=m
# CONFIG_RTC_DRV_RV3028 is not set
# CONFIG_RTC_DRV_RV8803 is not set
# CONFIG_RTC_DRV_SD3078 is not set

#
# SPI RTC drivers
#
# CONFIG_RTC_DRV_M41T93 is not set
# CONFIG_RTC_DRV_M41T94 is not set
# CONFIG_RTC_DRV_DS1302 is not set
# CONFIG_RTC_DRV_DS1305 is not set
# CONFIG_RTC_DRV_DS1343 is not set
# CONFIG_RTC_DRV_DS1347 is not set
# CONFIG_RTC_DRV_DS1390 is not set
# CONFIG_RTC_DRV_MAX6916 is not set
# CONFIG_RTC_DRV_R9701 is not set
CONFIG_RTC_DRV_RX4581=m
# CONFIG_RTC_DRV_RX6110 is not set
# CONFIG_RTC_DRV_RS5C348 is not set
# CONFIG_RTC_DRV_MAX6902 is not set
# CONFIG_RTC_DRV_PCF2123 is not set
# CONFIG_RTC_DRV_MCP795 is not set
CONFIG_RTC_I2C_AND_SPI=y

#
# SPI and I2C RTC drivers
#
CONFIG_RTC_DRV_DS3232=m
CONFIG_RTC_DRV_DS3232_HWMON=y
# CONFIG_RTC_DRV_PCF2127 is not set
CONFIG_RTC_DRV_RV3029C2=m
# CONFIG_RTC_DRV_RV3029_HWMON is not set

#
# Platform RTC drivers
#
CONFIG_RTC_DRV_CMOS=y
CONFIG_RTC_DRV_DS1286=m
CONFIG_RTC_DRV_DS1511=m
CONFIG_RTC_DRV_DS1553=m
# CONFIG_RTC_DRV_DS1685_FAMILY is not set
CONFIG_RTC_DRV_DS1742=m
CONFIG_RTC_DRV_DS2404=m
CONFIG_RTC_DRV_STK17TA8=m
# CONFIG_RTC_DRV_M48T86 is not set
CONFIG_RTC_DRV_M48T35=m
CONFIG_RTC_DRV_M48T59=m
CONFIG_RTC_DRV_MSM6242=m
CONFIG_RTC_DRV_BQ4802=m
CONFIG_RTC_DRV_RP5C01=m
CONFIG_RTC_DRV_V3020=m

#
# on-CPU RTC drivers
#
# CONFIG_RTC_DRV_FTRTC010 is not set

#
# HID Sensor RTC drivers
#
CONFIG_DMADEVICES=y
# CONFIG_DMADEVICES_DEBUG is not set

#
# DMA Devices
#
CONFIG_DMA_ENGINE=y
CONFIG_DMA_VIRTUAL_CHANNELS=y
CONFIG_DMA_ACPI=y
# CONFIG_ALTERA_MSGDMA is not set
CONFIG_INTEL_IDMA64=m
# CONFIG_INTEL_IDXD is not set
CONFIG_INTEL_IOATDMA=m
# CONFIG_PLX_DMA is not set
# CONFIG_XILINX_ZYNQMP_DPDMA is not set
# CONFIG_QCOM_HIDMA_MGMT is not set
# CONFIG_QCOM_HIDMA is not set
CONFIG_DW_DMAC_CORE=y
CONFIG_DW_DMAC=m
CONFIG_DW_DMAC_PCI=y
# CONFIG_DW_EDMA is not set
# CONFIG_DW_EDMA_PCIE is not set
CONFIG_HSU_DMA=y
# CONFIG_SF_PDMA is not set

#
# DMA Clients
#
CONFIG_ASYNC_TX_DMA=y
CONFIG_DMATEST=m
CONFIG_DMA_ENGINE_RAID=y

#
# DMABUF options
#
CONFIG_SYNC_FILE=y
# CONFIG_SW_SYNC is not set
# CONFIG_UDMABUF is not set
# CONFIG_DMABUF_MOVE_NOTIFY is not set
# CONFIG_DMABUF_SELFTESTS is not set
# CONFIG_DMABUF_HEAPS is not set
# end of DMABUF options

CONFIG_DCA=m
# CONFIG_AUXDISPLAY is not set
# CONFIG_PANEL is not set
CONFIG_UIO=m
CONFIG_UIO_CIF=m
CONFIG_UIO_PDRV_GENIRQ=m
# CONFIG_UIO_DMEM_GENIRQ is not set
CONFIG_UIO_AEC=m
CONFIG_UIO_SERCOS3=m
CONFIG_UIO_PCI_GENERIC=m
# CONFIG_UIO_NETX is not set
# CONFIG_UIO_PRUSS is not set
# CONFIG_UIO_MF624 is not set
CONFIG_UIO_HV_GENERIC=m
CONFIG_VFIO_IOMMU_TYPE1=m
CONFIG_VFIO_VIRQFD=m
CONFIG_VFIO=m
CONFIG_VFIO_NOIOMMU=y
CONFIG_VFIO_PCI=m
# CONFIG_VFIO_PCI_VGA is not set
CONFIG_VFIO_PCI_MMAP=y
CONFIG_VFIO_PCI_INTX=y
# CONFIG_VFIO_PCI_IGD is not set
CONFIG_VFIO_MDEV=m
CONFIG_VFIO_MDEV_DEVICE=m
CONFIG_IRQ_BYPASS_MANAGER=m
# CONFIG_VIRT_DRIVERS is not set
CONFIG_VIRTIO=y
CONFIG_VIRTIO_MENU=y
CONFIG_VIRTIO_PCI=y
CONFIG_VIRTIO_PCI_LEGACY=y
# CONFIG_VIRTIO_PMEM is not set
CONFIG_VIRTIO_BALLOON=y
CONFIG_VIRTIO_MEM=m
CONFIG_VIRTIO_INPUT=m
# CONFIG_VIRTIO_MMIO is not set
# CONFIG_VDPA is not set
CONFIG_VHOST_IOTLB=m
CONFIG_VHOST=m
CONFIG_VHOST_MENU=y
CONFIG_VHOST_NET=m
# CONFIG_VHOST_SCSI is not set
CONFIG_VHOST_VSOCK=m
# CONFIG_VHOST_CROSS_ENDIAN_LEGACY is not set

#
# Microsoft Hyper-V guest support
#
CONFIG_HYPERV=m
CONFIG_HYPERV_TIMER=y
CONFIG_HYPERV_UTILS=m
CONFIG_HYPERV_BALLOON=m
# end of Microsoft Hyper-V guest support

#
# Xen driver support
#
# CONFIG_XEN_BALLOON is not set
CONFIG_XEN_DEV_EVTCHN=m
# CONFIG_XEN_BACKEND is not set
CONFIG_XENFS=m
CONFIG_XEN_COMPAT_XENFS=y
CONFIG_XEN_SYS_HYPERVISOR=y
CONFIG_XEN_XENBUS_FRONTEND=y
# CONFIG_XEN_GNTDEV is not set
# CONFIG_XEN_GRANT_DEV_ALLOC is not set
# CONFIG_XEN_GRANT_DMA_ALLOC is not set
CONFIG_SWIOTLB_XEN=y
# CONFIG_XEN_PVCALLS_FRONTEND is not set
CONFIG_XEN_PRIVCMD=m
CONFIG_XEN_EFI=y
CONFIG_XEN_AUTO_XLATE=y
CONFIG_XEN_ACPI=y
# CONFIG_XEN_UNPOPULATED_ALLOC is not set
# end of Xen driver support

# CONFIG_GREYBUS is not set
# CONFIG_STAGING is not set
CONFIG_X86_PLATFORM_DEVICES=y
CONFIG_ACPI_WMI=m
CONFIG_WMI_BMOF=m
# CONFIG_ALIENWARE_WMI is not set
# CONFIG_HUAWEI_WMI is not set
# CONFIG_INTEL_WMI_SBL_FW_UPDATE is not set
CONFIG_INTEL_WMI_THUNDERBOLT=m
CONFIG_MXM_WMI=m
# CONFIG_PEAQ_WMI is not set
# CONFIG_XIAOMI_WMI is not set
CONFIG_ACERHDF=m
# CONFIG_ACER_WIRELESS is not set
CONFIG_ACER_WMI=m
CONFIG_APPLE_GMUX=m
CONFIG_ASUS_LAPTOP=m
# CONFIG_ASUS_WIRELESS is not set
CONFIG_ASUS_WMI=m
CONFIG_ASUS_NB_WMI=m
CONFIG_EEEPC_LAPTOP=m
CONFIG_EEEPC_WMI=m
CONFIG_DCDBAS=m
CONFIG_DELL_SMBIOS=m
CONFIG_DELL_SMBIOS_WMI=y
# CONFIG_DELL_SMBIOS_SMM is not set
CONFIG_DELL_LAPTOP=m
CONFIG_DELL_RBTN=m
CONFIG_DELL_RBU=m
CONFIG_DELL_SMO8800=m
CONFIG_DELL_WMI=m
CONFIG_DELL_WMI_DESCRIPTOR=m
CONFIG_DELL_WMI_AIO=m
CONFIG_DELL_WMI_LED=m
CONFIG_AMILO_RFKILL=m
CONFIG_FUJITSU_LAPTOP=m
CONFIG_FUJITSU_TABLET=m
# CONFIG_GPD_POCKET_FAN is not set
CONFIG_HP_ACCEL=m
CONFIG_HP_WIRELESS=m
CONFIG_HP_WMI=m
# CONFIG_IBM_RTL is not set
CONFIG_IDEAPAD_LAPTOP=m
CONFIG_SENSORS_HDAPS=m
CONFIG_THINKPAD_ACPI=m
# CONFIG_THINKPAD_ACPI_DEBUGFACILITIES is not set
# CONFIG_THINKPAD_ACPI_DEBUG is not set
# CONFIG_THINKPAD_ACPI_UNSAFE_LEDS is not set
CONFIG_THINKPAD_ACPI_VIDEO=y
CONFIG_THINKPAD_ACPI_HOTKEY_POLL=y
# CONFIG_INTEL_ATOMISP2_PM is not set
CONFIG_INTEL_HID_EVENT=m
# CONFIG_INTEL_INT0002_VGPIO is not set
# CONFIG_INTEL_MENLOW is not set
CONFIG_INTEL_OAKTRAIL=m
CONFIG_INTEL_VBTN=m
# CONFIG_SURFACE3_WMI is not set
# CONFIG_SURFACE_3_POWER_OPREGION is not set
# CONFIG_SURFACE_PRO3_BUTTON is not set
CONFIG_MSI_LAPTOP=m
CONFIG_MSI_WMI=m
# CONFIG_PCENGINES_APU2 is not set
CONFIG_SAMSUNG_LAPTOP=m
CONFIG_SAMSUNG_Q10=m
CONFIG_TOSHIBA_BT_RFKILL=m
# CONFIG_TOSHIBA_HAPS is not set
# CONFIG_TOSHIBA_WMI is not set
CONFIG_ACPI_CMPC=m
CONFIG_COMPAL_LAPTOP=m
# CONFIG_LG_LAPTOP is not set
CONFIG_PANASONIC_LAPTOP=m
CONFIG_SONY_LAPTOP=m
CONFIG_SONYPI_COMPAT=y
# CONFIG_SYSTEM76_ACPI is not set
CONFIG_TOPSTAR_LAPTOP=m
# CONFIG_I2C_MULTI_INSTANTIATE is not set
CONFIG_MLX_PLATFORM=m
CONFIG_INTEL_IPS=m
CONFIG_INTEL_RST=m
# CONFIG_INTEL_SMARTCONNECT is not set

#
# Intel Speed Select Technology interface support
#
# CONFIG_INTEL_SPEED_SELECT_INTERFACE is not set
# end of Intel Speed Select Technology interface support

CONFIG_INTEL_TURBO_MAX_3=y
# CONFIG_INTEL_UNCORE_FREQ_CONTROL is not set
CONFIG_INTEL_PMC_CORE=m
# CONFIG_INTEL_PUNIT_IPC is not set
# CONFIG_INTEL_SCU_PCI is not set
# CONFIG_INTEL_SCU_PLATFORM is not set
CONFIG_PMC_ATOM=y
# CONFIG_MFD_CROS_EC is not set
# CONFIG_CHROME_PLATFORMS is not set
CONFIG_MELLANOX_PLATFORM=y
CONFIG_MLXREG_HOTPLUG=m
# CONFIG_MLXREG_IO is not set
CONFIG_HAVE_CLK=y
CONFIG_CLKDEV_LOOKUP=y
CONFIG_HAVE_CLK_PREPARE=y
CONFIG_COMMON_CLK=y
# CONFIG_COMMON_CLK_MAX9485 is not set
# CONFIG_COMMON_CLK_SI5341 is not set
# CONFIG_COMMON_CLK_SI5351 is not set
# CONFIG_COMMON_CLK_SI544 is not set
# CONFIG_COMMON_CLK_CDCE706 is not set
# CONFIG_COMMON_CLK_CS2000_CP is not set
# CONFIG_COMMON_CLK_PWM is not set
CONFIG_HWSPINLOCK=y

#
# Clock Source drivers
#
CONFIG_CLKEVT_I8253=y
CONFIG_I8253_LOCK=y
CONFIG_CLKBLD_I8253=y
# end of Clock Source drivers

CONFIG_MAILBOX=y
CONFIG_PCC=y
# CONFIG_ALTERA_MBOX is not set
CONFIG_IOMMU_IOVA=y
CONFIG_IOASID=y
CONFIG_IOMMU_API=y
CONFIG_IOMMU_SUPPORT=y

#
# Generic IOMMU Pagetable Support
#
# end of Generic IOMMU Pagetable Support

# CONFIG_IOMMU_DEBUGFS is not set
# CONFIG_IOMMU_DEFAULT_PASSTHROUGH is not set
CONFIG_IOMMU_DMA=y
CONFIG_AMD_IOMMU=y
CONFIG_AMD_IOMMU_V2=m
CONFIG_DMAR_TABLE=y
CONFIG_INTEL_IOMMU=y
# CONFIG_INTEL_IOMMU_SVM is not set
# CONFIG_INTEL_IOMMU_DEFAULT_ON is not set
CONFIG_INTEL_IOMMU_FLOPPY_WA=y
# CONFIG_INTEL_IOMMU_SCALABLE_MODE_DEFAULT_ON is not set
CONFIG_IRQ_REMAP=y
CONFIG_HYPERV_IOMMU=y

#
# Remoteproc drivers
#
# CONFIG_REMOTEPROC is not set
# end of Remoteproc drivers

#
# Rpmsg drivers
#
# CONFIG_RPMSG_QCOM_GLINK_RPM is not set
# CONFIG_RPMSG_VIRTIO is not set
# end of Rpmsg drivers

# CONFIG_SOUNDWIRE is not set

#
# SOC (System On Chip) specific Drivers
#

#
# Amlogic SoC drivers
#
# end of Amlogic SoC drivers

#
# Aspeed SoC drivers
#
# end of Aspeed SoC drivers

#
# Broadcom SoC drivers
#
# end of Broadcom SoC drivers

#
# NXP/Freescale QorIQ SoC drivers
#
# end of NXP/Freescale QorIQ SoC drivers

#
# i.MX SoC drivers
#
# end of i.MX SoC drivers

#
# Qualcomm SoC drivers
#
# end of Qualcomm SoC drivers

# CONFIG_SOC_TI is not set

#
# Xilinx SoC drivers
#
# CONFIG_XILINX_VCU is not set
# end of Xilinx SoC drivers
# end of SOC (System On Chip) specific Drivers

# CONFIG_PM_DEVFREQ is not set
# CONFIG_EXTCON is not set
# CONFIG_MEMORY is not set
# CONFIG_IIO is not set
CONFIG_NTB=m
# CONFIG_NTB_MSI is not set
# CONFIG_NTB_AMD is not set
# CONFIG_NTB_IDT is not set
# CONFIG_NTB_INTEL is not set
# CONFIG_NTB_SWITCHTEC is not set
# CONFIG_NTB_PINGPONG is not set
# CONFIG_NTB_TOOL is not set
# CONFIG_NTB_PERF is not set
# CONFIG_NTB_TRANSPORT is not set
# CONFIG_VME_BUS is not set
CONFIG_PWM=y
CONFIG_PWM_SYSFS=y
# CONFIG_PWM_DEBUG is not set
CONFIG_PWM_LPSS=m
CONFIG_PWM_LPSS_PCI=m
CONFIG_PWM_LPSS_PLATFORM=m
# CONFIG_PWM_PCA9685 is not set

#
# IRQ chip support
#
# end of IRQ chip support

# CONFIG_IPACK_BUS is not set
# CONFIG_RESET_CONTROLLER is not set

#
# PHY Subsystem
#
# CONFIG_GENERIC_PHY is not set
# CONFIG_BCM_KONA_USB2_PHY is not set
# CONFIG_PHY_PXA_28NM_HSIC is not set
# CONFIG_PHY_PXA_28NM_USB2 is not set
# CONFIG_PHY_INTEL_EMMC is not set
# end of PHY Subsystem

CONFIG_POWERCAP=y
CONFIG_INTEL_RAPL_CORE=m
CONFIG_INTEL_RAPL=m
# CONFIG_IDLE_INJECT is not set
# CONFIG_MCB is not set

#
# Performance monitor support
#
# end of Performance monitor support

CONFIG_RAS=y
# CONFIG_RAS_CEC is not set
# CONFIG_USB4 is not set

#
# Android
#
# CONFIG_ANDROID is not set
# end of Android

CONFIG_LIBNVDIMM=m
CONFIG_BLK_DEV_PMEM=m
CONFIG_ND_BLK=m
CONFIG_ND_CLAIM=y
CONFIG_ND_BTT=m
CONFIG_BTT=y
CONFIG_ND_PFN=m
CONFIG_NVDIMM_PFN=y
CONFIG_NVDIMM_DAX=y
CONFIG_NVDIMM_KEYS=y
CONFIG_DAX_DRIVER=y
CONFIG_DAX=y
CONFIG_DEV_DAX=m
CONFIG_DEV_DAX_PMEM=m
CONFIG_DEV_DAX_KMEM=m
CONFIG_DEV_DAX_PMEM_COMPAT=m
CONFIG_NVMEM=y
CONFIG_NVMEM_SYSFS=y

#
# HW tracing support
#
CONFIG_STM=m
# CONFIG_STM_PROTO_BASIC is not set
# CONFIG_STM_PROTO_SYS_T is not set
CONFIG_STM_DUMMY=m
CONFIG_STM_SOURCE_CONSOLE=m
CONFIG_STM_SOURCE_HEARTBEAT=m
CONFIG_STM_SOURCE_FTRACE=m
CONFIG_INTEL_TH=m
CONFIG_INTEL_TH_PCI=m
CONFIG_INTEL_TH_ACPI=m
CONFIG_INTEL_TH_GTH=m
CONFIG_INTEL_TH_STH=m
CONFIG_INTEL_TH_MSU=m
CONFIG_INTEL_TH_PTI=m
# CONFIG_INTEL_TH_DEBUG is not set
# end of HW tracing support

# CONFIG_FPGA is not set
# CONFIG_TEE is not set
# CONFIG_UNISYS_VISORBUS is not set
# CONFIG_SIOX is not set
# CONFIG_SLIMBUS is not set
# CONFIG_INTERCONNECT is not set
# CONFIG_COUNTER is not set
# CONFIG_MOST is not set
# end of Device Drivers

#
# File systems
#
CONFIG_DCACHE_WORD_ACCESS=y
# CONFIG_VALIDATE_FS_PARSER is not set
CONFIG_FS_IOMAP=y
# CONFIG_EXT2_FS is not set
# CONFIG_EXT3_FS is not set
CONFIG_EXT4_FS=y
CONFIG_EXT4_USE_FOR_EXT2=y
CONFIG_EXT4_FS_POSIX_ACL=y
CONFIG_EXT4_FS_SECURITY=y
# CONFIG_EXT4_DEBUG is not set
CONFIG_EXT4_KUNIT_TESTS=m
CONFIG_JBD2=y
# CONFIG_JBD2_DEBUG is not set
CONFIG_FS_MBCACHE=y
# CONFIG_REISERFS_FS is not set
# CONFIG_JFS_FS is not set
CONFIG_XFS_FS=m
CONFIG_XFS_QUOTA=y
CONFIG_XFS_POSIX_ACL=y
CONFIG_XFS_RT=y
CONFIG_XFS_ONLINE_SCRUB=y
CONFIG_XFS_ONLINE_REPAIR=y
CONFIG_XFS_DEBUG=y
CONFIG_XFS_ASSERT_FATAL=y
CONFIG_GFS2_FS=m
CONFIG_GFS2_FS_LOCKING_DLM=y
CONFIG_OCFS2_FS=m
CONFIG_OCFS2_FS_O2CB=m
CONFIG_OCFS2_FS_USERSPACE_CLUSTER=m
CONFIG_OCFS2_FS_STATS=y
CONFIG_OCFS2_DEBUG_MASKLOG=y
# CONFIG_OCFS2_DEBUG_FS is not set
CONFIG_BTRFS_FS=m
CONFIG_BTRFS_FS_POSIX_ACL=y
# CONFIG_BTRFS_FS_CHECK_INTEGRITY is not set
# CONFIG_BTRFS_FS_RUN_SANITY_TESTS is not set
# CONFIG_BTRFS_DEBUG is not set
# CONFIG_BTRFS_ASSERT is not set
# CONFIG_BTRFS_FS_REF_VERIFY is not set
# CONFIG_NILFS2_FS is not set
CONFIG_F2FS_FS=m
CONFIG_F2FS_STAT_FS=y
CONFIG_F2FS_FS_XATTR=y
CONFIG_F2FS_FS_POSIX_ACL=y
CONFIG_F2FS_FS_SECURITY=y
# CONFIG_F2FS_CHECK_FS is not set
# CONFIG_F2FS_IO_TRACE is not set
# CONFIG_F2FS_FAULT_INJECTION is not set
# CONFIG_F2FS_FS_COMPRESSION is not set
# CONFIG_ZONEFS_FS is not set
CONFIG_FS_DAX=y
CONFIG_FS_DAX_PMD=y
CONFIG_FS_POSIX_ACL=y
CONFIG_EXPORTFS=y
CONFIG_EXPORTFS_BLOCK_OPS=y
CONFIG_FILE_LOCKING=y
CONFIG_MANDATORY_FILE_LOCKING=y
CONFIG_FS_ENCRYPTION=y
CONFIG_FS_ENCRYPTION_ALGS=y
# CONFIG_FS_VERITY is not set
CONFIG_FSNOTIFY=y
CONFIG_DNOTIFY=y
CONFIG_INOTIFY_USER=y
CONFIG_FANOTIFY=y
CONFIG_FANOTIFY_ACCESS_PERMISSIONS=y
CONFIG_QUOTA=y
CONFIG_QUOTA_NETLINK_INTERFACE=y
CONFIG_PRINT_QUOTA_WARNING=y
# CONFIG_QUOTA_DEBUG is not set
CONFIG_QUOTA_TREE=y
# CONFIG_QFMT_V1 is not set
CONFIG_QFMT_V2=y
CONFIG_QUOTACTL=y
CONFIG_QUOTACTL_COMPAT=y
CONFIG_AUTOFS4_FS=y
CONFIG_AUTOFS_FS=y
CONFIG_FUSE_FS=m
CONFIG_CUSE=m
# CONFIG_VIRTIO_FS is not set
CONFIG_OVERLAY_FS=m
# CONFIG_OVERLAY_FS_REDIRECT_DIR is not set
# CONFIG_OVERLAY_FS_REDIRECT_ALWAYS_FOLLOW is not set
# CONFIG_OVERLAY_FS_INDEX is not set
# CONFIG_OVERLAY_FS_XINO_AUTO is not set
# CONFIG_OVERLAY_FS_METACOPY is not set

#
# Caches
#
CONFIG_FSCACHE=m
CONFIG_FSCACHE_STATS=y
# CONFIG_FSCACHE_HISTOGRAM is not set
# CONFIG_FSCACHE_DEBUG is not set
# CONFIG_FSCACHE_OBJECT_LIST is not set
CONFIG_CACHEFILES=m
# CONFIG_CACHEFILES_DEBUG is not set
# CONFIG_CACHEFILES_HISTOGRAM is not set
# end of Caches

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=m
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_UDF_FS=m
# end of CD-ROM/DVD Filesystems

#
# DOS/FAT/EXFAT/NT Filesystems
#
CONFIG_FAT_FS=m
CONFIG_MSDOS_FS=m
CONFIG_VFAT_FS=m
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="ascii"
# CONFIG_FAT_DEFAULT_UTF8 is not set
# CONFIG_EXFAT_FS is not set
# CONFIG_NTFS_FS is not set
# end of DOS/FAT/EXFAT/NT Filesystems

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_PROC_VMCORE=y
CONFIG_PROC_VMCORE_DEVICE_DUMP=y
CONFIG_PROC_SYSCTL=y
CONFIG_PROC_PAGE_MONITOR=y
CONFIG_PROC_CHILDREN=y
CONFIG_PROC_PID_ARCH_STATUS=y
CONFIG_PROC_CPU_RESCTRL=y
CONFIG_KERNFS=y
CONFIG_SYSFS=y
CONFIG_TMPFS=y
CONFIG_TMPFS_POSIX_ACL=y
CONFIG_TMPFS_XATTR=y
# CONFIG_TMPFS_INODE64 is not set
CONFIG_HUGETLBFS=y
CONFIG_HUGETLB_PAGE=y
CONFIG_MEMFD_CREATE=y
CONFIG_ARCH_HAS_GIGANTIC_PAGE=y
CONFIG_CONFIGFS_FS=y
CONFIG_EFIVAR_FS=y
# end of Pseudo filesystems

CONFIG_MISC_FILESYSTEMS=y
# CONFIG_ORANGEFS_FS is not set
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_ECRYPT_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not set
CONFIG_CRAMFS=m
CONFIG_CRAMFS_BLOCKDEV=y
CONFIG_SQUASHFS=m
# CONFIG_SQUASHFS_FILE_CACHE is not set
CONFIG_SQUASHFS_FILE_DIRECT=y
# CONFIG_SQUASHFS_DECOMP_SINGLE is not set
# CONFIG_SQUASHFS_DECOMP_MULTI is not set
CONFIG_SQUASHFS_DECOMP_MULTI_PERCPU=y
CONFIG_SQUASHFS_XATTR=y
CONFIG_SQUASHFS_ZLIB=y
# CONFIG_SQUASHFS_LZ4 is not set
CONFIG_SQUASHFS_LZO=y
CONFIG_SQUASHFS_XZ=y
# CONFIG_SQUASHFS_ZSTD is not set
# CONFIG_SQUASHFS_4K_DEVBLK_SIZE is not set
# CONFIG_SQUASHFS_EMBEDDED is not set
CONFIG_SQUASHFS_FRAGMENT_CACHE_SIZE=3
# CONFIG_VXFS_FS is not set
CONFIG_MINIX_FS=m
# CONFIG_OMFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
# CONFIG_QNX6FS_FS is not set
# CONFIG_ROMFS_FS is not set
CONFIG_PSTORE=y
CONFIG_PSTORE_DEFLATE_COMPRESS=y
# CONFIG_PSTORE_LZO_COMPRESS is not set
# CONFIG_PSTORE_LZ4_COMPRESS is not set
# CONFIG_PSTORE_LZ4HC_COMPRESS is not set
# CONFIG_PSTORE_842_COMPRESS is not set
# CONFIG_PSTORE_ZSTD_COMPRESS is not set
CONFIG_PSTORE_COMPRESS=y
CONFIG_PSTORE_DEFLATE_COMPRESS_DEFAULT=y
CONFIG_PSTORE_COMPRESS_DEFAULT="deflate"
# CONFIG_PSTORE_CONSOLE is not set
# CONFIG_PSTORE_PMSG is not set
# CONFIG_PSTORE_FTRACE is not set
CONFIG_PSTORE_RAM=m
# CONFIG_PSTORE_BLK is not set
# CONFIG_SYSV_FS is not set
# CONFIG_UFS_FS is not set
# CONFIG_EROFS_FS is not set
CONFIG_NETWORK_FILESYSTEMS=y
CONFIG_NFS_FS=y
# CONFIG_NFS_V2 is not set
CONFIG_NFS_V3=y
CONFIG_NFS_V3_ACL=y
CONFIG_NFS_V4=m
# CONFIG_NFS_SWAP is not set
CONFIG_NFS_V4_1=y
CONFIG_NFS_V4_2=y
CONFIG_PNFS_FILE_LAYOUT=m
CONFIG_PNFS_BLOCK=m
CONFIG_PNFS_FLEXFILE_LAYOUT=m
CONFIG_NFS_V4_1_IMPLEMENTATION_ID_DOMAIN="kernel.org"
# CONFIG_NFS_V4_1_MIGRATION is not set
CONFIG_NFS_V4_SECURITY_LABEL=y
CONFIG_ROOT_NFS=y
# CONFIG_NFS_USE_LEGACY_DNS is not set
CONFIG_NFS_USE_KERNEL_DNS=y
CONFIG_NFS_DEBUG=y
CONFIG_NFS_DISABLE_UDP_SUPPORT=y
CONFIG_NFSD=m
CONFIG_NFSD_V2_ACL=y
CONFIG_NFSD_V3=y
CONFIG_NFSD_V3_ACL=y
CONFIG_NFSD_V4=y
CONFIG_NFSD_PNFS=y
# CONFIG_NFSD_BLOCKLAYOUT is not set
CONFIG_NFSD_SCSILAYOUT=y
# CONFIG_NFSD_FLEXFILELAYOUT is not set
# CONFIG_NFSD_V4_2_INTER_SSC is not set
CONFIG_NFSD_V4_SECURITY_LABEL=y
CONFIG_GRACE_PERIOD=y
CONFIG_LOCKD=y
CONFIG_LOCKD_V4=y
CONFIG_NFS_ACL_SUPPORT=y
CONFIG_NFS_COMMON=y
CONFIG_SUNRPC=y
CONFIG_SUNRPC_GSS=m
CONFIG_SUNRPC_BACKCHANNEL=y
CONFIG_RPCSEC_GSS_KRB5=m
# CONFIG_SUNRPC_DISABLE_INSECURE_ENCTYPES is not set
CONFIG_SUNRPC_DEBUG=y
CONFIG_SUNRPC_XPRT_RDMA=m
CONFIG_CEPH_FS=m
# CONFIG_CEPH_FSCACHE is not set
CONFIG_CEPH_FS_POSIX_ACL=y
# CONFIG_CEPH_FS_SECURITY_LABEL is not set
CONFIG_CIFS=m
# CONFIG_CIFS_STATS2 is not set
CONFIG_CIFS_ALLOW_INSECURE_LEGACY=y
CONFIG_CIFS_WEAK_PW_HASH=y
CONFIG_CIFS_UPCALL=y
CONFIG_CIFS_XATTR=y
CONFIG_CIFS_POSIX=y
CONFIG_CIFS_DEBUG=y
# CONFIG_CIFS_DEBUG2 is not set
# CONFIG_CIFS_DEBUG_DUMP_KEYS is not set
CONFIG_CIFS_DFS_UPCALL=y
# CONFIG_CIFS_SMB_DIRECT is not set
# CONFIG_CIFS_FSCACHE is not set
# CONFIG_CODA_FS is not set
# CONFIG_AFS_FS is not set
CONFIG_9P_FS=y
CONFIG_9P_FS_POSIX_ACL=y
# CONFIG_9P_FS_SECURITY is not set
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="utf8"
CONFIG_NLS_CODEPAGE_437=y
CONFIG_NLS_CODEPAGE_737=m
CONFIG_NLS_CODEPAGE_775=m
CONFIG_NLS_CODEPAGE_850=m
CONFIG_NLS_CODEPAGE_852=m
CONFIG_NLS_CODEPAGE_855=m
CONFIG_NLS_CODEPAGE_857=m
CONFIG_NLS_CODEPAGE_860=m
CONFIG_NLS_CODEPAGE_861=m
CONFIG_NLS_CODEPAGE_862=m
CONFIG_NLS_CODEPAGE_863=m
CONFIG_NLS_CODEPAGE_864=m
CONFIG_NLS_CODEPAGE_865=m
CONFIG_NLS_CODEPAGE_866=m
CONFIG_NLS_CODEPAGE_869=m
CONFIG_NLS_CODEPAGE_936=m
CONFIG_NLS_CODEPAGE_950=m
CONFIG_NLS_CODEPAGE_932=m
CONFIG_NLS_CODEPAGE_949=m
CONFIG_NLS_CODEPAGE_874=m
CONFIG_NLS_ISO8859_8=m
CONFIG_NLS_CODEPAGE_1250=m
CONFIG_NLS_CODEPAGE_1251=m
CONFIG_NLS_ASCII=y
CONFIG_NLS_ISO8859_1=m
CONFIG_NLS_ISO8859_2=m
CONFIG_NLS_ISO8859_3=m
CONFIG_NLS_ISO8859_4=m
CONFIG_NLS_ISO8859_5=m
CONFIG_NLS_ISO8859_6=m
CONFIG_NLS_ISO8859_7=m
CONFIG_NLS_ISO8859_9=m
CONFIG_NLS_ISO8859_13=m
CONFIG_NLS_ISO8859_14=m
CONFIG_NLS_ISO8859_15=m
CONFIG_NLS_KOI8_R=m
CONFIG_NLS_KOI8_U=m
CONFIG_NLS_MAC_ROMAN=m
CONFIG_NLS_MAC_CELTIC=m
CONFIG_NLS_MAC_CENTEURO=m
CONFIG_NLS_MAC_CROATIAN=m
CONFIG_NLS_MAC_CYRILLIC=m
CONFIG_NLS_MAC_GAELIC=m
CONFIG_NLS_MAC_GREEK=m
CONFIG_NLS_MAC_ICELAND=m
CONFIG_NLS_MAC_INUIT=m
CONFIG_NLS_MAC_ROMANIAN=m
CONFIG_NLS_MAC_TURKISH=m
CONFIG_NLS_UTF8=m
CONFIG_DLM=m
CONFIG_DLM_DEBUG=y
# CONFIG_UNICODE is not set
CONFIG_IO_WQ=y
# end of File systems

#
# Security options
#
CONFIG_KEYS=y
# CONFIG_KEYS_REQUEST_CACHE is not set
CONFIG_PERSISTENT_KEYRINGS=y
CONFIG_TRUSTED_KEYS=y
CONFIG_ENCRYPTED_KEYS=y
# CONFIG_KEY_DH_OPERATIONS is not set
# CONFIG_SECURITY_DMESG_RESTRICT is not set
CONFIG_SECURITY=y
CONFIG_SECURITY_WRITABLE_HOOKS=y
CONFIG_SECURITYFS=y
CONFIG_SECURITY_NETWORK=y
CONFIG_PAGE_TABLE_ISOLATION=y
# CONFIG_SECURITY_INFINIBAND is not set
CONFIG_SECURITY_NETWORK_XFRM=y
CONFIG_SECURITY_PATH=y
CONFIG_INTEL_TXT=y
CONFIG_LSM_MMAP_MIN_ADDR=65535
CONFIG_HAVE_HARDENED_USERCOPY_ALLOCATOR=y
CONFIG_HARDENED_USERCOPY=y
CONFIG_HARDENED_USERCOPY_FALLBACK=y
CONFIG_FORTIFY_SOURCE=y
# CONFIG_STATIC_USERMODEHELPER is not set
CONFIG_SECURITY_SELINUX=y
CONFIG_SECURITY_SELINUX_BOOTPARAM=y
CONFIG_SECURITY_SELINUX_DISABLE=y
CONFIG_SECURITY_SELINUX_DEVELOP=y
CONFIG_SECURITY_SELINUX_AVC_STATS=y
CONFIG_SECURITY_SELINUX_CHECKREQPROT_VALUE=1
CONFIG_SECURITY_SELINUX_SIDTAB_HASH_BITS=9
CONFIG_SECURITY_SELINUX_SID2STR_CACHE_SIZE=256
# CONFIG_SECURITY_SMACK is not set
# CONFIG_SECURITY_TOMOYO is not set
CONFIG_SECURITY_APPARMOR=y
CONFIG_SECURITY_APPARMOR_HASH=y
CONFIG_SECURITY_APPARMOR_HASH_DEFAULT=y
# CONFIG_SECURITY_APPARMOR_DEBUG is not set
# CONFIG_SECURITY_APPARMOR_KUNIT_TEST is not set
# CONFIG_SECURITY_LOADPIN is not set
CONFIG_SECURITY_YAMA=y
# CONFIG_SECURITY_SAFESETID is not set
# CONFIG_SECURITY_LOCKDOWN_LSM is not set
CONFIG_INTEGRITY=y
CONFIG_INTEGRITY_SIGNATURE=y
CONFIG_INTEGRITY_ASYMMETRIC_KEYS=y
CONFIG_INTEGRITY_TRUSTED_KEYRING=y
# CONFIG_INTEGRITY_PLATFORM_KEYRING is not set
CONFIG_INTEGRITY_AUDIT=y
CONFIG_IMA=y
CONFIG_IMA_MEASURE_PCR_IDX=10
CONFIG_IMA_LSM_RULES=y
# CONFIG_IMA_TEMPLATE is not set
CONFIG_IMA_NG_TEMPLATE=y
# CONFIG_IMA_SIG_TEMPLATE is not set
CONFIG_IMA_DEFAULT_TEMPLATE="ima-ng"
CONFIG_IMA_DEFAULT_HASH_SHA1=y
# CONFIG_IMA_DEFAULT_HASH_SHA256 is not set
# CONFIG_IMA_DEFAULT_HASH_SHA512 is not set
CONFIG_IMA_DEFAULT_HASH="sha1"
# CONFIG_IMA_WRITE_POLICY is not set
# CONFIG_IMA_READ_POLICY is not set
CONFIG_IMA_APPRAISE=y
# CONFIG_IMA_ARCH_POLICY is not set
# CONFIG_IMA_APPRAISE_BUILD_POLICY is not set
CONFIG_IMA_APPRAISE_BOOTPARAM=y
# CONFIG_IMA_APPRAISE_MODSIG is not set
CONFIG_IMA_TRUSTED_KEYRING=y
# CONFIG_IMA_BLACKLIST_KEYRING is not set
# CONFIG_IMA_LOAD_X509 is not set
CONFIG_IMA_MEASURE_ASYMMETRIC_KEYS=y
CONFIG_IMA_QUEUE_EARLY_BOOT_KEYS=y
# CONFIG_IMA_SECURE_AND_OR_TRUSTED_BOOT is not set
CONFIG_EVM=y
CONFIG_EVM_ATTR_FSUUID=y
# CONFIG_EVM_ADD_XATTRS is not set
# CONFIG_EVM_LOAD_X509 is not set
CONFIG_DEFAULT_SECURITY_SELINUX=y
# CONFIG_DEFAULT_SECURITY_APPARMOR is not set
# CONFIG_DEFAULT_SECURITY_DAC is not set
CONFIG_LSM="lockdown,yama,loadpin,safesetid,integrity,selinux,smack,tomoyo,apparmor,bpf"

#
# Kernel hardening options
#

#
# Memory initialization
#
CONFIG_INIT_STACK_NONE=y
# CONFIG_INIT_ON_ALLOC_DEFAULT_ON is not set
# CONFIG_INIT_ON_FREE_DEFAULT_ON is not set
# end of Memory initialization
# end of Kernel hardening options
# end of Security options

CONFIG_XOR_BLOCKS=m
CONFIG_ASYNC_CORE=m
CONFIG_ASYNC_MEMCPY=m
CONFIG_ASYNC_XOR=m
CONFIG_ASYNC_PQ=m
CONFIG_ASYNC_RAID6_RECOV=m
CONFIG_CRYPTO=y

#
# Crypto core or helper
#
CONFIG_CRYPTO_ALGAPI=y
CONFIG_CRYPTO_ALGAPI2=y
CONFIG_CRYPTO_AEAD=y
CONFIG_CRYPTO_AEAD2=y
CONFIG_CRYPTO_SKCIPHER=y
CONFIG_CRYPTO_SKCIPHER2=y
CONFIG_CRYPTO_HASH=y
CONFIG_CRYPTO_HASH2=y
CONFIG_CRYPTO_RNG=y
CONFIG_CRYPTO_RNG2=y
CONFIG_CRYPTO_RNG_DEFAULT=y
CONFIG_CRYPTO_AKCIPHER2=y
CONFIG_CRYPTO_AKCIPHER=y
CONFIG_CRYPTO_KPP2=y
CONFIG_CRYPTO_KPP=m
CONFIG_CRYPTO_ACOMP2=y
CONFIG_CRYPTO_MANAGER=y
CONFIG_CRYPTO_MANAGER2=y
CONFIG_CRYPTO_USER=m
CONFIG_CRYPTO_MANAGER_DISABLE_TESTS=y
CONFIG_CRYPTO_GF128MUL=y
CONFIG_CRYPTO_NULL=y
CONFIG_CRYPTO_NULL2=y
CONFIG_CRYPTO_PCRYPT=m
CONFIG_CRYPTO_CRYPTD=y
CONFIG_CRYPTO_AUTHENC=m
CONFIG_CRYPTO_TEST=m
CONFIG_CRYPTO_SIMD=y
CONFIG_CRYPTO_GLUE_HELPER_X86=y

#
# Public-key cryptography
#
CONFIG_CRYPTO_RSA=y
CONFIG_CRYPTO_DH=m
CONFIG_CRYPTO_ECC=m
CONFIG_CRYPTO_ECDH=m
# CONFIG_CRYPTO_ECRDSA is not set
# CONFIG_CRYPTO_CURVE25519 is not set
# CONFIG_CRYPTO_CURVE25519_X86 is not set

#
# Authenticated Encryption with Associated Data
#
CONFIG_CRYPTO_CCM=m
CONFIG_CRYPTO_GCM=y
CONFIG_CRYPTO_CHACHA20POLY1305=m
# CONFIG_CRYPTO_AEGIS128 is not set
# CONFIG_CRYPTO_AEGIS128_AESNI_SSE2 is not set
CONFIG_CRYPTO_SEQIV=y
CONFIG_CRYPTO_ECHAINIV=m

#
# Block modes
#
CONFIG_CRYPTO_CBC=y
CONFIG_CRYPTO_CFB=y
CONFIG_CRYPTO_CTR=y
CONFIG_CRYPTO_CTS=y
CONFIG_CRYPTO_ECB=y
CONFIG_CRYPTO_LRW=m
# CONFIG_CRYPTO_OFB is not set
CONFIG_CRYPTO_PCBC=m
CONFIG_CRYPTO_XTS=y
# CONFIG_CRYPTO_KEYWRAP is not set
# CONFIG_CRYPTO_NHPOLY1305_SSE2 is not set
# CONFIG_CRYPTO_NHPOLY1305_AVX2 is not set
# CONFIG_CRYPTO_ADIANTUM is not set
CONFIG_CRYPTO_ESSIV=m

#
# Hash modes
#
CONFIG_CRYPTO_CMAC=m
CONFIG_CRYPTO_HMAC=y
CONFIG_CRYPTO_XCBC=m
CONFIG_CRYPTO_VMAC=m

#
# Digest
#
CONFIG_CRYPTO_CRC32C=y
CONFIG_CRYPTO_CRC32C_INTEL=m
CONFIG_CRYPTO_CRC32=m
CONFIG_CRYPTO_CRC32_PCLMUL=m
CONFIG_CRYPTO_XXHASH=m
CONFIG_CRYPTO_BLAKE2B=m
# CONFIG_CRYPTO_BLAKE2S is not set
# CONFIG_CRYPTO_BLAKE2S_X86 is not set
CONFIG_CRYPTO_CRCT10DIF=y
CONFIG_CRYPTO_CRCT10DIF_PCLMUL=m
CONFIG_CRYPTO_GHASH=y
CONFIG_CRYPTO_POLY1305=m
CONFIG_CRYPTO_POLY1305_X86_64=m
CONFIG_CRYPTO_MD4=m
CONFIG_CRYPTO_MD5=y
CONFIG_CRYPTO_MICHAEL_MIC=m
CONFIG_CRYPTO_RMD128=m
CONFIG_CRYPTO_RMD160=m
CONFIG_CRYPTO_RMD256=m
CONFIG_CRYPTO_RMD320=m
CONFIG_CRYPTO_SHA1=y
CONFIG_CRYPTO_SHA1_SSSE3=y
CONFIG_CRYPTO_SHA256_SSSE3=y
CONFIG_CRYPTO_SHA512_SSSE3=m
CONFIG_CRYPTO_SHA256=y
CONFIG_CRYPTO_SHA512=y
CONFIG_CRYPTO_SHA3=m
# CONFIG_CRYPTO_SM3 is not set
# CONFIG_CRYPTO_STREEBOG is not set
CONFIG_CRYPTO_TGR192=m
CONFIG_CRYPTO_WP512=m
CONFIG_CRYPTO_GHASH_CLMUL_NI_INTEL=m

#
# Ciphers
#
CONFIG_CRYPTO_AES=y
# CONFIG_CRYPTO_AES_TI is not set
CONFIG_CRYPTO_AES_NI_INTEL=y
CONFIG_CRYPTO_ANUBIS=m
CONFIG_CRYPTO_ARC4=m
CONFIG_CRYPTO_BLOWFISH=m
CONFIG_CRYPTO_BLOWFISH_COMMON=m
CONFIG_CRYPTO_BLOWFISH_X86_64=m
CONFIG_CRYPTO_CAMELLIA=m
CONFIG_CRYPTO_CAMELLIA_X86_64=m
CONFIG_CRYPTO_CAMELLIA_AESNI_AVX_X86_64=m
CONFIG_CRYPTO_CAMELLIA_AESNI_AVX2_X86_64=m
CONFIG_CRYPTO_CAST_COMMON=m
CONFIG_CRYPTO_CAST5=m
CONFIG_CRYPTO_CAST5_AVX_X86_64=m
CONFIG_CRYPTO_CAST6=m
CONFIG_CRYPTO_CAST6_AVX_X86_64=m
CONFIG_CRYPTO_DES=m
CONFIG_CRYPTO_DES3_EDE_X86_64=m
CONFIG_CRYPTO_FCRYPT=m
CONFIG_CRYPTO_KHAZAD=m
CONFIG_CRYPTO_SALSA20=m
CONFIG_CRYPTO_CHACHA20=m
CONFIG_CRYPTO_CHACHA20_X86_64=m
CONFIG_CRYPTO_SEED=m
CONFIG_CRYPTO_SERPENT=m
CONFIG_CRYPTO_SERPENT_SSE2_X86_64=m
CONFIG_CRYPTO_SERPENT_AVX_X86_64=m
CONFIG_CRYPTO_SERPENT_AVX2_X86_64=m
# CONFIG_CRYPTO_SM4 is not set
CONFIG_CRYPTO_TEA=m
CONFIG_CRYPTO_TWOFISH=m
CONFIG_CRYPTO_TWOFISH_COMMON=m
CONFIG_CRYPTO_TWOFISH_X86_64=m
CONFIG_CRYPTO_TWOFISH_X86_64_3WAY=m
CONFIG_CRYPTO_TWOFISH_AVX_X86_64=m

#
# Compression
#
CONFIG_CRYPTO_DEFLATE=y
CONFIG_CRYPTO_LZO=y
# CONFIG_CRYPTO_842 is not set
# CONFIG_CRYPTO_LZ4 is not set
# CONFIG_CRYPTO_LZ4HC is not set
# CONFIG_CRYPTO_ZSTD is not set

#
# Random Number Generation
#
CONFIG_CRYPTO_ANSI_CPRNG=m
CONFIG_CRYPTO_DRBG_MENU=y
CONFIG_CRYPTO_DRBG_HMAC=y
CONFIG_CRYPTO_DRBG_HASH=y
CONFIG_CRYPTO_DRBG_CTR=y
CONFIG_CRYPTO_DRBG=y
CONFIG_CRYPTO_JITTERENTROPY=y
CONFIG_CRYPTO_USER_API=y
CONFIG_CRYPTO_USER_API_HASH=y
CONFIG_CRYPTO_USER_API_SKCIPHER=y
CONFIG_CRYPTO_USER_API_RNG=y
CONFIG_CRYPTO_USER_API_AEAD=y
# CONFIG_CRYPTO_STATS is not set
CONFIG_CRYPTO_HASH_INFO=y

#
# Crypto library routines
#
CONFIG_CRYPTO_LIB_AES=y
CONFIG_CRYPTO_LIB_ARC4=m
# CONFIG_CRYPTO_LIB_BLAKE2S is not set
CONFIG_CRYPTO_ARCH_HAVE_LIB_CHACHA=m
CONFIG_CRYPTO_LIB_CHACHA_GENERIC=m
# CONFIG_CRYPTO_LIB_CHACHA is not set
# CONFIG_CRYPTO_LIB_CURVE25519 is not set
CONFIG_CRYPTO_LIB_DES=m
CONFIG_CRYPTO_LIB_POLY1305_RSIZE=11
CONFIG_CRYPTO_ARCH_HAVE_LIB_POLY1305=m
CONFIG_CRYPTO_LIB_POLY1305_GENERIC=m
# CONFIG_CRYPTO_LIB_POLY1305 is not set
# CONFIG_CRYPTO_LIB_CHACHA20POLY1305 is not set
CONFIG_CRYPTO_LIB_SHA256=y
CONFIG_CRYPTO_HW=y
CONFIG_CRYPTO_DEV_PADLOCK=m
CONFIG_CRYPTO_DEV_PADLOCK_AES=m
CONFIG_CRYPTO_DEV_PADLOCK_SHA=m
# CONFIG_CRYPTO_DEV_ATMEL_ECC is not set
# CONFIG_CRYPTO_DEV_ATMEL_SHA204A is not set
CONFIG_CRYPTO_DEV_CCP=y
CONFIG_CRYPTO_DEV_CCP_DD=y
CONFIG_CRYPTO_DEV_SP_CCP=y
CONFIG_CRYPTO_DEV_CCP_CRYPTO=m
CONFIG_CRYPTO_DEV_SP_PSP=y
# CONFIG_CRYPTO_DEV_CCP_DEBUGFS is not set
CONFIG_CRYPTO_DEV_QAT=m
CONFIG_CRYPTO_DEV_QAT_DH895xCC=m
CONFIG_CRYPTO_DEV_QAT_C3XXX=m
CONFIG_CRYPTO_DEV_QAT_C62X=m
CONFIG_CRYPTO_DEV_QAT_DH895xCCVF=m
CONFIG_CRYPTO_DEV_QAT_C3XXXVF=m
CONFIG_CRYPTO_DEV_QAT_C62XVF=m
CONFIG_CRYPTO_DEV_NITROX=m
CONFIG_CRYPTO_DEV_NITROX_CNN55XX=m
# CONFIG_CRYPTO_DEV_VIRTIO is not set
# CONFIG_CRYPTO_DEV_SAFEXCEL is not set
# CONFIG_CRYPTO_DEV_AMLOGIC_GXL is not set
CONFIG_ASYMMETRIC_KEY_TYPE=y
CONFIG_ASYMMETRIC_PUBLIC_KEY_SUBTYPE=y
# CONFIG_ASYMMETRIC_TPM_KEY_SUBTYPE is not set
CONFIG_X509_CERTIFICATE_PARSER=y
# CONFIG_PKCS8_PRIVATE_KEY_PARSER is not set
CONFIG_PKCS7_MESSAGE_PARSER=y
# CONFIG_PKCS7_TEST_KEY is not set
CONFIG_SIGNED_PE_FILE_VERIFICATION=y

#
# Certificates for signature checking
#
CONFIG_MODULE_SIG_KEY="certs/signing_key.pem"
CONFIG_SYSTEM_TRUSTED_KEYRING=y
CONFIG_SYSTEM_TRUSTED_KEYS=""
# CONFIG_SYSTEM_EXTRA_CERTIFICATE is not set
# CONFIG_SECONDARY_TRUSTED_KEYRING is not set
CONFIG_SYSTEM_BLACKLIST_KEYRING=y
CONFIG_SYSTEM_BLACKLIST_HASH_LIST=""
# end of Certificates for signature checking

CONFIG_BINARY_PRINTF=y

#
# Library routines
#
CONFIG_RAID6_PQ=m
CONFIG_RAID6_PQ_BENCHMARK=y
# CONFIG_PACKING is not set
CONFIG_BITREVERSE=y
CONFIG_GENERIC_STRNCPY_FROM_USER=y
CONFIG_GENERIC_STRNLEN_USER=y
CONFIG_GENERIC_NET_UTILS=y
CONFIG_GENERIC_FIND_FIRST_BIT=y
CONFIG_CORDIC=m
# CONFIG_PRIME_NUMBERS is not set
CONFIG_RATIONAL=y
CONFIG_GENERIC_PCI_IOMAP=y
CONFIG_GENERIC_IOMAP=y
CONFIG_ARCH_USE_CMPXCHG_LOCKREF=y
CONFIG_ARCH_HAS_FAST_MULTIPLIER=y
CONFIG_ARCH_USE_SYM_ANNOTATIONS=y
CONFIG_CRC_CCITT=y
CONFIG_CRC16=y
CONFIG_CRC_T10DIF=y
CONFIG_CRC_ITU_T=m
CONFIG_CRC32=y
# CONFIG_CRC32_SELFTEST is not set
CONFIG_CRC32_SLICEBY8=y
# CONFIG_CRC32_SLICEBY4 is not set
# CONFIG_CRC32_SARWATE is not set
# CONFIG_CRC32_BIT is not set
# CONFIG_CRC64 is not set
# CONFIG_CRC4 is not set
CONFIG_CRC7=m
CONFIG_LIBCRC32C=m
CONFIG_CRC8=m
CONFIG_XXHASH=y
# CONFIG_RANDOM32_SELFTEST is not set
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=y
CONFIG_LZO_COMPRESS=y
CONFIG_LZO_DECOMPRESS=y
CONFIG_LZ4_DECOMPRESS=y
CONFIG_ZSTD_COMPRESS=m
CONFIG_ZSTD_DECOMPRESS=y
CONFIG_XZ_DEC=y
CONFIG_XZ_DEC_X86=y
CONFIG_XZ_DEC_POWERPC=y
CONFIG_XZ_DEC_IA64=y
CONFIG_XZ_DEC_ARM=y
CONFIG_XZ_DEC_ARMTHUMB=y
CONFIG_XZ_DEC_SPARC=y
CONFIG_XZ_DEC_BCJ=y
# CONFIG_XZ_DEC_TEST is not set
CONFIG_DECOMPRESS_GZIP=y
CONFIG_DECOMPRESS_BZIP2=y
CONFIG_DECOMPRESS_LZMA=y
CONFIG_DECOMPRESS_XZ=y
CONFIG_DECOMPRESS_LZO=y
CONFIG_DECOMPRESS_LZ4=y
CONFIG_DECOMPRESS_ZSTD=y
CONFIG_GENERIC_ALLOCATOR=y
CONFIG_REED_SOLOMON=m
CONFIG_REED_SOLOMON_ENC8=y
CONFIG_REED_SOLOMON_DEC8=y
CONFIG_TEXTSEARCH=y
CONFIG_TEXTSEARCH_KMP=m
CONFIG_TEXTSEARCH_BM=m
CONFIG_TEXTSEARCH_FSM=m
CONFIG_INTERVAL_TREE=y
CONFIG_XARRAY_MULTI=y
CONFIG_ASSOCIATIVE_ARRAY=y
CONFIG_HAS_IOMEM=y
CONFIG_HAS_IOPORT_MAP=y
CONFIG_HAS_DMA=y
CONFIG_DMA_OPS=y
CONFIG_NEED_SG_DMA_LENGTH=y
CONFIG_NEED_DMA_MAP_STATE=y
CONFIG_ARCH_DMA_ADDR_T_64BIT=y
CONFIG_ARCH_HAS_FORCE_DMA_UNENCRYPTED=y
CONFIG_DMA_VIRT_OPS=y
CONFIG_SWIOTLB=y
CONFIG_DMA_COHERENT_POOL=y
CONFIG_DMA_CMA=y

#
# Default contiguous memory area size:
#
CONFIG_CMA_SIZE_MBYTES=200
CONFIG_CMA_SIZE_SEL_MBYTES=y
# CONFIG_CMA_SIZE_SEL_PERCENTAGE is not set
# CONFIG_CMA_SIZE_SEL_MIN is not set
# CONFIG_CMA_SIZE_SEL_MAX is not set
CONFIG_CMA_ALIGNMENT=8
# CONFIG_DMA_API_DEBUG is not set
CONFIG_SGL_ALLOC=y
CONFIG_CHECK_SIGNATURE=y
CONFIG_CPUMASK_OFFSTACK=y
CONFIG_CPU_RMAP=y
CONFIG_DQL=y
CONFIG_GLOB=y
# CONFIG_GLOB_SELFTEST is not set
CONFIG_NLATTR=y
CONFIG_CLZ_TAB=y
CONFIG_IRQ_POLL=y
CONFIG_MPILIB=y
CONFIG_SIGNATURE=y
CONFIG_DIMLIB=y
CONFIG_OID_REGISTRY=y
CONFIG_UCS2_STRING=y
CONFIG_HAVE_GENERIC_VDSO=y
CONFIG_GENERIC_GETTIMEOFDAY=y
CONFIG_GENERIC_VDSO_TIME_NS=y
CONFIG_FONT_SUPPORT=y
# CONFIG_FONTS is not set
CONFIG_FONT_8x8=y
CONFIG_FONT_8x16=y
CONFIG_SG_POOL=y
CONFIG_ARCH_HAS_PMEM_API=y
CONFIG_MEMREGION=y
CONFIG_ARCH_HAS_UACCESS_FLUSHCACHE=y
CONFIG_ARCH_HAS_UACCESS_MCSAFE=y
CONFIG_ARCH_STACKWALK=y
CONFIG_SBITMAP=y
# CONFIG_STRING_SELFTEST is not set
# end of Library routines

#
# Kernel hacking
#

#
# printk and dmesg options
#
CONFIG_PRINTK_TIME=y
# CONFIG_PRINTK_CALLER is not set
CONFIG_CONSOLE_LOGLEVEL_DEFAULT=7
CONFIG_CONSOLE_LOGLEVEL_QUIET=4
CONFIG_MESSAGE_LOGLEVEL_DEFAULT=4
CONFIG_BOOT_PRINTK_DELAY=y
CONFIG_DYNAMIC_DEBUG=y
CONFIG_DYNAMIC_DEBUG_CORE=y
CONFIG_SYMBOLIC_ERRNAME=y
CONFIG_DEBUG_BUGVERBOSE=y
# end of printk and dmesg options

#
# Compile-time checks and compiler options
#
CONFIG_DEBUG_INFO=y
CONFIG_DEBUG_INFO_REDUCED=y
# CONFIG_DEBUG_INFO_COMPRESSED is not set
# CONFIG_DEBUG_INFO_SPLIT is not set
CONFIG_DEBUG_INFO_DWARF4=y
# CONFIG_GDB_SCRIPTS is not set
CONFIG_ENABLE_MUST_CHECK=y
CONFIG_FRAME_WARN=2048
CONFIG_STRIP_ASM_SYMS=y
# CONFIG_READABLE_ASM is not set
# CONFIG_HEADERS_INSTALL is not set
CONFIG_DEBUG_SECTION_MISMATCH=y
CONFIG_SECTION_MISMATCH_WARN_ONLY=y
CONFIG_STACK_VALIDATION=y
# CONFIG_DEBUG_FORCE_WEAK_PER_CPU is not set
# end of Compile-time checks and compiler options

#
# Generic Kernel Debugging Instruments
#
CONFIG_MAGIC_SYSRQ=y
CONFIG_MAGIC_SYSRQ_DEFAULT_ENABLE=0x1
CONFIG_MAGIC_SYSRQ_SERIAL=y
CONFIG_MAGIC_SYSRQ_SERIAL_SEQUENCE=""
CONFIG_DEBUG_FS=y
CONFIG_DEBUG_FS_ALLOW_ALL=y
# CONFIG_DEBUG_FS_DISALLOW_MOUNT is not set
# CONFIG_DEBUG_FS_ALLOW_NONE is not set
CONFIG_HAVE_ARCH_KGDB=y
# CONFIG_KGDB is not set
CONFIG_ARCH_HAS_UBSAN_SANITIZE_ALL=y
# CONFIG_UBSAN is not set
CONFIG_HAVE_ARCH_KCSAN=y
# end of Generic Kernel Debugging Instruments

CONFIG_DEBUG_KERNEL=y
CONFIG_DEBUG_MISC=y

#
# Memory Debugging
#
# CONFIG_PAGE_EXTENSION is not set
# CONFIG_DEBUG_PAGEALLOC is not set
# CONFIG_PAGE_OWNER is not set
# CONFIG_PAGE_POISONING is not set
# CONFIG_DEBUG_PAGE_REF is not set
# CONFIG_DEBUG_RODATA_TEST is not set
CONFIG_ARCH_HAS_DEBUG_WX=y
# CONFIG_DEBUG_WX is not set
CONFIG_GENERIC_PTDUMP=y
# CONFIG_PTDUMP_DEBUGFS is not set
# CONFIG_DEBUG_OBJECTS is not set
# CONFIG_SLUB_DEBUG_ON is not set
# CONFIG_SLUB_STATS is not set
CONFIG_HAVE_DEBUG_KMEMLEAK=y
# CONFIG_DEBUG_KMEMLEAK is not set
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_SCHED_STACK_END_CHECK is not set
CONFIG_ARCH_HAS_DEBUG_VM_PGTABLE=y
# CONFIG_DEBUG_VM is not set
# CONFIG_DEBUG_VM_PGTABLE is not set
CONFIG_ARCH_HAS_DEBUG_VIRTUAL=y
# CONFIG_DEBUG_VIRTUAL is not set
CONFIG_DEBUG_MEMORY_INIT=y
# CONFIG_DEBUG_PER_CPU_MAPS is not set
CONFIG_HAVE_ARCH_KASAN=y
CONFIG_HAVE_ARCH_KASAN_VMALLOC=y
CONFIG_CC_HAS_KASAN_GENERIC=y
CONFIG_CC_HAS_WORKING_NOSANITIZE_ADDRESS=y
# CONFIG_KASAN is not set
# end of Memory Debugging

CONFIG_DEBUG_SHIRQ=y

#
# Debug Oops, Lockups and Hangs
#
CONFIG_PANIC_ON_OOPS=y
CONFIG_PANIC_ON_OOPS_VALUE=1
CONFIG_PANIC_TIMEOUT=0
CONFIG_LOCKUP_DETECTOR=y
CONFIG_SOFTLOCKUP_DETECTOR=y
# CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC is not set
CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC_VALUE=0
CONFIG_HARDLOCKUP_DETECTOR_PERF=y
CONFIG_HARDLOCKUP_CHECK_TIMESTAMP=y
CONFIG_HARDLOCKUP_DETECTOR=y
CONFIG_BOOTPARAM_HARDLOCKUP_PANIC=y
CONFIG_BOOTPARAM_HARDLOCKUP_PANIC_VALUE=1
# CONFIG_DETECT_HUNG_TASK is not set
# CONFIG_WQ_WATCHDOG is not set
# CONFIG_TEST_LOCKUP is not set
# end of Debug Oops, Lockups and Hangs

#
# Scheduler Debugging
#
CONFIG_SCHED_DEBUG=y
CONFIG_SCHED_INFO=y
CONFIG_SCHEDSTATS=y
# end of Scheduler Debugging

# CONFIG_DEBUG_TIMEKEEPING is not set

#
# Lock Debugging (spinlocks, mutexes, etc...)
#
CONFIG_LOCK_DEBUGGING_SUPPORT=y
# CONFIG_PROVE_LOCKING is not set
# CONFIG_LOCK_STAT is not set
# CONFIG_DEBUG_RT_MUTEXES is not set
# CONFIG_DEBUG_SPINLOCK is not set
# CONFIG_DEBUG_MUTEXES is not set
# CONFIG_DEBUG_WW_MUTEX_SLOWPATH is not set
# CONFIG_DEBUG_RWSEMS is not set
# CONFIG_DEBUG_LOCK_ALLOC is not set
CONFIG_DEBUG_ATOMIC_SLEEP=y
# CONFIG_DEBUG_LOCKING_API_SELFTESTS is not set
CONFIG_LOCK_TORTURE_TEST=m
# CONFIG_WW_MUTEX_SELFTEST is not set
# end of Lock Debugging (spinlocks, mutexes, etc...)

CONFIG_STACKTRACE=y
# CONFIG_WARN_ALL_UNSEEDED_RANDOM is not set
# CONFIG_DEBUG_KOBJECT is not set

#
# Debug kernel data structures
#
CONFIG_DEBUG_LIST=y
# CONFIG_DEBUG_PLIST is not set
# CONFIG_DEBUG_SG is not set
# CONFIG_DEBUG_NOTIFIERS is not set
CONFIG_BUG_ON_DATA_CORRUPTION=y
# end of Debug kernel data structures

# CONFIG_DEBUG_CREDENTIALS is not set

#
# RCU Debugging
#
CONFIG_TORTURE_TEST=m
CONFIG_RCU_PERF_TEST=m
CONFIG_RCU_TORTURE_TEST=m
# CONFIG_RCU_REF_SCALE_TEST is not set
CONFIG_RCU_CPU_STALL_TIMEOUT=60
# CONFIG_RCU_TRACE is not set
# CONFIG_RCU_EQS_DEBUG is not set
# end of RCU Debugging

# CONFIG_DEBUG_WQ_FORCE_RR_CPU is not set
# CONFIG_DEBUG_BLOCK_EXT_DEVT is not set
# CONFIG_CPU_HOTPLUG_STATE_CONTROL is not set
CONFIG_LATENCYTOP=y
CONFIG_USER_STACKTRACE_SUPPORT=y
CONFIG_NOP_TRACER=y
CONFIG_HAVE_FUNCTION_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_HAVE_DYNAMIC_FTRACE_WITH_REGS=y
CONFIG_HAVE_DYNAMIC_FTRACE_WITH_DIRECT_CALLS=y
CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
CONFIG_HAVE_FENTRY=y
CONFIG_HAVE_C_RECORDMCOUNT=y
CONFIG_TRACER_MAX_TRACE=y
CONFIG_TRACE_CLOCK=y
CONFIG_RING_BUFFER=y
CONFIG_EVENT_TRACING=y
CONFIG_CONTEXT_SWITCH_TRACER=y
CONFIG_RING_BUFFER_ALLOW_SWAP=y
CONFIG_TRACING=y
CONFIG_GENERIC_TRACER=y
CONFIG_TRACING_SUPPORT=y
CONFIG_FTRACE=y
# CONFIG_BOOTTIME_TRACING is not set
CONFIG_FUNCTION_TRACER=y
CONFIG_FUNCTION_GRAPH_TRACER=y
CONFIG_DYNAMIC_FTRACE=y
CONFIG_DYNAMIC_FTRACE_WITH_REGS=y
CONFIG_DYNAMIC_FTRACE_WITH_DIRECT_CALLS=y
CONFIG_FUNCTION_PROFILER=y
CONFIG_STACK_TRACER=y
# CONFIG_IRQSOFF_TRACER is not set
CONFIG_SCHED_TRACER=y
CONFIG_HWLAT_TRACER=y
# CONFIG_MMIOTRACE is not set
CONFIG_FTRACE_SYSCALLS=y
CONFIG_TRACER_SNAPSHOT=y
# CONFIG_TRACER_SNAPSHOT_PER_CPU_SWAP is not set
CONFIG_BRANCH_PROFILE_NONE=y
# CONFIG_PROFILE_ANNOTATED_BRANCHES is not set
CONFIG_BLK_DEV_IO_TRACE=y
CONFIG_KPROBE_EVENTS=y
# CONFIG_KPROBE_EVENTS_ON_NOTRACE is not set
CONFIG_UPROBE_EVENTS=y
CONFIG_BPF_EVENTS=y
CONFIG_DYNAMIC_EVENTS=y
CONFIG_PROBE_EVENTS=y
# CONFIG_BPF_KPROBE_OVERRIDE is not set
CONFIG_FTRACE_MCOUNT_RECORD=y
CONFIG_TRACING_MAP=y
CONFIG_SYNTH_EVENTS=y
CONFIG_HIST_TRIGGERS=y
# CONFIG_TRACE_EVENT_INJECT is not set
# CONFIG_TRACEPOINT_BENCHMARK is not set
CONFIG_RING_BUFFER_BENCHMARK=m
# CONFIG_TRACE_EVAL_MAP_FILE is not set
# CONFIG_FTRACE_STARTUP_TEST is not set
# CONFIG_RING_BUFFER_STARTUP_TEST is not set
# CONFIG_PREEMPTIRQ_DELAY_TEST is not set
# CONFIG_SYNTH_EVENT_GEN_TEST is not set
# CONFIG_KPROBE_EVENT_GEN_TEST is not set
# CONFIG_HIST_TRIGGERS_DEBUG is not set
CONFIG_PROVIDE_OHCI1394_DMA_INIT=y
# CONFIG_SAMPLES is not set
CONFIG_ARCH_HAS_DEVMEM_IS_ALLOWED=y
CONFIG_STRICT_DEVMEM=y
# CONFIG_IO_STRICT_DEVMEM is not set

#
# x86 Debugging
#
CONFIG_TRACE_IRQFLAGS_SUPPORT=y
CONFIG_TRACE_IRQFLAGS_NMI_SUPPORT=y
CONFIG_EARLY_PRINTK_USB=y
CONFIG_X86_VERBOSE_BOOTUP=y
CONFIG_EARLY_PRINTK=y
CONFIG_EARLY_PRINTK_DBGP=y
CONFIG_EARLY_PRINTK_USB_XDBC=y
# CONFIG_EFI_PGT_DUMP is not set
# CONFIG_DEBUG_TLBFLUSH is not set
CONFIG_HAVE_MMIOTRACE_SUPPORT=y
CONFIG_X86_DECODER_SELFTEST=y
CONFIG_IO_DELAY_0X80=y
# CONFIG_IO_DELAY_0XED is not set
# CONFIG_IO_DELAY_UDELAY is not set
# CONFIG_IO_DELAY_NONE is not set
CONFIG_DEBUG_BOOT_PARAMS=y
# CONFIG_CPA_DEBUG is not set
# CONFIG_DEBUG_ENTRY is not set
# CONFIG_DEBUG_NMI_SELFTEST is not set
# CONFIG_X86_DEBUG_FPU is not set
# CONFIG_PUNIT_ATOM_DEBUG is not set
CONFIG_UNWINDER_ORC=y
# CONFIG_UNWINDER_FRAME_POINTER is not set
# end of x86 Debugging

#
# Kernel Testing and Coverage
#
CONFIG_KUNIT=y
# CONFIG_KUNIT_DEBUGFS is not set
CONFIG_KUNIT_TEST=m
CONFIG_KUNIT_EXAMPLE_TEST=m
# CONFIG_KUNIT_ALL_TESTS is not set
# CONFIG_NOTIFIER_ERROR_INJECTION is not set
CONFIG_FUNCTION_ERROR_INJECTION=y
CONFIG_FAULT_INJECTION=y
# CONFIG_FAILSLAB is not set
# CONFIG_FAIL_PAGE_ALLOC is not set
CONFIG_FAIL_MAKE_REQUEST=y
# CONFIG_FAIL_IO_TIMEOUT is not set
# CONFIG_FAIL_FUTEX is not set
CONFIG_FAULT_INJECTION_DEBUG_FS=y
# CONFIG_FAIL_FUNCTION is not set
# CONFIG_FAIL_MMC_REQUEST is not set
CONFIG_ARCH_HAS_KCOV=y
CONFIG_CC_HAS_SANCOV_TRACE_PC=y
# CONFIG_KCOV is not set
CONFIG_RUNTIME_TESTING_MENU=y
# CONFIG_LKDTM is not set
# CONFIG_TEST_LIST_SORT is not set
# CONFIG_TEST_MIN_HEAP is not set
# CONFIG_TEST_SORT is not set
# CONFIG_KPROBES_SANITY_TEST is not set
# CONFIG_BACKTRACE_SELF_TEST is not set
# CONFIG_RBTREE_TEST is not set
# CONFIG_REED_SOLOMON_TEST is not set
# CONFIG_INTERVAL_TREE_TEST is not set
# CONFIG_PERCPU_TEST is not set
CONFIG_ATOMIC64_SELFTEST=y
# CONFIG_ASYNC_RAID6_TEST is not set
# CONFIG_TEST_HEXDUMP is not set
# CONFIG_TEST_STRING_HELPERS is not set
# CONFIG_TEST_STRSCPY is not set
# CONFIG_TEST_KSTRTOX is not set
# CONFIG_TEST_PRINTF is not set
# CONFIG_TEST_BITMAP is not set
# CONFIG_TEST_BITFIELD is not set
# CONFIG_TEST_UUID is not set
# CONFIG_TEST_XARRAY is not set
# CONFIG_TEST_OVERFLOW is not set
# CONFIG_TEST_RHASHTABLE is not set
# CONFIG_TEST_HASH is not set
# CONFIG_TEST_IDA is not set
# CONFIG_TEST_LKM is not set
# CONFIG_TEST_BITOPS is not set
# CONFIG_TEST_VMALLOC is not set
# CONFIG_TEST_USER_COPY is not set
CONFIG_TEST_BPF=m
# CONFIG_TEST_BLACKHOLE_DEV is not set
# CONFIG_FIND_BIT_BENCHMARK is not set
# CONFIG_TEST_FIRMWARE is not set
# CONFIG_TEST_SYSCTL is not set
CONFIG_SYSCTL_KUNIT_TEST=m
CONFIG_LIST_KUNIT_TEST=m
# CONFIG_LINEAR_RANGES_TEST is not set
# CONFIG_BITS_TEST is not set
# CONFIG_TEST_UDELAY is not set
# CONFIG_TEST_STATIC_KEYS is not set
# CONFIG_TEST_KMOD is not set
# CONFIG_TEST_MEMCAT_P is not set
# CONFIG_TEST_LIVEPATCH is not set
# CONFIG_TEST_STACKINIT is not set
# CONFIG_TEST_MEMINIT is not set
# CONFIG_TEST_HMM is not set
# CONFIG_TEST_FPU is not set
# CONFIG_MEMTEST is not set
# CONFIG_HYPERV_TESTING is not set
# end of Kernel Testing and Coverage
# end of Kernel hacking

Re: [PATCH v19 18/20] mm/lru: replace pgdat lru_lock with lruvec lock

[Rong Chen]

On Wed, Oct 21, 2020 at 03:23:34PM +0800, Alex Shi wrote:
> 
> 在 2020/9/24 上午11:28, Alex Shi 写道:
> > --- a/include/linux/mmzone.h
> > +++ b/include/linux/mmzone.h
> > @@ -273,6 +273,8 @@ enum lruvec_flags {
> >  };
> >  
> >  struct lruvec {
> > +	/* per lruvec lru_lock for memcg */
> > +	spinlock_t			lru_lock;
> >  	struct list_head		lists[NR_LRU_LISTS];
> >  	/*
> >  	 * These track the cost of reclaiming one LRU - file or anon -
> 
> Hi All,
> 
> Intel Rong Chen, LKP, report a big regression on this patch, about 12 ~ 32% performance drop on fio.read_iops and case-lru-file-mmap-read case on wide Intel machine with attached kernel config. Hugh Dickins pointed it's a false sharing issue on the lru_lock. And that could be fixed by move the lru_lock out of busy lists[] cacheline, like the following patch:
> 
> diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h
> index a75e6d0effcb..58b21bffef95 100644
> --- a/include/linux/mmzone.h
> +++ b/include/linux/mmzone.h
> @@ -272,9 +272,9 @@ enum lruvec_flags {
>  };
> 
>  struct lruvec {
> +       struct list_head                lists[NR_LRU_LISTS];
>         /* per lruvec lru_lock for memcg */
>         spinlock_t                      lru_lock;
> -       struct list_head                lists[NR_LRU_LISTS];
>         /*
>          * These track the cost of reclaiming one LRU - file or anon -
>          * over the other. As the observed cost of reclaiming one LRU
> 
> Although the problem fixed， But I still no idea of the reasons and the gut problem. Any comments for this?
> 
> 

Hi all,

Here is the detail for your reference:

in testcase: fio-basic
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
with following parameters:

	disk: 2pmem
	fs: xfs
	runtime: 200s
	nr_task: 50%
	time_based: tb
	rw: randread
	bs: 2M
	ioengine: mmap
	test_size: 200G
	cpufreq_governor: performance
	ucode: 0x5002f01


=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
  2M/gcc-9/performance/2pmem/xfs/mmap/x86_64-rhel-8.3/50%/debian-10.4-x86_64-20200603.cgz/200s/randread/lkp-csl-2sp6/200G/fio-basic/tb/0x5002f01

commit: 
  b53890a41e2848c429ba7091b118f8219e9708f1 ("mm/swap.c: serialize memcg changes in pagevec_lru_move_fn")
  16c8a4eabc9980d6a11d4f39d9420e4b1d2f25eb ("mm/lru: replace pgdat lru_lock with lruvec lock")
  0a8b34c9a678c3421c83200a76d57ef0fc01b5b7 ("lru: fix false sharing on lru_lock")

b53890a41e2848c4 16c8a4eabc9980d6a11d4f39d94 0a8b34c9a678c3421c83200a76d 
---------------- --------------------------- --------------------------- 
       fail:runs  %reproduction    fail:runs  %reproduction    fail:runs
           |             |             |             |             |    
        321:3        20022%         921:3        10199%         627:3     dmesg.timestamp:last
        925:3         -136%         921:3         -333%         915:3     kmsg.timestamp:last
          3:3            0%           3:3            0%           3:3     stderr.Events_disabled
          3:3            0%           3:3            0%           3:3     stderr.Events_enabled
          3:3            0%           3:3            0%           3:3     stderr.[perf_record:Captured_and_wrote#MB/tmp/lkp/perf_c2c.data(#samples)]
          3:3            0%           3:3            0%           3:3     stderr.[perf_record:Woken_up#times_to_write_data]
          3:3            0%           3:3            0%           3:3     stderr.has_stderr
          1:3          -15%           0:3           -3%           1:3     perf-profile.children.cycles-pp.error_entry
          0:3           -3%           0:3           -1%           0:3     perf-profile.self.cycles-pp.error_entry
         %stddev     %change         %stddev     %change         %stddev
             \          |                \          |                \  
      0.01 ± 70%      +0.0        0.01 ± 80%      -0.0        0.00 ±141%  fio.latency_1000ms%
      0.41 ±  8%      -0.3        0.16 ± 11%      -0.2        0.24 ± 11%  fio.latency_1000us%
      0.25 ± 18%      +0.7        0.96 ± 19%      -0.1        0.17 ± 40%  fio.latency_100ms%
     41.92 ± 14%      +2.5       44.38 ±  5%      +3.5       45.42 ±  5%  fio.latency_10ms%
      0.01 ± 70%      +0.0        0.01 ± 83%      -0.0        0.00 ±141%  fio.latency_2000ms%
     26.70 ±  7%     -17.3        9.45 ± 21%      +2.0       28.70 ±  4%  fio.latency_20ms%
      0.07 ± 30%      +0.3        0.33 ± 20%      -0.0        0.04 ± 60%  fio.latency_250ms%
      0.01            +0.0        0.02 ± 45%      +0.0        0.01 ± 13%  fio.latency_250us%
      0.07 ± 44%      -0.1        0.02 ± 11%      -0.0        0.02 ± 45%  fio.latency_2ms%
     24.08 ± 27%      -1.2       22.92 ± 13%      -4.1       20.02 ± 15%  fio.latency_4ms%
      0.02 ± 23%      +0.0        0.06 ± 42%      -0.0        0.02 ± 27%  fio.latency_500ms%
      0.35 ± 17%      +0.2        0.51 ± 12%      +0.0        0.37 ±  9%  fio.latency_500us%
      5.34 ± 42%     +15.0       20.31 ± 14%      -1.2        4.11 ± 12%  fio.latency_50ms%
      0.01            +0.0        0.01            -0.0        0.00 ±141%  fio.latency_750ms%
      0.77 ±  5%      +0.1        0.88            +0.1        0.88 ±  7%  fio.latency_750us%
      0.00            +0.0        0.00 ±141%      +0.0        0.00        fio.latency_>=2000ms%
     10386 ±  2%     -27.8%       7494 ±  4%      -3.5%      10027        fio.read_bw_MBps
  18219008 ±  5%     +45.1%   26432853 ±  8%      +0.0%   18219008        fio.read_clat_90%_us
  20316160 ±  6%     +49.0%   30277632 ±  5%      -3.4%   19617109        fio.read_clat_95%_us
  33335978 ±  7%     +79.3%   59768832 ± 11%     -15.7%   28093098 ± 14%  fio.read_clat_99%_us
   9025993 ±  2%     +36.9%   12355145 ±  3%      +2.8%    9274865        fio.read_clat_mean_us
  12717159 ± 14%     +90.7%   24256888 ± 33%     -18.5%   10359535 ± 29%  fio.read_clat_stddev
      5193 ±  2%     -27.8%       3747 ±  4%      -3.5%       5013        fio.read_iops
    201.39            -0.0%     201.37            -0.1%     201.28        fio.time.elapsed_time
    201.39            -0.0%     201.37            -0.1%     201.28        fio.time.elapsed_time.max
 4.187e+09 ±  2%     -27.8%  3.022e+09 ±  4%      -3.4%  4.046e+09        fio.time.file_system_inputs
    487428 ±  4%      -9.0%     443649 ±  8%     +13.7%     554115 ±  3%  fio.time.involuntary_context_switches
 5.236e+08 ±  2%     -27.8%   3.78e+08 ±  4%      -3.4%   5.06e+08        fio.time.major_page_faults
   1602456 ±  9%      +1.3%    1622745 ±  4%      -1.2%    1582553 ± 13%  fio.time.maximum_resident_set_size
     42438 ± 59%     -11.3%      37625 ± 51%     +30.1%      55210 ± 58%  fio.time.minor_page_faults
      4096            +0.0%       4096            +0.0%       4096        fio.time.page_size
      4691            +0.5%       4714            +0.3%       4703        fio.time.percent_of_cpu_this_job_got
      8982            +2.4%       9195            +0.6%       9032        fio.time.system_time
    466.06 ±  3%     -35.6%     300.30 ±  7%      -6.4%     436.07 ±  4%  fio.time.user_time
     26383 ±  5%      +1.4%      26759 ±  6%      -7.0%      24543 ±  5%  fio.time.voluntary_context_switches
   1038928 ±  2%     -27.8%     749695 ±  4%      -3.5%    1003014        fio.workload
    397.85            -0.5%     395.74            -0.9%     394.15        uptime.boot
     27592            -0.7%      27391            -1.2%      27250        uptime.idle
     21.05            +0.1%      21.08            +0.0%      21.06        boot-time.boot
     15.50            +0.9%      15.64            +0.4%      15.57        boot-time.dhcp
      1666            +0.3%       1670            +0.1%       1668        boot-time.idle
      0.86            -0.0%       0.86            -0.0%       0.86        boot-time.smp_boot
     48.68            -0.0%      48.66            -0.2%      48.58        iostat.cpu.idle
      0.00        +1.6e+97%       0.00 ±141%  +4.9e+97%       0.00        iostat.cpu.iowait
     48.91            +1.8%      49.77            +0.5%      49.16        iostat.cpu.system
      2.41 ±  3%     -35.0%       1.57 ±  7%      -6.0%       2.26 ±  4%  iostat.cpu.user
      2699 ± 15%     -15.4%       2282 ±  6%      -3.6%       2602 ± 12%  perf-c2c.DRAM.local
      4502 ±  7%      +1.8%       4583 ±  8%      +3.6%       4666 ± 11%  perf-c2c.DRAM.remote
      4120 ±  8%     +27.3%       5243 ±  5%      +4.5%       4306 ±  6%  perf-c2c.HITM.local
      1061 ± 13%     +25.7%       1333 ±  5%      -8.8%     967.33 ±  8%  perf-c2c.HITM.remote
     48.20            -0.0       48.18            -0.1       48.11        mpstat.cpu.all.idle%
      1.29 ±  4%      -0.4        0.94 ±  3%      -0.1        1.19 ±  2%  mpstat.cpu.all.irq%
      0.06            -0.0        0.05 ±  2%      -0.0        0.06        mpstat.cpu.all.soft%
     48.02            +1.2       49.26            +0.3       48.35        mpstat.cpu.all.sys%
      2.43 ±  3%      -0.9        1.58 ±  7%      -0.1        2.28 ±  4%  mpstat.cpu.all.usr%
    830372 ± 16%   +4631.9%   39292060 ±135%     +34.2%    1114546 ± 11%  cpuidle.C1.time
     29231 ± 11%   +1554.6%     483661 ±124%     +28.9%      37675 ± 13%  cpuidle.C1.usage
 3.351e+09 ± 20%     +24.1%  4.159e+09 ± 59%     +75.2%  5.871e+09 ± 48%  cpuidle.C1E.time
  10620526 ±  2%     +16.1%   12329066 ± 20%     +41.5%   15026448 ± 22%  cpuidle.C1E.usage
 6.025e+09 ± 11%     -14.4%  5.158e+09 ± 49%     -42.2%   3.48e+09 ± 81%  cpuidle.C6.time
   8578083 ±  3%     -27.3%    6239788 ± 51%     -52.8%    4049845 ± 83%  cpuidle.C6.usage
     63769 ±  8%     +10.6%      70508 ± 19%      +0.4%      64022 ±  3%  cpuidle.POLL.time
     21855 ± 12%      -1.5%      21532 ± 16%      -5.7%      20609 ±  6%  cpuidle.POLL.usage
     48.00            +0.0%      48.00            +0.0%      48.00        vmstat.cpu.id
     48.67            +0.7%      49.00            +0.7%      49.00        vmstat.cpu.sy
      2.00           -50.0%       1.00            +0.0%       2.00        vmstat.cpu.us
  10243915 ±  2%     -27.8%    7394480 ±  4%      -3.2%    9915457        vmstat.io.bi
     55.67            +1.8%      56.67            +2.4%      57.00        vmstat.io.bo
      0.00          -100.0%       0.00          -100.0%       0.00        vmstat.memory.buff
  42704186            -0.0%   42695150            -0.1%   42659921        vmstat.memory.cache
   1097298            +0.3%    1100401            +1.6%    1114684 ±  2%  vmstat.memory.free
     48.33            +0.7%      48.67            +0.0%      48.33        vmstat.procs.r
      6914 ±  3%      -7.1%       6423 ±  6%      +8.7%       7517 ±  3%  vmstat.system.cs
    422616           -20.7%     335155            -4.3%     404446        vmstat.system.in
      0.00          -100.0%       0.00          -100.0%       0.00        numa-numastat.node0.interleave_hit
  2.02e+08 ±  7%     -28.1%  1.453e+08 ± 10%      -6.3%  1.893e+08 ±  5%  numa-numastat.node0.local_node
  55522626 ±  9%     -22.3%   43136856 ± 12%     +10.0%   61056981 ±  9%  numa-numastat.node0.numa_foreign
  2.02e+08 ±  7%     -28.1%  1.453e+08 ± 10%      -6.3%  1.893e+08 ±  5%  numa-numastat.node0.numa_hit
  52932496 ±  7%     -24.3%   40095020 ± 16%     +22.5%   64842596 ± 13%  numa-numastat.node0.numa_miss
  52965570 ±  7%     -24.3%   40109615 ± 16%     +22.5%   64882016 ± 13%  numa-numastat.node0.other_node
      0.00          -100.0%       0.00          -100.0%       0.00        numa-numastat.node1.interleave_hit
 2.142e+08 ±  2%     -29.8%  1.505e+08 ±  8%     -10.5%  1.918e+08 ±  4%  numa-numastat.node1.local_node
  52932496 ±  7%     -24.3%   40095020 ± 16%     +22.5%   64842596 ± 13%  numa-numastat.node1.numa_foreign
 2.142e+08 ±  2%     -29.7%  1.505e+08 ±  8%     -10.5%  1.918e+08 ±  4%  numa-numastat.node1.numa_hit
  55522626 ±  9%     -22.3%   43136856 ± 12%     +10.0%   61056981 ±  9%  numa-numastat.node1.numa_miss
  55533458 ±  9%     -22.3%   43166155 ± 12%     +10.0%   61061394 ±  9%  numa-numastat.node1.other_node
    201.39            -0.0%     201.37            -0.1%     201.28        time.elapsed_time
    201.39            -0.0%     201.37            -0.1%     201.28        time.elapsed_time.max
 4.187e+09 ±  2%     -27.8%  3.022e+09 ±  4%      -3.4%  4.046e+09        time.file_system_inputs
    487428 ±  4%      -9.0%     443649 ±  8%     +13.7%     554115 ±  3%  time.involuntary_context_switches
 5.236e+08 ±  2%     -27.8%   3.78e+08 ±  4%      -3.4%   5.06e+08        time.major_page_faults
   1602456 ±  9%      +1.3%    1622745 ±  4%      -1.2%    1582553 ± 13%  time.maximum_resident_set_size
     42438 ± 59%     -11.3%      37625 ± 51%     +30.1%      55210 ± 58%  time.minor_page_faults
      4096            +0.0%       4096            +0.0%       4096        time.page_size
      4691            +0.5%       4714            +0.3%       4703        time.percent_of_cpu_this_job_got
      8982            +2.4%       9195            +0.6%       9032        time.system_time
    466.06 ±  3%     -35.6%     300.30 ±  7%      -6.4%     436.07 ±  4%  time.user_time
     26383 ±  5%      +1.4%      26759 ±  6%      -7.0%      24543 ±  5%  time.voluntary_context_switches
   2414054 ±  2%      -1.8%    2370953            -4.3%    2310463        meminfo.Active
    578242 ±  4%     -13.5%     500374 ±  6%      -9.6%     522734 ±  4%  meminfo.Active(anon)
   1835811 ±  5%      +1.9%    1870577            -2.6%    1787729 ±  3%  meminfo.Active(file)
    348542            -0.4%     347123            -0.4%     347162        meminfo.AnonHugePages
    427055 ±  4%      +2.8%     438931 ±  2%      +4.5%     446092 ±  4%  meminfo.AnonPages
      0.00          -100.0%       0.00          -100.0%       0.00        meminfo.Buffers
  42294566            -0.0%   42281746            -0.1%   42250064        meminfo.Cached
     16759 ± 16%     -10.5%      14995           +12.7%      18896 ±  7%  meminfo.CmaFree
    204800            +0.0%     204800            +0.0%     204800        meminfo.CmaTotal
  24554032            +0.0%   24554032            +0.0%   24554032        meminfo.CommitLimit
   7089949            -1.0%    7019050            -0.6%    7047335        meminfo.Committed_AS
 2.531e+08            +0.6%  2.545e+08            +0.4%  2.541e+08        meminfo.DirectMap1G
  16418816 ±  3%      -8.7%   14994773 ±  3%      -6.5%   15353856 ±  6%  meminfo.DirectMap2M
    733290 ±  6%      +3.5%     759232 ±  3%      +2.2%     749674 ±  5%  meminfo.DirectMap4k
     30.33 ±  8%     -24.2%      23.00 ± 46%     -33.0%      20.33 ± 52%  meminfo.Dirty
      2048            +0.0%       2048            +0.0%       2048        meminfo.Hugepagesize
  39299826            +0.1%   39342118            +0.2%   39378057        meminfo.Inactive
   1574193            +0.8%    1587196            +1.4%    1595969        meminfo.Inactive(anon)
  37725632            +0.1%   37754922            +0.1%   37782087        meminfo.Inactive(file)
    378394            -1.0%     374526            +0.1%     378773        meminfo.KReclaimable
     16395            -0.1%      16385            +1.0%      16551        meminfo.KernelStack
  40522612            +0.3%   40652115            +0.2%   40605722        meminfo.Mapped
  40473542            +0.2%   40551231            +0.0%   40474208        meminfo.MemAvailable
   1124751            +1.1%    1137591            +1.3%    1139065        meminfo.MemFree
  49108064            +0.0%   49108064            +0.0%   49108064        meminfo.MemTotal
  47983312            -0.0%   47970471            -0.0%   47968997        meminfo.Memused
    553.00 ±  4%    +215.9%       1747 ± 48%    +213.8%       1735 ± 49%  meminfo.Mlocked
    397858            -0.6%     395466            +0.2%     398746        meminfo.PageTables
     46645            +0.8%      47036            +0.8%      47032        meminfo.Percpu
    378394            -1.0%     374526            +0.1%     378773        meminfo.SReclaimable
    206409            +0.6%     207718            +2.0%     210473        meminfo.SUnreclaim
   1725674            -4.4%    1649151            -3.0%    1673109        meminfo.Shmem
    584804            -0.4%     582245            +0.8%     589247        meminfo.Slab
   1001980            +0.0%    1002155            -0.0%    1001531        meminfo.Unevictable
 3.436e+10            +0.0%  3.436e+10            +0.0%  3.436e+10        meminfo.VmallocTotal
    142428            +0.0%     142461            +0.1%     142563        meminfo.VmallocUsed
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        meminfo.Writeback
    244185            +1.5%     247913            -0.0%     244163        meminfo.max_used_kB
   1050297 ±  6%     +12.7%    1184106 ±  4%      +5.6%    1109366 ±  7%  numa-meminfo.node0.Active
    174440 ± 19%     +60.4%     279850 ± 10%     +11.3%     194215 ± 27%  numa-meminfo.node0.Active(anon)
    875856 ± 10%      +3.2%     904255 ±  3%      +4.5%     915150 ±  4%  numa-meminfo.node0.Active(file)
    206183 ±  4%     +13.1%     233289 ± 20%     -10.6%     184306 ± 13%  numa-meminfo.node0.AnonHugePages
    250281 ±  8%     +16.1%     290525 ± 16%      -9.5%     226424 ±  5%  numa-meminfo.node0.AnonPages
      8.33 ±116%     +72.0%      14.33 ± 92%     -88.0%       1.00        numa-meminfo.node0.Dirty
  20764162            +0.2%   20807560            +0.2%   20804043        numa-meminfo.node0.FilePages
  19442140            -0.2%   19398241            -0.2%   19403151        numa-meminfo.node0.Inactive
    999002 ± 53%      +4.7%    1045717 ± 45%     -76.0%     239626 ±  7%  numa-meminfo.node0.Inactive(anon)
  18443137 ±  2%      -0.5%   18352523 ±  2%      +3.9%   19163524        numa-meminfo.node0.Inactive(file)
    206631 ±  3%      -5.6%     195049            -3.0%     200521        numa-meminfo.node0.KReclaimable
      9527 ±  2%      -2.8%       9261 ±  5%     -14.8%       8121 ±  4%  numa-meminfo.node0.KernelStack
  19983031            -0.3%   19923881            +0.3%   20035155        numa-meminfo.node0.Mapped
    553317 ±  2%      -0.6%     550113           +16.2%     642679 ±  9%  numa-meminfo.node0.MemFree
  24375744            +0.0%   24375744            +0.0%   24375744        numa-meminfo.node0.MemTotal
  23822425            +0.0%   23825629            -0.4%   23733063        numa-meminfo.node0.MemUsed
    304.33 ±  7%    +191.3%     886.67 ± 48%    +226.8%     994.67 ± 49%  numa-meminfo.node0.Mlocked
    225803 ±  2%      -1.2%     223146 ±  2%      -8.8%     205830 ± 11%  numa-meminfo.node0.PageTables
    206631 ±  3%      -5.6%     195049            -3.0%     200521        numa-meminfo.node0.SReclaimable
    122049            -1.4%     120292 ±  8%     -11.2%     108426 ± 11%  numa-meminfo.node0.SUnreclaim
    923343 ± 60%     +12.1%    1035323 ± 50%     -77.5%     207781 ± 26%  numa-meminfo.node0.Shmem
    328681 ±  2%      -4.1%     315342 ±  2%      -6.0%     308948 ±  3%  numa-meminfo.node0.Slab
    518678            -1.1%     513226            -0.8%     514726        numa-meminfo.node0.Unevictable
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        numa-meminfo.node0.Writeback
   1362489 ±  3%     -13.0%    1185342 ±  3%     -12.2%    1196148 ±  6%  numa-meminfo.node1.Active
    404100 ±  3%     -44.9%     222523 ±  3%     -19.0%     327252 ± 22%  numa-meminfo.node1.Active(anon)
    958388 ±  2%      +0.5%     962818 ±  4%      -9.3%     868895 ±  2%  numa-meminfo.node1.Active(file)
    142319 ±  7%     -19.9%     113947 ± 43%     +14.3%     162624 ± 16%  numa-meminfo.node1.AnonHugePages
    176746 ±  2%     -16.2%     148168 ± 25%     +24.4%     219794 ± 15%  numa-meminfo.node1.AnonPages
     21.33 ± 57%     -60.9%       8.33 ±133%     -12.5%      18.67 ± 57%  numa-meminfo.node1.Dirty
  21518698            -0.2%   21474912            -0.3%   21445060        numa-meminfo.node1.FilePages
  19846573            +0.5%   19945997            +0.7%   19979152        numa-meminfo.node1.Inactive
    574439 ± 91%      -6.0%     540254 ± 90%    +135.6%    1353307 ±  3%  numa-meminfo.node1.Inactive(anon)
  19272133 ±  2%      +0.7%   19405741 ±  2%      -3.4%   18625844        numa-meminfo.node1.Inactive(file)
    172057 ±  2%      +4.4%     179601            +3.6%     178227 ±  2%  numa-meminfo.node1.KReclaimable
      6872 ±  5%      +3.7%       7128 ±  5%     +22.6%       8428 ±  4%  numa-meminfo.node1.KernelStack
  20528715            +0.7%   20665531            +0.2%   20567867        numa-meminfo.node1.Mapped
    582511 ±  2%      +0.8%     587127           -14.3%     499088 ±  8%  numa-meminfo.node1.MemFree
  24732320            +0.0%   24732320            +0.0%   24732320        numa-meminfo.node1.MemTotal
  24149807            -0.0%   24145191            +0.3%   24233230        numa-meminfo.node1.MemUsed
    246.00 ±  4%    +249.7%     860.33 ± 53%    +200.7%     739.67 ± 49%  numa-meminfo.node1.Mlocked
    172131 ±  3%      -0.2%     171865 ±  2%     +11.9%     192643 ± 11%  numa-meminfo.node1.PageTables
    172057 ±  2%      +4.4%     179601            +3.6%     178227 ±  2%  numa-meminfo.node1.SReclaimable
     84364 ±  3%      +3.6%      87423 ± 13%     +20.9%     102036 ± 12%  numa-meminfo.node1.SUnreclaim
    801917 ± 65%     -23.3%     614842 ± 86%     +82.2%    1460885 ±  5%  numa-meminfo.node1.Shmem
    256422            +4.1%     267025 ±  4%      +9.3%     280263 ±  3%  numa-meminfo.node1.Slab
    483301            +1.2%     488928            +0.7%     486804        numa-meminfo.node1.Unevictable
      0.00          -100.0%       0.00          -100.0%       0.00        numa-meminfo.node1.Writeback
     10.34            -3.8%       9.94 ±  4%      +0.6%      10.40        perf-stat.i.MPKI
 1.232e+10 ±  2%     -20.4%  9.805e+09 ±  2%      -2.1%  1.207e+10        perf-stat.i.branch-instructions
      0.40            -0.0        0.37            +0.0        0.41        perf-stat.i.branch-miss-rate%
  49139003 ±  3%     -24.7%   37006246 ±  3%      -1.4%   48432296        perf-stat.i.branch-misses
     67.05            -3.7       63.38 ±  2%      -0.6       66.42        perf-stat.i.cache-miss-rate%
 4.269e+08 ±  2%     -26.4%   3.14e+08 ±  2%      -3.0%  4.139e+08        perf-stat.i.cache-misses
 6.312e+08 ±  2%     -23.2%   4.85e+08            -2.0%  6.189e+08        perf-stat.i.cache-references
      6927 ±  3%      -7.1%       6433 ±  6%      +8.7%       7531 ±  3%  perf-stat.i.context-switches
      2.36           +35.0%       3.19            +1.7%       2.40        perf-stat.i.cpi
     96017            -0.0%      96016            -0.0%      96012        perf-stat.i.cpu-clock
 1.382e+11            +0.4%  1.388e+11            -0.0%  1.382e+11        perf-stat.i.cpu-cycles
    125.33 ±  2%      -7.1%     116.43 ±  2%      -5.2%     118.82 ±  2%  perf-stat.i.cpu-migrations
    361.51           +66.5%     601.95 ± 10%      +0.6%     363.81 ±  3%  perf-stat.i.cycles-between-cache-misses
      0.40            -0.1        0.35            -0.0        0.40        perf-stat.i.dTLB-load-miss-rate%
  63070072 ±  2%     -30.2%   44024618 ±  4%      -4.9%   59969139        perf-stat.i.dTLB-load-misses
 1.517e+10 ±  2%     -21.8%  1.187e+10 ±  3%      -2.5%  1.479e+10        perf-stat.i.dTLB-loads
      0.05 ± 11%      +0.0        0.05 ±  6%      +0.0        0.05 ± 11%  perf-stat.i.dTLB-store-miss-rate%
   3712383 ± 13%     -25.0%    2785404 ±  9%      +8.1%    4014638 ± 12%  perf-stat.i.dTLB-store-misses
 7.653e+09 ±  2%     -27.5%   5.55e+09 ±  4%      -3.6%  7.375e+09        perf-stat.i.dTLB-stores
     89.95            -2.6       87.39            -0.3       89.64        perf-stat.i.iTLB-load-miss-rate%
  24264833 ±  4%     -22.9%   18720179 ±  3%      -4.1%   23274977 ±  3%  perf-stat.i.iTLB-load-misses
   2537218            -9.1%    2305974 ±  4%      +0.4%    2546729 ±  2%  perf-stat.i.iTLB-loads
 6.018e+10 ±  2%     -21.7%  4.713e+10 ±  3%      -2.3%  5.877e+10        perf-stat.i.instructions
      2569            +9.4%       2812 ±  6%      +0.9%       2592 ±  3%  perf-stat.i.instructions-per-iTLB-miss
      0.44 ±  2%     -21.6%       0.34 ±  3%      -2.2%       0.43        perf-stat.i.ipc
   2592013 ±  2%     -27.6%    1876230 ±  4%      -3.4%    2504255        perf-stat.i.major-faults
      1.44            +0.4%       1.45            -0.0%       1.44        perf-stat.i.metric.GHz
      0.11 ±  2%      -4.9%       0.11 ±  4%      +5.8%       0.12 ±  3%  perf-stat.i.metric.K/sec
    374.21 ±  2%     -22.6%     289.73 ±  3%      -2.6%     364.45        perf-stat.i.metric.M/sec
      3359 ±  4%      -3.6%       3238 ±  2%      +1.5%       3411 ±  4%  perf-stat.i.minor-faults
     62.49 ±  2%      +5.1       67.58 ±  4%      +2.9       65.38 ±  7%  perf-stat.i.node-load-miss-rate%
  18804483 ±  2%     -12.1%   16531877 ±  4%      +5.8%   19898585 ±  8%  perf-stat.i.node-load-misses
  11650303 ±  4%     -27.8%    8414395 ±  9%      -7.4%   10787735 ± 12%  perf-stat.i.node-loads
     31.36 ±  6%      +6.1       37.46 ±  8%      +4.2       35.52 ±  6%  perf-stat.i.node-store-miss-rate%
  27565405 ±  6%     -18.3%   22508980 ±  9%     +13.5%   31279383 ±  7%  perf-stat.i.node-store-misses
  66371056 ±  5%     -29.8%   46577558 ±  8%      -7.5%   61415123 ±  4%  perf-stat.i.node-stores
   2595373 ±  2%     -27.6%    1879470 ±  4%      -3.4%    2507667        perf-stat.i.page-faults
     96017            -0.0%      96016            -0.0%      96012        perf-stat.i.task-clock
     10.49            -1.8%      10.30 ±  3%      +0.4%      10.53        perf-stat.overall.MPKI
      0.40            -0.0        0.38            +0.0        0.40        perf-stat.overall.branch-miss-rate%
     67.63            -2.9       64.74 ±  2%      -0.7       66.88        perf-stat.overall.cache-miss-rate%
      2.30 ±  2%     +28.5%       2.95 ±  2%      +2.3%       2.35        perf-stat.overall.cpi
    323.92 ±  2%     +36.8%     443.22 ±  2%      +3.0%     333.79        perf-stat.overall.cycles-between-cache-misses
      0.41            -0.0        0.37            -0.0        0.40        perf-stat.overall.dTLB-load-miss-rate%
      0.05 ± 12%      +0.0        0.05 ±  6%      +0.0        0.05 ± 11%  perf-stat.overall.dTLB-store-miss-rate%
     90.52            -1.5       89.01            -0.4       90.14        perf-stat.overall.iTLB-load-miss-rate%
      2482            +1.5%       2520 ±  2%      +1.8%       2527 ±  2%  perf-stat.overall.instructions-per-iTLB-miss
      0.44 ±  2%     -22.1%       0.34 ±  2%      -2.3%       0.43        perf-stat.overall.ipc
     61.74 ±  2%      +4.6       66.30 ±  4%      +3.0       64.79 ±  7%  perf-stat.overall.node-load-miss-rate%
     29.37 ±  8%      +3.3       32.70 ± 12%      +4.3       33.72 ±  8%  perf-stat.overall.node-store-miss-rate%
  11673055            +8.3%   12636088            +1.0%   11784264        perf-stat.overall.path-length
 1.226e+10 ±  2%     -20.5%  9.743e+09 ±  2%      -2.1%  1.201e+10        perf-stat.ps.branch-instructions
  48948647 ±  3%     -24.9%   36780728 ±  3%      -1.4%   48264445        perf-stat.ps.branch-misses
 4.247e+08 ±  2%     -26.6%  3.118e+08 ±  2%      -3.0%  4.119e+08        perf-stat.ps.cache-misses
 6.281e+08 ±  2%     -23.3%  4.816e+08            -1.9%  6.159e+08        perf-stat.ps.cache-references
      6891 ±  3%      -7.1%       6402 ±  6%      +8.8%       7495 ±  3%  perf-stat.ps.context-switches
     95521            -0.0%      95519            -0.0%      95521        perf-stat.ps.cpu-clock
 1.375e+11            +0.4%  1.381e+11            -0.0%  1.375e+11        perf-stat.ps.cpu-cycles
    125.05 ±  2%      -7.2%     116.05 ±  2%      -5.1%     118.67 ±  2%  perf-stat.ps.cpu-migrations
  62750257 ±  2%     -30.3%   43706114 ±  4%      -4.9%   59672484        perf-stat.ps.dTLB-load-misses
  1.51e+10 ±  2%     -21.9%  1.179e+10 ±  3%      -2.5%  1.472e+10        perf-stat.ps.dTLB-loads
   3693247 ± 13%     -25.1%    2765293 ±  9%      +8.2%    3994538 ± 12%  perf-stat.ps.dTLB-store-misses
 7.615e+09 ±  2%     -27.6%  5.513e+09 ±  3%      -3.6%  7.339e+09        perf-stat.ps.dTLB-stores
  24142213 ±  4%     -23.0%   18588478 ±  3%      -4.1%   23159291 ±  3%  perf-stat.ps.iTLB-load-misses
   2523754            -9.2%    2292057 ±  4%      +0.4%    2533327 ±  2%  perf-stat.ps.iTLB-loads
 5.987e+10 ±  2%     -21.8%  4.683e+10 ±  3%      -2.3%  5.848e+10        perf-stat.ps.instructions
   2579173 ±  2%     -27.8%    1862784 ±  4%      -3.4%    2492104        perf-stat.ps.major-faults
      3345 ±  3%      -3.6%       3224 ±  3%      +1.6%       3400 ±  4%  perf-stat.ps.minor-faults
  18707796 ±  2%     -12.2%   16427710 ±  4%      +5.8%   19798960 ±  8%  perf-stat.ps.node-load-misses
  11593240 ±  4%     -27.9%    8355615 ±  9%      -7.4%   10737491 ± 13%  perf-stat.ps.node-loads
  27422418 ±  6%     -18.5%   22361316 ±  9%     +13.4%   31096559 ±  7%  perf-stat.ps.node-store-misses
  66049478 ±  5%     -30.0%   46241141 ±  8%      -7.4%   61146712 ±  4%  perf-stat.ps.node-stores
   2582518 ±  2%     -27.7%    1866009 ±  4%      -3.4%    2495504        perf-stat.ps.page-faults
     95521            -0.0%      95519            -0.0%      95521        perf-stat.ps.task-clock
 1.213e+13 ±  2%     -21.9%  9.469e+12 ±  3%      -2.5%  1.182e+13        perf-stat.total.instructions
     43625 ± 19%     +60.6%      70078 ±  9%     +11.3%      48552 ± 27%  numa-vmstat.node0.nr_active_anon
    219159 ± 10%      +3.3%     226404 ±  3%      +4.4%     228829 ±  4%  numa-vmstat.node0.nr_active_file
     62543 ±  8%     +16.2%      72664 ± 16%      -9.5%      56629 ±  5%  numa-vmstat.node0.nr_anon_pages
    100.00 ±  5%     +13.7%     113.67 ± 20%     -10.3%      89.67 ± 13%  numa-vmstat.node0.nr_anon_transparent_hugepages
  33438804 ± 68%      +3.2%   34506747 ± 67%     -93.9%    2045900 ± 42%  numa-vmstat.node0.nr_dirtied
      1.67 ±141%     +80.0%       3.00 ±118%    -100.0%       0.00        numa-vmstat.node0.nr_dirty
   5191398            +0.1%    5198729            +0.1%    5197458        numa-vmstat.node0.nr_file_pages
    138407 ±  2%      +1.6%     140634           +18.6%     164115 ±  9%  numa-vmstat.node0.nr_free_pages
    250153 ± 53%      +4.5%     261450 ± 45%     -76.1%      59888 ±  7%  numa-vmstat.node0.nr_inactive_anon
   4610563 ±  2%      -0.6%    4584446 ±  2%      +3.8%    4787384        numa-vmstat.node0.nr_inactive_file
      0.00          -100.0%       0.00          -100.0%       0.00        numa-vmstat.node0.nr_isolated_anon
    125.00 ±  4%     +17.6%     147.00 ±  9%     +23.7%     154.67 ± 12%  numa-vmstat.node0.nr_isolated_file
      9525 ±  2%      -2.8%       9255 ±  5%     -14.7%       8122 ±  4%  numa-vmstat.node0.nr_kernel_stack
   4987445            -0.0%    4985165            +0.5%    5013596        numa-vmstat.node0.nr_mapped
     76.00 ±  5%    +192.1%     222.00 ± 47%    +226.8%     248.33 ± 49%  numa-vmstat.node0.nr_mlock
     56329 ±  2%      -0.9%      55829 ±  2%      -8.5%      51528 ± 11%  numa-vmstat.node0.nr_page_table_pages
    231279 ± 60%     +12.0%     258933 ± 50%     -77.6%      51902 ± 26%  numa-vmstat.node0.nr_shmem
     51650 ±  3%      -5.7%      48680            -2.9%      50131        numa-vmstat.node0.nr_slab_reclaimable
     30509            -1.4%      30071 ±  8%     -11.1%      27107 ± 11%  numa-vmstat.node0.nr_slab_unreclaimable
    129669            -1.1%     128306            -0.8%     128681        numa-vmstat.node0.nr_unevictable
     31.33 ±130%     +12.8%      35.33 ± 64%     -91.5%       2.67 ± 17%  numa-vmstat.node0.nr_vmscan_immediate_reclaim
      0.00          -100.0%       0.00          -100.0%       0.00        numa-vmstat.node0.nr_writeback
  33438802 ± 68%      +3.2%   34506743 ± 67%     -93.9%    2045900 ± 42%  numa-vmstat.node0.nr_written
     43629 ± 19%     +60.6%      70082 ±  9%     +11.3%      48556 ± 27%  numa-vmstat.node0.nr_zone_active_anon
    219062 ± 10%      +3.3%     226249 ±  3%      +4.4%     228694 ±  4%  numa-vmstat.node0.nr_zone_active_file
    250182 ± 53%      +4.5%     261480 ± 45%     -76.0%      59919 ±  7%  numa-vmstat.node0.nr_zone_inactive_anon
   4610176 ±  2%      -0.6%    4584095 ±  2%      +3.8%    4787084        numa-vmstat.node0.nr_zone_inactive_file
    129669            -1.1%     128306            -0.8%     128681        numa-vmstat.node0.nr_zone_unevictable
      1.67 ±141%     +80.0%       3.00 ±118%    -100.0%       0.00        numa-vmstat.node0.nr_zone_write_pending
  30289403 ± 17%     -26.0%   22415296 ± 22%      +2.9%   31166745 ±  9%  numa-vmstat.node0.numa_foreign
 1.394e+08 ± 10%     -19.4%  1.124e+08 ± 19%     -31.1%   96106445 ±  6%  numa-vmstat.node0.numa_hit
    139905            +0.1%     139988            -0.0%     139889        numa-vmstat.node0.numa_interleave
 1.393e+08 ± 10%     -19.3%  1.124e+08 ± 19%     -31.1%   96023624 ±  6%  numa-vmstat.node0.numa_local
  25181301 ± 10%     -25.5%   18764436 ± 24%     +36.0%   34238111 ± 16%  numa-vmstat.node0.numa_miss
  25257943 ± 10%     -25.6%   18783711 ± 24%     +35.9%   34321089 ± 16%  numa-vmstat.node0.numa_other
    176633 ± 21%     -22.4%     137056 ±  6%     +16.5%     205726 ± 13%  numa-vmstat.node0.workingset_activate_file
    168137 ±  4%      -5.8%     158446            -4.2%     161103 ±  3%  numa-vmstat.node0.workingset_nodes
  16538515 ±  9%     -34.4%   10853930 ± 11%      +2.2%   16895852 ±  4%  numa-vmstat.node0.workingset_refault_file
      6492 ± 46%     -13.8%       5595 ± 14%    +102.3%      13134 ± 38%  numa-vmstat.node0.workingset_restore_file
    101207 ±  4%     -45.0%      55710 ±  3%     -19.0%      81931 ± 22%  numa-vmstat.node1.nr_active_anon
    239627 ±  3%      +0.4%     240616 ±  4%      -9.3%     217376 ±  2%  numa-vmstat.node1.nr_active_file
     44157 ±  2%     -16.1%      37038 ± 25%     +24.5%      54958 ± 15%  numa-vmstat.node1.nr_anon_pages
     68.67 ±  7%     -19.4%      55.33 ± 43%     +14.6%      78.67 ± 16%  numa-vmstat.node1.nr_anon_transparent_hugepages
  18990065 ±120%      -5.6%   17922123 ±129%    +165.3%   50382970        numa-vmstat.node1.nr_dirtied
      5.33 ± 57%     -62.5%       2.00 ±141%     -18.8%       4.33 ± 57%  numa-vmstat.node1.nr_dirty
   5379686            -0.2%    5366863            -0.3%    5361699        numa-vmstat.node1.nr_file_pages
      4240 ± 15%     -12.1%       3726           +10.9%       4704 ±  7%  numa-vmstat.node1.nr_free_cma
    146370            +1.6%     148686           -14.7%     124887 ±  8%  numa-vmstat.node1.nr_free_pages
    143278 ± 91%      -6.1%     134595 ± 90%    +136.3%     338638 ±  2%  numa-vmstat.node1.nr_inactive_anon
   4818099 ±  2%      +0.7%    4850042 ±  2%      -3.4%    4656235        numa-vmstat.node1.nr_inactive_file
      0.67 ±141%    -100.0%       0.00          -100.0%       0.00        numa-vmstat.node1.nr_isolated_anon
    129.00 ±  5%     +29.2%     166.67 ±  5%      +9.6%     141.33 ±  6%  numa-vmstat.node1.nr_isolated_file
      6873 ±  5%      +3.7%       7126 ±  5%     +22.6%       8427 ±  4%  numa-vmstat.node1.nr_kernel_stack
   5123259            +1.0%    5172122            +0.5%    5150260        numa-vmstat.node1.nr_mapped
     61.33 ±  4%    +250.5%     215.00 ± 53%    +201.1%     184.67 ± 50%  numa-vmstat.node1.nr_mlock
     42938 ±  2%      +0.1%      42978 ±  2%     +12.3%      48240 ± 11%  numa-vmstat.node1.nr_page_table_pages
    200360 ± 65%     -23.5%     153321 ± 86%     +82.5%     365642 ±  5%  numa-vmstat.node1.nr_shmem
     43011 ±  2%      +4.4%      44896            +3.6%      44571 ±  2%  numa-vmstat.node1.nr_slab_reclaimable
     21089 ±  3%      +3.6%      21855 ± 13%     +21.0%      25509 ± 12%  numa-vmstat.node1.nr_slab_unreclaimable
    120825            +1.2%     122231            +0.7%     121700        numa-vmstat.node1.nr_unevictable
     71.67 ± 62%     -56.3%      31.33 ±136%     +13.5%      81.33 ± 24%  numa-vmstat.node1.nr_vmscan_immediate_reclaim
      0.00          -100.0%       0.00          -100.0%       0.00        numa-vmstat.node1.nr_writeback
  18990060 ±120%      -5.6%   17922121 ±129%    +165.3%   50382965        numa-vmstat.node1.nr_written
    101212 ±  4%     -45.0%      55713 ±  3%     -19.0%      81935 ± 22%  numa-vmstat.node1.nr_zone_active_anon
    239504 ±  2%      +0.4%     240475 ±  4%      -9.3%     217328 ±  2%  numa-vmstat.node1.nr_zone_active_file
    143314 ± 91%      -6.1%     134628 ± 90%    +136.3%     338671 ±  2%  numa-vmstat.node1.nr_zone_inactive_anon
   4817828 ±  2%      +0.7%    4849859 ±  2%      -3.4%    4656086        numa-vmstat.node1.nr_zone_inactive_file
    120825            +1.2%     122231            +0.7%     121700        numa-vmstat.node1.nr_zone_unevictable
      5.00 ± 71%     -60.0%       2.00 ±141%     -13.3%       4.33 ± 57%  numa-vmstat.node1.nr_zone_write_pending
  25183355 ± 10%     -25.5%   18766785 ± 24%     +36.0%   34240646 ± 16%  numa-vmstat.node1.numa_foreign
 1.265e+08 ± 23%     -24.4%   95645441 ± 31%     +17.0%  1.481e+08 ±  2%  numa-vmstat.node1.numa_hit
    139985            -0.1%     139894            -0.1%     139847        numa-vmstat.node1.numa_interleave
 1.264e+08 ± 23%     -24.5%   95473968 ± 31%     +17.1%  1.479e+08 ±  2%  numa-vmstat.node1.numa_local
  30291122 ± 17%     -26.0%   22417710 ± 22%      +2.9%   31169202 ±  9%  numa-vmstat.node1.numa_miss
  30405026 ± 17%     -25.7%   22589299 ± 22%      +2.9%   31276582 ±  9%  numa-vmstat.node1.numa_other
    263132 ±  5%     -29.7%     184983 ±  2%     -29.1%     186545        numa-vmstat.node1.workingset_activate_file
    136992 ±  4%      +5.2%     144058            +4.5%     143212 ±  2%  numa-vmstat.node1.workingset_nodes
  19319023           -34.5%   12661014 ±  5%     -14.7%   16474573 ±  2%  numa-vmstat.node1.workingset_refault_file
     10002 ± 29%     -38.6%       6137 ± 24%     -19.2%       8080 ± 47%  numa-vmstat.node1.workingset_restore_file
    356986 ±  2%     -30.5%     248036 ±  3%      -4.0%     342586 ±  2%  proc-vmstat.allocstall_movable
      2875 ± 17%     -21.6%       2254 ±  8%      -5.6%       2713 ±  8%  proc-vmstat.allocstall_normal
   2052774 ± 29%     -51.9%     986935 ± 50%     -33.5%    1365578 ± 32%  proc-vmstat.compact_daemon_free_scanned
   1199355 ± 12%     -28.2%     861419 ± 20%     +21.3%    1454234 ± 35%  proc-vmstat.compact_daemon_migrate_scanned
      2013 ± 20%     -13.2%       1748 ±  6%     +12.6%       2267 ± 12%  proc-vmstat.compact_daemon_wake
    186.00 ± 21%      +4.3%     194.00 ± 10%     -31.4%     127.67 ± 26%  proc-vmstat.compact_fail
   2166008 ± 28%     -46.9%    1149814 ± 39%     -28.1%    1558440 ± 32%  proc-vmstat.compact_free_scanned
    226662 ±  4%     -43.4%     128279 ± 54%      -4.8%     215878 ± 16%  proc-vmstat.compact_isolated
   1200209 ± 12%     -28.1%     863088 ± 20%     +21.4%    1456590 ± 35%  proc-vmstat.compact_migrate_scanned
    189.67 ± 20%      +3.7%     196.67 ± 11%     -31.1%     130.67 ± 26%  proc-vmstat.compact_stall
      3.67 ± 25%     -27.3%       2.67 ± 17%     -18.2%       3.00 ± 54%  proc-vmstat.compact_success
     11.67 ± 31%     -40.0%       7.00 ± 30%     +20.0%      14.00 ± 67%  proc-vmstat.kswapd_high_wmark_hit_quickly
      6603 ±  5%     -22.9%       5091 ±  3%      -3.7%       6357 ±  5%  proc-vmstat.kswapd_low_wmark_hit_quickly
    144882 ±  4%     -13.1%     125923 ±  6%     -10.1%     130201 ±  4%  proc-vmstat.nr_active_anon
    458897 ±  5%      +2.1%     468725            -2.8%     445946 ±  3%  proc-vmstat.nr_active_file
    106708 ±  4%      +2.8%     109660 ±  2%      +4.6%     111584 ±  4%  proc-vmstat.nr_anon_pages
    169.67            -0.4%     169.00            -0.2%     169.33        proc-vmstat.nr_anon_transparent_hugepages
     57.33            +0.0%      57.33            +0.0%      57.33        proc-vmstat.nr_dirtied
      7.00 ± 11%     -23.8%       5.33 ± 46%     -33.3%       4.67 ± 61%  proc-vmstat.nr_dirty
   1008812            +0.2%    1010746            +0.1%    1009493        proc-vmstat.nr_dirty_background_threshold
   2020092            +0.2%    2023966            +0.1%    2021454        proc-vmstat.nr_dirty_threshold
  10570596            -0.0%   10567453            -0.1%   10562418        proc-vmstat.nr_file_pages
      4201 ± 15%     -10.7%       3753           +14.0%       4791 ±  9%  proc-vmstat.nr_free_cma
    284363            +0.8%     286767            +0.4%     285635        proc-vmstat.nr_free_pages
    393517            +0.7%     396184            +1.3%     398687        proc-vmstat.nr_inactive_anon
   9428031            +0.1%    9434308            +0.2%    9447327        proc-vmstat.nr_inactive_file
      0.00          -100.0%       0.00          -100.0%       0.00        proc-vmstat.nr_isolated_anon
    250.00           +24.9%     312.33 ±  4%     +18.3%     295.67 ±  7%  proc-vmstat.nr_isolated_file
     16394            -0.1%      16381            +1.0%      16554        proc-vmstat.nr_kernel_stack
  10116113            +0.3%   10141659            +0.5%   10167670        proc-vmstat.nr_mapped
    138.67 ±  3%    +214.9%     436.67 ± 48%    +212.5%     433.33 ± 49%  proc-vmstat.nr_mlock
     99468            -0.7%      98784            +0.3%      99794        proc-vmstat.nr_page_table_pages
    431764            -4.4%     412573 ±  2%      -3.3%     417418        proc-vmstat.nr_shmem
     94695            -1.0%      93721            -0.0%      94693        proc-vmstat.nr_slab_reclaimable
     51603            +0.6%      51929            +2.0%      52617        proc-vmstat.nr_slab_unreclaimable
    250494            +0.0%     250538            -0.0%     250382        proc-vmstat.nr_unevictable
    119.33 ±  6%     -35.2%      77.33 ± 29%     -18.2%      97.67 ± 23%  proc-vmstat.nr_vmscan_immediate_reclaim
      0.00          -100.0%       0.00          -100.0%       0.00        proc-vmstat.nr_writeback
     56.00            +0.6%      56.33            +0.6%      56.33        proc-vmstat.nr_written
    144890 ±  4%     -13.1%     125930 ±  6%     -10.1%     130207 ±  4%  proc-vmstat.nr_zone_active_anon
    458667 ±  5%      +2.1%     468467            -2.8%     445698 ±  3%  proc-vmstat.nr_zone_active_file
    393577            +0.7%     396249            +1.3%     398753        proc-vmstat.nr_zone_inactive_anon
   9427741            +0.1%    9433856            +0.2%    9447305        proc-vmstat.nr_zone_inactive_file
    250494            +0.0%     250538            -0.0%     250382        proc-vmstat.nr_zone_unevictable
      7.00 ± 11%     -23.8%       5.33 ± 46%     -33.3%       4.67 ± 61%  proc-vmstat.nr_zone_write_pending
 1.084e+08 ±  8%     -23.3%   83145561 ± 14%     +15.9%  1.256e+08 ± 11%  proc-vmstat.numa_foreign
     51139 ± 40%     -27.3%      37184 ± 38%     +13.5%      58053 ± 47%  proc-vmstat.numa_hint_faults
     23972 ± 36%     -39.3%      14550 ± 31%      +0.8%      24161 ± 40%  proc-vmstat.numa_hint_faults_local
 4.162e+08 ±  5%     -28.9%  2.957e+08 ±  9%      -8.7%  3.801e+08 ±  5%  proc-vmstat.numa_hit
      1605 ± 14%     -30.0%       1124 ± 14%     -21.9%       1254 ± 18%  proc-vmstat.numa_huge_pte_updates
      0.00          -100.0%       0.00          -100.0%       0.00        proc-vmstat.numa_interleave
 4.161e+08 ±  5%     -28.9%  2.957e+08 ±  9%      -8.7%    3.8e+08 ±  5%  proc-vmstat.numa_local
 1.084e+08 ±  8%     -23.3%   83145561 ± 14%     +15.9%  1.256e+08 ± 11%  proc-vmstat.numa_miss
 1.085e+08 ±  8%     -23.3%   83189591 ± 14%     +15.9%  1.257e+08 ± 11%  proc-vmstat.numa_other
     38930 ± 19%     -39.3%      23638 ± 15%     -13.3%      33767 ± 22%  proc-vmstat.numa_pages_migrated
    886156 ± 13%     -29.5%     624406 ± 16%     -19.4%     714093 ± 20%  proc-vmstat.numa_pte_updates
      6617 ±  5%     -22.9%       5101 ±  3%      -3.7%       6373 ±  5%  proc-vmstat.pageoutrun
   6812161 ±  3%     -25.8%    5057613            -6.0%    6405488 ±  5%  proc-vmstat.pgactivate
      0.00          -100.0%       0.00          -100.0%       0.00        proc-vmstat.pgalloc_dma
  19651994 ±  2%     -28.6%   14041272 ±  3%      -4.7%   18737401        proc-vmstat.pgalloc_dma32
 5.054e+08 ±  2%     -27.7%  3.653e+08 ±  4%      -3.3%  4.885e+08        proc-vmstat.pgalloc_normal
   7011545 ±  4%     -28.1%    5042341            -6.7%    6542693 ±  6%  proc-vmstat.pgdeactivate
 1.048e+09 ±  2%     -27.8%  7.568e+08 ±  4%      -3.4%  1.012e+09        proc-vmstat.pgfault
 5.148e+08 ±  2%     -28.3%   3.69e+08 ±  4%      -3.5%  4.968e+08        proc-vmstat.pgfree
 5.233e+08 ±  2%     -27.8%  3.778e+08 ±  4%      -3.4%  5.055e+08        proc-vmstat.pgmajfault
     66259 ± 75%     -68.9%      20636 ± 39%     -58.7%      27376 ± 53%  proc-vmstat.pgmigrate_fail
    147352 ±  2%     -42.0%      85440 ± 38%      -6.6%     137591 ± 17%  proc-vmstat.pgmigrate_success
 2.093e+09 ±  2%     -27.8%  1.511e+09 ±  4%      -3.4%  2.022e+09        proc-vmstat.pgpgin
    132.00 ±  8%      -6.1%     124.00            -6.1%     124.00        proc-vmstat.pgpgout
   7011545 ±  4%     -28.1%    5042343            -6.7%    6542700 ±  6%  proc-vmstat.pgrefill
     36650            -0.5%      36450            -0.8%      36351        proc-vmstat.pgreuse
    458.00 ± 10%     -54.9%     206.33 ± 13%     -34.0%     302.33 ± 22%  proc-vmstat.pgrotated
 8.877e+08 ±  3%     -30.2%  6.194e+08 ±  5%      -5.4%  8.394e+08 ±  2%  proc-vmstat.pgscan_direct
 1.037e+09 ±  2%     -28.2%  7.449e+08 ±  4%      -3.5%  1.001e+09        proc-vmstat.pgscan_file
 1.497e+08 ±  3%     -16.2%  1.255e+08 ±  4%      +8.1%  1.618e+08 ±  6%  proc-vmstat.pgscan_kswapd
 4.648e+08 ±  2%     -27.6%  3.366e+08 ±  3%      -2.9%  4.514e+08        proc-vmstat.pgsteal_direct
 5.134e+08 ±  2%     -28.4%  3.678e+08 ±  4%      -3.5%  4.956e+08        proc-vmstat.pgsteal_file
  48611615 ±  2%     -36.0%   31132152 ±  9%      -9.2%   44134337 ±  2%  proc-vmstat.pgsteal_kswapd
     75785 ±  2%      +0.1%      75864 ± 10%     -15.2%      64268 ± 13%  proc-vmstat.slabs_scanned
      0.67 ± 70%     -50.0%       0.33 ±141%      +0.0%       0.67 ± 70%  proc-vmstat.thp_collapse_alloc
      0.00       +3.3e+101%       0.33 ±141% +6.7e+101%       0.67 ± 70%  proc-vmstat.thp_collapse_alloc_failed
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ±141%  proc-vmstat.thp_deferred_split_page
     60.33            +1.1%      61.00 ±  2%      +1.7%      61.33 ±  2%  proc-vmstat.thp_fault_alloc
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ±141%  proc-vmstat.thp_split_pmd
      0.00          -100.0%       0.00          -100.0%       0.00        proc-vmstat.thp_zero_page_alloc
    100.33           -55.5%      44.67 ± 90%     -56.5%      43.67 ± 91%  proc-vmstat.unevictable_pgs_culled
    586.00           -66.7%     195.33 ±141%     -66.7%     195.33 ±141%  proc-vmstat.unevictable_pgs_mlocked
    440304 ±  9%     -26.8%     322290           -11.0%     391833 ±  6%  proc-vmstat.workingset_activate_file
    305338            -0.6%     303592            -0.2%     304734        proc-vmstat.workingset_nodes
  35897368 ±  4%     -34.4%   23532131 ±  8%      -7.1%   33334969        proc-vmstat.workingset_refault_file
     16525 ± 32%     -29.0%      11737 ±  5%     +28.2%      21186 ± 41%  proc-vmstat.workingset_restore_file
    130.25 ±110%     -79.0%      27.41 ±141%     -55.1%      58.46 ±141%  sched_debug.cfs_rq:/.MIN_vruntime.avg
      9442 ±103%     -73.6%       2494 ±141%     -65.3%       3273 ±141%  sched_debug.cfs_rq:/.MIN_vruntime.max
      0.00            +0.0%       0.00            +0.0%       0.00        sched_debug.cfs_rq:/.MIN_vruntime.min
      1099 ±107%     -76.4%     260.04 ±141%     -60.6%     433.53 ±141%  sched_debug.cfs_rq:/.MIN_vruntime.stddev
     35640 ± 19%     +29.5%      46156           +15.0%      40988 ± 18%  sched_debug.cfs_rq:/.exec_clock.avg
     60004 ± 20%     +36.8%      82102 ±  4%     +15.0%      69029 ± 15%  sched_debug.cfs_rq:/.exec_clock.max
     10509 ± 61%      -9.4%       9521 ± 25%     -12.6%       9181 ± 43%  sched_debug.cfs_rq:/.exec_clock.min
     11415 ± 20%     +41.3%      16134 ± 14%     +11.1%      12678 ± 14%  sched_debug.cfs_rq:/.exec_clock.stddev
    445507            +8.2%     481992 ±  4%      +4.7%     466232 ±  7%  sched_debug.cfs_rq:/.load.avg
    851108 ± 16%     +23.4%    1050048           +23.2%    1048576        sched_debug.cfs_rq:/.load.max
    361177 ±  6%     +11.8%     403965 ±  2%     +12.1%     404733 ±  4%  sched_debug.cfs_rq:/.load.stddev
    460.09            +3.9%     477.93 ±  4%      +1.6%     467.41 ±  7%  sched_debug.cfs_rq:/.load_avg.avg
      1131 ±  8%      -7.1%       1051 ±  5%      -5.8%       1066 ±  6%  sched_debug.cfs_rq:/.load_avg.max
    415.17 ±  6%      -0.2%     414.41            +1.6%     422.02 ±  4%  sched_debug.cfs_rq:/.load_avg.stddev
    130.25 ±110%     -79.0%      27.41 ±141%     -55.1%      58.46 ±141%  sched_debug.cfs_rq:/.max_vruntime.avg
      9442 ±103%     -73.6%       2494 ±141%     -65.3%       3273 ±141%  sched_debug.cfs_rq:/.max_vruntime.max
      0.00            +0.0%       0.00            +0.0%       0.00        sched_debug.cfs_rq:/.max_vruntime.min
      1099 ±107%     -76.4%     260.04 ±141%     -60.6%     433.53 ±141%  sched_debug.cfs_rq:/.max_vruntime.stddev
     67776 ± 14%     +16.0%      78590           +11.6%      75647 ± 13%  sched_debug.cfs_rq:/.min_vruntime.avg
    121925 ± 23%     +19.4%     145579 ± 16%      -6.8%     113645 ± 14%  sched_debug.cfs_rq:/.min_vruntime.max
     38249 ± 20%      +3.3%      39529 ± 11%      +3.8%      39684 ± 15%  sched_debug.cfs_rq:/.min_vruntime.min
     15708 ± 27%     +26.9%      19935 ± 19%      -2.7%      15280 ± 14%  sched_debug.cfs_rq:/.min_vruntime.stddev
      0.48 ±  3%      +4.4%       0.51 ±  4%      +3.6%       0.50 ±  5%  sched_debug.cfs_rq:/.nr_running.avg
      1.00            +8.3%       1.08 ± 10%      +0.0%       1.00        sched_debug.cfs_rq:/.nr_running.max
      0.45            +0.5%       0.45            +2.2%       0.46        sched_debug.cfs_rq:/.nr_running.stddev
      0.10 ±105%    +133.8%       0.23 ± 17%     +62.2%       0.16 ± 60%  sched_debug.cfs_rq:/.nr_spread_over.avg
      1.64 ± 26%     +32.2%       2.17 ± 27%      +8.5%       1.78 ± 21%  sched_debug.cfs_rq:/.nr_spread_over.max
      0.26 ± 46%     +48.8%       0.39 ± 17%      +4.3%       0.27 ± 29%  sched_debug.cfs_rq:/.nr_spread_over.stddev
     12.04 ± 69%     -77.9%       2.67 ± 82%     -31.6%       8.24 ± 88%  sched_debug.cfs_rq:/.removed.load_avg.avg
    312.89 ± 12%     -47.2%     165.33 ± 70%     -26.2%     231.03 ± 78%  sched_debug.cfs_rq:/.removed.load_avg.max
     55.69 ± 38%     -63.3%      20.43 ± 73%     -28.9%      39.58 ± 71%  sched_debug.cfs_rq:/.removed.load_avg.stddev
      4.66 ± 74%     -75.2%       1.15 ± 76%     -32.0%       3.16 ± 73%  sched_debug.cfs_rq:/.removed.runnable_avg.avg
    133.08 ± 22%     -37.3%      83.50 ± 70%      -8.5%     121.81 ± 92%  sched_debug.cfs_rq:/.removed.runnable_avg.max
     21.26 ± 47%     -56.6%       9.22 ± 71%     -17.6%      17.51 ± 76%  sched_debug.cfs_rq:/.removed.runnable_avg.stddev
      4.63 ± 74%     -75.1%       1.15 ± 76%     -31.7%       3.16 ± 73%  sched_debug.cfs_rq:/.removed.util_avg.avg
    131.64 ± 21%     -36.6%      83.50 ± 70%      -7.6%     121.69 ± 92%  sched_debug.cfs_rq:/.removed.util_avg.max
     21.14 ± 46%     -56.4%       9.22 ± 71%     -17.2%      17.50 ± 76%  sched_debug.cfs_rq:/.removed.util_avg.stddev
    559.67 ±  5%      -1.5%     551.27 ±  4%      +2.0%     570.88 ±  4%  sched_debug.cfs_rq:/.runnable_avg.avg
      1205 ±  6%      -0.3%       1201 ±  3%      -0.6%       1197 ±  4%  sched_debug.cfs_rq:/.runnable_avg.max
    450.27 ±  2%      +3.1%     464.36            +1.4%     456.41 ±  2%  sched_debug.cfs_rq:/.runnable_avg.stddev
    -16675          +198.1%     -49704          -173.3%      12227 ± 55%  sched_debug.cfs_rq:/.spread0.avg
     37499 ± 19%     -53.9%      17291 ±106%     +33.9%      50223 ± 27%  sched_debug.cfs_rq:/.spread0.max
    -46203           +92.1%     -88758           -48.6%     -23735        sched_debug.cfs_rq:/.spread0.min
     15711 ± 27%     +26.9%      19937 ± 19%      -2.7%      15280 ± 14%  sched_debug.cfs_rq:/.spread0.stddev
    556.76 ±  5%      -1.3%     549.62 ±  4%      +2.3%     569.73 ±  5%  sched_debug.cfs_rq:/.util_avg.avg
      1192 ±  6%      -0.1%       1190 ±  3%      -0.0%       1191 ±  5%  sched_debug.cfs_rq:/.util_avg.max
    448.11 ±  2%      +3.3%     463.11            +1.6%     455.40 ±  2%  sched_debug.cfs_rq:/.util_avg.stddev
    425.88            +7.7%     458.57 ±  4%      +3.3%     440.14 ±  6%  sched_debug.cfs_rq:/.util_est_enqueued.avg
    864.06 ±  2%     +12.2%     969.50 ±  5%      +1.8%     879.94 ±  3%  sched_debug.cfs_rq:/.util_est_enqueued.max
    370.13 ±  5%      +8.8%     402.70            +4.7%     387.50 ±  4%  sched_debug.cfs_rq:/.util_est_enqueued.stddev
    844186            -9.2%     766344 ±  3%      +1.6%     857345 ±  3%  sched_debug.cpu.avg_idle.avg
   1000000            +0.0%    1000000           +13.3%    1133287 ±  7%  sched_debug.cpu.avg_idle.max
    150262 ± 26%     -30.3%     104774 ± 22%     +11.5%     167572 ± 23%  sched_debug.cpu.avg_idle.min
    218705 ±  7%     +19.1%     260527            +3.3%     225850 ± 11%  sched_debug.cpu.avg_idle.stddev
    265382 ±  6%      +6.9%     283597            +2.5%     272057 ±  5%  sched_debug.cpu.clock.avg
    265395 ±  6%      +6.9%     283613            +2.5%     272068 ±  5%  sched_debug.cpu.clock.max
    265368 ±  6%      +6.9%     283576            +2.5%     272047 ±  5%  sched_debug.cpu.clock.min
      7.86 ± 40%     +32.2%      10.39 ± 50%      -9.1%       7.14 ± 42%  sched_debug.cpu.clock.stddev
    264275 ±  6%      +6.9%     282546            +2.5%     270910 ±  5%  sched_debug.cpu.clock_task.avg
    264516 ±  6%      +6.9%     282752            +2.5%     271142 ±  5%  sched_debug.cpu.clock_task.max
    259102 ±  6%      +7.1%     277511            +2.4%     265421 ±  5%  sched_debug.cpu.clock_task.min
    607.39 ±  6%      -1.7%     597.13 ±  2%      +2.3%     621.32        sched_debug.cpu.clock_task.stddev
      1144 ±  3%      +5.7%       1209 ±  2%      +2.0%       1167 ±  4%  sched_debug.cpu.curr->pid.avg
      4399 ±  8%     +10.2%       4846            +6.2%       4670 ±  7%  sched_debug.cpu.curr->pid.max
      1260            +2.5%       1290 ±  3%      +0.2%       1262 ±  2%  sched_debug.cpu.curr->pid.stddev
    500008            +0.0%     500196            +0.2%     501204        sched_debug.cpu.max_idle_balance_cost.avg
    500770            +3.3%     517520 ±  4%     +12.5%     563425 ±  7%  sched_debug.cpu.max_idle_balance_cost.max
    500000            +0.0%     500000            +0.0%     500000        sched_debug.cpu.max_idle_balance_cost.min
     78.20 ±141%   +2179.8%       1782 ±141%   +8670.1%       6858 ± 67%  sched_debug.cpu.max_idle_balance_cost.stddev
      4294            +0.0%       4294            +0.0%       4294        sched_debug.cpu.next_balance.avg
      4294            +0.0%       4294            +0.0%       4294        sched_debug.cpu.next_balance.max
      4294            +0.0%       4294            +0.0%       4294        sched_debug.cpu.next_balance.min
      0.00 ± 27%     +12.5%       0.00 ± 23%     -16.4%       0.00 ±  2%  sched_debug.cpu.next_balance.stddev
      0.42 ±  3%      +6.5%       0.44            +2.9%       0.43 ±  4%  sched_debug.cpu.nr_running.avg
      1.00           +16.7%       1.17 ± 20%      +0.0%       1.00        sched_debug.cpu.nr_running.max
      0.45            +2.1%       0.46 ±  2%      +0.2%       0.45        sched_debug.cpu.nr_running.stddev
     65936 ± 12%      -7.0%      61303 ± 19%     -18.7%      53596 ±  4%  sched_debug.cpu.nr_switches.avg
   3145363 ± 59%     -15.4%    2659603 ± 55%     -77.6%     703277 ± 36%  sched_debug.cpu.nr_switches.max
      3014 ± 27%      +8.9%       3281 ± 21%     +22.4%       3690 ±  5%  sched_debug.cpu.nr_switches.min
    336745 ± 50%     -11.2%     298976 ± 47%     -64.8%     118391 ± 20%  sched_debug.cpu.nr_switches.stddev
      0.01 ± 12%     -18.2%       0.01           -22.7%       0.00 ± 36%  sched_debug.cpu.nr_uninterruptible.avg
     42.22 ±  5%     +13.7%      48.00 ±  8%     -40.2%      25.25 ± 29%  sched_debug.cpu.nr_uninterruptible.max
    -15.97            -2.4%     -15.58           -14.8%     -13.61        sched_debug.cpu.nr_uninterruptible.min
      7.65 ±  8%      +8.2%       8.28 ± 10%      -7.0%       7.12        sched_debug.cpu.nr_uninterruptible.stddev
      5353 ± 17%     +15.1%       6160 ±  7%     +17.8%       6308 ± 13%  sched_debug.cpu.sched_count.avg
     12336            +4.0%      12828            -2.2%      12065 ± 18%  sched_debug.cpu.sched_count.max
      1989 ± 40%      +1.1%       2012 ± 20%     +24.1%       2469 ± 10%  sched_debug.cpu.sched_count.min
      1562 ± 10%     +27.1%       1986 ±  3%     +15.7%       1807 ± 17%  sched_debug.cpu.sched_count.stddev
    710.90 ± 17%     +23.9%     880.64 ±  2%      +9.7%     780.08 ± 15%  sched_debug.cpu.sched_goidle.avg
      3581           +35.0%       4834 ±  6%      +9.0%       3903 ± 19%  sched_debug.cpu.sched_goidle.max
    137.75 ± 29%     -15.9%     115.83 ± 19%     -19.9%     110.33 ± 14%  sched_debug.cpu.sched_goidle.min
    625.81 ± 10%     +47.4%     922.70 ±  9%     +20.0%     750.91 ± 16%  sched_debug.cpu.sched_goidle.stddev
      2613 ± 17%     +14.7%       2998 ±  8%     +18.0%       3083 ± 13%  sched_debug.cpu.ttwu_count.avg
      5031 ± 19%     +34.8%       6783 ± 13%     +19.2%       5998 ±  4%  sched_debug.cpu.ttwu_count.max
    884.53 ± 46%      +3.0%     911.00 ± 24%     +18.1%       1045 ± 23%  sched_debug.cpu.ttwu_count.min
    773.84 ± 12%     +37.1%       1060 ± 11%     +23.4%     954.55 ±  9%  sched_debug.cpu.ttwu_count.stddev
      1904 ± 20%     +18.2%       2251 ±  4%     +30.8%       2491 ± 17%  sched_debug.cpu.ttwu_local.avg
      3336 ± 16%     +40.7%       4694 ± 18%     +33.0%       4438 ± 20%  sched_debug.cpu.ttwu_local.max
    658.94 ± 49%      -5.9%     620.00 ± 19%     +22.0%     803.94 ± 28%  sched_debug.cpu.ttwu_local.min
    506.63 ± 17%     +38.0%     699.01 ± 13%     +38.3%     700.74 ± 15%  sched_debug.cpu.ttwu_local.stddev
    265370 ±  6%      +6.9%     283577            +2.5%     272048 ±  5%  sched_debug.cpu_clk
    996147            +0.0%     996147            +0.0%     996147        sched_debug.dl_rq:.dl_bw->bw.avg
    996147            +0.0%     996147            +0.0%     996147        sched_debug.dl_rq:.dl_bw->bw.max
    996147            +0.0%     996147            +0.0%     996147        sched_debug.dl_rq:.dl_bw->bw.min
 4.295e+09            +0.0%  4.295e+09            +0.0%  4.295e+09        sched_debug.jiffies
    264873 ±  6%      +6.9%     283081            +2.5%     271552 ±  5%  sched_debug.ktime
    950.00            +0.0%     950.00            +0.0%     950.00        sched_debug.rt_rq:/.rt_runtime.avg
    950.00            +0.0%     950.00            +0.0%     950.00        sched_debug.rt_rq:/.rt_runtime.max
    950.00            +0.0%     950.00            +0.0%     950.00        sched_debug.rt_rq:/.rt_runtime.min
    265722 ±  6%      +6.9%     283930            +2.5%     272402 ±  5%  sched_debug.sched_clk
      1.00            +0.0%       1.00            +0.0%       1.00        sched_debug.sched_clock_stable()
   4156219            +0.0%    4156219            +0.0%    4156219        sched_debug.sysctl_sched.sysctl_sched_features
     24.00            +0.0%      24.00            +0.0%      24.00        sched_debug.sysctl_sched.sysctl_sched_latency
      3.00            +0.0%       3.00            +0.0%       3.00        sched_debug.sysctl_sched.sysctl_sched_min_granularity
      1.00            +0.0%       1.00            +0.0%       1.00        sched_debug.sysctl_sched.sysctl_sched_tunable_scaling
      4.00            +0.0%       4.00            +0.0%       4.00        sched_debug.sysctl_sched.sysctl_sched_wakeup_granularity
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ±141%  latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00          -100.0%       0.00         +8e+102%       8.00 ±141%  latency_stats.avg.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.do_huge_pmd_numa_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     54.67 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
    121.67 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      9.67 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.avg.stop_one_cpu.sched_exec.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.33 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.avg.rwsem_down_write_slowpath.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    -100.0%       0.00         +1700.0%       6.00 ±108%  latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    314.33 ±120%     -95.3%      14.67 ±141%     +12.3%     353.00 ±141%  latency_stats.avg.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe
    356.33 ± 99%     -86.4%      48.33 ± 34%     -90.0%      35.67 ± 53%  latency_stats.avg.down.xfs_buf_lock.[xfs].xfs_buf_find.[xfs].xfs_buf_get_map.[xfs].xfs_buf_read_map.[xfs].xfs_trans_read_buf_map.[xfs].xfs_imap_to_bp.[xfs].xfs_trans_log_inode.[xfs].xfs_vn_update_time.[xfs].touch_atime.xfs_file_mmap.[xfs].mmap_region
      1122 ±  6%     -67.9%     360.67 ±141%     -68.6%     352.00 ±141%  latency_stats.avg.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      2966           -67.2%     972.00 ±141%     -70.1%     886.67 ±141%  latency_stats.avg.msleep_interruptible.uart_wait_until_sent.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      2.67 ±141%     -62.5%       1.00 ±141%     -62.5%       1.00 ±141%  latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.00 ±108%     -50.0%       1.00 ±141%     -16.7%       1.67 ± 74%  latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
    244.00 ± 42%     -37.3%     153.00            -6.1%     229.00 ± 44%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx
    106.00 ± 40%     -26.4%      78.00 ± 54%     -54.1%      48.67 ±  2%  latency_stats.avg.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe
    665.00 ± 15%      -9.4%     602.33 ± 10%      -8.7%     607.33 ±  4%  latency_stats.avg.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3019            -4.1%       2894 ±  7%      -5.6%       2850 ±  8%  latency_stats.avg.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3071            -3.7%       2956 ±  6%      -3.7%       2957 ±  8%  latency_stats.avg.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     35.33 ± 10%      -2.8%      34.33 ±  8%     -37.7%      22.00 ± 17%  latency_stats.avg.smp_call_on_cpu.lockup_detector_reconfigure.proc_watchdog_common.proc_sys_call_handler.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.00 ± 90%      +0.0%       5.00 ± 74%     -80.0%       1.00 ±141%  latency_stats.avg.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     13.00 ± 16%      +0.0%      13.00 ± 27%     +17.9%      15.33 ± 49%  latency_stats.avg.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11396 ±  3%      +0.2%      11422            +5.5%      12023 ±  2%  latency_stats.avg.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1538 ±  6%      +0.7%       1550 ± 15%      -3.9%       1478 ±  7%  latency_stats.avg.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1787 ± 24%      +2.7%       1836 ±  9%     -13.0%       1555 ± 14%  latency_stats.avg.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1561 ±  4%      +6.0%       1655 ±  2%      +4.5%       1631        latency_stats.avg.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
    107.00 ±  2%      +6.5%     114.00            +5.9%     113.33 ±  3%  latency_stats.avg.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
    200.33 ± 13%     +11.1%     222.67 ±  3%     +18.3%     237.00 ±  7%  latency_stats.avg.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1140           +14.6%       1306 ±  3%      +6.2%       1210 ±  2%  latency_stats.avg.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
     18.67 ±141%     +19.6%      22.33 ±141%    +532.1%     118.00 ± 35%  latency_stats.avg.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
    884.67 ±  8%     +22.4%       1082 ± 28%     +14.1%       1009 ±  5%  latency_stats.avg.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
    184.67 ± 11%     +32.7%     245.00 ± 16%      -6.7%     172.33 ±  8%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup
     16165 ± 39%     +55.7%      25174 ± 45%     +80.4%      29154 ± 73%  latency_stats.avg.max
      9126 ±124%     +77.9%      16235 ± 48%    +219.5%      29154 ± 73%  latency_stats.avg.lru_add_drain_all.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5398 ± 85%    +291.0%      21108 ± 62%      +0.9%       5444 ± 20%  latency_stats.avg.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     55.00 ±141%    +695.2%     437.33 ± 47%    +267.3%     202.00 ± 89%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk
      0.00       +9.7e+102%       9.67 ±141% +2.1e+104%     214.67 ±  5%  latency_stats.avg.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.00       +2.5e+103%      25.00 ±141% +1.2e+104%     115.33 ± 43%  latency_stats.avg.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00       +3.3e+103%      32.67 ±141%   +2e+104%     198.67 ± 69%  latency_stats.avg.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  latency_stats.hits.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.do_huge_pmd_numa_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ±141%  latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.hits.rwsem_down_write_slowpath.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.hits.stop_one_cpu.sched_exec.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    -100.0%       0.00          +100.0%       0.67 ± 70%  latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.67 ±106%     -94.1%       0.33 ±141%     -52.9%       2.67 ±115%  latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.33 ± 35%     -75.0%       0.33 ±141%     -50.0%       0.67 ±141%  latency_stats.hits.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.00           -66.7%       3.00 ±141%     -66.7%       3.00 ±141%  latency_stats.hits.msleep_interruptible.uart_wait_until_sent.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
     38.67 ±  6%     -64.7%      13.67 ±141%     -64.7%      13.67 ±141%  latency_stats.hits.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
     31.00 ± 16%     -48.4%      16.00 ± 35%     -55.9%      13.67 ± 39%  latency_stats.hits.down.xfs_buf_lock.[xfs].xfs_buf_find.[xfs].xfs_buf_get_map.[xfs].xfs_buf_read_map.[xfs].xfs_trans_read_buf_map.[xfs].xfs_imap_to_bp.[xfs].xfs_trans_log_inode.[xfs].xfs_vn_update_time.[xfs].touch_atime.xfs_file_mmap.[xfs].mmap_region
      1464 ±  3%     -37.0%     921.67 ±  8%     -15.0%       1245 ±  7%  latency_stats.hits.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
    114.33 ±  3%     -23.6%      87.33 ± 32%     -18.7%      93.00 ± 26%  latency_stats.hits.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
    107.67 ± 32%     -22.6%      83.33 ±  5%      -4.3%     103.00 ± 24%  latency_stats.hits.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.67 ±101%     -20.0%       1.33 ± 93%     -60.0%       0.67 ±141%  latency_stats.hits.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.33 ±  8%     -18.8%       4.33 ± 39%     -62.5%       2.00 ± 40%  latency_stats.hits.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.00           -16.7%       1.67 ± 28%      +0.0%       2.00        latency_stats.hits.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      8.67 ± 57%      -7.7%       8.00 ± 54%     -34.6%       5.67 ± 16%  latency_stats.hits.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3219            -5.7%       3034            -3.1%       3117        latency_stats.hits.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
     51.33 ±  7%      -4.5%      49.00            -3.9%      49.33 ±  6%  latency_stats.hits.lru_add_drain_all.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
     10.67 ±  4%      -3.1%      10.33 ±  4%      -6.2%      10.00        latency_stats.hits.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.00            +0.0%       1.00            +0.0%       1.00        latency_stats.hits.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.00            +0.0%       9.00            +0.0%       9.00        latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup
      1.00            +0.0%       1.00            +0.0%       1.00        latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx
      1.00            +0.0%       1.00            +0.0%       1.00        latency_stats.hits.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%      +0.0%       0.33 ±141%      +0.0%       0.33 ±141%  latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    189.00            +0.2%     189.33            +0.0%     189.00        latency_stats.hits.smp_call_on_cpu.lockup_detector_reconfigure.proc_watchdog_common.proc_sys_call_handler.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     49755            +2.6%      51039            +1.9%      50701        latency_stats.hits.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     49755            +2.6%      51039            +1.9%      50701        latency_stats.hits.max
    284.00 ±  4%     +14.3%     324.67 ± 17%      +8.7%     308.67 ±  4%  latency_stats.hits.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
     12.67 ±  9%     +34.2%      17.00 ± 25%     +39.5%      17.67 ± 14%  latency_stats.hits.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     13.00 ±  6%     +35.9%      17.67 ± 27%     +43.6%      18.67 ± 14%  latency_stats.hits.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.67 ±141%    +150.0%       1.67 ±141%    +700.0%       5.33 ± 17%  latency_stats.hits.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    +500.0%       2.00 ± 40%    +100.0%       0.67 ± 70%  latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk
      0.00       +6.7e+101%       0.67 ±141%   +6e+102%       6.00 ± 54%  latency_stats.hits.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.00         +1e+102%       1.00 ±141% +9.3e+102%       9.33 ± 33%  latency_stats.hits.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00         +1e+102%       1.00 ±141%   +1e+103%      10.00 ± 94%  latency_stats.hits.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00          -100.0%       0.00         +1e+102%       1.00 ±141%  latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00          -100.0%       0.00         +8e+102%       8.00 ±141%  latency_stats.max.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.do_huge_pmd_numa_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     54.67 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
    121.67 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      9.67 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.max.stop_one_cpu.sched_exec.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.33 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.max.rwsem_down_write_slowpath.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    -100.0%       0.00         +1700.0%       6.00 ±108%  latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    584.67 ±130%     -97.5%      14.67 ±141%     +18.8%     694.33 ±141%  latency_stats.max.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1587 ± 65%     -91.0%     142.33 ± 48%     -94.6%      86.33 ± 51%  latency_stats.max.down.xfs_buf_lock.[xfs].xfs_buf_find.[xfs].xfs_buf_get_map.[xfs].xfs_buf_read_map.[xfs].xfs_trans_read_buf_map.[xfs].xfs_imap_to_bp.[xfs].xfs_trans_log_inode.[xfs].xfs_vn_update_time.[xfs].touch_atime.xfs_file_mmap.[xfs].mmap_region
      3.33 ±101%     -70.0%       1.00 ±141%     -20.0%       2.67 ± 93%  latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3750 ±  3%     -66.5%       1257 ±141%     -70.9%       1091 ±141%  latency_stats.max.msleep_interruptible.uart_wait_until_sent.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      2.67 ±141%     -62.5%       1.00 ±141%     -62.5%       1.00 ±141%  latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1360           -61.5%     523.33 ±141%     -66.9%     450.33 ±141%  latency_stats.max.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
    700.67 ± 65%     -46.4%     375.67 ±122%     -92.9%      50.00        latency_stats.max.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe
    244.00 ± 42%     -37.3%     153.00            -6.1%     229.00 ± 44%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx
     14.00 ±121%     -33.3%       9.33 ± 99%     -90.5%       1.33 ±141%  latency_stats.max.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     27.00 ±  8%     -17.3%      22.33 ± 14%     -25.9%      20.00 ± 57%  latency_stats.max.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe
    119.33 ±  3%     -15.4%     101.00 ±  2%     -21.8%      93.33 ±  2%  latency_stats.max.smp_call_on_cpu.lockup_detector_reconfigure.proc_watchdog_common.proc_sys_call_handler.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11802 ±  5%      -1.1%      11673 ±  3%      +4.0%      12269 ±  3%  latency_stats.max.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4987            -0.2%       4975            +0.1%       4994        latency_stats.max.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4981            +0.0%       4981            -0.1%       4975        latency_stats.max.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4930            +0.0%       4931            -2.6%       4804 ±  3%  latency_stats.max.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4842            +0.7%       4875            +0.5%       4866 ±  2%  latency_stats.max.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1538 ±  6%      +0.7%       1550 ± 15%      -3.9%       1478 ±  7%  latency_stats.max.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4832            +0.9%       4877            +0.4%       4853 ±  2%  latency_stats.max.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4796 ±  2%      +2.2%       4904            +3.0%       4938        latency_stats.max.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3018 ± 29%     +10.0%       3320 ± 26%     +16.3%       3509 ± 13%  latency_stats.max.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
    200.33 ± 13%     +11.1%     222.67 ±  3%     +18.3%     237.00 ±  7%  latency_stats.max.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
    160179 ±129%     +31.8%     211172 ± 63%     +60.9%     257737 ±131%  latency_stats.max.max
    151640 ±140%     +33.8%     202932 ± 71%     +70.0%     257737 ±131%  latency_stats.max.lru_add_drain_all.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
    262.33 ±  3%     +86.9%     490.33 ± 58%      +8.8%     285.33 ± 23%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup
     23.67 ±141%    +131.0%      54.67 ±141%   +1369.0%     347.67 ± 45%  latency_stats.max.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
     43989 ±108%    +131.6%     101864 ±107%     -79.0%       9220 ± 41%  latency_stats.max.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     18099 ± 89%    +195.5%      53485 ± 29%     -34.4%      11871 ± 38%  latency_stats.max.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     55.00 ±141%   +1337.0%     790.33 ± 83%    +267.3%     202.00 ± 89%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk
      0.00       +1.7e+103%      16.67 ±141% +4.1e+104%     410.00 ± 37%  latency_stats.max.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.00         +5e+103%      50.33 ±141%   +3e+104%     300.33 ± 34%  latency_stats.max.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00       +5.4e+103%      53.67 ±141% +2.4e+104%     241.67 ± 29%  latency_stats.max.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00          -100.0%       0.00       +1.7e+102%       1.67 ±141%  latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00          -100.0%       0.00         +8e+102%       8.00 ±141%  latency_stats.sum.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.do_huge_pmd_numa_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     54.67 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
    121.67 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      9.67 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.sum.stop_one_cpu.sched_exec.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.33 ±141%    -100.0%       0.00          -100.0%       0.00        latency_stats.sum.rwsem_down_write_slowpath.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    -100.0%       0.00         +1700.0%       6.00 ±108%  latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    597.67 ±130%     -97.5%      14.67 ±141%     +18.2%     706.33 ±141%  latency_stats.sum.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe
     25.33 ±127%     -96.1%       1.00 ±141%     -61.8%       9.67 ±127%  latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     12023 ±100%     -93.0%     841.67 ± 67%     -95.4%     548.33 ± 61%  latency_stats.sum.down.xfs_buf_lock.[xfs].xfs_buf_find.[xfs].xfs_buf_get_map.[xfs].xfs_buf_read_map.[xfs].xfs_trans_read_buf_map.[xfs].xfs_imap_to_bp.[xfs].xfs_trans_log_inode.[xfs].xfs_vn_update_time.[xfs].touch_atime.xfs_file_mmap.[xfs].mmap_region
     26701           -67.2%       8749 ±141%     -70.1%       7980 ±141%  latency_stats.sum.msleep_interruptible.uart_wait_until_sent.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
     43219           -65.8%      14800 ±141%     -66.6%      14439 ±141%  latency_stats.sum.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      2.67 ±141%     -62.5%       1.00 ±141%     -62.5%       1.00 ±141%  latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    244.00 ± 42%     -37.3%     153.00            -6.1%     229.00 ± 44%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx
   2286234 ±  6%     -33.1%    1528413 ± 10%     -11.1%    2031545 ±  7%  latency_stats.sum.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
     16.67 ±124%     -32.0%      11.33 ±106%     -86.0%       2.33 ±141%  latency_stats.sum.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1155 ± 42%     -27.9%     832.67 ± 58%     -57.5%     491.67 ±  2%  latency_stats.sum.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe
     22794 ±  3%     -16.2%      19111 ± 29%      +5.5%      24048 ±  2%  latency_stats.sum.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
    177439 ±  3%     -13.7%     153212 ± 11%     -13.0%     154460 ± 10%  latency_stats.sum.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe
     72.00 ± 27%     -13.4%      62.33 ± 58%     -56.5%      31.33 ± 56%  latency_stats.sum.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe
    101087 ±  8%     -11.6%      89382 ± 22%      -8.4%      92615 ± 20%  latency_stats.sum.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6793 ± 10%      -2.5%       6621 ±  8%     -36.7%       4303 ± 17%  latency_stats.sum.smp_call_on_cpu.lockup_detector_reconfigure.proc_watchdog_common.proc_sys_call_handler.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1538 ±  6%      +0.7%       1550 ± 15%      -3.9%       1478 ±  7%  latency_stats.sum.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
    187755 ± 12%      +2.4%     192239 ±  8%      +0.1%     187887 ±  8%  latency_stats.sum.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
   3671346            +8.0%    3964849 ±  3%      +2.9%    3776545        latency_stats.sum.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
   5356584            +9.0%    5839450            +7.7%    5768748 ±  3%  latency_stats.sum.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
   5356584            +9.0%    5839450            +7.7%    5768748 ±  3%  latency_stats.sum.max
    200.33 ± 13%     +11.1%     222.67 ±  3%     +18.3%     237.00 ±  7%  latency_stats.sum.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
     38879 ±  9%     +27.7%      49649 ± 21%     +35.1%      52519 ± 19%  latency_stats.sum.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     39288 ±  7%     +28.0%      50296 ± 22%     +36.2%      53512 ± 18%  latency_stats.sum.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1665 ± 12%     +32.8%       2211 ± 16%      -6.6%       1555 ±  9%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup
    513961 ±126%     +55.3%     797989 ± 49%    +193.8%    1510268 ± 80%  latency_stats.sum.lru_add_drain_all.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
     43695 ±116%    +156.7%     112174 ± 26%     -28.0%      31446 ± 32%  latency_stats.sum.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     37.67 ±141%    +198.2%     112.33 ±141%   +1486.7%     597.67 ± 24%  latency_stats.sum.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
     55.00 ±141%   +1682.4%     980.33 ± 83%    +267.3%     202.00 ± 89%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk
      0.00         +2e+103%      19.67 ±141% +1.3e+105%       1317 ± 55%  latency_stats.sum.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.00       +7.5e+103%      75.00 ±141% +1.1e+105%       1066 ± 59%  latency_stats.sum.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00       +9.8e+103%      98.33 ±141% +1.3e+105%       1259 ± 93%  latency_stats.sum.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
    194455            -0.1%     194317            -0.1%     194260        slabinfo.Acpi-Operand.active_objs
      3471            -0.1%       3469            -0.1%       3468        slabinfo.Acpi-Operand.active_slabs
    194455            -0.1%     194317            -0.1%     194260        slabinfo.Acpi-Operand.num_objs
      3471            -0.1%       3469            -0.1%       3468        slabinfo.Acpi-Operand.num_slabs
      1411 ±  9%      +1.7%       1435 ±  2%      +8.6%       1533 ±  3%  slabinfo.Acpi-Parse.active_objs
     19.33 ±  9%      +1.7%      19.67 ±  2%      +8.6%      21.00 ±  3%  slabinfo.Acpi-Parse.active_slabs
      1411 ±  9%      +1.7%       1435 ±  2%      +8.6%       1533 ±  3%  slabinfo.Acpi-Parse.num_objs
     19.33 ±  9%      +1.7%      19.67 ±  2%      +8.6%      21.00 ±  3%  slabinfo.Acpi-Parse.num_slabs
      4975            -0.1%       4968            +0.2%       4984        slabinfo.Acpi-State.active_objs
     97.00            +0.0%      97.00            +0.0%      97.00        slabinfo.Acpi-State.active_slabs
      4975            -0.1%       4968            +0.2%       4984        slabinfo.Acpi-State.num_objs
     97.00            +0.0%      97.00            +0.0%      97.00        slabinfo.Acpi-State.num_slabs
      1977 ±  3%      +8.4%       2142 ±  3%      +6.6%       2108 ±  7%  slabinfo.PING.active_objs
     61.67 ±  3%      +8.1%      66.67 ±  3%      +5.9%      65.33 ±  7%  slabinfo.PING.active_slabs
      1977 ±  3%      +8.4%       2142 ±  3%      +6.6%       2108 ±  7%  slabinfo.PING.num_objs
     61.67 ±  3%      +8.1%      66.67 ±  3%      +5.9%      65.33 ±  7%  slabinfo.PING.num_slabs
    192.00            +0.0%     192.00            +0.0%     192.00        slabinfo.RAW.active_objs
      6.00            +0.0%       6.00            +0.0%       6.00        slabinfo.RAW.active_slabs
    192.00            +0.0%     192.00            +0.0%     192.00        slabinfo.RAW.num_objs
      6.00            +0.0%       6.00            +0.0%       6.00        slabinfo.RAW.num_slabs
    112.67 ± 10%      +7.7%     121.33 ± 10%      +0.0%     112.67 ± 10%  slabinfo.RAWv6.active_objs
      4.33 ± 10%      +7.7%       4.67 ± 10%      +0.0%       4.33 ± 10%  slabinfo.RAWv6.active_slabs
    112.67 ± 10%      +7.7%     121.33 ± 10%      +0.0%     112.67 ± 10%  slabinfo.RAWv6.num_objs
      4.33 ± 10%      +7.7%       4.67 ± 10%      +0.0%       4.33 ± 10%  slabinfo.RAWv6.num_slabs
     79.33 ±  8%      +5.9%      84.00            +5.9%      84.00        slabinfo.TCP.active_objs
      5.67 ±  8%      +5.9%       6.00            +5.9%       6.00        slabinfo.TCP.active_slabs
     79.33 ±  8%      +5.9%      84.00            +5.9%      84.00        slabinfo.TCP.num_objs
      5.67 ±  8%      +5.9%       6.00            +5.9%       6.00        slabinfo.TCP.num_slabs
     52.00            +0.0%      52.00            +0.0%      52.00        slabinfo.TCPv6.active_objs
      4.00            +0.0%       4.00            +0.0%       4.00        slabinfo.TCPv6.active_slabs
     52.00            +0.0%      52.00            +0.0%      52.00        slabinfo.TCPv6.num_objs
      4.00            +0.0%       4.00            +0.0%       4.00        slabinfo.TCPv6.num_slabs
    218.67 ±  5%      -3.7%     210.67            -0.3%     218.00 ±  5%  slabinfo.UDPv6.active_objs
      8.33 ±  5%      -4.0%       8.00            +0.0%       8.33 ±  5%  slabinfo.UDPv6.active_slabs
    218.67 ±  5%      -3.7%     210.67            -0.3%     218.00 ±  5%  slabinfo.UDPv6.num_objs
      8.33 ±  5%      -4.0%       8.00            +0.0%       8.33 ±  5%  slabinfo.UDPv6.num_slabs
     24576 ±  2%      +2.3%      25145            +1.6%      24966        slabinfo.anon_vma.active_objs
    533.67 ±  2%      +2.3%     546.00            +1.6%     542.33        slabinfo.anon_vma.active_slabs
     24576 ±  2%      +2.3%      25145            +1.6%      24966        slabinfo.anon_vma.num_objs
    533.67 ±  2%      +2.3%     546.00            +1.6%     542.33        slabinfo.anon_vma.num_slabs
     52187 ±  4%      +4.0%      54299 ±  2%      +3.6%      54050        slabinfo.anon_vma_chain.active_objs
    815.00 ±  4%      +4.0%     848.00 ±  2%      +3.6%     844.00        slabinfo.anon_vma_chain.active_slabs
     52187 ±  4%      +4.0%      54299 ±  2%      +3.6%      54050        slabinfo.anon_vma_chain.num_objs
    815.00 ±  4%      +4.0%     848.00 ±  2%      +3.6%     844.00        slabinfo.anon_vma_chain.num_slabs
    455.00 ±  4%      +5.7%     481.00 ± 13%      +5.7%     481.00 ±  7%  slabinfo.bdev_cache.active_objs
     11.67 ±  4%      +5.7%      12.33 ± 13%      +5.7%      12.33 ±  7%  slabinfo.bdev_cache.active_slabs
    455.00 ±  4%      +5.7%     481.00 ± 13%      +5.7%     481.00 ±  7%  slabinfo.bdev_cache.num_objs
     11.67 ±  4%      +5.7%      12.33 ± 13%      +5.7%      12.33 ±  7%  slabinfo.bdev_cache.num_slabs
    294.00 ±  9%      -3.2%     284.67 ± 11%      +8.7%     319.67 ± 15%  slabinfo.biovec-128.active_objs
     17.67 ±  9%      -1.9%      17.33 ±  9%     +11.3%      19.67 ± 16%  slabinfo.biovec-128.active_slabs
    294.00 ±  9%      -3.2%     284.67 ± 11%      +8.7%     319.67 ± 15%  slabinfo.biovec-128.num_objs
     17.67 ±  9%      -1.9%      17.33 ±  9%     +11.3%      19.67 ± 16%  slabinfo.biovec-128.num_slabs
    213.33 ± 14%     +25.0%     266.67 ± 20%     +25.0%     266.67 ± 11%  slabinfo.biovec-64.active_objs
      6.67 ± 14%     +25.0%       8.33 ± 20%     +25.0%       8.33 ± 11%  slabinfo.biovec-64.active_slabs
    213.33 ± 14%     +25.0%     266.67 ± 20%     +25.0%     266.67 ± 11%  slabinfo.biovec-64.num_objs
      6.67 ± 14%     +25.0%       8.33 ± 20%     +25.0%       8.33 ± 11%  slabinfo.biovec-64.num_slabs
    554.67 ± 24%      -4.0%     532.67 ± 18%     +51.9%     842.67 ± 19%  slabinfo.biovec-max.active_objs
     71.33 ± 23%      -3.3%      69.00 ± 18%     +51.9%     108.33 ± 17%  slabinfo.biovec-max.active_slabs
    570.67 ± 23%      -3.3%     552.00 ± 18%     +51.9%     866.67 ± 17%  slabinfo.biovec-max.num_objs
     71.33 ± 23%      -3.3%      69.00 ± 18%     +51.9%     108.33 ± 17%  slabinfo.biovec-max.num_slabs
      2239 ±  2%      -2.9%       2175 ±  2%      -1.2%       2213        slabinfo.blkdev_ioc.active_objs
     57.00 ±  2%      +0.0%      57.00 ±  2%      +0.0%      57.00 ±  2%  slabinfo.blkdev_ioc.active_slabs
      2246 ±  2%      -0.4%       2237 ±  2%      -0.4%       2238 ±  2%  slabinfo.blkdev_ioc.num_objs
     57.00 ±  2%      +0.0%      57.00 ±  2%      +0.0%      57.00 ±  2%  slabinfo.blkdev_ioc.num_slabs
    108.00            -8.3%      99.00 ± 12%      +0.0%     108.00        slabinfo.btrfs_inode.active_objs
      4.00            -8.3%       3.67 ± 12%      +0.0%       4.00        slabinfo.btrfs_inode.active_slabs
    108.00            -8.3%      99.00 ± 12%      +0.0%     108.00        slabinfo.btrfs_inode.num_objs
      4.00            -8.3%       3.67 ± 12%      +0.0%       4.00        slabinfo.btrfs_inode.num_slabs
    299.00 ±  6%     +21.7%     364.00 ±  5%      -4.3%     286.00 ± 23%  slabinfo.buffer_head.active_objs
      7.67 ±  6%     +21.7%       9.33 ±  5%      -4.3%       7.33 ± 23%  slabinfo.buffer_head.active_slabs
    299.00 ±  6%     +21.7%     364.00 ±  5%      -4.3%     286.00 ± 23%  slabinfo.buffer_head.num_objs
      7.67 ±  6%     +21.7%       9.33 ±  5%      -4.3%       7.33 ± 23%  slabinfo.buffer_head.num_slabs
      5400            +0.0%       5403            +1.3%       5473        slabinfo.cred_jar.active_objs
    127.67            +0.0%     127.67            +1.3%     129.33        slabinfo.cred_jar.active_slabs
      5400            +0.0%       5403            +1.3%       5473        slabinfo.cred_jar.num_objs
    127.67            +0.0%     127.67            +1.3%     129.33        slabinfo.cred_jar.num_slabs
    112.00 ± 17%      +0.0%     112.00 ± 17%      +0.0%     112.00 ± 17%  slabinfo.dax_cache.active_objs
      2.67 ± 17%      +0.0%       2.67 ± 17%      +0.0%       2.67 ± 17%  slabinfo.dax_cache.active_slabs
    112.00 ± 17%      +0.0%     112.00 ± 17%      +0.0%     112.00 ± 17%  slabinfo.dax_cache.num_objs
      2.67 ± 17%      +0.0%       2.67 ± 17%      +0.0%       2.67 ± 17%  slabinfo.dax_cache.num_slabs
     99243            +3.2%     102415            +1.2%     100396        slabinfo.dentry.active_objs
      2375            +3.3%       2453            +1.2%       2404        slabinfo.dentry.active_slabs
     99771            +3.2%     102991            +1.2%     100983        slabinfo.dentry.num_objs
      2375            +3.3%       2453            +1.2%       2404        slabinfo.dentry.num_slabs
     30.00            +0.0%      30.00            +0.0%      30.00        slabinfo.dmaengine-unmap-128.active_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.dmaengine-unmap-128.active_slabs
     30.00            +0.0%      30.00            +0.0%      30.00        slabinfo.dmaengine-unmap-128.num_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.dmaengine-unmap-128.num_slabs
      4893 ±  6%      -6.8%       4561            -3.3%       4733 ±  9%  slabinfo.dmaengine-unmap-16.active_objs
    115.67 ±  6%      -6.3%     108.33            -2.9%     112.33 ±  9%  slabinfo.dmaengine-unmap-16.active_slabs
      4893 ±  6%      -6.8%       4561            -3.3%       4733 ±  9%  slabinfo.dmaengine-unmap-16.num_objs
    115.67 ±  6%      -6.3%     108.33            -2.9%     112.33 ±  9%  slabinfo.dmaengine-unmap-16.num_slabs
     15.00            +0.0%      15.00            +0.0%      15.00        slabinfo.dmaengine-unmap-256.active_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.dmaengine-unmap-256.active_slabs
     15.00            +0.0%      15.00            +0.0%      15.00        slabinfo.dmaengine-unmap-256.num_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.dmaengine-unmap-256.num_slabs
      4115 ± 12%      +5.1%       4324 ± 15%     +11.5%       4589 ±  8%  slabinfo.eventpoll_pwq.active_objs
     73.33 ± 13%      +5.0%      77.00 ± 15%     +11.4%      81.67 ±  8%  slabinfo.eventpoll_pwq.active_slabs
      4115 ± 12%      +5.1%       4324 ± 15%     +11.5%       4589 ±  8%  slabinfo.eventpoll_pwq.num_objs
     73.33 ± 13%      +5.0%      77.00 ± 15%     +11.4%      81.67 ±  8%  slabinfo.eventpoll_pwq.num_slabs
    954.67 ± 11%     +16.9%       1115 ±  8%     +19.4%       1140 ±  2%  slabinfo.file_lock_cache.active_objs
     25.33 ± 13%     +18.4%      30.00 ±  8%     +21.1%      30.67 ±  3%  slabinfo.file_lock_cache.active_slabs
    954.67 ± 11%     +16.9%       1115 ±  8%     +19.4%       1140 ±  2%  slabinfo.file_lock_cache.num_objs
     25.33 ± 13%     +18.4%      30.00 ±  8%     +21.1%      30.67 ±  3%  slabinfo.file_lock_cache.num_slabs
      4586            +1.4%       4649            +0.7%       4616        slabinfo.files_cache.active_objs
    100.00            +0.3%     100.33            +0.0%     100.00        slabinfo.files_cache.active_slabs
      4586            +1.4%       4649            +0.7%       4616        slabinfo.files_cache.num_objs
    100.00            +0.3%     100.33            +0.0%     100.00        slabinfo.files_cache.num_slabs
     32617 ±  2%      +3.8%      33851 ±  2%      +4.9%      34218        slabinfo.filp.active_objs
      1023 ±  2%      +3.9%       1063 ±  2%      +4.9%       1073        slabinfo.filp.active_slabs
     32759 ±  2%      +3.9%      34024 ±  2%      +4.9%      34357        slabinfo.filp.num_objs
      1023 ±  2%      +3.9%       1063 ±  2%      +4.9%       1073        slabinfo.filp.num_slabs
      2865 ±  7%      -4.0%       2750 ±  3%      +0.1%       2868 ± 12%  slabinfo.fsnotify_mark_connector.active_objs
     22.00 ±  7%      -3.0%      21.33 ±  2%      +1.5%      22.33 ± 12%  slabinfo.fsnotify_mark_connector.active_slabs
      2865 ±  7%      -4.0%       2750 ±  3%      +0.1%       2868 ± 12%  slabinfo.fsnotify_mark_connector.num_objs
     22.00 ±  7%      -3.0%      21.33 ±  2%      +1.5%      22.33 ± 12%  slabinfo.fsnotify_mark_connector.num_slabs
     32186            +0.0%      32186            -0.2%      32130        slabinfo.ftrace_event_field.active_objs
    378.67            +0.0%     378.67            -0.2%     378.00        slabinfo.ftrace_event_field.active_slabs
     32186            +0.0%      32186            -0.2%      32130        slabinfo.ftrace_event_field.num_objs
    378.67            +0.0%     378.67            -0.2%     378.00        slabinfo.ftrace_event_field.num_slabs
    104.00            +0.0%     104.00            +0.0%     104.00        slabinfo.hugetlbfs_inode_cache.active_objs
      2.00            +0.0%       2.00            +0.0%       2.00        slabinfo.hugetlbfs_inode_cache.active_slabs
    104.00            +0.0%     104.00            +0.0%     104.00        slabinfo.hugetlbfs_inode_cache.num_objs
      2.00            +0.0%       2.00            +0.0%       2.00        slabinfo.hugetlbfs_inode_cache.num_slabs
     54212            +3.3%      55977 ±  4%      +1.4%      54957        slabinfo.inode_cache.active_objs
      1017            +3.2%       1050 ±  4%      +1.2%       1029        slabinfo.inode_cache.active_slabs
     54928            +3.2%      56688 ±  4%      +1.3%      55636        slabinfo.inode_cache.num_objs
      1017            +3.2%       1050 ±  4%      +1.2%       1029        slabinfo.inode_cache.num_slabs
      2668 ± 18%      -5.7%       2516 ± 14%      +1.1%       2698 ± 16%  slabinfo.ip6-frags.active_objs
     60.00 ± 19%      -5.6%      56.67 ± 15%      +1.1%      60.67 ± 16%  slabinfo.ip6-frags.active_slabs
      2668 ± 18%      -5.7%       2516 ± 14%      +1.1%       2698 ± 16%  slabinfo.ip6-frags.num_objs
     60.00 ± 19%      -5.6%      56.67 ± 15%      +1.1%      60.67 ± 16%  slabinfo.ip6-frags.num_slabs
     83680            +0.0%      83698            +0.2%      83812        slabinfo.kernfs_node_cache.active_objs
      2614            +0.0%       2615            +0.2%       2619        slabinfo.kernfs_node_cache.active_slabs
     83680            +0.0%      83698            +0.2%      83812        slabinfo.kernfs_node_cache.num_objs
      2614            +0.0%       2615            +0.2%       2619        slabinfo.kernfs_node_cache.num_slabs
      1606 ±  2%      +6.7%       1714 ±  4%      +4.5%       1678 ±  2%  slabinfo.khugepaged_mm_slot.active_objs
     43.67 ±  2%      +6.9%      46.67 ±  4%      +4.6%      45.67 ±  2%  slabinfo.khugepaged_mm_slot.active_slabs
      1606 ±  2%      +6.7%       1714 ±  4%      +4.5%       1678 ±  2%  slabinfo.khugepaged_mm_slot.num_objs
     43.67 ±  2%      +6.9%      46.67 ±  4%      +4.6%      45.67 ±  2%  slabinfo.khugepaged_mm_slot.num_slabs
      5258            -1.4%       5184            -0.3%       5245        slabinfo.kmalloc-128.active_objs
    166.67            -1.8%     163.67            +0.4%     167.33        slabinfo.kmalloc-128.active_slabs
      5346            -1.9%       5244            +0.3%       5360        slabinfo.kmalloc-128.num_objs
    166.67            -1.8%     163.67            +0.4%     167.33        slabinfo.kmalloc-128.num_slabs
     35242            +0.1%      35295            +0.2%      35328        slabinfo.kmalloc-16.active_objs
    137.67            +0.5%     138.33            +0.2%     138.00        slabinfo.kmalloc-16.active_slabs
     35242            +0.5%      35413            +0.2%      35328        slabinfo.kmalloc-16.num_objs
    137.67            +0.5%     138.33            +0.2%     138.00        slabinfo.kmalloc-16.num_slabs
      5616            -0.1%       5613            +0.5%       5642        slabinfo.kmalloc-192.active_objs
    134.00            +0.7%     135.00            +0.0%     134.00        slabinfo.kmalloc-192.active_slabs
      5653            +0.7%       5694            +0.2%       5661        slabinfo.kmalloc-192.num_objs
    134.00            +0.7%     135.00            +0.0%     134.00        slabinfo.kmalloc-192.num_slabs
      5873            +0.3%       5888 ±  2%      +0.0%       5874 ±  2%  slabinfo.kmalloc-1k.active_objs
    187.00            -0.5%     186.00 ±  3%      -0.4%     186.33 ±  3%  slabinfo.kmalloc-1k.active_slabs
      5993            -0.3%       5975 ±  3%      -0.2%       5982 ±  3%  slabinfo.kmalloc-1k.num_objs
    187.00            -0.5%     186.00 ±  3%      -0.4%     186.33 ±  3%  slabinfo.kmalloc-1k.num_slabs
      7549            +4.5%       7885            +1.3%       7647        slabinfo.kmalloc-256.active_objs
    241.00            +4.0%     250.67            +2.6%     247.33        slabinfo.kmalloc-256.active_slabs
      7728            +4.1%       8043            +2.5%       7924        slabinfo.kmalloc-256.num_objs
    241.00            +4.0%     250.67            +2.6%     247.33        slabinfo.kmalloc-256.num_slabs
      9025 ±  3%      -0.1%       9012 ±  3%      +1.2%       9133 ±  3%  slabinfo.kmalloc-2k.active_objs
    567.67 ±  3%      +0.0%     567.67 ±  3%      +1.3%     575.00 ±  3%  slabinfo.kmalloc-2k.active_slabs
      9089 ±  3%      -0.0%       9087 ±  3%      +1.3%       9203 ±  3%  slabinfo.kmalloc-2k.num_objs
    567.67 ±  3%      +0.0%     567.67 ±  3%      +1.3%     575.00 ±  3%  slabinfo.kmalloc-2k.num_slabs
     72566            -2.3%      70882            -0.2%      72449        slabinfo.kmalloc-32.active_objs
    567.33            -2.4%     554.00            -0.2%     566.33        slabinfo.kmalloc-32.active_slabs
     72672            -2.3%      70995            -0.1%      72577        slabinfo.kmalloc-32.num_objs
    567.33            -2.4%     554.00            -0.2%     566.33        slabinfo.kmalloc-32.num_slabs
      1904            +0.4%       1911            +0.9%       1922        slabinfo.kmalloc-4k.active_objs
    244.33            -0.4%     243.33            +1.2%     247.33        slabinfo.kmalloc-4k.active_slabs
      1956            -0.2%       1951            +1.3%       1980        slabinfo.kmalloc-4k.num_objs
    244.33            -0.4%     243.33            +1.2%     247.33        slabinfo.kmalloc-4k.num_slabs
     32670            +1.1%      33025            +1.9%      33295        slabinfo.kmalloc-512.active_objs
      1086            +0.5%       1092            +2.3%       1111 ±  2%  slabinfo.kmalloc-512.active_slabs
     34785            +0.5%      34967            +2.3%      35581 ±  2%  slabinfo.kmalloc-512.num_objs
      1086            +0.5%       1092            +2.3%       1111 ±  2%  slabinfo.kmalloc-512.num_slabs
     48899            -0.0%      48895            -0.2%      48804        slabinfo.kmalloc-64.active_objs
    784.33            -0.4%     781.33            -0.1%     783.33        slabinfo.kmalloc-64.active_slabs
     50234            -0.4%      50036            -0.1%      50171        slabinfo.kmalloc-64.num_objs
    784.33            -0.4%     781.33            -0.1%     783.33        slabinfo.kmalloc-64.num_slabs
     54345            -0.0%      54341            +2.0%      55410        slabinfo.kmalloc-8.active_objs
    113.33            -1.2%     112.00 ±  2%      +5.3%     119.33 ±  4%  slabinfo.kmalloc-8.active_slabs
     58231            -1.1%      57601 ±  2%      +5.3%      61346 ±  4%  slabinfo.kmalloc-8.num_objs
    113.33            -1.2%     112.00 ±  2%      +5.3%     119.33 ±  4%  slabinfo.kmalloc-8.num_slabs
    794.00            -1.3%     783.33            -0.3%     791.67        slabinfo.kmalloc-8k.active_objs
    203.00            -1.3%     200.33            -0.2%     202.67        slabinfo.kmalloc-8k.active_slabs
    815.00            -1.4%     803.67            -0.3%     812.33        slabinfo.kmalloc-8k.num_objs
    203.00            -1.3%     200.33            -0.2%     202.67        slabinfo.kmalloc-8k.num_slabs
      9749 ±  5%      -0.7%       9684 ±  4%      -0.2%       9729 ±  4%  slabinfo.kmalloc-96.active_objs
    233.67 ±  5%      -1.0%     231.33 ±  4%      -0.6%     232.33 ±  4%  slabinfo.kmalloc-96.active_slabs
      9834 ±  5%      -1.0%       9732 ±  4%      -0.5%       9785 ±  4%  slabinfo.kmalloc-96.num_objs
    233.67 ±  5%      -1.0%     231.33 ±  4%      -0.6%     232.33 ±  4%  slabinfo.kmalloc-96.num_slabs
    810.67 ± 14%     -10.5%     725.33 ±  4%      +5.3%     853.33 ± 19%  slabinfo.kmalloc-rcl-128.active_objs
     25.33 ± 14%     -10.5%      22.67 ±  4%      +5.3%      26.67 ± 19%  slabinfo.kmalloc-rcl-128.active_slabs
    810.67 ± 14%     -10.5%     725.33 ±  4%      +5.3%     853.33 ± 19%  slabinfo.kmalloc-rcl-128.num_objs
     25.33 ± 14%     -10.5%      22.67 ±  4%      +5.3%      26.67 ± 19%  slabinfo.kmalloc-rcl-128.num_slabs
     42.00            +0.0%      42.00            +0.0%      42.00        slabinfo.kmalloc-rcl-192.active_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.kmalloc-rcl-192.active_slabs
     42.00            +0.0%      42.00            +0.0%      42.00        slabinfo.kmalloc-rcl-192.num_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.kmalloc-rcl-192.num_slabs
     64.00            +0.0%      64.00            +0.0%      64.00        slabinfo.kmalloc-rcl-256.active_objs
      2.00            +0.0%       2.00            +0.0%       2.00        slabinfo.kmalloc-rcl-256.active_slabs
     64.00            +0.0%      64.00            +0.0%      64.00        slabinfo.kmalloc-rcl-256.num_objs
      2.00            +0.0%       2.00            +0.0%       2.00        slabinfo.kmalloc-rcl-256.num_slabs
      1435 ±  6%     +15.8%       1662 ±  8%      +9.8%       1576 ±  7%  slabinfo.kmalloc-rcl-512.active_objs
     44.33 ±  6%     +16.5%      51.67 ±  7%     +10.5%      49.00 ±  8%  slabinfo.kmalloc-rcl-512.active_slabs
      1435 ±  6%     +15.8%       1662 ±  8%     +10.2%       1581 ±  8%  slabinfo.kmalloc-rcl-512.num_objs
     44.33 ±  6%     +16.5%      51.67 ±  7%     +10.5%      49.00 ±  8%  slabinfo.kmalloc-rcl-512.num_slabs
      4487            +6.0%       4754 ±  5%      +3.0%       4623        slabinfo.kmalloc-rcl-64.active_objs
     69.67            +6.2%      74.00 ±  4%      +2.9%      71.67        slabinfo.kmalloc-rcl-64.active_slabs
      4487            +6.0%       4754 ±  5%      +3.0%       4623        slabinfo.kmalloc-rcl-64.num_objs
     69.67            +6.2%      74.00 ±  4%      +2.9%      71.67        slabinfo.kmalloc-rcl-64.num_slabs
      2453 ±  4%      -3.4%       2369 ±  2%      -1.1%       2425 ±  6%  slabinfo.kmalloc-rcl-96.active_objs
     58.33 ±  4%      -3.4%      56.33 ±  2%      -1.1%      57.67 ±  6%  slabinfo.kmalloc-rcl-96.active_slabs
      2453 ±  4%      -3.4%       2369 ±  2%      -1.1%       2425 ±  6%  slabinfo.kmalloc-rcl-96.num_objs
     58.33 ±  4%      -3.4%      56.33 ±  2%      -1.1%      57.67 ±  6%  slabinfo.kmalloc-rcl-96.num_slabs
    437.33 ±  3%     +12.2%     490.67 ± 11%      -2.4%     426.67 ± 12%  slabinfo.kmem_cache.active_objs
     13.67 ±  3%     +12.2%      15.33 ± 11%      -2.4%      13.33 ± 12%  slabinfo.kmem_cache.active_slabs
    437.33 ±  3%     +12.2%     490.67 ± 11%      -2.4%     426.67 ± 12%  slabinfo.kmem_cache.num_objs
     13.67 ±  3%     +12.2%      15.33 ± 11%      -2.4%      13.33 ± 12%  slabinfo.kmem_cache.num_slabs
    968.67 ±  3%      +4.4%       1011 ± 10%      -4.4%     926.00 ±  9%  slabinfo.kmem_cache_node.active_objs
     15.67 ±  3%      +4.3%      16.33 ± 10%      -4.3%      15.00 ±  9%  slabinfo.kmem_cache_node.active_slabs
      1002 ±  3%      +4.3%       1045 ± 10%      -4.3%     960.00 ±  9%  slabinfo.kmem_cache_node.num_objs
     15.67 ±  3%      +4.3%      16.33 ± 10%      -4.3%      15.00 ±  9%  slabinfo.kmem_cache_node.num_slabs
     17560            -0.0%      17559            -0.6%      17447        slabinfo.lsm_file_cache.active_objs
    102.33            +0.0%     102.33            -0.7%     101.67        slabinfo.lsm_file_cache.active_slabs
     17560            -0.0%      17559            -0.6%      17447        slabinfo.lsm_file_cache.num_objs
    102.33            +0.0%     102.33            -0.7%     101.67        slabinfo.lsm_file_cache.num_slabs
      3133            -0.2%       3127            -0.2%       3127        slabinfo.mm_struct.active_objs
    103.67            -0.3%     103.33            -0.3%     103.33        slabinfo.mm_struct.active_slabs
      3133            -0.2%       3127            -0.2%       3127        slabinfo.mm_struct.num_objs
    103.67            -0.3%     103.33            -0.3%     103.33        slabinfo.mm_struct.num_slabs
      1071 ± 10%     -17.5%     884.00 ± 11%     -12.7%     935.00 ±  6%  slabinfo.mnt_cache.active_objs
     21.00 ± 10%     -17.5%      17.33 ± 11%     -12.7%      18.33 ±  6%  slabinfo.mnt_cache.active_slabs
      1071 ± 10%     -17.5%     884.00 ± 11%     -12.7%     935.00 ±  6%  slabinfo.mnt_cache.num_objs
     21.00 ± 10%     -17.5%      17.33 ± 11%     -12.7%      18.33 ±  6%  slabinfo.mnt_cache.num_slabs
     34.00            +0.0%      34.00            +0.0%      34.00        slabinfo.mqueue_inode_cache.active_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.mqueue_inode_cache.active_slabs
     34.00            +0.0%      34.00            +0.0%      34.00        slabinfo.mqueue_inode_cache.num_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.mqueue_inode_cache.num_slabs
    768.00            +0.0%     768.00            +0.0%     768.00        slabinfo.names_cache.active_objs
     96.00            +0.0%      96.00            +0.0%      96.00        slabinfo.names_cache.active_slabs
    768.00            +0.0%     768.00            +0.0%     768.00        slabinfo.names_cache.num_objs
     96.00            +0.0%      96.00            +0.0%      96.00        slabinfo.names_cache.num_slabs
    119.67           -16.4%     100.00 ± 28%      -8.1%     110.00 ± 12%  slabinfo.nfs_inode_cache.active_objs
      3.67 ± 12%      -9.1%       3.33 ± 28%      +0.0%       3.67 ± 12%  slabinfo.nfs_inode_cache.active_slabs
    119.67           -16.4%     100.00 ± 28%      -8.1%     110.00 ± 12%  slabinfo.nfs_inode_cache.num_objs
      3.67 ± 12%      -9.1%       3.33 ± 28%      +0.0%       3.67 ± 12%  slabinfo.nfs_inode_cache.num_slabs
    125.67 ±  7%      -0.3%     125.33 ± 10%      +8.2%     136.00 ± 12%  slabinfo.nfs_read_data.active_objs
      3.00            +0.0%       3.00           +11.1%       3.33 ± 14%  slabinfo.nfs_read_data.active_slabs
    125.67 ±  7%      -0.3%     125.33 ± 10%      +8.2%     136.00 ± 12%  slabinfo.nfs_read_data.num_objs
      3.00            +0.0%       3.00           +11.1%       3.33 ± 14%  slabinfo.nfs_read_data.num_slabs
      3204 ± 18%      -2.9%       3113 ± 15%      +2.9%       3297 ± 14%  slabinfo.numa_policy.active_objs
     51.33 ± 18%      -2.6%      50.00 ± 15%      +2.6%      52.67 ± 15%  slabinfo.numa_policy.active_slabs
      3204 ± 18%      -2.9%       3113 ± 15%      +2.9%       3297 ± 14%  slabinfo.numa_policy.num_objs
     51.33 ± 18%      -2.6%      50.00 ± 15%      +2.6%      52.67 ± 15%  slabinfo.numa_policy.num_slabs
      9378            +0.8%       9450            +1.4%       9505        slabinfo.pde_opener.active_objs
     91.33            +1.1%      92.33            +1.5%      92.67        slabinfo.pde_opener.active_slabs
      9378            +0.8%       9450            +1.4%       9505        slabinfo.pde_opener.num_objs
     91.33            +1.1%      92.33            +1.5%      92.67        slabinfo.pde_opener.num_slabs
      4415            +2.0%       4504            +0.9%       4454        slabinfo.pid.active_objs
    137.33            +1.9%     140.00            +1.0%     138.67        slabinfo.pid.active_slabs
      4415            +2.0%       4504            +0.9%       4454        slabinfo.pid.num_objs
    137.33            +1.9%     140.00            +1.0%     138.67        slabinfo.pid.num_slabs
     92.00 ± 27%     -19.6%      74.00 ± 34%     -39.1%      56.00        slabinfo.pid_namespace.active_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.pid_namespace.active_slabs
     92.00 ± 27%     -19.6%      74.00 ± 34%     -39.1%      56.00        slabinfo.pid_namespace.num_objs
      1.00            +0.0%       1.00            +0.0%       1.00        slabinfo.pid_namespace.num_slabs
      2989 ± 10%      -9.6%       2703 ± 15%     -16.7%       2489 ±  8%  slabinfo.pool_workqueue.active_objs
     93.33 ± 11%     -10.0%      84.00 ± 15%     -17.5%      77.00 ±  9%  slabinfo.pool_workqueue.active_slabs
      3008 ± 11%     -10.1%       2703 ± 15%     -17.2%       2490 ±  8%  slabinfo.pool_workqueue.num_objs
     93.33 ± 11%     -10.0%      84.00 ± 15%     -17.5%      77.00 ±  9%  slabinfo.pool_workqueue.num_slabs
      2912            +1.9%       2968            +1.9%       2968        slabinfo.proc_dir_entry.active_objs
     69.33            +1.9%      70.67            +1.9%      70.67        slabinfo.proc_dir_entry.active_slabs
      2912            +1.9%       2968            +1.9%       2968        slabinfo.proc_dir_entry.num_objs
     69.33            +1.9%      70.67            +1.9%      70.67        slabinfo.proc_dir_entry.num_slabs
     12479 ±  3%     -21.7%       9772 ±  4%     -15.8%      10506 ± 13%  slabinfo.proc_inode_cache.active_objs
    265.67 ±  3%     -19.9%     212.67 ±  5%     -15.6%     224.33 ± 13%  slabinfo.proc_inode_cache.active_slabs
     12738 ±  3%     -21.3%      10024 ±  3%     -15.5%      10767 ± 13%  slabinfo.proc_inode_cache.num_objs
    265.67 ±  3%     -19.9%     212.67 ±  5%     -15.6%     224.33 ± 13%  slabinfo.proc_inode_cache.num_slabs
    507751            -0.6%     504586            +0.1%     508356        slabinfo.radix_tree_node.active_objs
      9914            -1.5%       9769            +0.2%       9929        slabinfo.radix_tree_node.active_slabs
    551267            -1.4%     543647            +0.2%     552280        slabinfo.radix_tree_node.num_objs
      9914            -1.5%       9769            +0.2%       9929        slabinfo.radix_tree_node.num_slabs
     45.00            +0.0%      45.00            +0.0%      45.00 ± 27%  slabinfo.request_queue.active_objs
      3.00            +0.0%       3.00            +0.0%       3.00 ± 27%  slabinfo.request_queue.active_slabs
     45.00            +0.0%      45.00            +0.0%      45.00 ± 27%  slabinfo.request_queue.num_objs
      3.00            +0.0%       3.00            +0.0%       3.00 ± 27%  slabinfo.request_queue.num_slabs
    102.00            +0.0%     102.00            +0.0%     102.00        slabinfo.rpc_inode_cache.active_objs
      2.00            +0.0%       2.00            +0.0%       2.00        slabinfo.rpc_inode_cache.active_slabs
    102.00            +0.0%     102.00            +0.0%     102.00        slabinfo.rpc_inode_cache.num_objs
      2.00            +0.0%       2.00            +0.0%       2.00        slabinfo.rpc_inode_cache.num_slabs
    640.00            +0.0%     640.00            -1.7%     629.33 ±  2%  slabinfo.scsi_sense_cache.active_objs
     20.00            +0.0%      20.00            -1.7%      19.67 ±  2%  slabinfo.scsi_sense_cache.active_slabs
    640.00            +0.0%     640.00            -1.7%     629.33 ±  2%  slabinfo.scsi_sense_cache.num_objs
     20.00            +0.0%      20.00            -1.7%      19.67 ±  2%  slabinfo.scsi_sense_cache.num_slabs
      3264            +0.0%       3264            +0.0%       3264        slabinfo.seq_file.active_objs
     96.00            +0.0%      96.00            +0.0%      96.00        slabinfo.seq_file.active_slabs
      3264            +0.0%       3264            +0.0%       3264        slabinfo.seq_file.num_objs
     96.00            +0.0%      96.00            +0.0%      96.00        slabinfo.seq_file.num_slabs
      5384            +1.9%       5487 ±  3%      -0.4%       5364        slabinfo.shmem_inode_cache.active_objs
    116.33            +1.7%     118.33 ±  3%      -0.6%     115.67        slabinfo.shmem_inode_cache.active_slabs
      5384            +1.9%       5487 ±  3%      -0.4%       5364        slabinfo.shmem_inode_cache.num_objs
    116.33            +1.7%     118.33 ±  3%      -0.6%     115.67        slabinfo.shmem_inode_cache.num_slabs
      2345            +1.1%       2370            +2.0%       2392        slabinfo.sighand_cache.active_objs
    156.00            +0.9%     157.33            +1.9%     159.00        slabinfo.sighand_cache.active_slabs
      2345            +1.1%       2370            +2.0%       2393        slabinfo.sighand_cache.num_objs
    156.00            +0.9%     157.33            +1.9%     159.00        slabinfo.sighand_cache.num_slabs
      3755 ±  2%      +0.5%       3774            +1.8%       3821        slabinfo.signal_cache.active_objs
    133.67 ±  2%      +0.2%     134.00            +2.0%     136.33        slabinfo.signal_cache.active_slabs
      3755 ±  2%      +0.5%       3774            +2.2%       3837        slabinfo.signal_cache.num_objs
    133.67 ±  2%      +0.2%     134.00            +2.0%     136.33        slabinfo.signal_cache.num_slabs
    639.67 ±  8%      +1.5%     649.33 ± 13%      +7.5%     687.67 ±  8%  slabinfo.skbuff_fclone_cache.active_objs
     20.33 ± 10%      +0.0%      20.33 ± 12%      +4.9%      21.33 ±  9%  slabinfo.skbuff_fclone_cache.active_slabs
    639.67 ±  8%      +1.5%     649.33 ± 13%      +7.5%     687.67 ±  8%  slabinfo.skbuff_fclone_cache.num_objs
     20.33 ± 10%      +0.0%      20.33 ± 12%      +4.9%      21.33 ±  9%  slabinfo.skbuff_fclone_cache.num_slabs
      4021 ±  8%      -8.2%       3690 ±  2%      -1.8%       3950 ±  3%  slabinfo.skbuff_head_cache.active_objs
    125.67 ±  8%      -8.2%     115.33 ±  2%      -0.5%     125.00 ±  2%  slabinfo.skbuff_head_cache.active_slabs
      4021 ±  8%      -8.2%       3690 ±  2%      -0.4%       4004 ±  2%  slabinfo.skbuff_head_cache.num_objs
    125.67 ±  8%      -8.2%     115.33 ±  2%      -0.5%     125.00 ±  2%  slabinfo.skbuff_head_cache.num_slabs
      3165 ±  2%      +6.9%       3384            +4.6%       3310 ±  4%  slabinfo.sock_inode_cache.active_objs
     81.00 ±  2%      +6.6%      86.33            +4.1%      84.33 ±  4%  slabinfo.sock_inode_cache.active_slabs
      3165 ±  2%      +6.9%       3384            +4.6%       3310 ±  4%  slabinfo.sock_inode_cache.num_objs
     81.00 ±  2%      +6.6%      86.33            +4.1%      84.33 ±  4%  slabinfo.sock_inode_cache.num_slabs
      6085            +0.8%       6135            -0.7%       6043        slabinfo.task_delay_info.active_objs
    118.67            +0.8%     119.67            -0.6%     118.00        slabinfo.task_delay_info.active_slabs
      6085            +0.8%       6135            -0.7%       6043        slabinfo.task_delay_info.num_objs
    118.67            +0.8%     119.67            -0.6%     118.00        slabinfo.task_delay_info.num_slabs
      2225 ± 11%      +2.9%       2290 ±  9%      +4.1%       2317 ±  6%  slabinfo.task_group.active_objs
     52.33 ± 11%      +3.8%      54.33 ±  9%      +4.5%      54.67 ±  5%  slabinfo.task_group.active_slabs
      2225 ± 11%      +2.9%       2290 ±  9%      +4.1%       2317 ±  6%  slabinfo.task_group.num_objs
     52.33 ± 11%      +3.8%      54.33 ±  9%      +4.5%      54.67 ±  5%  slabinfo.task_group.num_slabs
      1278            +0.7%       1286            +1.4%       1295        slabinfo.task_struct.active_objs
      1285            +0.5%       1291            +1.3%       1301        slabinfo.task_struct.active_slabs
      1285            +0.5%       1291            +1.3%       1301        slabinfo.task_struct.num_objs
      1285            +0.5%       1291            +1.3%       1301        slabinfo.task_struct.num_slabs
    216.67 ± 25%     -17.8%     178.00           -18.2%     177.33        slabinfo.taskstats.active_objs
      4.00 ± 35%     -25.0%       3.00           -25.0%       3.00        slabinfo.taskstats.active_slabs
    216.67 ± 25%     -17.8%     178.00           -18.2%     177.33        slabinfo.taskstats.num_objs
      4.00 ± 35%     -25.0%       3.00           -25.0%       3.00        slabinfo.taskstats.num_slabs
      3187 ±  3%      -3.7%       3070 ±  2%      -0.3%       3177        slabinfo.trace_event_file.active_objs
     69.00 ±  3%      -3.4%      66.67 ±  2%      +0.0%      69.00        slabinfo.trace_event_file.active_slabs
      3187 ±  3%      -3.7%       3070 ±  2%      -0.3%       3177        slabinfo.trace_event_file.num_objs
     69.00 ±  3%      -3.4%      66.67 ±  2%      +0.0%      69.00        slabinfo.trace_event_file.num_slabs
     88.00 ± 17%     +12.5%      99.00           +12.5%      99.00        slabinfo.tw_sock_TCP.active_objs
      2.67 ± 17%     +12.5%       3.00           +12.5%       3.00        slabinfo.tw_sock_TCP.active_slabs
     88.00 ± 17%     +12.5%      99.00           +12.5%      99.00        slabinfo.tw_sock_TCP.num_objs
      2.67 ± 17%     +12.5%       3.00           +12.5%       3.00        slabinfo.tw_sock_TCP.num_slabs
     63425 ±  5%      +4.6%      66358 ±  2%      +5.3%      66811        slabinfo.vm_area_struct.active_objs
      1585 ±  5%      +4.8%       1661 ±  2%      +5.5%       1672        slabinfo.vm_area_struct.active_slabs
     63444 ±  5%      +4.8%      66477 ±  2%      +5.5%      66928        slabinfo.vm_area_struct.num_objs
      1585 ±  5%      +4.8%       1661 ±  2%      +5.5%       1672        slabinfo.vm_area_struct.num_slabs
     11832            +2.5%      12131            +2.1%      12083        slabinfo.vmap_area.active_objs
    184.33            +2.5%     189.00            +2.2%     188.33        slabinfo.vmap_area.active_slabs
     11834            +2.5%      12131            +2.1%      12085        slabinfo.vmap_area.num_objs
    184.33            +2.5%     189.00            +2.2%     188.33        slabinfo.vmap_area.num_slabs
    504.00 ± 70%     -11.9%     444.00 ± 55%     +95.2%     984.00 ± 19%  slabinfo.xfs_btree_cur.active_objs
     14.00 ± 70%     -11.9%      12.33 ± 55%     +95.2%      27.33 ± 19%  slabinfo.xfs_btree_cur.active_slabs
    504.00 ± 70%     -11.9%     444.00 ± 55%     +95.2%     984.00 ± 19%  slabinfo.xfs_btree_cur.num_objs
     14.00 ± 70%     -11.9%      12.33 ± 55%     +95.2%      27.33 ± 19%  slabinfo.xfs_btree_cur.num_slabs
    378.00 ± 41%     -22.2%     294.00 ± 23%      +7.4%     406.00 ± 12%  slabinfo.xfs_buf.active_objs
      9.00 ± 41%     -22.2%       7.00 ± 23%      +7.4%       9.67 ± 12%  slabinfo.xfs_buf.active_slabs
    378.00 ± 41%     -22.2%     294.00 ± 23%      +7.4%     406.00 ± 12%  slabinfo.xfs_buf.num_objs
      9.00 ± 41%     -22.2%       7.00 ± 23%      +7.4%       9.67 ± 12%  slabinfo.xfs_buf.num_slabs
    504.00 ± 76%     -13.9%     434.00 ± 66%    +116.7%       1092 ± 20%  slabinfo.xfs_ili.active_objs
     12.00 ± 76%     -13.9%      10.33 ± 66%    +116.7%      26.00 ± 20%  slabinfo.xfs_ili.active_slabs
    504.00 ± 76%     -13.9%     434.00 ± 66%    +116.7%       1092 ± 20%  slabinfo.xfs_ili.num_objs
     12.00 ± 76%     -13.9%      10.33 ± 66%    +116.7%      26.00 ± 20%  slabinfo.xfs_ili.num_slabs
    437.33 ± 63%      -9.8%     394.67 ± 55%    +100.0%     874.67 ± 19%  slabinfo.xfs_inode.active_objs
     13.67 ± 63%      -9.8%      12.33 ± 55%    +100.0%      27.33 ± 19%  slabinfo.xfs_inode.active_slabs
    437.33 ± 63%      -9.8%     394.67 ± 55%    +100.0%     874.67 ± 19%  slabinfo.xfs_inode.num_objs
     13.67 ± 63%      -9.8%      12.33 ± 55%    +100.0%      27.33 ± 19%  slabinfo.xfs_inode.num_slabs
      6.69 ±  8%      -6.7        0.00            -6.7        0.00        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.pagecache_get_page
      6.65 ±  8%      -6.6        0.00            -6.6        0.00        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
     15.82 ±  5%      -5.5       10.29 ±  3%      -8.1        7.68 ±  5%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node
     15.75 ±  5%      -5.5       10.24 ±  3%      -8.1        7.63 ±  5%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec
     15.23 ±  6%      -4.9       10.37 ±  3%      -7.5        7.77 ±  5%  perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
      8.12            -3.4        4.76 ±  3%      -1.1        7.01 ±  7%  perf-profile.calltrace.cycles-pp.iomap_readpage.filemap_fault.__xfs_filemap_fault.__do_fault.do_fault
      6.94 ±  2%      -2.9        4.02 ±  4%      -1.0        5.97 ±  7%  perf-profile.calltrace.cycles-pp.submit_bio_noacct.submit_bio.iomap_readpage.filemap_fault.__xfs_filemap_fault
      6.96 ±  2%      -2.9        4.04 ±  4%      -1.0        5.99 ±  7%  perf-profile.calltrace.cycles-pp.submit_bio.iomap_readpage.filemap_fault.__xfs_filemap_fault.__do_fault
      6.54 ±  2%      -2.8        3.69 ±  4%      -0.9        5.60 ±  7%  perf-profile.calltrace.cycles-pp.pmem_submit_bio.submit_bio_noacct.submit_bio.iomap_readpage.filemap_fault
      5.90 ±  2%      -2.6        3.29 ±  4%      -0.9        5.04 ±  7%  perf-profile.calltrace.cycles-pp.pmem_do_read.pmem_submit_bio.submit_bio_noacct.submit_bio.iomap_readpage
      5.83 ±  2%      -2.6        3.23 ±  4%      -0.9        4.98 ±  7%  perf-profile.calltrace.cycles-pp.__memcpy_mcsafe.pmem_do_read.pmem_submit_bio.submit_bio_noacct.submit_bio
      4.91            -1.7        3.22 ±  3%      -0.4        4.50 ±  4%  perf-profile.calltrace.cycles-pp.xfs_filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      4.63 ±  2%      -1.6        3.02 ±  3%      -0.4        4.23 ±  4%  perf-profile.calltrace.cycles-pp.filemap_map_pages.xfs_filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault
      1.35 ± 52%      -1.4        0.00            -1.4        0.00        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.deactivate_file_page.invalidate_mapping_pages.generic_fadvise
      1.34 ± 52%      -1.3        0.00            -1.3        0.00        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.deactivate_file_page.invalidate_mapping_pages
      2.24 ±  3%      -1.0        1.28 ± 22%      -0.4        1.82 ±  6%  perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.filemap_fault.__xfs_filemap_fault
      0.90 ± 11%      -0.9        0.00            -0.3        0.64 ±  6%  perf-profile.calltrace.cycles-pp.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.pagecache_get_page.filemap_fault
      1.22 ±  8%      -0.9        0.37 ± 70%      -0.3        0.88 ±  5%  perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault
      0.77 ±  4%      -0.8        0.00            -0.8        0.00        perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
      0.70 ±  4%      -0.7        0.00            -0.1        0.60 ±  2%  perf-profile.calltrace.cycles-pp.page_add_file_rmap.alloc_set_pte.filemap_map_pages.xfs_filemap_map_pages.do_fault
      1.14 ±  9%      -0.7        0.44 ± 70%      -0.2        0.89 ± 13%  perf-profile.calltrace.cycles-pp.mem_cgroup_charge.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.filemap_fault
      0.62 ± 11%      -0.6        0.00            -0.6        0.00        perf-profile.calltrace.cycles-pp.rmqueue_bulk.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.pagecache_get_page
      0.58 ±  2%      -0.6        0.00            -0.0        0.56 ±  4%  perf-profile.calltrace.cycles-pp.unlock_page.filemap_map_pages.xfs_filemap_map_pages.do_fault.__handle_mm_fault
      0.75 ±  3%      -0.6        0.17 ±141%      -0.1        0.69 ±  4%  perf-profile.calltrace.cycles-pp.page_referenced_one.rmap_walk_file.page_referenced.shrink_page_list.shrink_inactive_list
      8.09 ±  4%      -0.6        7.51            +0.7        8.76 ±  7%  perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
      2.99 ±  6%      -0.5        2.48 ±  9%      -0.1        2.88 ± 14%  perf-profile.calltrace.cycles-pp.shrink_node.balance_pgdat.kswapd.kthread.ret_from_fork
      2.99 ±  6%      -0.5        2.48 ±  9%      -0.1        2.88 ± 14%  perf-profile.calltrace.cycles-pp.kswapd.kthread.ret_from_fork
      2.99 ±  6%      -0.5        2.48 ±  9%      -0.1        2.88 ± 14%  perf-profile.calltrace.cycles-pp.balance_pgdat.kswapd.kthread.ret_from_fork
      0.51            -0.5        0.00            -0.3        0.17 ±141%  perf-profile.calltrace.cycles-pp.iomap_readpage_actor.iomap_apply.iomap_readpage.filemap_fault.__xfs_filemap_fault
      3.16 ±  4%      -0.5        2.66 ±  9%      -0.1        3.05 ± 13%  perf-profile.calltrace.cycles-pp.ret_from_fork
      3.16 ±  4%      -0.5        2.66 ±  9%      -0.1        3.05 ± 13%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      2.96 ±  6%      -0.5        2.46 ±  9%      -0.1        2.85 ± 14%  perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat.kswapd
      2.98 ±  6%      -0.5        2.48 ±  9%      -0.1        2.87 ± 14%  perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.balance_pgdat.kswapd.kthread
      2.09 ±  9%      -0.5        1.61 ±  5%      +0.2        2.26 ± 12%  perf-profile.calltrace.cycles-pp.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
      1.05 ±  2%      -0.5        0.59 ± 14%      -0.1        0.92 ±  2%  perf-profile.calltrace.cycles-pp.alloc_set_pte.filemap_map_pages.xfs_filemap_map_pages.do_fault.__handle_mm_fault
      1.32 ±  2%      -0.4        0.87 ±  2%      -0.1        1.23 ±  4%  perf-profile.calltrace.cycles-pp.page_referenced.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
      1.13 ±  5%      -0.4        0.70 ±  3%      -0.1        1.00 ±  4%  perf-profile.calltrace.cycles-pp.iomap_apply.iomap_readpage.filemap_fault.__xfs_filemap_fault.__do_fault
      1.16 ±  2%      -0.4        0.77 ±  2%      -0.1        1.08 ±  3%  perf-profile.calltrace.cycles-pp.rmap_walk_file.page_referenced.shrink_page_list.shrink_inactive_list.shrink_lruvec
      0.56 ±  3%      -0.4        0.17 ±141%      +0.0        0.59 ±  6%  perf-profile.calltrace.cycles-pp.__delete_from_page_cache.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec
      0.39 ± 71%      -0.4        0.00            -0.2        0.18 ±141%  perf-profile.calltrace.cycles-pp.__count_memcg_events.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.37 ± 70%      -0.4        0.00            -0.4        0.00        perf-profile.calltrace.cycles-pp.xfs_read_iomap_begin.iomap_apply.iomap_readpage.filemap_fault.__xfs_filemap_fault
     66.79            -0.3       66.46            -2.0       64.84 ±  2%  perf-profile.calltrace.cycles-pp.asm_exc_page_fault
     66.70            -0.3       66.40            -1.9       64.76 ±  2%  perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault
      1.30 ±  7%      -0.3        1.01 ± 14%      +0.0        1.34 ± 13%  perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
     66.64            -0.3       66.36            -1.9       64.70 ±  2%  perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.27 ±141%      -0.3        0.00            +0.1        0.39 ± 71%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64
      0.27 ±141%      -0.3        0.00            +0.1        0.39 ± 71%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
      0.27 ±141%      -0.3        0.00            +0.1        0.39 ± 71%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
      0.27 ±141%      -0.3        0.00            +0.1        0.39 ± 71%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
      0.27 ±141%      -0.3        0.00            +0.1        0.39 ± 71%  perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64
      1.04 ±  3%      -0.3        0.77 ± 10%      -0.0        1.03 ±  5%  perf-profile.calltrace.cycles-pp.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
     25.69 ±  4%      -0.2       25.44 ±  3%      +1.1       26.82 ±  4%  perf-profile.calltrace.cycles-pp.secondary_startup_64
      0.95 ±  3%      -0.2        0.72 ± 12%      +0.0        0.96 ±  5%  perf-profile.calltrace.cycles-pp.rmap_walk_file.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_lruvec
     25.35 ±  4%      -0.2       25.13 ±  3%      +1.3       26.63 ±  3%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      0.77 ±  3%      -0.2        0.59 ± 15%      +0.0        0.79 ±  6%  perf-profile.calltrace.cycles-pp.try_to_unmap_one.rmap_walk_file.try_to_unmap.shrink_page_list.shrink_inactive_list
      0.18 ±141%      -0.2        0.00            -0.0        0.17 ±141%  perf-profile.calltrace.cycles-pp.page_vma_mapped_walk.page_referenced_one.rmap_walk_file.page_referenced.shrink_page_list
      0.17 ±141%      -0.2        0.00            -0.2        0.00        perf-profile.calltrace.cycles-pp.get_mem_cgroup_from_mm.mem_cgroup_charge.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page
      0.17 ±141%      -0.2        0.00            +0.2        0.37 ± 71%  perf-profile.calltrace.cycles-pp.workingset_eviction.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec
     66.16            -0.1       66.05            -1.9       64.28 ±  2%  perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.59 ± 70%      -0.1        0.52 ± 70%      +0.3        0.85 ± 23%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec
      0.55 ± 70%      -0.1        0.49 ± 70%      +0.2        0.80 ± 25%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list
      0.00            +0.0        0.00            +0.2        0.17 ±141%  perf-profile.calltrace.cycles-pp.free_unref_page_list.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
      0.75 ±  2%      +0.0        0.76            -0.0        0.75 ±  5%  perf-profile.calltrace.cycles-pp.isolate_lru_pages.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
     25.16 ±  3%      +0.0       25.18 ±  3%      +1.2       26.36 ±  4%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
     25.16 ±  3%      +0.0       25.18 ±  3%      +1.2       26.36 ±  4%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     25.16 ±  3%      +0.0       25.18 ±  3%      +1.2       26.36 ±  4%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
     25.16 ±  3%      +0.0       25.18 ±  3%      +1.2       26.36 ±  4%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     25.16 ±  3%      +0.0       25.18 ±  3%      +1.2       26.36 ±  4%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      0.35 ± 70%      +0.2        0.51 ± 73%      +0.2        0.58 ±  4%  perf-profile.calltrace.cycles-pp.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write.vfs_write
      0.35 ± 70%      +0.2        0.51 ± 73%      +0.2        0.58 ±  4%  perf-profile.calltrace.cycles-pp.__generic_file_write_iter.generic_file_write_iter.new_sync_write.vfs_write.ksys_write
      0.35 ± 70%      +0.2        0.51 ± 73%      +0.2        0.58 ±  4%  perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.35 ± 70%      +0.2        0.51 ± 73%      +0.2        0.58 ±  4%  perf-profile.calltrace.cycles-pp.generic_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
      0.00            +0.2        0.17 ±141%      +0.0        0.00        perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page
      0.00            +0.2        0.17 ±141%      +0.0        0.00        perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma
      0.00            +0.2        0.17 ±141%      +0.0        0.00        perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page
      0.00            +0.2        0.18 ±141%      +0.0        0.00        perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp
      0.00            +0.2        0.18 ±141%      +0.0        0.00        perf-profile.calltrace.cycles-pp.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_write_begin
      0.00            +0.2        0.18 ±141%      +0.0        0.00        perf-profile.calltrace.cycles-pp.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter
      0.00            +0.2        0.18 ±141%      +0.0        0.00        perf-profile.calltrace.cycles-pp.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_write_begin.generic_perform_write
      0.64 ±  6%      +0.2        0.85 ±  8%      +0.2        0.86 ± 15%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
     65.23            +0.3       65.53            -1.7       63.52 ±  2%  perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.36 ± 70%      +0.3        0.68 ± 24%      +0.2        0.59 ±  4%  perf-profile.calltrace.cycles-pp.__libc_write
      0.36 ± 70%      +0.3        0.68 ± 24%      +0.2        0.59 ±  3%  perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write
      0.36 ± 70%      +0.3        0.68 ± 24%      +0.2        0.59 ±  4%  perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write
      0.36 ± 70%      +0.3        0.68 ± 24%      +0.2        0.59 ±  4%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_write
      0.36 ± 70%      +0.3        0.68 ± 24%      +0.2        0.59 ±  4%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write
     64.85            +0.4       65.23            -1.7       63.16 ±  2%  perf-profile.calltrace.cycles-pp.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
      0.00            +0.5        0.46 ± 74%      +0.0        0.00        perf-profile.calltrace.cycles-pp.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write
      0.00            +0.5        0.46 ± 74%      +0.0        0.00        perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
      2.34            +1.1        3.46 ±  8%      +0.6        2.98 ±  6%  perf-profile.calltrace.cycles-pp.smp_call_function_many_cond.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list
      2.45 ±  2%      +1.2        3.63 ±  8%      +0.6        3.07 ±  6%  perf-profile.calltrace.cycles-pp.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
      2.45 ±  2%      +1.2        3.63 ±  8%      +0.6        3.07 ±  6%  perf-profile.calltrace.cycles-pp.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_lruvec
      2.44 ±  2%      +1.2        3.62 ±  9%      +0.6        3.07 ±  6%  perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list.shrink_inactive_list
      2.00 ± 53%      +1.4        3.40 ± 49%      +1.1        3.07 ± 30%  perf-profile.calltrace.cycles-pp.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64
      2.00 ± 53%      +1.4        3.41 ± 49%      +1.1        3.09 ± 30%  perf-profile.calltrace.cycles-pp.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.00 ± 53%      +1.4        3.41 ± 49%      +1.1        3.09 ± 30%  perf-profile.calltrace.cycles-pp.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.00 ± 53%      +1.4        3.41 ± 49%      +1.1        3.09 ± 30%  perf-profile.calltrace.cycles-pp.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.03 ± 52%      +1.4        3.44 ± 49%      +1.1        3.11 ± 30%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      2.03 ± 52%      +1.4        3.44 ± 49%      +1.1        3.11 ± 30%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.48 ± 53%      +1.5        2.99 ± 51%      +1.0        2.44 ± 34%  perf-profile.calltrace.cycles-pp.deactivate_file_page.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64
      1.46 ± 52%      +1.5        2.97 ± 51%      +1.0        2.41 ± 34%  perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.deactivate_file_page.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64
     59.72 ±  2%      +2.1       61.84            -1.2       58.47        perf-profile.calltrace.cycles-pp.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
     59.67 ±  2%      +2.1       61.80            -1.2       58.43        perf-profile.calltrace.cycles-pp.__xfs_filemap_fault.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault
     59.49 ±  2%      +2.2       61.69            -1.2       58.27        perf-profile.calltrace.cycles-pp.filemap_fault.__xfs_filemap_fault.__do_fault.do_fault.__handle_mm_fault
     40.49 ±  4%      +2.3       42.79 ±  2%      -3.7       36.78 ±  4%  perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault.__do_fault
      0.00            +2.9        2.87 ± 52%      +2.3        2.27 ± 35%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.deactivate_file_page
      0.00            +2.9        2.88 ± 51%      +2.3        2.28 ± 35%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.deactivate_file_page.invalidate_mapping_pages
      0.00            +2.9        2.88 ± 51%      +2.3        2.29 ± 35%  perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.pagevec_lru_move_fn.deactivate_file_page.invalidate_mapping_pages.generic_fadvise
     39.15 ±  4%      +3.0       42.19 ±  2%      -3.3       35.81 ±  4%  perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault
     38.75 ±  4%      +3.2       42.00 ±  2%      -3.2       35.55 ±  4%  perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault
     38.73 ±  4%      +3.3       41.99 ±  2%      -3.2       35.53 ±  4%  perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page
     38.73 ±  4%      +3.4       42.16 ±  2%      -3.2       35.52 ±  4%  perf-profile.calltrace.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
      9.97 ±  5%      +3.6       13.55 ±  5%      +3.7       13.64 ±  9%  perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.filemap_fault.__xfs_filemap_fault.__do_fault
     37.92 ±  5%      +3.6       41.56 ±  2%      -3.2       34.74 ±  5%  perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages
     38.12 ±  5%      +3.7       41.87 ±  2%      -3.0       35.09 ±  4%  perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
      7.55 ±  8%      +4.6       12.16 ±  8%      +4.1       11.66 ± 12%  perf-profile.calltrace.cycles-pp.lru_cache_add.add_to_page_cache_lru.pagecache_get_page.filemap_fault.__xfs_filemap_fault
      7.48 ±  8%      +4.6       12.11 ±  8%      +4.1       11.60 ± 12%  perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.pagecache_get_page.filemap_fault
     50.80 ±  2%      +5.8       56.57            -0.0       50.75        perf-profile.calltrace.cycles-pp.pagecache_get_page.filemap_fault.__xfs_filemap_fault.__do_fault.do_fault
     13.35 ±  6%      +8.8       22.12 ±  2%      +3.6       16.92 ±  6%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
     13.95 ±  6%      +9.0       22.92 ±  2%      +3.8       17.74 ±  6%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node
      0.00           +11.3       11.34 ±  8%     +10.7       10.67 ± 13%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add
      0.00           +11.4       11.37 ±  8%     +10.7       10.72 ± 13%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
      0.00           +11.4       11.37 ±  8%     +10.7       10.72 ± 13%  perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.pagecache_get_page
     16.27 ±  5%      -5.2       11.05 ±  4%      -7.9        8.33 ±  5%  perf-profile.children.cycles-pp.lru_note_cost
      8.12            -3.4        4.77 ±  3%      -1.1        7.02 ±  7%  perf-profile.children.cycles-pp.iomap_readpage
      6.96 ±  2%      -2.9        4.04 ±  4%      -1.0        5.99 ±  7%  perf-profile.children.cycles-pp.submit_bio
      6.94 ±  2%      -2.9        4.03 ±  4%      -1.0        5.97 ±  7%  perf-profile.children.cycles-pp.submit_bio_noacct
      6.54 ±  2%      -2.8        3.69 ±  4%      -0.9        5.61 ±  7%  perf-profile.children.cycles-pp.pmem_submit_bio
      5.90 ±  2%      -2.6        3.30 ±  4%      -0.9        5.04 ±  7%  perf-profile.children.cycles-pp.pmem_do_read
      5.84 ±  2%      -2.6        3.24 ±  4%      -0.8        5.00 ±  7%  perf-profile.children.cycles-pp.__memcpy_mcsafe
      4.91            -1.7        3.22 ±  3%      -0.4        4.50 ±  4%  perf-profile.children.cycles-pp.xfs_filemap_map_pages
      4.69 ±  2%      -1.6        3.06 ±  3%      -0.4        4.30 ±  4%  perf-profile.children.cycles-pp.filemap_map_pages
      2.25 ±  3%      -1.0        1.28 ± 22%      -0.4        1.83 ±  6%  perf-profile.children.cycles-pp.__add_to_page_cache_locked
      9.55 ±  2%      -0.9        8.68 ±  2%      +0.7       10.24 ±  4%  perf-profile.children.cycles-pp.shrink_page_list
      2.60            -0.8        1.76 ±  3%      -0.1        2.51        perf-profile.children.cycles-pp.rmap_walk_file
      1.53 ±  4%      -0.8        0.70 ±  5%      -0.4        1.12 ±  5%  perf-profile.children.cycles-pp.get_page_from_freelist
      1.18 ±  6%      -0.7        0.52 ±  9%      -0.3        0.86 ±  6%  perf-profile.children.cycles-pp.rmqueue
      2.37 ±  7%      -0.6        1.77 ±  5%      +0.2        2.52 ± 11%  perf-profile.children.cycles-pp.__remove_mapping
      1.64            -0.6        1.07 ±  4%      -0.1        1.56        perf-profile.children.cycles-pp.page_referenced
      1.15 ±  9%      -0.5        0.62 ± 12%      -0.3        0.90 ± 13%  perf-profile.children.cycles-pp.mem_cgroup_charge
      2.99 ±  6%      -0.5        2.48 ±  9%      -0.1        2.88 ± 14%  perf-profile.children.cycles-pp.kswapd
      2.99 ±  6%      -0.5        2.48 ±  9%      -0.1        2.88 ± 14%  perf-profile.children.cycles-pp.balance_pgdat
      3.16 ±  4%      -0.5        2.66 ±  9%      -0.1        3.05 ± 13%  perf-profile.children.cycles-pp.ret_from_fork
      3.16 ±  4%      -0.5        2.66 ±  9%      -0.1        3.05 ± 13%  perf-profile.children.cycles-pp.kthread
      1.04 ±  9%      -0.5        0.54 ± 11%      -0.2        0.82 ± 14%  perf-profile.children.cycles-pp.__count_memcg_events
      1.10            -0.5        0.61 ±  4%      -0.2        0.92 ±  3%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.80 ±  7%      -0.5        0.32 ± 11%      -0.2        0.56 ±  8%  perf-profile.children.cycles-pp.rmqueue_bulk
      1.06 ±  2%      -0.5        0.59 ± 14%      -0.1        0.93 ±  2%  perf-profile.children.cycles-pp.alloc_set_pte
      0.98 ±  3%      -0.5        0.52 ±  9%      -0.2        0.75 ± 11%  perf-profile.children.cycles-pp._raw_spin_lock
      1.13 ±  5%      -0.4        0.70 ±  3%      -0.1        1.00 ±  4%  perf-profile.children.cycles-pp.iomap_apply
      0.88 ±  3%      -0.4        0.48 ±  4%      -0.1        0.74 ±  7%  perf-profile.children.cycles-pp.native_irq_return_iret
      1.24            -0.4        0.88 ±  9%      -0.0        1.21 ±  3%  perf-profile.children.cycles-pp.try_to_unmap
      0.71 ±  3%      -0.4        0.36 ± 22%      -0.1        0.61 ±  2%  perf-profile.children.cycles-pp.page_add_file_rmap
      0.94            -0.3        0.61 ±  3%      -0.1        0.88        perf-profile.children.cycles-pp.page_referenced_one
     66.88            -0.3       66.55            -2.0       64.90 ±  2%  perf-profile.children.cycles-pp.asm_exc_page_fault
      0.87 ±  3%      -0.3        0.55            -0.1        0.79        perf-profile.children.cycles-pp.down_read
     66.77            -0.3       66.48            -2.0       64.81 ±  2%  perf-profile.children.cycles-pp.exc_page_fault
      0.96 ±  3%      -0.3        0.68 ± 25%      +0.0        1.00 ±  3%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.81            -0.3        0.53 ±  3%      -0.0        0.77 ±  2%  perf-profile.children.cycles-pp.page_vma_mapped_walk
     66.72            -0.3       66.45            -2.0       64.76 ±  2%  perf-profile.children.cycles-pp.do_user_addr_fault
      0.53 ± 39%      -0.3        0.26 ± 75%      -0.1        0.46 ± 39%  perf-profile.children.cycles-pp.start_kernel
      0.95            -0.3        0.68 ± 14%      -0.0        0.94 ±  4%  perf-profile.children.cycles-pp.try_to_unmap_one
     25.69 ±  4%      -0.2       25.44 ±  3%      +1.1       26.82 ±  4%  perf-profile.children.cycles-pp.secondary_startup_64
     25.69 ±  4%      -0.2       25.44 ±  3%      +1.1       26.82 ±  4%  perf-profile.children.cycles-pp.cpu_startup_entry
     25.69 ±  4%      -0.2       25.44 ±  3%      +1.1       26.82 ±  4%  perf-profile.children.cycles-pp.do_idle
     25.68 ±  4%      -0.2       25.43 ±  3%      +1.1       26.82 ±  4%  perf-profile.children.cycles-pp.cpuidle_enter
     25.68 ±  4%      -0.2       25.43 ±  3%      +1.1       26.82 ±  4%  perf-profile.children.cycles-pp.cpuidle_enter_state
      0.85 ±  2%      -0.2        0.60 ±  2%      -0.0        0.82 ±  4%  perf-profile.children.cycles-pp.unlock_page
      0.52 ± 11%      -0.2        0.29 ±  2%      -0.1        0.43 ±  6%  perf-profile.children.cycles-pp.xfs_read_iomap_begin
      0.52 ±  5%      -0.2        0.30 ± 10%      -0.1        0.45 ± 10%  perf-profile.children.cycles-pp.__mod_memcg_state
      0.53 ±  8%      -0.2        0.31 ±  7%      +0.0        0.57 ± 11%  perf-profile.children.cycles-pp.workingset_eviction
     25.60 ±  4%      -0.2       25.39 ±  3%      +1.1       26.70 ±  3%  perf-profile.children.cycles-pp.intel_idle
      0.44 ± 12%      -0.2        0.23 ± 14%      -0.1        0.31 ± 18%  perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
      0.67 ±  4%      -0.2        0.47 ±  4%      -0.0        0.66        perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
      0.62 ± 12%      -0.2        0.44 ±  5%      +0.0        0.63 ±  3%  perf-profile.children.cycles-pp.xas_store
      0.57            -0.2        0.38 ±  4%      -0.0        0.56 ±  9%  perf-profile.children.cycles-pp.free_unref_page_list
      0.68            -0.2        0.50 ± 11%      +0.0        0.69 ±  5%  perf-profile.children.cycles-pp.__delete_from_page_cache
      0.42 ± 10%      -0.2        0.25 ± 18%      -0.1        0.36 ±  2%  perf-profile.children.cycles-pp.shrink_slab
      0.33 ±  2%      -0.2        0.16 ±  7%      -0.1        0.24 ±  5%  perf-profile.children.cycles-pp.__mod_lruvec_state
      0.47            -0.2        0.30 ±  7%      -0.0        0.42 ±  5%  perf-profile.children.cycles-pp.up_read
      0.57 ±  2%      -0.2        0.40 ±  5%      +0.0        0.57 ±  2%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.36 ±  5%      -0.2        0.19            -0.0        0.32 ±  6%  perf-profile.children.cycles-pp.iomap_read_end_io
      0.51            -0.2        0.35 ±  4%      -0.0        0.49 ±  3%  perf-profile.children.cycles-pp.iomap_readpage_actor
      0.52 ±  3%      -0.2        0.36 ±  4%      +0.0        0.52 ±  3%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      0.29 ±  2%      -0.2        0.13 ±  9%      -0.1        0.20 ±  4%  perf-profile.children.cycles-pp.__mod_node_page_state
      0.49 ±  3%      -0.2        0.34 ±  5%      +0.0        0.49 ±  3%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      0.48 ±  4%      -0.1        0.33 ±  7%      +0.0        0.48 ±  3%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.55 ±  9%      -0.1        0.40 ±  8%      +0.0        0.56 ±  5%  perf-profile.children.cycles-pp.xas_load
      0.57 ± 14%      -0.1        0.43 ± 13%      -0.0        0.55 ± 17%  perf-profile.children.cycles-pp.free_pcppages_bulk
      0.25 ±  6%      -0.1        0.12 ±  3%      -0.0        0.22 ±  5%  perf-profile.children.cycles-pp.iomap_set_range_uptodate
      0.30 ±  8%      -0.1        0.17 ±  2%      +0.0        0.33 ±  8%  perf-profile.children.cycles-pp.workingset_age_nonresident
      0.41 ±  5%      -0.1        0.28 ±  5%      -0.0        0.40 ±  3%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.37            -0.1        0.25            -0.0        0.35 ±  3%  perf-profile.children.cycles-pp.sync_regs
      0.30            -0.1        0.19 ± 12%      -0.1        0.25 ±  8%  perf-profile.children.cycles-pp.tick_sched_timer
      0.33            -0.1        0.22 ±  3%      -0.0        0.31 ±  6%  perf-profile.children.cycles-pp.xas_create
      0.29            -0.1        0.19 ± 10%      -0.0        0.24 ±  9%  perf-profile.children.cycles-pp.tick_sched_handle
      0.29            -0.1        0.19 ± 10%      -0.0        0.24 ±  9%  perf-profile.children.cycles-pp.update_process_times
      0.30 ±  3%      -0.1        0.20 ±  4%      -0.0        0.28 ±  6%  perf-profile.children.cycles-pp.asm_sysvec_call_function
     66.24            -0.1       66.13            -1.9       64.33 ±  2%  perf-profile.children.cycles-pp.handle_mm_fault
      0.33 ±  2%      -0.1        0.23 ±  9%      -0.0        0.31 ±  4%  perf-profile.children.cycles-pp.xas_find
      0.30 ±  3%      -0.1        0.21 ±  2%      -0.0        0.27 ±  3%  perf-profile.children.cycles-pp.xfs_ilock
      0.23 ±  8%      -0.1        0.14 ±  3%      -0.0        0.20 ± 10%  perf-profile.children.cycles-pp.try_charge
      0.19 ± 11%      -0.1        0.10 ± 16%      -0.0        0.16 ±  8%  perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
      0.09 ±  9%      -0.1        0.00            -0.1        0.00        perf-profile.children.cycles-pp.wake_all_kswapds
      0.23 ±  2%      -0.1        0.14 ± 10%      -0.0        0.19 ±  7%  perf-profile.children.cycles-pp.scheduler_tick
      0.18 ± 14%      -0.1        0.10            -0.0        0.16 ± 10%  perf-profile.children.cycles-pp.xfs_bmapi_read
      0.17 ±  5%      -0.1        0.09 ± 18%      -0.0        0.15 ± 13%  perf-profile.children.cycles-pp.lock_page_memcg
      0.26            -0.1        0.18 ±  2%      -0.0        0.24        perf-profile.children.cycles-pp.___might_sleep
      0.07 ±  6%      -0.1        0.00            -0.1        0.00        perf-profile.children.cycles-pp.wakeup_kswapd
      0.22 ±  2%      -0.1        0.14 ±  6%      -0.0        0.19 ±  6%  perf-profile.children.cycles-pp.xfs_iunlock
      0.22 ±  2%      -0.1        0.14 ±  3%      -0.0        0.19 ±  6%  perf-profile.children.cycles-pp.sysvec_call_function
      0.20 ±  2%      -0.1        0.13 ±  3%      -0.0        0.18 ±  4%  perf-profile.children.cycles-pp._cond_resched
      0.15 ±  8%      -0.1        0.08 ±  6%      -0.0        0.11 ±  7%  perf-profile.children.cycles-pp.xfs_ilock_for_iomap
      0.20 ±  2%      -0.1        0.13            -0.0        0.17 ±  7%  perf-profile.children.cycles-pp.flush_smp_call_function_queue
      0.20 ±  2%      -0.1        0.13            -0.0        0.18 ±  4%  perf-profile.children.cycles-pp.__sysvec_call_function
      0.23            -0.1        0.16 ±  2%      -0.0        0.23 ±  4%  perf-profile.children.cycles-pp.bio_alloc_bioset
      0.16 ± 13%      -0.1        0.09 ± 22%      -0.0        0.14 ±  8%  perf-profile.children.cycles-pp.down_read_trylock
      0.22 ±  5%      -0.1        0.15 ±  5%      +0.0        0.22 ±  5%  perf-profile.children.cycles-pp.find_get_entry
      0.15 ±  3%      -0.1        0.09 ±  5%      -0.0        0.13 ±  9%  perf-profile.children.cycles-pp.workingset_refault
      0.19 ±  5%      -0.1        0.13 ±  3%      -0.0        0.18 ±  9%  perf-profile.children.cycles-pp.__perf_sw_event
      0.06 ±  8%      -0.1        0.00            -0.0        0.04 ± 71%  perf-profile.children.cycles-pp.cpumask_any_but
      0.06 ±  8%      -0.1        0.00            -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.find_vma
      0.06 ±  8%      -0.1        0.00            +0.0        0.06 ±  8%  perf-profile.children.cycles-pp.default_send_IPI_mask_sequence_phys
      0.13 ± 10%      -0.1        0.07 ± 12%      -0.0        0.11 ± 14%  perf-profile.children.cycles-pp.page_counter_try_charge
      0.07 ± 11%      -0.1        0.02 ±141%      -0.1        0.00        perf-profile.children.cycles-pp.native_flush_tlb_one_user
      0.07            -0.1        0.02 ±141%      -0.0        0.06 ± 13%  perf-profile.children.cycles-pp.bio_endio
      0.12 ±  3%      -0.1        0.07 ± 11%      -0.0        0.10 ±  9%  perf-profile.children.cycles-pp.task_tick_fair
      0.15 ±  6%      -0.1        0.10 ±  4%      -0.0        0.13 ±  9%  perf-profile.children.cycles-pp.do_shrink_slab
      0.05            -0.1        0.00            -0.1        0.00        perf-profile.children.cycles-pp.vmacache_find
      0.05            -0.1        0.00            -0.1        0.00        perf-profile.children.cycles-pp.bio_init
      0.05            -0.1        0.00            -0.1        0.00        perf-profile.children.cycles-pp.update_load_avg
      0.05            -0.1        0.00            -0.1        0.00        perf-profile.children.cycles-pp.ghes_notify_nmi
      0.05            -0.1        0.00            -0.0        0.04 ± 71%  perf-profile.children.cycles-pp.llist_reverse_order
      0.05            -0.1        0.00            +0.0        0.05        perf-profile.children.cycles-pp.check_pte
      0.07 ± 14%      -0.1        0.02 ±141%      -0.1        0.00        perf-profile.children.cycles-pp.acpi_os_read_memory
      0.16 ±  5%      -0.1        0.11 ±  4%      -0.0        0.16 ±  5%  perf-profile.children.cycles-pp.page_mapping
      0.07 ±  7%      -0.1        0.02 ±141%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.ptep_clear_flush_young
      0.32            -0.0        0.27            -0.0        0.29 ± 11%  perf-profile.children.cycles-pp.submit_bio_checks
      0.14 ±  5%      -0.0        0.09 ±  5%      -0.0        0.13 ±  9%  perf-profile.children.cycles-pp.___perf_sw_event
      0.15            -0.0        0.10 ±  4%      +0.0        0.15 ±  3%  perf-profile.children.cycles-pp.mempool_alloc
      0.15 ±  3%      -0.0        0.11 ±  4%      -0.0        0.14 ± 13%  perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
      0.16 ± 55%      -0.0        0.12 ± 33%      +0.0        0.20 ± 15%  perf-profile.children.cycles-pp.pagevec_lookup_entries
      0.16 ± 55%      -0.0        0.12 ± 33%      +0.0        0.20 ± 15%  perf-profile.children.cycles-pp.find_get_entries
      0.08 ±  6%      -0.0        0.03 ± 70%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.bio_associate_blkg_from_css
      0.08 ±  6%      -0.0        0.03 ± 70%      -0.0        0.07        perf-profile.children.cycles-pp.__mod_zone_page_state
      0.08 ± 22%      -0.0        0.03 ± 70%      +0.0        0.08 ± 12%  perf-profile.children.cycles-pp.kmem_cache_free
      0.11 ±  8%      -0.0        0.06 ±  7%      -0.0        0.09 ±  5%  perf-profile.children.cycles-pp.rcu_all_qs
      0.14            -0.0        0.10 ±  4%      -0.0        0.14 ±  3%  perf-profile.children.cycles-pp.__might_sleep
      0.04 ± 71%      -0.0        0.00            +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.04 ± 71%      -0.0        0.00            +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
      0.04 ± 70%      -0.0        0.00            +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.copyin
      0.94            -0.0        0.90            -0.0        0.93 ±  2%  perf-profile.children.cycles-pp.isolate_lru_pages
      0.07            -0.0        0.03 ± 70%      -0.0        0.06 ±  8%  perf-profile.children.cycles-pp.perf_event_task_tick
      0.13 ±  3%      -0.0        0.09 ±  9%      -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.ktime_get
      0.13 ± 14%      -0.0        0.10 ± 17%      +0.0        0.13 ±  7%  perf-profile.children.cycles-pp.xas_init_marks
      0.12 ± 21%      -0.0        0.09 ± 10%      +0.0        0.13 ± 10%  perf-profile.children.cycles-pp.release_pages
      0.11 ±  4%      -0.0        0.08 ±  6%      -0.0        0.11 ± 12%  perf-profile.children.cycles-pp.uncharge_batch
      0.10 ±  4%      -0.0        0.06 ± 14%      -0.0        0.08 ± 10%  perf-profile.children.cycles-pp.bio_associate_blkg
      0.03 ± 70%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.mem_cgroup_iter
      0.03 ± 70%      -0.0        0.00            -0.0        0.02 ±141%  perf-profile.children.cycles-pp.xfs_bmbt_to_iomap
      0.03 ± 70%      -0.0        0.00            -0.0        0.02 ±141%  perf-profile.children.cycles-pp.__default_send_IPI_dest_field
      0.03 ± 70%      -0.0        0.00            +0.0        0.03 ± 70%  perf-profile.children.cycles-pp.cpumask_next
      0.05            -0.0        0.02 ±141%      +0.0        0.05 ±  8%  perf-profile.children.cycles-pp.mem_cgroup_update_lru_size
      0.10 ± 17%      -0.0        0.07 ±  7%      +0.0        0.10 ±  4%  perf-profile.children.cycles-pp.workingset_update_node
      0.23 ±  4%      -0.0        0.20 ± 37%      +0.0        0.26        perf-profile.children.cycles-pp.page_remove_rmap
      0.09 ±  5%      -0.0        0.07 ±  7%      -0.0        0.09 ± 10%  perf-profile.children.cycles-pp.count_shadow_nodes
      0.09 ±  5%      -0.0        0.07 ±  7%      -0.0        0.09 ±  9%  perf-profile.children.cycles-pp.PageHuge
      0.09 ±  9%      -0.0        0.06 ±  7%      +0.0        0.09 ±  9%  perf-profile.children.cycles-pp.page_counter_cancel
      0.09 ±  9%      -0.0        0.06 ±  7%      +0.0        0.09 ± 13%  perf-profile.children.cycles-pp.page_counter_uncharge
      0.03 ±141%      -0.0        0.00            +0.0        0.04 ± 71%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.08 ± 20%      -0.0        0.06 ± 79%      +0.0        0.12 ± 26%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.02 ±141%      -0.0        0.00            -0.0        0.02 ±141%  perf-profile.children.cycles-pp.rcu_core
      0.02 ±141%      -0.0        0.00            -0.0        0.02 ±141%  perf-profile.children.cycles-pp.rcu_do_batch
      0.08 ± 14%      -0.0        0.06 ± 23%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.xas_clear_mark
      0.08 ± 20%      -0.0        0.06 ± 81%      +0.0        0.13 ± 28%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.21 ± 15%      -0.0        0.19 ± 18%      -0.1        0.15 ± 16%  perf-profile.children.cycles-pp.__poll
      0.21 ± 15%      -0.0        0.19 ± 18%      -0.1        0.15 ± 16%  perf-profile.children.cycles-pp.__x64_sys_poll
      0.21 ± 15%      -0.0        0.19 ± 18%      -0.1        0.15 ± 16%  perf-profile.children.cycles-pp.do_sys_poll
      0.17 ±  5%      -0.0        0.14 ±  8%      +0.0        0.19 ±  6%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.18            -0.0        0.16 ± 31%      +0.0        0.21 ±  2%  perf-profile.children.cycles-pp.unaccount_page_cache_page
      0.07 ±  6%      -0.0        0.05 ±  8%      -0.0        0.07 ±  7%  perf-profile.children.cycles-pp.flush_tlb_func_common
      0.05 ±  8%      -0.0        0.03 ± 70%      +0.0        0.05 ± 72%  perf-profile.children.cycles-pp.perf_session__deliver_event
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.xfs_bmapi_update_map
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.mem_cgroup_page_lruvec
      0.07            -0.0        0.05            +0.0        0.07        perf-profile.children.cycles-pp._find_next_bit
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.shmem_mapping
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.xfs_filemap_fault
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.fput_many
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.irq_exit_rcu
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.to_nd_region
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.mem_cgroup_from_task
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.list_lru_del
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.children.cycles-pp.xas_alloc
      0.02 ±141%      -0.0        0.00            +0.0        0.02 ±141%  perf-profile.children.cycles-pp.smpboot_thread_fn
      0.02 ±141%      -0.0        0.00            +0.0        0.02 ±141%  perf-profile.children.cycles-pp.run_ksoftirqd
      0.03 ± 70%      -0.0        0.02 ±141%      +0.0        0.05 ± 71%  perf-profile.children.cycles-pp.perf_session__process_user_event
      0.03 ± 70%      -0.0        0.02 ±141%      +0.0        0.05 ± 71%  perf-profile.children.cycles-pp.__ordered_events__flush
      0.08            -0.0        0.06 ±  7%      -0.0        0.07 ± 14%  perf-profile.children.cycles-pp.read_tsc
      0.19 ± 12%      -0.0        0.18 ± 19%      -0.1        0.13 ± 16%  perf-profile.children.cycles-pp.perf_poll
      0.09            -0.0        0.08 ± 22%      +0.0        0.09 ± 72%  perf-profile.children.cycles-pp.process_simple
      0.09 ± 14%      -0.0        0.07 ± 25%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.xas_start
      0.17            -0.0        0.16 ± 18%      -0.0        0.17 ± 37%  perf-profile.children.cycles-pp.cmd_record
      0.15 ±  3%      -0.0        0.14 ± 17%      -0.0        0.15 ± 37%  perf-profile.children.cycles-pp.perf_session__process_events
      0.15 ±  3%      -0.0        0.14 ± 17%      -0.0        0.15 ± 38%  perf-profile.children.cycles-pp.record__finish_output
      0.12 ± 10%      -0.0        0.12            -0.0        0.11 ± 12%  perf-profile.children.cycles-pp.blk_throtl_bio
      0.21 ± 39%      -0.0        0.21 ± 68%      -0.1        0.16 ± 29%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.15 ± 10%      +0.0        0.15 ± 23%      -0.1        0.10 ± 25%  perf-profile.children.cycles-pp.__pollwait
      0.00            +0.0        0.00            +0.0        0.02 ±141%  perf-profile.children.cycles-pp.ordered_events__queue
      0.00            +0.0        0.00            +0.0        0.02 ±141%  perf-profile.children.cycles-pp.queue_event
      0.00            +0.0        0.00            +0.0        0.02 ±141%  perf-profile.children.cycles-pp.bio_add_page
      0.00            +0.0        0.00            +0.0        0.02 ±141%  perf-profile.children.cycles-pp.clockevents_program_event
      0.17 ± 11%      +0.0        0.18 ± 16%      -0.1        0.11 ± 23%  perf-profile.children.cycles-pp.__get_free_pages
      0.07 ± 11%      +0.0        0.08 ±  5%      -0.0        0.06 ±  8%  perf-profile.children.cycles-pp.percpu_counter_add_batch
      0.12 ± 68%      +0.0        0.13 ± 33%      -0.0        0.11 ± 71%  perf-profile.children.cycles-pp.drain_pages
     25.16 ±  3%      +0.0       25.18 ±  3%      +1.2       26.36 ±  4%  perf-profile.children.cycles-pp.start_secondary
      0.13 ± 61%      +0.0        0.15 ± 28%      -0.0        0.12 ± 70%  perf-profile.children.cycles-pp.worker_thread
      0.13 ± 65%      +0.0        0.15 ± 32%      -0.0        0.12 ± 70%  perf-profile.children.cycles-pp.process_one_work
      0.00            +0.0        0.02 ±141%      +0.0        0.00        perf-profile.children.cycles-pp.exec_binprm
      0.00            +0.0        0.02 ±141%      +0.0        0.00        perf-profile.children.cycles-pp.load_elf_binary
      0.12 ± 70%      +0.0        0.14 ± 35%      -0.0        0.11 ± 70%  perf-profile.children.cycles-pp.drain_local_pages_wq
      0.12 ± 70%      +0.0        0.14 ± 35%      -0.0        0.11 ± 70%  perf-profile.children.cycles-pp.drain_pages_zone
      0.00            +0.0        0.02 ±141%      +0.0        0.00        perf-profile.children.cycles-pp.bprm_execve
      0.00            +0.0        0.02 ±141%      +0.0        0.00        perf-profile.children.cycles-pp.mm_init
      0.00            +0.0        0.02 ±141%      +0.0        0.00        perf-profile.children.cycles-pp.pgd_alloc
      0.06            +0.0        0.09 ±  9%      +0.0        0.07 ± 14%  perf-profile.children.cycles-pp.lru_add_drain
      0.00            +0.0        0.03 ± 70%      +0.0        0.00        perf-profile.children.cycles-pp.__vmalloc_node_range
      0.06 ±  8%      +0.0        0.09 ±  9%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.lru_add_drain_cpu
      0.10 ±  4%      +0.0        0.13 ±  3%      +0.0        0.12        perf-profile.children.cycles-pp.__list_add_valid
      0.00            +0.0        0.04 ± 70%      +0.0        0.00        perf-profile.children.cycles-pp.__x64_sys_execve
      0.00            +0.0        0.04 ± 70%      +0.0        0.00        perf-profile.children.cycles-pp.do_execveat_common
      0.00            +0.0        0.04 ± 70%      +0.0        0.00        perf-profile.children.cycles-pp.execve
      0.07 ±141%      +0.0        0.11 ±141%      -0.0        0.03 ±141%  perf-profile.children.cycles-pp.xas_nomem
      0.09 ±103%      +0.0        0.13 ±111%      -0.1        0.04 ±141%  perf-profile.children.cycles-pp.__slab_alloc
      0.09 ±103%      +0.0        0.13 ±111%      -0.1        0.04 ±141%  perf-profile.children.cycles-pp.___slab_alloc
      0.09 ±103%      +0.0        0.13 ±111%      -0.1        0.04 ±141%  perf-profile.children.cycles-pp.allocate_slab
      0.02 ±141%      +0.0        0.06 ± 77%      +0.0        0.03 ±141%  perf-profile.children.cycles-pp.do_anonymous_page
      0.04 ± 71%      +0.1        0.10 ± 48%      -0.0        0.00        perf-profile.children.cycles-pp.pte_alloc_one
      0.11 ± 23%      +0.1        0.17 ± 16%      -0.0        0.10 ±  8%  perf-profile.children.cycles-pp.smp_call_function_single
      0.00            +0.1        0.07 ± 23%      +0.0        0.02 ±141%  perf-profile.children.cycles-pp.__do_sys_clone
      0.00            +0.1        0.07 ± 23%      +0.0        0.02 ±141%  perf-profile.children.cycles-pp._do_fork
      0.00            +0.1        0.07 ± 23%      +0.0        0.02 ±141%  perf-profile.children.cycles-pp.copy_process
      0.00            +0.1        0.07 ± 23%      +0.0        0.02 ±141%  perf-profile.children.cycles-pp.__libc_fork
      0.15 ± 56%      +0.1        0.27 ± 36%      +0.2        0.31 ± 51%  perf-profile.children.cycles-pp.shrink_active_list
      0.25 ±  8%      +0.1        0.39 ± 30%      +0.0        0.28 ± 12%  perf-profile.children.cycles-pp.shmem_alloc_and_acct_page
      0.24 ± 10%      +0.1        0.39 ± 30%      +0.0        0.28 ± 12%  perf-profile.children.cycles-pp.shmem_alloc_page
      0.30 ±  3%      +0.2        0.46 ±  4%      +0.0        0.35 ±  6%  perf-profile.children.cycles-pp.move_pages_to_lru
      0.29 ±  7%      +0.2        0.47 ± 30%      +0.0        0.33 ± 15%  perf-profile.children.cycles-pp.alloc_pages_vma
      0.49 ± 15%      +0.2        0.68 ± 23%      +0.1        0.59 ±  4%  perf-profile.children.cycles-pp.vfs_write
      0.49 ± 15%      +0.2        0.68 ± 23%      +0.1        0.59 ±  4%  perf-profile.children.cycles-pp.ksys_write
      0.49 ± 15%      +0.2        0.68 ± 23%      +0.1        0.59 ±  4%  perf-profile.children.cycles-pp.__libc_write
      0.48 ± 14%      +0.2        0.68 ± 23%      +0.1        0.58 ±  4%  perf-profile.children.cycles-pp.generic_file_write_iter
      0.48 ± 15%      +0.2        0.68 ± 24%      +0.1        0.59 ±  3%  perf-profile.children.cycles-pp.new_sync_write
      0.47 ± 15%      +0.2        0.68 ± 23%      +0.1        0.58 ±  4%  perf-profile.children.cycles-pp.generic_perform_write
      0.47 ± 15%      +0.2        0.68 ± 23%      +0.1        0.58 ±  4%  perf-profile.children.cycles-pp.__generic_file_write_iter
      0.38 ± 12%      +0.2        0.60 ± 27%      +0.1        0.46 ±  5%  perf-profile.children.cycles-pp.shmem_write_begin
      0.37 ± 12%      +0.2        0.60 ± 27%      +0.1        0.46 ±  5%  perf-profile.children.cycles-pp.shmem_getpage_gfp
     65.30            +0.3       65.61            -1.7       63.57 ±  2%  perf-profile.children.cycles-pp.__handle_mm_fault
     64.91            +0.4       65.30            -1.7       63.20 ±  2%  perf-profile.children.cycles-pp.do_fault
      2.71            +1.1        3.81 ±  3%      +0.7        3.44 ±  3%  perf-profile.children.cycles-pp.smp_call_function_many_cond
      2.82            +1.2        3.98 ±  3%      +0.7        3.55 ±  3%  perf-profile.children.cycles-pp.on_each_cpu_cond_mask
      2.82            +1.2        3.98 ±  3%      +0.7        3.55 ±  3%  perf-profile.children.cycles-pp.try_to_unmap_flush
      2.82            +1.2        3.98 ±  3%      +0.7        3.55 ±  3%  perf-profile.children.cycles-pp.arch_tlbbatch_flush
      2.00 ± 53%      +1.4        3.41 ± 49%      +1.1        3.08 ± 30%  perf-profile.children.cycles-pp.invalidate_mapping_pages
      2.00 ± 53%      +1.4        3.41 ± 49%      +1.1        3.09 ± 30%  perf-profile.children.cycles-pp.__x64_sys_fadvise64
      2.00 ± 53%      +1.4        3.41 ± 49%      +1.1        3.09 ± 30%  perf-profile.children.cycles-pp.ksys_fadvise64_64
      2.00 ± 53%      +1.4        3.41 ± 49%      +1.1        3.09 ± 30%  perf-profile.children.cycles-pp.generic_fadvise
      1.48 ± 53%      +1.5        2.99 ± 51%      +1.0        2.44 ± 34%  perf-profile.children.cycles-pp.deactivate_file_page
      1.46 ± 53%      +1.5        2.99 ± 51%      +1.0        2.42 ± 34%  perf-profile.children.cycles-pp.pagevec_lru_move_fn
      2.86 ± 38%      +1.6        4.50 ± 33%      +1.1        3.96 ± 22%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      2.85 ± 38%      +1.6        4.50 ± 33%      +1.1        3.96 ± 22%  perf-profile.children.cycles-pp.do_syscall_64
     59.72 ±  2%      +2.1       61.84            -1.2       58.47        perf-profile.children.cycles-pp.__do_fault
     59.67 ±  2%      +2.1       61.81            -1.2       58.43        perf-profile.children.cycles-pp.__xfs_filemap_fault
     59.50 ±  2%      +2.2       61.70            -1.2       58.28        perf-profile.children.cycles-pp.filemap_fault
     41.13 ±  4%      +2.6       43.75 ±  2%      -3.8       37.34 ±  5%  perf-profile.children.cycles-pp.__alloc_pages_nodemask
     42.33 ±  4%      +3.1       45.41 ±  2%      -3.4       38.92 ±  4%  perf-profile.children.cycles-pp.shrink_node
     41.51 ±  4%      +3.3       44.82 ±  3%      -3.4       38.14 ±  4%  perf-profile.children.cycles-pp.shrink_inactive_list
     39.76 ±  4%      +3.4       43.13 ±  2%      -3.4       36.34 ±  5%  perf-profile.children.cycles-pp.__alloc_pages_slowpath
     41.70 ±  4%      +3.4       45.10 ±  2%      -3.2       38.48 ±  4%  perf-profile.children.cycles-pp.shrink_lruvec
      9.97 ±  5%      +3.6       13.55 ±  5%      +3.7       13.64 ±  9%  perf-profile.children.cycles-pp.add_to_page_cache_lru
     39.36 ±  4%      +3.6       42.94 ±  2%      -3.3       36.06 ±  5%  perf-profile.children.cycles-pp.try_to_free_pages
     39.34 ±  4%      +3.6       42.93 ±  2%      -3.3       36.05 ±  5%  perf-profile.children.cycles-pp.do_try_to_free_pages
     30.64 ±  5%      +4.1       34.75 ±  3%      -4.0       26.64 ±  5%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      7.63 ±  7%      +4.7       12.34 ±  7%      +4.2       11.81 ± 12%  perf-profile.children.cycles-pp.lru_cache_add
      7.62 ±  8%      +4.8       12.38 ±  7%      +4.2       11.81 ± 12%  perf-profile.children.cycles-pp.__pagevec_lru_add
     50.80 ±  2%      +5.8       56.57            -0.0       50.75        perf-profile.children.cycles-pp.pagecache_get_page
      9.01 ± 12%      +6.2       15.23 ± 16%      +5.1       14.14 ± 15%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
     39.95 ±  2%     +10.1       50.03 ±  2%      +1.0       40.90        perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      0.00           +14.5       14.52 ± 16%     +13.2       13.22 ± 16%  perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
      5.68 ±  2%      -2.5        3.16 ±  4%      -0.8        4.90 ±  7%  perf-profile.self.cycles-pp.__memcpy_mcsafe
      2.68 ±  2%      -0.9        1.82 ±  2%      -0.2        2.49 ±  6%  perf-profile.self.cycles-pp.filemap_map_pages
      1.03 ±  9%      -0.5        0.53 ± 12%      -0.2        0.81 ± 15%  perf-profile.self.cycles-pp.__count_memcg_events
      1.09            -0.5        0.60 ±  4%      -0.2        0.92 ±  4%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.87 ±  3%      -0.4        0.48 ±  4%      -0.1        0.73 ±  7%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.80 ±  3%      -0.2        0.57 ±  2%      -0.0        0.78 ±  4%  perf-profile.self.cycles-pp.unlock_page
      0.60 ±  2%      -0.2        0.38            -0.1        0.55        perf-profile.self.cycles-pp.down_read
     25.60 ±  4%      -0.2       25.39 ±  3%      +1.1       26.70 ±  3%  perf-profile.self.cycles-pp.intel_idle
      0.51 ±  5%      -0.2        0.30 ±  9%      -0.1        0.44 ± 10%  perf-profile.self.cycles-pp.__mod_memcg_state
      0.43 ± 13%      -0.2        0.22 ± 13%      -0.1        0.31 ± 18%  perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
      0.37 ±  5%      -0.2        0.18 ± 17%      -0.1        0.31 ±  5%  perf-profile.self.cycles-pp.__add_to_page_cache_locked
      0.51            -0.2        0.33            -0.0        0.48 ±  2%  perf-profile.self.cycles-pp.page_vma_mapped_walk
      0.45            -0.2        0.29 ±  5%      -0.0        0.41 ±  4%  perf-profile.self.cycles-pp.up_read
      0.28 ±  2%      -0.2        0.12 ± 10%      -0.1        0.19 ±  2%  perf-profile.self.cycles-pp.__mod_node_page_state
      0.27 ±  9%      -0.2        0.11 ± 32%      -0.1        0.21 ± 10%  perf-profile.self.cycles-pp.page_add_file_rmap
      0.31            -0.2        0.15 ±  6%      -0.1        0.23 ±  2%  perf-profile.self.cycles-pp.get_page_from_freelist
      0.47 ±  2%      -0.2        0.31 ±  2%      -0.0        0.44        perf-profile.self.cycles-pp.shrink_page_list
      0.41            -0.1        0.28 ±  2%      -0.0        0.38 ±  5%  perf-profile.self.cycles-pp.try_to_unmap_one
      0.25 ±  6%      -0.1        0.12 ±  6%      -0.0        0.21 ±  5%  perf-profile.self.cycles-pp.iomap_set_range_uptodate
      0.30 ±  8%      -0.1        0.17 ±  2%      +0.0        0.33 ±  8%  perf-profile.self.cycles-pp.workingset_age_nonresident
      0.45 ±  9%      -0.1        0.32 ±  6%      +0.0        0.46 ±  6%  perf-profile.self.cycles-pp.xas_load
      0.27 ±  9%      -0.1        0.14 ± 17%      -0.1        0.20 ± 12%  perf-profile.self.cycles-pp.mem_cgroup_charge
      0.34 ±  3%      -0.1        0.21 ±  4%      -0.0        0.29 ±  4%  perf-profile.self.cycles-pp.__handle_mm_fault
      0.36            -0.1        0.24 ±  3%      -0.0        0.34 ±  3%  perf-profile.self.cycles-pp.sync_regs
      0.30 ±  2%      -0.1        0.20 ±  2%      -0.0        0.28 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock
      0.28            -0.1        0.19 ±  2%      -0.0        0.28 ±  7%  perf-profile.self.cycles-pp.xas_create
      0.23 ±  2%      -0.1        0.14 ±  3%      -0.0        0.21 ±  2%  perf-profile.self.cycles-pp.page_referenced_one
      0.24 ±  8%      -0.1        0.15 ± 13%      +0.0        0.27 ± 12%  perf-profile.self.cycles-pp.workingset_eviction
      0.24            -0.1        0.15 ±  5%      -0.0        0.21 ±  6%  perf-profile.self.cycles-pp.handle_mm_fault
      0.17 ±  4%      -0.1        0.09 ± 18%      -0.0        0.15 ± 13%  perf-profile.self.cycles-pp.lock_page_memcg
      0.08            -0.1        0.00            -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.workingset_refault
      0.27 ±  8%      -0.1        0.19 ± 10%      -0.0        0.25 ±  8%  perf-profile.self.cycles-pp.__remove_mapping
      0.26 ±  7%      -0.1        0.19 ±  6%      -0.0        0.25 ±  5%  perf-profile.self.cycles-pp.filemap_fault
      0.24 ±  3%      -0.1        0.16            -0.0        0.22 ±  6%  perf-profile.self.cycles-pp.alloc_set_pte
      0.25            -0.1        0.17 ±  4%      -0.0        0.23 ±  2%  perf-profile.self.cycles-pp.___might_sleep
      0.23            -0.1        0.16 ±  6%      -0.0        0.23 ±  7%  perf-profile.self.cycles-pp.free_pcppages_bulk
      0.09            -0.1        0.02 ±141%      -0.0        0.05        perf-profile.self.cycles-pp.lru_note_cost
      0.07 ±  6%      -0.1        0.00            -0.0        0.07 ± 18%  perf-profile.self.cycles-pp.xfs_bmapi_read
      0.16 ± 12%      -0.1        0.09 ± 19%      -0.0        0.14 ± 10%  perf-profile.self.cycles-pp.down_read_trylock
      0.07            -0.1        0.00            -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.xfs_iunlock
      0.44 ±  8%      -0.1        0.37 ± 39%      +0.1        0.55 ± 12%  perf-profile.self.cycles-pp.__mod_memcg_lruvec_state
      0.06 ±  7%      -0.1        0.00            -0.1        0.00        perf-profile.self.cycles-pp.wakeup_kswapd
      0.06            -0.1        0.00            -0.0        0.05 ±  8%  perf-profile.self.cycles-pp.asm_exc_page_fault
      0.07 ±  6%      -0.1        0.02 ±141%      -0.0        0.06        perf-profile.self.cycles-pp.flush_smp_call_function_queue
      0.07 ±  6%      -0.1        0.02 ±141%      -0.0        0.07 ±  7%  perf-profile.self.cycles-pp.__mod_zone_page_state
      0.09            -0.1        0.03 ± 70%      -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.__alloc_pages_nodemask
      0.07 ± 11%      -0.1        0.02 ±141%      -0.1        0.00        perf-profile.self.cycles-pp.native_flush_tlb_one_user
      0.07 ± 11%      -0.1        0.02 ±141%      -0.0        0.06 ±  8%  perf-profile.self.cycles-pp.lru_cache_add
      0.05 ±  8%      -0.1        0.00            -0.0        0.03 ± 70%  perf-profile.self.cycles-pp.page_referenced
      0.05 ±  8%      -0.1        0.00            -0.0        0.04 ± 73%  perf-profile.self.cycles-pp.blk_throtl_bio
      0.05 ±  8%      -0.1        0.00            -0.0        0.04 ± 70%  perf-profile.self.cycles-pp.kmem_cache_free
      0.05 ±  8%      -0.1        0.00            +0.0        0.05 ±  8%  perf-profile.self.cycles-pp.iomap_read_end_io
      0.12 ± 11%      -0.1        0.07 ±  7%      -0.0        0.10 ± 12%  perf-profile.self.cycles-pp.page_counter_try_charge
      0.10 ± 12%      -0.1        0.04 ± 71%      -0.0        0.08        perf-profile.self.cycles-pp.shrink_slab
      0.22 ±  9%      -0.1        0.17 ± 10%      -0.0        0.20 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.16 ±  3%      -0.1        0.10 ±  4%      -0.0        0.15 ±  5%  perf-profile.self.cycles-pp.page_mapping
      0.14 ±  6%      -0.1        0.09 ±  5%      -0.0        0.13 ±  6%  perf-profile.self.cycles-pp.rmqueue
      0.05            -0.1        0.00            -0.1        0.00        perf-profile.self.cycles-pp.bio_init
      0.05            -0.1        0.00            -0.1        0.00        perf-profile.self.cycles-pp.ghes_notify_nmi
      0.05            -0.1        0.00            -0.0        0.03 ± 70%  perf-profile.self.cycles-pp.__perf_sw_event
      0.05            -0.1        0.00            -0.0        0.03 ± 70%  perf-profile.self.cycles-pp.ktime_get
      0.05            -0.1        0.00            -0.0        0.03 ± 70%  perf-profile.self.cycles-pp.perf_event_task_tick
      0.05            -0.1        0.00            -0.0        0.04 ± 71%  perf-profile.self.cycles-pp.submit_bio_checks
      0.05            -0.1        0.00            -0.0        0.04 ± 71%  perf-profile.self.cycles-pp.llist_reverse_order
      0.05            -0.1        0.00            +0.0        0.05        perf-profile.self.cycles-pp.xfs_ilock
      0.07 ± 14%      -0.1        0.02 ±141%      -0.1        0.00        perf-profile.self.cycles-pp.acpi_os_read_memory
      0.07 ±  7%      -0.1        0.02 ±141%      -0.0        0.06 ± 13%  perf-profile.self.cycles-pp.ptep_clear_flush_young
      0.15 ±  9%      -0.0        0.10 ±  4%      -0.0        0.13 ±  7%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.06 ±  7%      -0.0        0.02 ±141%      -0.0        0.06 ± 16%  perf-profile.self.cycles-pp.count_shadow_nodes
      0.11 ± 22%      -0.0        0.06 ± 23%      +0.0        0.11 ±  8%  perf-profile.self.cycles-pp.release_pages
      0.10 ± 21%      -0.0        0.05 ±  8%      -0.0        0.07        perf-profile.self.cycles-pp.xfs_read_iomap_begin
      0.08 ±  6%      -0.0        0.03 ± 70%      -0.0        0.06 ± 13%  perf-profile.self.cycles-pp.bio_associate_blkg_from_css
      0.11            -0.0        0.07 ±  7%      -0.0        0.09 ±  9%  perf-profile.self.cycles-pp.rmqueue_bulk
      0.14 ± 58%      -0.0        0.09 ± 36%      +0.0        0.16 ± 16%  perf-profile.self.cycles-pp.find_get_entries
      0.10 ±  4%      -0.0        0.06 ±  7%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp.try_charge
      0.04 ± 70%      -0.0        0.00            +0.0        0.06 ±  7%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.12            -0.0        0.08            -0.0        0.12 ±  4%  perf-profile.self.cycles-pp.__might_sleep
      0.10 ±  9%      -0.0        0.06            -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.xas_find
      0.10 ±  4%      -0.0        0.07 ±  7%      -0.0        0.10        perf-profile.self.cycles-pp.iomap_readpage_actor
      0.09 ± 10%      -0.0        0.06 ±  8%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.do_user_addr_fault
      0.05 ±  8%      -0.0        0.02 ±141%      -0.0        0.02 ±141%  perf-profile.self.cycles-pp.submit_bio_noacct
      0.13 ± 21%      -0.0        0.09 ± 13%      +0.0        0.14 ±  5%  perf-profile.self.cycles-pp.xas_store
      0.11 ±  4%      -0.0        0.08 ±  6%      -0.0        0.11        perf-profile.self.cycles-pp.rmap_walk_file
      0.10            -0.0        0.07 ±  7%      -0.0        0.09 ±  9%  perf-profile.self.cycles-pp.do_fault
      0.09            -0.0        0.06 ±  8%      +0.0        0.09        perf-profile.self.cycles-pp.kmem_cache_alloc
      0.03 ± 70%      -0.0        0.00            -0.0        0.02 ±141%  perf-profile.self.cycles-pp.__mod_lruvec_state
      0.03 ± 70%      -0.0        0.00            -0.0        0.02 ±141%  perf-profile.self.cycles-pp.__default_send_IPI_dest_field
      0.03 ± 70%      -0.0        0.00            +0.0        0.03 ± 70%  perf-profile.self.cycles-pp.check_pte
      0.03 ± 70%      -0.0        0.00            +0.0        0.04 ± 71%  perf-profile.self.cycles-pp.__delete_from_page_cache
      0.11 ±  8%      -0.0        0.07 ±  6%      +0.0        0.11 ±  8%  perf-profile.self.cycles-pp.___perf_sw_event
      0.09            -0.0        0.06            -0.0        0.08 ± 10%  perf-profile.self.cycles-pp.iomap_apply
      0.08 ± 10%      -0.0        0.05            -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.rcu_all_qs
      0.08 ± 11%      -0.0        0.05 ±  8%      +0.0        0.08 ± 14%  perf-profile.self.cycles-pp.page_counter_cancel
      0.08            -0.0        0.05 ±  8%      +0.0        0.08        perf-profile.self.cycles-pp._cond_resched
      0.08 ± 20%      -0.0        0.06 ± 79%      +0.0        0.12 ± 26%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.08 ± 17%      -0.0        0.06 ± 16%      +0.0        0.08 ± 10%  perf-profile.self.cycles-pp.xas_clear_mark
      0.07 ±  6%      -0.0        0.05 ±  8%      +0.0        0.07 ±  6%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.08 ±  6%      -0.0        0.06 ±  8%      +0.0        0.08 ± 10%  perf-profile.self.cycles-pp.PageHuge
      0.08            -0.0        0.06 ± 13%      -0.0        0.07 ± 14%  perf-profile.self.cycles-pp.read_tsc
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.self.cycles-pp.xfs_bmapi_update_map
      0.04 ± 71%      -0.0        0.02 ±141%      +0.0        0.05        perf-profile.self.cycles-pp.xas_init_marks
      0.07            -0.0        0.05            -0.0        0.06 ±  7%  perf-profile.self.cycles-pp._find_next_bit
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.self.cycles-pp.vmacache_find
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.self.cycles-pp.shmem_mapping
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.self.cycles-pp.mem_cgroup_iter
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.self.cycles-pp.xfs_filemap_fault
      0.02 ±141%      -0.0        0.00            -0.0        0.00        perf-profile.self.cycles-pp.mem_cgroup_page_lruvec
      0.02 ±141%      -0.0        0.00            +0.0        0.02 ±141%  perf-profile.self.cycles-pp.bio_endio
      0.03 ± 70%      -0.0        0.02 ±141%      +0.0        0.05 ±  8%  perf-profile.self.cycles-pp.shrink_inactive_list
      0.08 ± 16%      -0.0        0.06 ± 23%      +0.0        0.08        perf-profile.self.cycles-pp.xas_start
      0.10 ±  4%      -0.0        0.09 ± 23%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.pmem_submit_bio
      0.07            -0.0        0.06 ± 29%      +0.0        0.08        perf-profile.self.cycles-pp.unaccount_page_cache_page
      0.08 ±  5%      -0.0        0.08 ± 40%      +0.0        0.09 ±  5%  perf-profile.self.cycles-pp.page_remove_rmap
      0.03 ±141%      -0.0        0.03 ±141%      +0.0        0.07 ± 17%  perf-profile.self.cycles-pp.invalidate_mapping_pages
      0.06            -0.0        0.05 ±  8%      -0.0        0.05 ±  8%  perf-profile.self.cycles-pp.pmem_do_read
      0.00            +0.0        0.00            +0.0        0.02 ±141%  perf-profile.self.cycles-pp.xfs_filemap_map_pages
      0.00            +0.0        0.00            +0.0        0.02 ±141%  perf-profile.self.cycles-pp.free_unref_page_list
      0.00            +0.0        0.00            +0.0        0.02 ±141%  perf-profile.self.cycles-pp.queue_event
      0.02 ±141%      +0.0        0.02 ±141%      +0.0        0.04 ± 76%  perf-profile.self.cycles-pp.pagevec_lru_move_fn
      0.02 ±141%      +0.0        0.02 ±141%      +0.0        0.05 ±  8%  perf-profile.self.cycles-pp.mem_cgroup_update_lru_size
      0.07 ±  7%      +0.0        0.08            -0.0        0.06 ±  8%  perf-profile.self.cycles-pp.percpu_counter_add_batch
      0.09 ±  5%      +0.0        0.13 ±  6%      +0.0        0.11 ±  4%  perf-profile.self.cycles-pp.__list_add_valid
      0.10 ± 19%      +0.1        0.17 ± 18%      -0.0        0.10 ±  8%  perf-profile.self.cycles-pp.smp_call_function_single
      0.18 ±  7%      +0.1        0.31 ±  5%      +0.0        0.21 ±  6%  perf-profile.self.cycles-pp.move_pages_to_lru
      0.24 ±  5%      +0.1        0.38 ±  6%      +0.1        0.37 ±  8%  perf-profile.self.cycles-pp.__pagevec_lru_add
      0.35            +0.2        0.54 ±  3%      +0.1        0.43        perf-profile.self.cycles-pp.isolate_lru_pages
      2.55            +1.1        3.70 ±  3%      +0.7        3.30 ±  3%  perf-profile.self.cycles-pp.smp_call_function_many_cond
     39.94 ±  2%     +10.1       50.03 ±  2%      +1.0       40.90        perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
    365.67            +1.1%     369.67            -0.1%     365.33        softirqs.BLOCK
      6.67 ± 86%     -30.0%       4.67 ±141%     -95.0%       0.33 ±141%  softirqs.CPU0.BLOCK
      1.00            +0.0%       1.00            +0.0%       1.00        softirqs.CPU0.HI
      2.33 ±112%    +100.0%       4.67 ±112%     +28.6%       3.00 ± 54%  softirqs.CPU0.NET_RX
      0.00       +1.8e+103%      17.67 ±141% +6.7e+101%       0.67 ± 70%  softirqs.CPU0.NET_TX
     16900 ± 33%     +14.2%      19303 ± 27%     -42.6%       9706 ± 23%  softirqs.CPU0.RCU
     34359 ± 11%     -10.7%      30699 ±  8%     -10.9%      30605 ± 12%  softirqs.CPU0.SCHED
    105.00            +0.0%     105.00            +0.0%     105.00        softirqs.CPU0.TASKLET
      2833 ± 11%      +7.5%       3046 ±  3%     +30.7%       3703 ± 41%  softirqs.CPU0.TIMER
     12.33 ±135%     -78.4%       2.67 ±141%    -100.0%       0.00        softirqs.CPU1.BLOCK
      9.67 ± 57%     -89.7%       1.00 ±141%     -13.8%       8.33 ± 62%  softirqs.CPU1.NET_RX
     35.00 ± 68%     -99.0%       0.33 ±141%      -1.9%      34.33 ± 70%  softirqs.CPU1.NET_TX
     14913 ± 35%      -5.5%      14088 ± 36%     -49.0%       7598        softirqs.CPU1.RCU
     20175 ± 19%      -2.5%      19665 ± 35%     -26.5%      14821 ±  9%  softirqs.CPU1.SCHED
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU1.TASKLET
    435.33 ± 35%     +12.4%     489.33 ± 17%     -14.0%     374.33 ± 54%  softirqs.CPU1.TIMER
      1.33 ± 35%      +0.0%       1.33 ± 35%     +25.0%       1.67 ± 28%  softirqs.CPU10.HI
      1.00 ± 81%   +1100.0%      12.00 ± 58%  +15866.7%     159.67 ±141%  softirqs.CPU10.NET_RX
      0.00         +2e+102%       2.00 ± 81% +3.3e+101%       0.33 ±141%  softirqs.CPU10.NET_TX
      6652 ±  7%     -11.9%       5857 ±  7%      -5.9%       6261 ±  2%  softirqs.CPU10.RCU
     14950 ± 18%     +12.4%      16806 ± 15%      -0.8%      14826 ± 16%  softirqs.CPU10.SCHED
     36.00            +6.5%      38.33 ±  4%      +0.0%      36.00        softirqs.CPU10.TASKLET
    145.67 ± 20%     +81.2%     264.00 ± 26%    +174.4%     399.67 ± 35%  softirqs.CPU10.TIMER
      0.00          -100.0%       0.00         +9e+102%       9.00 ±141%  softirqs.CPU11.BLOCK
      1.33 ±141%     +25.0%       1.67 ±101%    +200.0%       4.00 ±124%  softirqs.CPU11.NET_RX
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU11.NET_TX
      6534 ± 10%     -19.0%       5292 ±  8%      -6.4%       6113 ±  6%  softirqs.CPU11.RCU
     14141 ± 12%     +18.8%      16793 ±  6%      -9.8%      12749 ± 29%  softirqs.CPU11.SCHED
      3.67 ± 64%     -45.5%       2.00           -45.5%       2.00        softirqs.CPU11.TASKLET
    226.00 ± 54%     -35.1%     146.67 ± 32%     -30.1%     158.00 ± 20%  softirqs.CPU11.TIMER
      0.00          -100.0%       0.00       +6.7e+102%       6.67 ±141%  softirqs.CPU12.BLOCK
      0.33 ±141%    +100.0%       0.67 ±141%   +1000.0%       3.67 ±122%  softirqs.CPU12.NET_RX
      0.00          -100.0%       0.00       +1.7e+102%       1.67 ±101%  softirqs.CPU12.NET_TX
      6326 ±  7%      +2.6%       6489 ± 18%      -3.2%       6124 ±  5%  softirqs.CPU12.RCU
     14685 ± 13%     -24.4%      11096 ± 39%      -5.4%      13885 ± 17%  softirqs.CPU12.SCHED
      9.00 ±109%     -77.8%       2.00           -77.8%       2.00        softirqs.CPU12.TASKLET
    847.67 ± 87%     -61.2%     329.00 ± 69%     -59.9%     340.00 ± 66%  softirqs.CPU12.TIMER
      8.33 ±124%     -76.0%       2.00 ± 70%    +396.0%      41.33 ±137%  softirqs.CPU13.NET_RX
      0.33 ±141%    +200.0%       1.00 ± 81%    +100.0%       0.67 ± 70%  softirqs.CPU13.NET_TX
      7025 ± 14%      -6.0%       6600 ± 17%      -4.5%       6708 ±  8%  softirqs.CPU13.RCU
     13141 ± 32%      -6.4%      12296 ± 40%      +4.0%      13668 ±  7%  softirqs.CPU13.SCHED
      2.67 ± 35%    +150.0%       6.67 ± 78%     -50.0%       1.33 ± 70%  softirqs.CPU13.TASKLET
    363.00 ± 97%     -58.3%     151.33 ± 31%     +81.5%     659.00 ± 72%  softirqs.CPU13.TIMER
      2.00 ±141%     +33.3%       2.67 ±141%    -100.0%       0.00        softirqs.CPU14.BLOCK
      2.00 ± 40%    +933.3%      20.67 ±114%     -66.7%       0.67 ± 70%  softirqs.CPU14.NET_RX
      1.67 ± 28%     -40.0%       1.00 ± 81%     -60.0%       0.67 ± 70%  softirqs.CPU14.NET_TX
      7908 ± 13%     -24.0%       6013 ±  2%     -14.5%       6763 ±  7%  softirqs.CPU14.RCU
     16706 ± 22%     -17.6%      13766 ± 32%     -28.9%      11873 ± 19%  softirqs.CPU14.SCHED
      3.00 ± 47%    +166.7%       8.00 ±106%     -11.1%       2.67 ± 35%  softirqs.CPU14.TASKLET
    929.00 ± 38%     -81.3%     174.00 ± 34%     -56.8%     401.67 ± 57%  softirqs.CPU14.TIMER
     13.33 ±141%     -60.0%       5.33 ±141%    -100.0%       0.00        softirqs.CPU15.BLOCK
    110.33 ±134%     -98.5%       1.67 ± 74%     -98.8%       1.33 ± 35%  softirqs.CPU15.NET_RX
      3.33 ± 56%     -80.0%       0.67 ± 70%     -80.0%       0.67 ± 70%  softirqs.CPU15.NET_TX
      7358 ±  9%     -13.8%       6342 ±  8%     -10.2%       6608 ±  4%  softirqs.CPU15.RCU
     13227 ±  4%     -12.1%      11626 ± 13%     +11.4%      14733 ± 12%  softirqs.CPU15.SCHED
      6.33 ± 66%     -68.4%       2.00           -78.9%       1.33 ± 70%  softirqs.CPU15.TASKLET
    635.00 ± 36%     -57.0%     273.33 ± 79%     -69.3%     194.67 ± 49%  softirqs.CPU15.TIMER
      2.67 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU16.BLOCK
      3.33 ± 37%    +350.0%      15.00 ±127%     -60.0%       1.33 ± 35%  softirqs.CPU16.NET_RX
      0.33 ±141%    +200.0%       1.00 ± 81%    +100.0%       0.67 ± 70%  softirqs.CPU16.NET_TX
      6858 ±  3%     -12.4%       6009 ± 10%      -7.5%       6343 ±  2%  softirqs.CPU16.RCU
     13320 ± 19%     +23.0%      16389 ± 15%     +39.1%      18522 ± 10%  softirqs.CPU16.SCHED
      2.67 ± 70%     -25.0%       2.00           -25.0%       2.00        softirqs.CPU16.TASKLET
    510.00 ±  8%      +4.9%     535.00 ±110%    +183.9%       1448 ± 25%  softirqs.CPU16.TIMER
     48.33 ±141%     -77.9%      10.67 ± 93%     -26.2%      35.67 ±141%  softirqs.CPU17.BLOCK
      2.67 ± 46%     -62.5%       1.00 ± 81%   +6387.5%     173.00 ±141%  softirqs.CPU17.NET_RX
      0.67 ± 70%     +50.0%       1.00 ± 81%     -50.0%       0.33 ±141%  softirqs.CPU17.NET_TX
      6084 ±  4%      -4.4%       5816 ±  2%     +14.4%       6958 ± 10%  softirqs.CPU17.RCU
     16228 ± 31%     -17.3%      13420 ± 23%     -11.5%      14367 ± 38%  softirqs.CPU17.SCHED
      0.00       +1.3e+102%       1.33 ± 70% +1.3e+103%      13.33 ±120%  softirqs.CPU17.TASKLET
      1565 ±116%     -89.9%     157.67 ± 33%     -31.6%       1070 ±100%  softirqs.CPU17.TIMER
    119.00 ± 72%      -7.0%     110.67 ± 23%     -97.8%       2.67 ±141%  softirqs.CPU18.BLOCK
      1.00 ± 81%      +0.0%       1.00 ±141%     +33.3%       1.33 ± 35%  softirqs.CPU18.NET_RX
      1.00 ± 81%     -66.7%       0.33 ±141%      +0.0%       1.00        softirqs.CPU18.NET_TX
      6306 ±  9%      +9.9%       6927 ± 13%      +4.6%       6596 ± 11%  softirqs.CPU18.RCU
     14761 ±  6%     -14.4%      12634 ±  8%      +0.2%      14789 ± 20%  softirqs.CPU18.SCHED
      0.00       +3.3e+101%       0.33 ±141% +6.7e+101%       0.67 ±141%  softirqs.CPU18.TASKLET
    401.67 ± 83%     -66.0%     136.67 ± 20%    +139.3%     961.33 ± 45%  softirqs.CPU18.TIMER
      0.00         +4e+102%       4.00 ±141% +3.5e+103%      35.33 ±141%  softirqs.CPU19.BLOCK
      2.00        +50416.7%       1010 ±141%     -50.0%       1.00 ± 81%  softirqs.CPU19.NET_RX
      0.33 ±141%    +100.0%       0.67 ± 70%    +100.0%       0.67 ± 70%  softirqs.CPU19.NET_TX
      7100 ± 12%      -5.8%       6686 ± 10%      -3.5%       6852 ±  7%  softirqs.CPU19.RCU
      9904 ±  4%      -8.1%       9102 ± 19%     +43.8%      14245 ± 16%  softirqs.CPU19.SCHED
     16.67 ±141%     -98.0%       0.33 ±141%    -100.0%       0.00        softirqs.CPU19.TASKLET
    634.67 ± 52%     -62.7%     237.00 ± 71%    +144.5%       1552 ±107%  softirqs.CPU19.TIMER
      2.33 ±112%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU2.BLOCK
    763.67 ± 75%     -99.8%       1.67 ± 28%     -98.9%       8.67 ±125%  softirqs.CPU2.NET_RX
      1.33 ± 70%     -75.0%       0.33 ±141%     -25.0%       1.00 ± 81%  softirqs.CPU2.NET_TX
      8301 ±  4%     -14.8%       7074           -14.8%       7071 ±  4%  softirqs.CPU2.RCU
     18699 ±  9%      -6.6%      17459 ± 18%     -17.6%      15409 ±  9%  softirqs.CPU2.SCHED
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU2.TASKLET
    888.67 ± 35%     -71.5%     253.33 ± 22%     -64.0%     320.00 ± 58%  softirqs.CPU2.TIMER
      0.00          -100.0%       0.00       +7.2e+103%      72.33 ±138%  softirqs.CPU20.BLOCK
      2.00 ± 40%   +9750.0%     197.00 ±131%     +33.3%       2.67 ± 17%  softirqs.CPU20.NET_RX
      1.33 ± 35%     -25.0%       1.00 ±141%     -25.0%       1.00 ± 81%  softirqs.CPU20.NET_TX
      6880 ±  8%     -12.2%       6040 ±  9%      -8.7%       6283 ±  9%  softirqs.CPU20.RCU
     12458 ± 14%      +5.0%      13080 ± 22%      +8.5%      13515 ± 18%  softirqs.CPU20.SCHED
      0.00       +3.3e+101%       0.33 ±141% +3.3e+101%       0.33 ±141%  softirqs.CPU20.TASKLET
    280.67 ± 68%    +104.3%     573.33 ±111%     +44.9%     406.67 ± 58%  softirqs.CPU20.TIMER
      0.67 ±141%    -100.0%       0.00          +300.0%       2.67 ±141%  softirqs.CPU21.BLOCK
      2.33 ± 88%     +57.1%       3.67 ± 64%     -57.1%       1.00 ± 81%  softirqs.CPU21.NET_RX
      1.33 ± 70%      +0.0%       1.33 ± 93%     -75.0%       0.33 ±141%  softirqs.CPU21.NET_TX
      6444 ±  3%      -5.2%       6111 ± 11%      +1.6%       6544 ±  5%  softirqs.CPU21.RCU
     15529 ± 13%     -10.2%      13946 ± 20%     -33.4%      10346 ± 23%  softirqs.CPU21.SCHED
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU21.TASKLET
    594.00 ± 61%     -18.6%     483.67 ± 31%     -59.8%     238.67 ± 37%  softirqs.CPU21.TIMER
      0.67 ±141%    -100.0%       0.00         +1250.0%       9.00 ±133%  softirqs.CPU22.BLOCK
     14.33 ±112%     -88.4%       1.67 ±101%    -100.0%       0.00        softirqs.CPU22.NET_RX
      2.33 ± 53%     -85.7%       0.33 ±141%    -100.0%       0.00        softirqs.CPU22.NET_TX
      6533 ± 10%      -6.1%       6133 ±  9%      -8.7%       5962 ±  5%  softirqs.CPU22.RCU
     15098 ± 14%     -17.9%      12391 ± 30%      -7.5%      13970 ± 23%  softirqs.CPU22.SCHED
      0.33 ±141%      +0.0%       0.33 ±141%    -100.0%       0.00        softirqs.CPU22.TASKLET
    391.00 ± 76%      -9.5%     353.67 ± 66%     -49.4%     197.67 ± 38%  softirqs.CPU22.TIMER
      2.00 ± 81%     +16.7%       2.33 ± 20%     -16.7%       1.67 ± 74%  softirqs.CPU23.NET_RX
      0.33 ±141%    +300.0%       1.33 ± 35%      +0.0%       0.33 ±141%  softirqs.CPU23.NET_TX
      6869 ±  8%      -7.8%       6337 ±  5%      +1.0%       6941 ±  7%  softirqs.CPU23.RCU
     11180 ±  2%     +21.7%      13609 ± 22%     +33.2%      14896 ± 21%  softirqs.CPU23.SCHED
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU23.TASKLET
    227.00 ± 54%     -50.7%     112.00           -26.9%     166.00 ± 18%  softirqs.CPU23.TIMER
      9.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU24.BLOCK
      0.33 ±141%  +19400.0%      65.00 ± 94%   +9800.0%      33.00 ±128%  softirqs.CPU24.NET_RX
      0.00         +2e+102%       2.00 ±108%   +1e+102%       1.00 ± 81%  softirqs.CPU24.NET_TX
      8332 ± 12%     -18.2%       6818 ± 25%     +10.6%       9213 ± 16%  softirqs.CPU24.RCU
     15181 ± 20%     -20.6%      12050 ± 13%      -4.0%      14569 ± 18%  softirqs.CPU24.SCHED
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU24.TASKLET
      2183 ±117%     -77.9%     483.33 ± 49%     -59.2%     890.33 ± 91%  softirqs.CPU24.TIMER
      9.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU25.BLOCK
      1.67 ±141%   +2860.0%      49.33 ± 84%    +300.0%       6.67 ± 79%  softirqs.CPU25.NET_RX
      0.67 ±141%     +50.0%       1.00 ±141%      +0.0%       0.67 ±141%  softirqs.CPU25.NET_TX
      6830 ±  7%      +0.6%       6868 ±  8%     +11.9%       7644        softirqs.CPU25.RCU
     12351 ± 16%      -3.3%      11943 ± 17%      +9.2%      13482 ±  4%  softirqs.CPU25.SCHED
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU25.TASKLET
    660.00 ± 96%      -7.8%     608.33 ± 76%     -77.8%     146.33 ±  7%  softirqs.CPU25.TIMER
      0.00          -100.0%       0.00         +1e+102%       1.00 ±141%  softirqs.CPU26.BLOCK
      0.33 ±141%  +24300.0%      81.33 ±141%    +500.0%       2.00 ± 70%  softirqs.CPU26.NET_RX
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ± 70%  softirqs.CPU26.NET_TX
      6728 ±  6%     +12.0%       7535 ± 36%     +15.1%       7741 ±  9%  softirqs.CPU26.RCU
     12526 ±  3%      +7.9%      13516 ± 18%      +6.9%      13387 ± 11%  softirqs.CPU26.SCHED
      2.00            +0.0%       2.00            +0.0%       2.00        softirqs.CPU26.TASKLET
    783.67 ± 61%      -1.1%     775.33 ± 61%     -69.4%     240.00 ± 31%  softirqs.CPU26.TIMER
      0.00       +6.3e+102%       6.33 ±141%    -100.0%       0.00        softirqs.CPU27.BLOCK
      0.33 ±141%    +300.0%       1.33 ± 70%      +0.0%       0.33 ±141%  softirqs.CPU27.NET_RX
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU27.NET_TX
      7577 ± 13%     -10.0%       6820 ± 18%      -6.3%       7098 ±  7%  softirqs.CPU27.RCU
     12117 ±  9%     +21.3%      14696 ±  6%      +7.6%      13037 ± 16%  softirqs.CPU27.SCHED
      2.00            +0.0%       2.00            +0.0%       2.00        softirqs.CPU27.TASKLET
    166.33 ± 12%    +513.4%       1020 ± 35%     +89.8%     315.67 ± 39%  softirqs.CPU27.TIMER
      1.00 ±141%    +700.0%       8.00 ±141%    -100.0%       0.00        softirqs.CPU28.BLOCK
      0.00          -100.0%       0.00       +3.3e+102%       3.33 ±101%  softirqs.CPU28.NET_RX
      0.00          -100.0%       0.00       +1.3e+102%       1.33 ± 93%  softirqs.CPU28.NET_TX
      7672 ± 21%     -10.1%       6897 ± 11%     -11.8%       6763 ± 15%  softirqs.CPU28.RCU
     10936 ±  4%      +4.9%      11472 ±  3%     +50.5%      16462 ± 23%  softirqs.CPU28.SCHED
      2.33 ± 20%     -14.3%       2.00           -14.3%       2.00        softirqs.CPU28.TASKLET
    198.00 ± 16%     +60.9%     318.67 ± 30%     +75.3%     347.00 ± 55%  softirqs.CPU28.TIMER
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU29.BLOCK
      0.00       +6.6e+103%      65.67 ± 89%    -100.0%       0.00        softirqs.CPU29.NET_RX
      7357 ± 22%      -0.6%       7314 ±  9%      -5.4%       6959 ±  6%  softirqs.CPU29.RCU
     12415 ± 21%      -3.0%      12043 ± 16%     +15.9%      14386 ±  2%  softirqs.CPU29.SCHED
      2.00            +0.0%       2.00           +16.7%       2.33 ± 20%  softirqs.CPU29.TASKLET
    443.33 ± 76%     -41.6%     259.00 ± 21%      -9.3%     402.00 ± 55%  softirqs.CPU29.TIMER
      0.00          -100.0%       0.00       +3.7e+102%       3.67 ±141%  softirqs.CPU3.BLOCK
      6.33 ± 97%     +68.4%      10.67 ± 74%    +263.2%      23.00 ±132%  softirqs.CPU3.NET_RX
     17.67 ±133%      -1.9%      17.33 ±141%     -98.1%       0.33 ±141%  softirqs.CPU3.NET_TX
      7023 ± 10%      -5.4%       6643 ± 10%      -8.2%       6448 ±  5%  softirqs.CPU3.RCU
     15583 ±  9%      -4.4%      14901 ± 20%     -11.5%      13789 ±  5%  softirqs.CPU3.SCHED
      0.00       +5.3e+102%       5.33 ±141%    -100.0%       0.00        softirqs.CPU3.TASKLET
    316.67 ± 58%     +55.3%     491.67 ± 38%    +259.9%       1139 ± 64%  softirqs.CPU3.TIMER
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU30.BLOCK
      0.67 ±141%    +200.0%       2.00 ±108%   +3200.0%      22.00 ±141%  softirqs.CPU30.NET_RX
      0.00          -100.0%       0.00         +2e+102%       2.00 ±141%  softirqs.CPU30.NET_TX
      6522 ± 14%      -3.8%       6275 ±  2%     +12.3%       7328 ± 13%  softirqs.CPU30.RCU
     14681 ±  8%     +26.7%      18607 ± 34%     -13.3%      12722 ± 16%  softirqs.CPU30.SCHED
      2.00           -16.7%       1.67 ± 28%     +33.3%       2.67 ± 35%  softirqs.CPU30.TASKLET
    312.67 ± 57%   +1466.2%       4897 ±129%      +3.3%     323.00 ± 42%  softirqs.CPU30.TIMER
      0.00         +4e+102%       4.00 ±141% +7.7e+102%       7.67 ±141%  softirqs.CPU31.BLOCK
     22.67 ±138%    -100.0%       0.00           -55.9%      10.00 ±114%  softirqs.CPU31.NET_RX
      0.33 ±141%    -100.0%       0.00          +200.0%       1.00 ± 81%  softirqs.CPU31.NET_TX
      7019 ±  5%     -16.9%       5834 ± 14%      -7.4%       6502 ± 22%  softirqs.CPU31.RCU
     10887 ± 17%     +39.4%      15174 ± 12%     +10.8%      12063 ± 43%  softirqs.CPU31.SCHED
      2.67 ± 35%     -25.0%       2.00           -25.0%       2.00        softirqs.CPU31.TASKLET
    705.67 ± 38%     +66.4%       1174 ± 44%      +7.3%     757.00 ± 73%  softirqs.CPU31.TIMER
      0.00       +2.3e+103%      23.00 ±141% +6.7e+101%       0.67 ±141%  softirqs.CPU32.BLOCK
      1.00 ±141%    -100.0%       0.00          +200.0%       3.00 ± 27%  softirqs.CPU32.NET_RX
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU32.NET_TX
      7019 ± 10%     -22.5%       5437 ± 16%      -4.7%       6687 ± 14%  softirqs.CPU32.RCU
     11972 ± 13%     +47.7%      17683 ±  8%     +43.2%      17147 ± 13%  softirqs.CPU32.SCHED
      2.00           +16.7%       2.33 ± 20%      +0.0%       2.00        softirqs.CPU32.TASKLET
    336.33 ± 48%    +182.6%     950.33 ± 53%    +338.5%       1474 ± 37%  softirqs.CPU32.TIMER
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU33.BLOCK
     28.00 ±138%   +3128.6%     904.00 ±141%     -23.8%      21.33 ±134%  softirqs.CPU33.NET_RX
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU33.NET_TX
      7107 ±  7%     -11.2%       6312 ±  2%      -7.6%       6569 ±  7%  softirqs.CPU33.RCU
     14106 ± 16%     -10.1%      12678 ± 18%      +5.9%      14943 ±  3%  softirqs.CPU33.SCHED
      1.33 ± 70%     +50.0%       2.00           +75.0%       2.33 ± 20%  softirqs.CPU33.TASKLET
      1461 ±106%     -67.4%     476.67 ± 56%     -36.1%     933.67 ± 84%  softirqs.CPU33.TIMER
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU34.NET_RX
      6175 ±  6%      -2.2%       6040 ±  9%      +5.5%       6513 ±  5%  softirqs.CPU34.RCU
     12488 ± 12%     +18.4%      14786 ± 23%     +35.6%      16940 ± 22%  softirqs.CPU34.SCHED
      1.00 ±141%    -100.0%       0.00           -66.7%       0.33 ±141%  softirqs.CPU34.TASKLET
    505.67 ± 49%      -1.6%     497.67 ± 43%    +170.5%       1368 ± 29%  softirqs.CPU34.TIMER
      0.00       +9.3e+102%       9.33 ±141%    -100.0%       0.00        softirqs.CPU35.BLOCK
    305.00 ±141%     -99.5%       1.67 ±141%     -99.3%       2.00 ± 81%  softirqs.CPU35.NET_RX
      0.00       +3.3e+101%       0.33 ±141% +6.7e+101%       0.67 ±141%  softirqs.CPU35.NET_TX
      6710 ±  6%      -2.3%       6553 ±  3%      -0.1%       6703 ±  9%  softirqs.CPU35.RCU
     12848 ± 32%      +2.3%      13146 ± 26%     +10.9%      14254 ±  7%  softirqs.CPU35.SCHED
    975.67 ± 60%      -5.7%     920.00 ± 81%     -42.4%     562.33 ± 44%  softirqs.CPU35.TIMER
      0.00          -100.0%       0.00       +5.7e+102%       5.67 ±141%  softirqs.CPU36.BLOCK
      5.67 ±141%    -100.0%       0.00          +358.8%      26.00 ±141%  softirqs.CPU36.NET_RX
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU36.NET_TX
      7024 ± 14%     -22.9%       5413 ±  6%      -4.3%       6723 ±  2%  softirqs.CPU36.RCU
     12339 ±  4%     +50.2%      18532 ± 10%     +22.2%      15074 ±  6%  softirqs.CPU36.SCHED
      0.00       +1.9e+103%      18.67 ±126%    -100.0%       0.00        softirqs.CPU36.TASKLET
    274.33 ± 22%    +507.3%       1666 ± 47%      -7.2%     254.67 ± 33%  softirqs.CPU36.TIMER
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU37.BLOCK
      1.00 ±141%     +66.7%       1.67 ± 28%     -66.7%       0.33 ±141%  softirqs.CPU37.NET_RX
      0.67 ±141%     -50.0%       0.33 ±141%    -100.0%       0.00        softirqs.CPU37.NET_TX
      6858 ± 23%     -10.9%       6113 ± 11%      -7.4%       6351 ±  2%  softirqs.CPU37.RCU
     16000 ±  9%      -8.7%      14607 ± 21%      -7.6%      14787 ± 22%  softirqs.CPU37.SCHED
    370.00 ± 44%      -2.4%     361.00 ± 30%     +60.0%     592.00 ± 95%  softirqs.CPU37.TIMER
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU38.BLOCK
      0.00          -100.0%       0.00         +2e+104%     202.00 ±141%  softirqs.CPU38.NET_RX
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU38.NET_TX
      6978 ± 11%     -11.3%       6192 ±  5%      +1.5%       7080 ±  9%  softirqs.CPU38.RCU
     14448 ±  9%     -33.4%       9622 ± 25%      -5.0%      13726 ± 23%  softirqs.CPU38.SCHED
    935.00 ± 79%     -60.9%     365.67 ± 93%     -28.5%     668.67 ± 40%  softirqs.CPU38.TIMER
      7.67 ±141%    +843.5%      72.33 ±135%    +126.1%      17.33 ±133%  softirqs.CPU39.NET_RX
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU39.NET_TX
      7012 ± 19%     -19.2%       5669 ±  5%      -0.8%       6956 ± 12%  softirqs.CPU39.RCU
     14687 ± 15%     -13.7%      12677 ± 21%     -12.1%      12904 ± 23%  softirqs.CPU39.SCHED
      0.33 ±141%      +0.0%       0.33 ±141%    -100.0%       0.00        softirqs.CPU39.TASKLET
    796.67 ± 57%     -64.4%     283.33 ± 75%     -35.2%     516.00 ± 29%  softirqs.CPU39.TIMER
      2.67 ±141%     -75.0%       0.67 ±141%    -100.0%       0.00        softirqs.CPU4.BLOCK
    786.33 ±141%     -99.7%       2.33 ± 88%     -99.9%       0.67 ± 70%  softirqs.CPU4.NET_RX
      0.00       +3.3e+101%       0.33 ±141% +3.3e+101%       0.33 ±141%  softirqs.CPU4.NET_TX
      7449 ±  8%     -19.3%       6012 ±  6%     -14.4%       6376 ± 11%  softirqs.CPU4.RCU
     17086 ± 27%     +32.4%      22620 ±  7%      -0.3%      17034 ± 10%  softirqs.CPU4.SCHED
      1.33 ± 93%     -50.0%       0.67 ±141%    -100.0%       0.00        softirqs.CPU4.TASKLET
    566.00 ± 91%     +36.0%     769.67 ± 66%      -9.2%     514.00 ± 51%  softirqs.CPU4.TIMER
      3.67 ±141%    -100.0%       0.00          +172.7%      10.00 ±141%  softirqs.CPU40.BLOCK
      1.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU40.NET_RX
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU40.NET_TX
      6867 ±  5%      -7.1%       6380            -5.8%       6467 ±  3%  softirqs.CPU40.RCU
     12344 ± 28%     -12.0%      10868 ± 23%     +28.3%      15834 ±  9%  softirqs.CPU40.SCHED
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU40.TASKLET
    653.33 ±100%     -69.7%     198.00 ± 45%     -55.9%     288.00 ± 39%  softirqs.CPU40.TIMER
      0.33 ±141%    -100.0%       0.00            +0.0%       0.33 ±141%  softirqs.CPU41.BLOCK
      0.00       +2.5e+103%      25.33 ±138%    -100.0%       0.00        softirqs.CPU41.NET_RX
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU41.NET_TX
      7048 ± 14%     -15.8%       5934 ±  3%      +0.8%       7105 ± 11%  softirqs.CPU41.RCU
     10932 ± 10%      +1.0%      11039 ± 31%      -8.4%      10009 ±  9%  softirqs.CPU41.SCHED
      0.00         +1e+103%      10.00 ±141% +3.3e+101%       0.33 ±141%  softirqs.CPU41.TASKLET
    529.00 ± 71%     -65.2%     184.00 ± 41%     -20.2%     422.00 ± 29%  softirqs.CPU41.TIMER
      4.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU42.BLOCK
     20.00 ±134%     -60.0%       8.00 ±141%      +5.0%      21.00 ± 83%  softirqs.CPU42.NET_RX
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU42.NET_TX
      6650 ± 11%      +2.9%       6844 ±  3%      +7.4%       7139 ± 18%  softirqs.CPU42.RCU
     12259 ± 24%     -11.8%      10811 ± 43%     +15.4%      14143 ± 30%  softirqs.CPU42.SCHED
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU42.TASKLET
    483.33 ± 55%     -42.6%     277.33 ± 19%    +136.6%       1143 ±115%  softirqs.CPU42.TIMER
      0.00          -100.0%       0.00       +1.4e+103%      14.00 ±141%  softirqs.CPU43.BLOCK
     20.67 ±138%     -95.2%       1.00 ±141%    -100.0%       0.00        softirqs.CPU43.NET_RX
      0.67 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU43.NET_TX
      7227 ±  3%     -16.5%       6035 ±  8%      -5.0%       6867 ± 20%  softirqs.CPU43.RCU
     10474 ± 23%     +18.5%      12413 ± 21%      +9.7%      11494 ± 15%  softirqs.CPU43.SCHED
      6.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU43.TASKLET
    925.33 ± 36%     -56.5%     402.33 ±  7%     -52.8%     436.33 ± 55%  softirqs.CPU43.TIMER
      0.00       +1.7e+103%      16.67 ±124%    -100.0%       0.00        softirqs.CPU44.BLOCK
      2.00 ±108%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU44.NET_RX
      0.67 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU44.NET_TX
      6937 ±  8%     -11.3%       6152 ±  3%      +6.7%       7403 ± 10%  softirqs.CPU44.RCU
     10911 ± 10%     +13.2%      12351 ±  5%     +20.6%      13162 ±  5%  softirqs.CPU44.SCHED
    233.67 ± 40%     +50.8%     352.33 ± 56%    +144.9%     572.33 ± 54%  softirqs.CPU44.TIMER
      0.67 ±141%    -100.0%       0.00         +2150.0%      15.00 ±132%  softirqs.CPU45.BLOCK
    113.00 ±141%     -92.0%       9.00 ±141%     -99.1%       1.00 ± 81%  softirqs.CPU45.NET_RX
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU45.NET_TX
      6643 ±  9%      +1.0%       6707 ±  6%     +17.9%       7834 ± 14%  softirqs.CPU45.RCU
     13091 ± 11%      -5.5%      12367 ± 19%      -9.0%      11907 ± 28%  softirqs.CPU45.SCHED
    342.67 ± 34%     +85.9%     637.00 ±113%    +139.7%     821.33 ± 94%  softirqs.CPU45.TIMER
      0.33 ±141%    -100.0%       0.00         +2800.0%       9.67 ±100%  softirqs.CPU46.NET_RX
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU46.NET_TX
      6582 ±  7%      +2.6%       6750 ±  7%     +21.8%       8017 ± 25%  softirqs.CPU46.RCU
     13846 ± 15%     -13.9%      11922 ± 23%      -0.3%      13808 ±  2%  softirqs.CPU46.SCHED
      1.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU46.TASKLET
    791.33 ± 69%     +30.9%       1036 ±124%     +88.6%       1492 ±119%  softirqs.CPU46.TIMER
      0.00       +9.3e+102%       9.33 ±141% +1.6e+103%      15.67 ± 73%  softirqs.CPU47.BLOCK
      0.00       +3.3e+101%       0.33 ±141%   +2e+102%       2.00 ±108%  softirqs.CPU47.NET_RX
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU47.NET_TX
      6950 ±  2%     -16.7%       5790 ±  7%     +21.1%       8416 ± 12%  softirqs.CPU47.RCU
     10347 ± 12%     +34.4%      13911 ± 32%      -4.6%       9874 ±  2%  softirqs.CPU47.SCHED
    343.00 ± 29%    +309.9%       1406 ±120%     +56.3%     536.00 ± 64%  softirqs.CPU47.TIMER
      2.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU48.BLOCK
      6843 ±141%    -100.0%       0.00          -100.0%       2.00 ± 70%  softirqs.CPU48.NET_RX
      0.67 ± 70%    -100.0%       0.00            +0.0%       0.67 ± 70%  softirqs.CPU48.NET_TX
      8282 ± 30%     -31.7%       5659 ±  2%     -25.1%       6200 ± 11%  softirqs.CPU48.RCU
     13803 ± 37%      -7.9%      12706 ± 11%     -13.1%      11999 ± 35%  softirqs.CPU48.SCHED
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU48.TASKLET
      1591 ±119%     -89.2%     172.33 ± 22%     -68.3%     504.33 ± 69%  softirqs.CPU48.TIMER
      8.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU49.BLOCK
      1.00 ± 81%  +1.9e+05%       1927 ±141%      +0.0%       1.00 ± 81%  softirqs.CPU49.NET_RX
      0.67 ± 70%      +0.0%       0.67 ±141%    -100.0%       0.00        softirqs.CPU49.NET_TX
      7482 ± 10%     -19.0%       6061 ± 23%     -18.7%       6082 ±  8%  softirqs.CPU49.RCU
     13065 ± 17%     +19.8%      15654 ±  8%     +14.6%      14972 ± 11%  softirqs.CPU49.SCHED
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU49.TASKLET
      1174 ±118%     -19.9%     940.33 ± 63%     -74.7%     297.67 ± 53%  softirqs.CPU49.TIMER
      2.00 ±141%    +533.3%      12.67 ±100%    -100.0%       0.00        softirqs.CPU5.BLOCK
      1.67 ±101%     -60.0%       0.67 ±141%     -80.0%       0.33 ±141%  softirqs.CPU5.NET_RX
      0.33 ±141%    +100.0%       0.67 ± 70%      +0.0%       0.33 ±141%  softirqs.CPU5.NET_TX
      6100 ±  5%      +0.2%       6113            +3.7%       6326 ±  8%  softirqs.CPU5.RCU
     16920 ±  9%     -11.6%      14949 ± 12%      -4.6%      16135 ± 22%  softirqs.CPU5.SCHED
      0.67 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU5.TASKLET
    495.00 ± 58%     -72.5%     136.00 ± 18%     -47.0%     262.33 ± 42%  softirqs.CPU5.TIMER
    393.33 ±136%     -98.5%       6.00 ±117%     -99.7%       1.33 ± 35%  softirqs.CPU50.NET_RX
      1.00           -33.3%       0.67 ± 70%     -66.7%       0.33 ±141%  softirqs.CPU50.NET_TX
      6365 ±  7%      -4.6%       6069 ±  5%      +0.2%       6376 ±  2%  softirqs.CPU50.RCU
     14683 ±  8%      -7.0%      13649 ± 32%      -6.8%      13682 ± 15%  softirqs.CPU50.SCHED
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU50.TASKLET
    860.00 ± 98%     -66.4%     289.33 ± 67%     -55.0%     387.00 ± 39%  softirqs.CPU50.TIMER
      4.33 ±141%    -100.0%       0.00          +415.4%      22.33 ±141%  softirqs.CPU51.BLOCK
      9.33 ±118%   +3496.4%     335.67 ±140%     -96.4%       0.33 ±141%  softirqs.CPU51.NET_RX
      2.00 ± 40%     -33.3%       1.33 ± 35%    -100.0%       0.00        softirqs.CPU51.NET_TX
      6990 ±  7%     -10.5%       6256 ±  9%      -4.8%       6651 ± 10%  softirqs.CPU51.RCU
     13292 ± 23%      +9.9%      14604 ± 28%      +8.2%      14384 ± 22%  softirqs.CPU51.SCHED
      1229 ±127%     -10.7%       1097 ±124%     -78.4%     266.00 ± 41%  softirqs.CPU51.TIMER
      0.00         +2e+102%       2.00 ±141%    -100.0%       0.00        softirqs.CPU52.BLOCK
     47.67 ±134%     -93.7%       3.00 ± 94%     -86.7%       6.33 ±130%  softirqs.CPU52.NET_RX
      2.67 ±115%     -50.0%       1.33 ± 93%     -75.0%       0.67 ± 70%  softirqs.CPU52.NET_TX
      7553 ±  4%      -9.8%       6811 ±  8%     -10.6%       6749        softirqs.CPU52.RCU
     12471 ± 16%     -41.9%       7242 ± 26%      +1.1%      12605 ±  9%  softirqs.CPU52.SCHED
      0.67 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU52.TASKLET
    224.33 ± 50%    +727.6%       1856 ± 85%     +29.4%     290.33 ± 85%  softirqs.CPU52.TIMER
      0.33 ±141%    +500.0%       2.00 ±141%    -100.0%       0.00        softirqs.CPU53.BLOCK
     48.00 ±135%     -97.2%       1.33 ± 35%      +7.6%      51.67 ±138%  softirqs.CPU53.NET_RX
      1.67 ± 74%     -40.0%       1.00 ± 81%      +0.0%       1.67 ±101%  softirqs.CPU53.NET_TX
      7075 ± 11%     -22.0%       5517 ±  4%      -7.4%       6554 ±  7%  softirqs.CPU53.RCU
     10482 ± 14%     +25.3%      13138 ± 13%     +21.0%      12682 ± 25%  softirqs.CPU53.SCHED
    233.00 ± 39%     -19.0%     188.67 ± 58%      +5.9%     246.67 ± 45%  softirqs.CPU53.TIMER
      3.33 ±101%    -100.0%       0.00           -90.0%       0.33 ±141%  softirqs.CPU54.BLOCK
     53.67 ± 65%      -7.5%      49.67 ±130%     -15.5%      45.33 ±121%  softirqs.CPU54.NET_RX
      3.00 ± 72%     -11.1%       2.67 ±115%     -33.3%       2.00 ±108%  softirqs.CPU54.NET_TX
      7188 ±  7%     -21.4%       5649 ±  7%      -4.3%       6879 ±  7%  softirqs.CPU54.RCU
     13591 ±  7%     +17.0%      15898 ± 24%      -2.3%      13276 ± 20%  softirqs.CPU54.SCHED
      1.33 ± 93%    -100.0%       0.00           -75.0%       0.33 ±141%  softirqs.CPU54.TASKLET
    848.33 ± 55%     -83.2%     142.67 ± 43%     -53.9%     390.67 ± 47%  softirqs.CPU54.TIMER
      4.00 ±141%     -33.3%       2.67 ±141%    -100.0%       0.00        softirqs.CPU55.BLOCK
     12.33 ± 91%     +64.9%      20.33 ±120%     -54.1%       5.67 ±104%  softirqs.CPU55.NET_RX
      1.67 ± 74%     -60.0%       0.67 ± 70%     -20.0%       1.33 ± 93%  softirqs.CPU55.NET_TX
      7201 ±  3%     -19.4%       5805 ±  8%     -13.9%       6196 ±  9%  softirqs.CPU55.RCU
     12253 ± 16%      +4.8%      12837 ± 20%     +27.6%      15638 ± 22%  softirqs.CPU55.SCHED
      0.00          -100.0%       0.00       +9.3e+102%       9.33 ±141%  softirqs.CPU55.TASKLET
    544.67 ± 93%     -42.0%     316.00 ± 98%     -70.9%     158.67 ± 62%  softirqs.CPU55.TIMER
      0.67 ±141%    -100.0%       0.00          +600.0%       4.67 ±141%  softirqs.CPU56.BLOCK
     10.00 ±113%     -46.7%       5.33 ± 44%     -83.3%       1.67 ± 28%  softirqs.CPU56.NET_RX
      1.33 ± 35%     +75.0%       2.33 ± 40%     -25.0%       1.00        softirqs.CPU56.NET_TX
      6308 ± 12%     -14.1%       5418 ±  9%      +0.0%       6308 ±  4%  softirqs.CPU56.RCU
     14272 ±  9%      +5.1%      15005 ± 12%      +2.4%      14608 ±  8%  softirqs.CPU56.SCHED
      0.67 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU56.TASKLET
    472.67 ± 53%     -50.7%     233.00 ± 78%     -57.6%     200.33 ± 18%  softirqs.CPU56.TIMER
      0.00          -100.0%       0.00         +4e+102%       4.00 ±141%  softirqs.CPU57.BLOCK
     10.33 ±120%      +9.7%      11.33 ±116%     -83.9%       1.67 ± 28%  softirqs.CPU57.NET_RX
      1.00 ± 81%     -33.3%       0.67 ±141%     -33.3%       0.67 ± 70%  softirqs.CPU57.NET_TX
      6641 ±  2%      -9.0%       6045 ±  8%     -15.5%       5613 ± 12%  softirqs.CPU57.RCU
     12514 ± 32%      -7.5%      11579 ± 16%     +40.1%      17534 ± 27%  softirqs.CPU57.SCHED
      2.67 ±141%    -100.0%       0.00           -87.5%       0.33 ±141%  softirqs.CPU57.TASKLET
    113.67 ± 12%      +2.1%     116.00 ±  7%     +24.3%     141.33 ± 38%  softirqs.CPU57.TIMER
      0.00          -100.0%       0.00       +5.3e+102%       5.33 ±141%  softirqs.CPU58.BLOCK
     16.33 ±132%     -83.7%       2.67 ± 93%     -95.9%       0.67 ± 70%  softirqs.CPU58.NET_RX
      0.33 ±141%    +100.0%       0.67 ± 70%    +100.0%       0.67 ± 70%  softirqs.CPU58.NET_TX
      6561 ± 11%      -8.2%       6022 ±  7%      -2.9%       6373 ±  9%  softirqs.CPU58.RCU
     12192 ± 17%      -3.6%      11752 ± 24%      +6.6%      12994 ± 20%  softirqs.CPU58.SCHED
      0.33 ±141%    -100.0%       0.00            +0.0%       0.33 ±141%  softirqs.CPU58.TASKLET
    124.67 ± 12%     +88.8%     235.33 ± 75%     +39.8%     174.33 ± 35%  softirqs.CPU58.TIMER
      8.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU59.BLOCK
    204.67 ±139%     -99.5%       1.00 ± 81%     -89.4%      21.67 ±110%  softirqs.CPU59.NET_RX
      1.67 ± 28%     -80.0%       0.33 ±141%     -80.0%       0.33 ±141%  softirqs.CPU59.NET_TX
      6654 ±  6%      -5.5%       6286 ±  3%      -0.9%       6593 ±  5%  softirqs.CPU59.RCU
     13077 ± 18%     -11.5%      11568 ±  5%     +21.7%      15912 ± 24%  softirqs.CPU59.SCHED
      0.00       +1.3e+102%       1.33 ± 70%    -100.0%       0.00        softirqs.CPU59.TASKLET
    195.00 ± 27%      +3.1%     201.00 ± 36%    +242.7%     668.33 ± 84%  softirqs.CPU59.TIMER
      5.33 ±141%     -50.0%       2.67 ±141%    -100.0%       0.00        softirqs.CPU6.BLOCK
     19.67 ±134%     -84.7%       3.00 ± 72%     -94.9%       1.00 ± 81%  softirqs.CPU6.NET_RX
      1.00 ± 81%     -33.3%       0.67 ± 70%     -33.3%       0.67 ± 70%  softirqs.CPU6.NET_TX
      6888 ±  7%      -6.9%       6414 ±  6%     -13.4%       5968 ±  3%  softirqs.CPU6.RCU
     15009 ±  7%      -8.1%      13798 ± 22%      +3.7%      15563 ± 26%  softirqs.CPU6.SCHED
      0.67 ± 70%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU6.TASKLET
    496.33 ± 78%    +239.7%       1686 ± 71%     -39.2%     302.00 ± 50%  softirqs.CPU6.TIMER
      0.67 ±141%    -100.0%       0.00         +1900.0%      13.33 ± 74%  softirqs.CPU60.BLOCK
     46.67 ±138%     -97.1%       1.33 ± 35%     -97.9%       1.00        softirqs.CPU60.NET_RX
      1.67 ±141%    -100.0%       0.00           -60.0%       0.67 ± 70%  softirqs.CPU60.NET_TX
      6732 ±  7%     -19.0%       5453 ± 14%     -10.8%       6002 ±  7%  softirqs.CPU60.RCU
     11973 ± 18%     +41.8%      16973 ± 23%     +21.7%      14565 ± 21%  softirqs.CPU60.SCHED
    393.00 ± 60%     -69.9%     118.33 ± 29%     -36.6%     249.33 ± 59%  softirqs.CPU60.TIMER
      2.00 ± 40%     +50.0%       3.00 ± 54%     +16.7%       2.33 ± 20%  softirqs.CPU61.NET_RX
      0.33 ±141%    +200.0%       1.00 ± 81%    +300.0%       1.33 ± 35%  softirqs.CPU61.NET_TX
      6410 ±  2%     -11.0%       5706 ± 11%      -3.6%       6180 ±  8%  softirqs.CPU61.RCU
     15148 ± 26%      +1.9%      15434 ± 28%      +5.4%      15966 ± 16%  softirqs.CPU61.SCHED
    284.00 ± 42%     +69.6%     481.67 ± 65%     -21.2%     223.67 ± 28%  softirqs.CPU61.TIMER
     11.33 ±141%    -100.0%       0.00           -76.5%       2.67 ±141%  softirqs.CPU62.BLOCK
      1.67 ±101%    +420.0%       8.67 ±125%  +49240.0%     822.33 ±141%  softirqs.CPU62.NET_RX
      1.00 ± 81%      +0.0%       1.00 ± 81%     -33.3%       0.67 ± 70%  softirqs.CPU62.NET_TX
      6531 ± 11%     -15.2%       5540 ±  7%     -11.8%       5759 ±  6%  softirqs.CPU62.RCU
     11311 ± 42%     +24.6%      14097 ± 32%     +53.1%      17319 ±  9%  softirqs.CPU62.SCHED
     11.00 ±141%    -100.0%       0.00           -93.9%       0.67 ±141%  softirqs.CPU62.TASKLET
    223.00 ± 44%     +14.5%     255.33 ± 73%   +1209.9%       2921 ± 82%  softirqs.CPU62.TIMER
      2.00 ± 70%     -66.7%       0.67 ± 70%     -16.7%       1.67 ± 28%  softirqs.CPU63.NET_RX
      0.33 ±141%    -100.0%       0.00          +200.0%       1.00 ± 81%  softirqs.CPU63.NET_TX
      6407 ±  4%     -23.2%       4922 ±  8%      -0.7%       6361 ± 12%  softirqs.CPU63.RCU
     12594 ± 17%     +26.3%      15900 ±  9%      +6.7%      13432 ± 25%  softirqs.CPU63.SCHED
    213.67 ± 44%      +2.2%     218.33 ± 43%    +106.7%     441.67 ± 53%  softirqs.CPU63.TIMER
      4.33 ± 96%    +369.2%      20.33 ± 94%     -69.2%       1.33 ± 35%  softirqs.CPU64.NET_RX
      0.33 ±141%    +300.0%       1.33 ± 93%    +200.0%       1.00        softirqs.CPU64.NET_TX
      6413 ± 10%      -6.9%       5968 ±  4%     +11.4%       7146 ±  7%  softirqs.CPU64.RCU
     13468 ±  7%      -9.8%      12148 ± 18%     -13.0%      11716 ± 29%  softirqs.CPU64.SCHED
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU64.TASKLET
    158.67 ±  9%    +120.0%     349.00 ± 92%     +66.6%     264.33 ±  7%  softirqs.CPU64.TIMER
      2.33 ±112%    +771.4%      20.33 ±127%    +457.1%      13.00 ±130%  softirqs.CPU65.NET_RX
      0.00         +1e+102%       1.00 ± 81% +6.7e+101%       0.67 ±141%  softirqs.CPU65.NET_TX
      7043 ± 14%     -15.6%       5943 ±  6%     -14.7%       6010 ± 13%  softirqs.CPU65.RCU
     10844 ± 16%     +34.4%      14574 ± 27%     +38.2%      14991 ± 36%  softirqs.CPU65.SCHED
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU65.TASKLET
    335.67 ± 57%     -52.6%     159.00 ± 31%     -46.2%     180.67 ± 63%  softirqs.CPU65.TIMER
      0.00       +1.1e+103%      11.33 ±141%    -100.0%       0.00        softirqs.CPU66.BLOCK
    684.33 ±140%     -98.6%       9.67 ±119%     -98.6%       9.67 ±106%  softirqs.CPU66.NET_RX
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU66.NET_TX
      7191 ± 14%     -23.4%       5510 ±  5%      -2.4%       7017 ± 14%  softirqs.CPU66.RCU
     16220 ± 36%      -6.4%      15189 ±  9%     -10.7%      14488 ± 25%  softirqs.CPU66.SCHED
      0.00          -100.0%       0.00       +2.7e+102%       2.67 ±141%  softirqs.CPU66.TASKLET
      3757 ±125%     -90.9%     342.33 ± 95%     -93.1%     258.00 ± 41%  softirqs.CPU66.TIMER
      0.33 ±141%    +100.0%       0.67 ±141%    -100.0%       0.00        softirqs.CPU67.BLOCK
      1649 ±141%    -100.0%       0.67 ± 70%     -97.5%      41.67 ±127%  softirqs.CPU67.NET_RX
      0.00       +3.3e+101%       0.33 ±141% +6.7e+101%       0.67 ±141%  softirqs.CPU67.NET_TX
      6192 ±  5%     -14.5%       5293 ±  9%      -2.0%       6065 ±  7%  softirqs.CPU67.RCU
     16594 ±  8%     +14.9%      19072 ± 16%      -1.9%      16284 ±  6%  softirqs.CPU67.SCHED
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU67.TASKLET
    420.00 ± 92%     -29.1%     297.67 ± 34%     +56.0%     655.33 ± 92%  softirqs.CPU67.TIMER
      0.00          -100.0%       0.00         +2e+102%       2.00 ±141%  softirqs.CPU68.BLOCK
      4.00 ±106%   +1500.0%      64.00 ±129%      +8.3%       4.33 ± 39%  softirqs.CPU68.NET_RX
      0.67 ±141%     -50.0%       0.33 ±141%    +150.0%       1.67 ± 28%  softirqs.CPU68.NET_TX
      6130 ±  9%     -12.5%       5361 ±  6%      +5.5%       6468 ±  3%  softirqs.CPU68.RCU
     14249 ± 10%     +12.1%      15980 ± 10%      +8.1%      15408 ± 16%  softirqs.CPU68.SCHED
      0.00          -100.0%       0.00       +2.3e+102%       2.33 ±112%  softirqs.CPU68.TASKLET
    447.33 ± 33%     +38.7%     620.67 ±107%     -14.5%     382.33 ± 44%  softirqs.CPU68.TIMER
      0.00       +1.2e+103%      12.00 ±141%    -100.0%       0.00        softirqs.CPU69.BLOCK
      2.33 ± 88%     -28.6%       1.67 ±141%    +314.3%       9.67 ±105%  softirqs.CPU69.NET_RX
      0.67 ±141%      +0.0%       0.67 ±141%     +50.0%       1.00 ± 81%  softirqs.CPU69.NET_TX
      6902 ±  3%     -16.7%       5748 ±  3%      +4.8%       7230 ± 24%  softirqs.CPU69.RCU
     10975 ± 18%     +27.9%      14042 ± 20%     +60.6%      17622 ± 19%  softirqs.CPU69.SCHED
      0.33 ±141%      +0.0%       0.33 ±141%    -100.0%       0.00        softirqs.CPU69.TASKLET
    628.00 ± 51%     -78.9%     132.67 ± 15%     +22.2%     767.33 ± 70%  softirqs.CPU69.TIMER
      0.00       +1.3e+103%      13.33 ±141%    -100.0%       0.00        softirqs.CPU7.BLOCK
      1.00           +33.3%       1.33 ±141%   +2200.0%      23.00 ±111%  softirqs.CPU7.NET_RX
      0.00       +6.7e+101%       0.67 ±141% +6.7e+101%       0.67 ± 70%  softirqs.CPU7.NET_TX
      7894 ± 31%     -15.1%       6703 ± 20%     -16.4%       6596 ± 10%  softirqs.CPU7.RCU
     15921 ± 10%      +3.9%      16541 ± 10%     -16.6%      13284 ± 19%  softirqs.CPU7.SCHED
    908.00 ± 38%     -75.0%     226.67 ± 76%     -51.7%     438.67 ± 73%  softirqs.CPU7.TIMER
      2.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU70.BLOCK
      2.67 ± 77%     -25.0%       2.00 ± 40%     -75.0%       0.67 ±141%  softirqs.CPU70.NET_RX
      0.67 ± 70%     +50.0%       1.00 ±141%    -100.0%       0.00        softirqs.CPU70.NET_TX
      8167 ± 23%     -31.5%       5596 ±  3%     -21.1%       6442 ± 14%  softirqs.CPU70.RCU
     10950 ± 31%     +39.4%      15265 ± 22%     +30.5%      14294 ± 31%  softirqs.CPU70.SCHED
      0.67 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU70.TASKLET
    630.33 ± 93%     -76.2%     150.33 ± 43%     -26.3%     464.33 ± 76%  softirqs.CPU70.TIMER
      1.00         +1633.3%      17.33 ±141%    +133.3%       2.33 ± 40%  softirqs.CPU71.NET_RX
      0.33 ±141%      +0.0%       0.33 ±141%    +100.0%       0.67 ± 70%  softirqs.CPU71.NET_TX
      6463 ± 11%     -10.6%       5780 ±  2%      -0.4%       6436 ± 10%  softirqs.CPU71.RCU
     15363 ±  7%      -7.6%      14190 ± 26%      -1.4%      15152 ±  9%  softirqs.CPU71.SCHED
      0.00       +3.3e+101%       0.33 ±141%   +1e+102%       1.00 ±141%  softirqs.CPU71.TASKLET
    796.00 ±109%     -55.9%     350.67 ± 92%     -45.5%     433.67 ± 53%  softirqs.CPU71.TIMER
      0.00       +2.3e+102%       2.33 ± 72%    -100.0%       0.00        softirqs.CPU72.BLOCK
      0.00       +3.3e+101%       0.33 ±141% +3.7e+102%       3.67 ± 56%  softirqs.CPU72.NET_RX
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU72.NET_TX
      6405 ± 10%      -9.0%       5826 ±  5%      +4.4%       6689 ±  9%  softirqs.CPU72.RCU
     17474 ± 10%      -1.5%      17216 ± 12%      -6.5%      16334 ± 16%  softirqs.CPU72.SCHED
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU72.TASKLET
    525.00 ± 42%     -53.3%     245.33 ± 39%     -43.0%     299.33 ± 67%  softirqs.CPU72.TIMER
      0.00       +3.3e+101%       0.33 ±141% +1.7e+102%       1.67 ±141%  softirqs.CPU73.NET_RX
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU73.NET_TX
      6577 ± 14%      +8.1%       7112 ± 32%     +10.2%       7249 ± 13%  softirqs.CPU73.RCU
     17830 ±  9%      -4.0%      17115 ± 16%     -12.9%      15537 ±  9%  softirqs.CPU73.SCHED
      0.00          -100.0%       0.00         +3e+102%       3.00 ±141%  softirqs.CPU73.TASKLET
    462.00 ± 55%     -44.0%     258.67 ± 43%      -3.2%     447.00 ± 65%  softirqs.CPU73.TIMER
      2.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU74.BLOCK
      0.00       +1.3e+104%     126.33 ±141%   +3e+102%       3.00 ±141%  softirqs.CPU74.NET_RX
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU74.NET_TX
      6119           +14.3%       6995 ± 16%     +17.6%       7194 ± 14%  softirqs.CPU74.RCU
     18092 ±  8%      -3.2%      17521 ± 21%     -10.1%      16258 ± 12%  softirqs.CPU74.SCHED
    607.00 ± 23%     +13.9%     691.67 ± 56%     +85.9%       1128 ± 53%  softirqs.CPU74.TIMER
      0.00          -100.0%       0.00       +3.5e+103%      34.67 ± 90%  softirqs.CPU75.BLOCK
    944.67 ±141%     -99.9%       0.67 ± 70%     -99.4%       5.33 ± 93%  softirqs.CPU75.NET_RX
      0.00          -100.0%       0.00       +1.7e+103%      16.67 ±141%  softirqs.CPU75.NET_TX
      6590 ± 19%     -12.4%       5774 ± 15%      +3.4%       6812 ± 10%  softirqs.CPU75.RCU
     20884 ± 11%     -24.8%      15703 ± 13%     -20.8%      16542 ± 19%  softirqs.CPU75.SCHED
      1.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU75.TASKLET
    997.00 ± 80%     +75.9%       1753 ± 84%     -69.8%     300.67 ± 22%  softirqs.CPU75.TIMER
      7.33 ±113%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU76.BLOCK
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU76.NET_RX
      6520 ± 12%     -16.2%       5463 ±  2%      +1.0%       6586 ±  7%  softirqs.CPU76.RCU
     19765            -8.6%      18071 ±  4%     -32.3%      13386 ± 32%  softirqs.CPU76.SCHED
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU76.TASKLET
    592.33 ± 87%     -12.7%     517.33 ± 56%     -63.9%     213.67 ± 66%  softirqs.CPU76.TIMER
      1.00 ±141%     -33.3%       0.67 ±141%    -100.0%       0.00        softirqs.CPU77.NET_RX
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU77.NET_TX
      6722 ± 25%     -16.9%       5588 ± 12%     +18.7%       7976 ± 16%  softirqs.CPU77.RCU
     19442 ± 14%     -11.8%      17142 ± 11%     -24.1%      14760 ± 11%  softirqs.CPU77.SCHED
    782.67 ± 44%     +21.3%     949.00 ±  3%      -8.9%     713.33 ± 78%  softirqs.CPU77.TIMER
     34.67 ± 76%     -56.7%      15.00 ±141%     -88.5%       4.00 ±141%  softirqs.CPU78.BLOCK
      0.00       +3.3e+101%       0.33 ±141% +2.1e+104%     208.00 ±141%  softirqs.CPU78.NET_RX
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU78.NET_TX
      7064 ± 15%      -7.6%       6526 ± 15%     +16.9%       8260 ± 29%  softirqs.CPU78.RCU
     16911 ± 12%      +2.1%      17258 ± 22%      +6.3%      17970 ± 12%  softirqs.CPU78.SCHED
      0.00       +3.7e+102%       3.67 ±141%    -100.0%       0.00        softirqs.CPU78.TASKLET
    531.67 ± 41%     -17.4%     439.00 ± 57%     +88.5%       1002 ±101%  softirqs.CPU78.TIMER
     21.67 ±141%     -72.3%       6.00 ±118%     -92.3%       1.67 ±141%  softirqs.CPU79.BLOCK
      0.33 ±141%    +600.0%       2.33 ±141%    +500.0%       2.00 ±141%  softirqs.CPU79.NET_RX
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU79.NET_TX
      6134 ± 23%      -1.2%       6060 ±  5%     +29.9%       7971 ± 44%  softirqs.CPU79.RCU
     20458 ± 11%     -31.5%      14016 ± 16%     -17.1%      16969 ± 30%  softirqs.CPU79.SCHED
    431.00 ± 60%    +132.8%       1003 ± 57%     -13.1%     374.67 ± 39%  softirqs.CPU79.TIMER
      1.33 ± 35%  +29925.0%     400.33 ±141%     -25.0%       1.00        softirqs.CPU8.NET_RX
      0.67 ± 70%    -100.0%       0.00            +0.0%       0.67 ± 70%  softirqs.CPU8.NET_TX
      7230 ±  3%      +5.8%       7651 ±  7%     -14.5%       6184        softirqs.CPU8.RCU
     12284 ±  6%     +16.3%      14282 ± 16%     +16.2%      14272 ±  7%  softirqs.CPU8.SCHED
    232.00 ± 70%    +402.6%       1166 ± 76%     +76.3%     409.00 ± 61%  softirqs.CPU8.TIMER
      0.00          -100.0%       0.00       +7.7e+102%       7.67 ±141%  softirqs.CPU80.BLOCK
      0.00          -100.0%       0.00         +1e+102%       1.00 ± 81%  softirqs.CPU80.NET_RX
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU80.NET_TX
      7696 ± 26%     -20.3%       6133 ±  6%     -15.9%       6472 ±  7%  softirqs.CPU80.RCU
     18946 ±  6%     -43.0%      10793 ± 16%     -32.6%      12768 ± 25%  softirqs.CPU80.SCHED
      0.00       +6.7e+101%       0.67 ± 70%    -100.0%       0.00        softirqs.CPU80.TASKLET
      1155 ± 26%     -83.3%     192.67 ± 46%     -79.2%     240.00 ± 18%  softirqs.CPU80.TIMER
      0.00       +2.4e+103%      23.67 ±141%    -100.0%       0.00        softirqs.CPU81.BLOCK
      0.00       +1.5e+104%     148.33 ±138%    -100.0%       0.00        softirqs.CPU81.NET_RX
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU81.NET_TX
      6388 ± 10%     -15.9%       5373 ± 22%      -2.8%       6208 ±  5%  softirqs.CPU81.RCU
     17993 ±  9%      -2.2%      17591 ± 14%     -21.1%      14203 ± 11%  softirqs.CPU81.SCHED
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU81.TASKLET
    663.33 ± 63%     +87.6%       1244 ± 79%     -55.2%     297.00 ± 46%  softirqs.CPU81.TIMER
      0.00       +7.7e+102%       7.67 ±141% +3.3e+101%       0.33 ±141%  softirqs.CPU82.BLOCK
      3.67 ±105%     -63.6%       1.33 ±141%  +65318.2%       2398 ±141%  softirqs.CPU82.NET_RX
      0.67 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU82.NET_TX
      6388 ± 18%      -6.1%       5999 ±  2%     +18.5%       7570 ± 24%  softirqs.CPU82.RCU
     18690 ± 12%     -20.1%      14937 ± 25%     -20.5%      14857 ± 41%  softirqs.CPU82.SCHED
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU82.TASKLET
    307.00 ± 16%     +15.9%     355.67 ± 41%    +149.9%     767.33 ±107%  softirqs.CPU82.TIMER
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU83.BLOCK
    201.67 ±141%     -99.5%       1.00 ±141%     -95.9%       8.33 ±141%  softirqs.CPU83.NET_RX
      0.00       +3.3e+101%       0.33 ±141% +3.3e+101%       0.33 ±141%  softirqs.CPU83.NET_TX
      6118 ±  8%     -13.8%       5272 ± 17%      +1.4%       6202 ±  2%  softirqs.CPU83.RCU
     18673 ± 31%     -12.7%      16294 ± 16%     -16.8%      15538 ±  8%  softirqs.CPU83.SCHED
    850.33 ± 71%     -71.8%     239.67 ± 25%     +38.9%       1181 ± 48%  softirqs.CPU83.TIMER
      0.00          -100.0%       0.00       +1.2e+103%      11.67 ± 71%  softirqs.CPU84.BLOCK
      7.67 ±141%      +0.0%       7.67 ±141%     -91.3%       0.67 ±141%  softirqs.CPU84.NET_RX
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU84.NET_TX
      5690 ± 11%      -0.7%       5653 ±  9%     +12.5%       6399 ± 12%  softirqs.CPU84.RCU
     21551 ± 11%     -44.9%      11870 ± 17%     -30.6%      14953 ± 14%  softirqs.CPU84.SCHED
    512.33 ± 54%     +39.4%     714.33 ±120%     -40.1%     307.00 ± 43%  softirqs.CPU84.TIMER
      0.00       +1.1e+103%      11.00 ±141%    -100.0%       0.00        softirqs.CPU85.BLOCK
      0.33 ±141%    -100.0%       0.00            +0.0%       0.33 ±141%  softirqs.CPU85.NET_RX
      6367 ±  8%      -8.6%       5822 ± 19%      +1.5%       6461 ± 17%  softirqs.CPU85.RCU
     15532 ± 14%      -6.0%      14594 ± 23%      -9.8%      14012 ± 30%  softirqs.CPU85.SCHED
      0.00       +3.3e+101%       0.33 ±141%   +3e+102%       3.00 ±141%  softirqs.CPU85.TASKLET
    544.00 ± 77%    +186.2%       1556 ± 93%     -20.6%     431.67 ± 79%  softirqs.CPU85.TIMER
      0.00       +9.3e+102%       9.33 ±141%    -100.0%       0.00        softirqs.CPU86.BLOCK
      0.33 ±141%    -100.0%       0.00        +1.4e+05%     467.67 ± 74%  softirqs.CPU86.NET_RX
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU86.NET_TX
      5726 ± 12%      -9.2%       5197 ±  7%      +2.9%       5893 ± 13%  softirqs.CPU86.RCU
     17691 ± 13%      +9.5%      19374 ±  8%      -3.7%      17037 ± 19%  softirqs.CPU86.SCHED
      0.00          -100.0%       0.00         +1e+103%      10.00 ±141%  softirqs.CPU86.TASKLET
    870.67 ± 39%     -51.1%     425.33 ± 56%     -38.4%     536.67 ±  8%  softirqs.CPU86.TIMER
      0.00       +1.3e+103%      12.67 ±141%    -100.0%       0.00        softirqs.CPU87.BLOCK
    257.67 ±141%     -73.9%      67.33 ±141%    -100.0%       0.00        softirqs.CPU87.NET_RX
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU87.NET_TX
      6130 ±  5%      -2.5%       5979 ± 12%      -1.7%       6023 ±  3%  softirqs.CPU87.RCU
     17710 ± 27%      -4.5%      16904 ± 16%      -8.7%      16169 ± 12%  softirqs.CPU87.SCHED
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU87.TASKLET
    626.33 ± 57%     -26.5%     460.67 ± 61%     +50.9%     945.00 ± 70%  softirqs.CPU87.TIMER
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU88.BLOCK
      0.00       +3.7e+102%       3.67 ±141%    -100.0%       0.00        softirqs.CPU88.NET_RX
      0.00       +1.7e+103%      17.00 ±141%    -100.0%       0.00        softirqs.CPU88.NET_TX
      5694 ± 20%      -7.7%       5256 ± 10%     +15.2%       6561 ±  4%  softirqs.CPU88.RCU
     18995 ± 19%      +0.2%      19025 ± 11%     -31.9%      12936 ± 14%  softirqs.CPU88.SCHED
    497.00 ±  5%     +12.3%     558.33 ± 86%     +21.3%     603.00 ± 63%  softirqs.CPU88.TIMER
      4.00 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU89.BLOCK
      1.33 ±141%    -100.0%       0.00          -100.0%       0.00        softirqs.CPU89.NET_RX
      5879 ±  9%      -5.5%       5557 ±  7%      +5.3%       6193 ± 10%  softirqs.CPU89.RCU
     19696 ±  7%      -9.1%      17895 ± 22%      -2.1%      19288 ± 10%  softirqs.CPU89.SCHED
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU89.TASKLET
    370.00 ± 54%     +41.9%     525.00 ±104%     +45.9%     540.00 ± 29%  softirqs.CPU89.TIMER
     19.33 ±134%     -93.1%       1.33 ± 35%     -98.3%       0.33 ±141%  softirqs.CPU9.NET_RX
      1.00           -33.3%       0.67 ± 70%    -100.0%       0.00        softirqs.CPU9.NET_TX
      6503 ± 11%      -7.7%       6004 ±  2%      +9.7%       7131 ±  2%  softirqs.CPU9.RCU
     14045 ± 21%     +16.9%      16421 ± 10%     -24.6%      10587 ± 25%  softirqs.CPU9.SCHED
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU9.TASKLET
    202.00 ± 64%     -45.4%     110.33 ± 13%     -27.2%     147.00 ± 36%  softirqs.CPU9.TIMER
      1.33 ±141%     +75.0%       2.33 ±112%  +16525.0%     221.67 ±141%  softirqs.CPU90.NET_RX
      0.67 ±141%     -50.0%       0.33 ±141%    -100.0%       0.00        softirqs.CPU90.NET_TX
      5572 ±  4%     -11.1%       4952 ±  5%      +8.7%       6055 ±  9%  softirqs.CPU90.RCU
     18897 ± 10%      -1.6%      18604 ± 21%     -11.4%      16752 ±  9%  softirqs.CPU90.SCHED
      0.00          -100.0%       0.00          -100.0%       0.00        softirqs.CPU90.TASKLET
    376.00 ± 23%     +11.2%     418.00 ±108%     +30.5%     490.67 ± 63%  softirqs.CPU90.TIMER
      0.00       +2.3e+102%       2.33 ±141% +3.3e+101%       0.33 ±141%  softirqs.CPU91.NET_RX
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        softirqs.CPU91.NET_TX
      5213 ±  9%     +14.1%       5947 ± 30%      +5.7%       5512        softirqs.CPU91.RCU
     20732 ±  9%     -20.9%      16402 ± 13%     -12.7%      18091 ±  7%  softirqs.CPU91.SCHED
    500.67 ± 38%     -17.2%     414.67 ± 63%     -75.8%     121.33 ±  5%  softirqs.CPU91.TIMER
      0.00         +1e+102%       1.00 ±141%    -100.0%       0.00        softirqs.CPU92.BLOCK
      0.00       +6.7e+101%       0.67 ±141%   +1e+102%       1.00 ±141%  softirqs.CPU92.NET_RX
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU92.NET_TX
      5295 ±  5%     +12.6%       5960 ±  8%      +7.0%       5669 ±  3%  softirqs.CPU92.RCU
     19964 ±  5%     -10.5%      17867 ±  8%     -18.9%      16182 ± 11%  softirqs.CPU92.SCHED
    371.67 ± 18%    +115.4%     800.67 ± 97%     +38.5%     514.67 ± 57%  softirqs.CPU92.TIMER
      7.67 ±141%  +10187.0%     788.67 ±141%     +43.5%      11.00 ±141%  softirqs.CPU93.NET_RX
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU93.NET_TX
      6115 ± 11%     -11.1%       5438 ± 12%      +3.5%       6331 ±  7%  softirqs.CPU93.RCU
     18240 ±  8%      +3.0%      18780 ± 17%      -1.5%      17958 ± 17%  softirqs.CPU93.SCHED
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU93.TASKLET
    406.00 ± 76%    +154.0%       1031 ±111%     -35.3%     262.67 ± 49%  softirqs.CPU93.TIMER
      5.00 ±141%    -100.0%       0.00           -33.3%       3.33 ±141%  softirqs.CPU94.BLOCK
      6275 ± 11%     -19.9%       5024 ±  5%     -15.2%       5324 ±  6%  softirqs.CPU94.RCU
     17762 ±  5%     +12.6%      20003 ±  6%      -7.6%      16420 ± 22%  softirqs.CPU94.SCHED
      0.00          -100.0%       0.00       +6.3e+102%       6.33 ±141%  softirqs.CPU94.TASKLET
    647.33 ± 44%     -54.0%     298.00 ± 87%     -16.6%     539.67 ± 58%  softirqs.CPU94.TIMER
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        softirqs.CPU95.NET_TX
      6622 ± 11%     -11.6%       5852 ± 12%      +0.4%       6647 ± 14%  softirqs.CPU95.RCU
     22790 ± 17%     -25.5%      16976 ± 16%      -7.8%      21017 ± 10%  softirqs.CPU95.SCHED
      2383 ±124%     -86.6%     319.00 ± 73%     -78.2%     519.67 ± 49%  softirqs.CPU95.TIMER
      2.33 ± 20%      +0.0%       2.33 ± 20%     +14.3%       2.67 ± 17%  softirqs.HI
     13788 ± 52%     -51.6%       6667 ± 16%     -62.0%       5240 ± 53%  softirqs.NET_RX
    106.00 ±  6%      -1.9%     104.00 ±  3%      -1.6%     104.33 ±  4%  softirqs.NET_TX
    666139 ±  5%      -9.5%     602568 ±  3%      -3.2%     644544 ±  2%  softirqs.RCU
   1449751            -1.5%    1427706            -1.7%    1425517        softirqs.SCHED
    235.33            -2.4%     229.67            -3.3%     227.67        softirqs.TASKLET
     62465 ±  2%      -9.5%      56552 ±  2%     -11.8%      55077 ±  3%  softirqs.TIMER
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.0:IO-APIC.2-edge.timer
      1.33 ± 93%    +650.0%      10.00 ±141%     -50.0%       0.67 ±141%  interrupts.100:PCI-MSI.31981633-edge.i40e-eth0-TxRx-64
      4.67 ± 88%    +192.9%      13.67 ±120%    +178.6%      13.00 ±130%  interrupts.101:PCI-MSI.31981634-edge.i40e-eth0-TxRx-65
     58.33 ±128%     -89.7%       6.00 ±141%     -84.0%       9.33 ± 72%  interrupts.102:PCI-MSI.31981635-edge.i40e-eth0-TxRx-66
    530.33 ±141%     -99.9%       0.67 ±141%     -94.5%      29.33 ±120%  interrupts.103:PCI-MSI.31981636-edge.i40e-eth0-TxRx-67
      0.33 ±141%  +27900.0%      93.33 ±141%   +1100.0%       4.00 ±141%  interrupts.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68
      2.33 ± 88%     -57.1%       1.00 ± 81%    -100.0%       0.00        interrupts.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69
      1.00 ± 81%    -100.0%       0.00           -33.3%       0.67 ±141%  interrupts.106:PCI-MSI.31981639-edge.i40e-eth0-TxRx-70
      0.00       +1.3e+103%      12.67 ±141% +1.3e+102%       1.33 ± 93%  interrupts.107:PCI-MSI.31981640-edge.i40e-eth0-TxRx-71
      0.33 ±141%      +0.0%       0.33 ±141%    +300.0%       1.33 ± 70%  interrupts.108:PCI-MSI.31981641-edge.i40e-eth0-TxRx-72
      0.00       +1.3e+102%       1.33 ±141% +3.3e+101%       0.33 ±141%  interrupts.109:PCI-MSI.31981642-edge.i40e-eth0-TxRx-73
      0.67 ±141%   +9600.0%      64.67 ±139%     +50.0%       1.00 ± 81%  interrupts.110:PCI-MSI.31981643-edge.i40e-eth0-TxRx-74
      1250 ±141%    -100.0%       0.00           -99.7%       3.33 ±120%  interrupts.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        interrupts.112:PCI-MSI.31981645-edge.i40e-eth0-TxRx-76
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        interrupts.113:PCI-MSI.31981646-edge.i40e-eth0-TxRx-77
      0.00         +1e+102%       1.00 ±141% +2.4e+104%     238.00 ±141%  interrupts.114:PCI-MSI.31981647-edge.i40e-eth0-TxRx-78
      0.00         +2e+102%       2.00 ± 81% +3.3e+101%       0.33 ±141%  interrupts.115:PCI-MSI.31981648-edge.i40e-eth0-TxRx-79
      0.00          -100.0%       0.00       +1.7e+102%       1.67 ±141%  interrupts.116:PCI-MSI.31981649-edge.i40e-eth0-TxRx-80
      0.00       +2.3e+104%     228.67 ±140%    -100.0%       0.00        interrupts.117:PCI-MSI.31981650-edge.i40e-eth0-TxRx-81
      2.00 ±141%     -66.7%       0.67 ±141%  +18916.7%     380.33 ±141%  interrupts.118:PCI-MSI.31981651-edge.i40e-eth0-TxRx-82
    202.67 ±141%    -100.0%       0.00           -95.9%       8.33 ±141%  interrupts.119:PCI-MSI.31981652-edge.i40e-eth0-TxRx-83
      5.67 ±141%      -5.9%       5.33 ±141%    -100.0%       0.00        interrupts.120:PCI-MSI.31981653-edge.i40e-eth0-TxRx-84
      1.00 ±141%     -66.7%       0.33 ±141%      +0.0%       1.00 ± 81%  interrupts.121:PCI-MSI.31981654-edge.i40e-eth0-TxRx-85
      0.00          -100.0%       0.00       +6.4e+104%     644.67 ± 70%  interrupts.122:PCI-MSI.31981655-edge.i40e-eth0-TxRx-86
    107.00 ±141%     +23.1%     131.67 ±141%     -99.7%       0.33 ±141%  interrupts.123:PCI-MSI.31981656-edge.i40e-eth0-TxRx-87
      0.33 ±141%      +0.0%       0.33 ±141%    -100.0%       0.00        interrupts.124:PCI-MSI.31981657-edge.i40e-eth0-TxRx-88
      2.00 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.125:PCI-MSI.31981658-edge.i40e-eth0-TxRx-89
      0.00       +4.3e+102%       4.33 ± 84%    -100.0%       0.00        interrupts.126:PCI-MSI.31981659-edge.i40e-eth0-TxRx-90
      0.00       +5.7e+102%       5.67 ±117% +6.7e+101%       0.67 ±141%  interrupts.127:PCI-MSI.31981660-edge.i40e-eth0-TxRx-91
      1.33 ± 70%     +25.0%       1.67 ±141%     -50.0%       0.67 ±141%  interrupts.128:PCI-MSI.31981661-edge.i40e-eth0-TxRx-92
      5.67 ±129%  +12982.4%     741.33 ±141%    +105.9%      11.67 ±141%  interrupts.129:PCI-MSI.31981662-edge.i40e-eth0-TxRx-93
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.293:PCI-MSI.327680-edge.xhci_hcd
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.297:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.298:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.299:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.299:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.300:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.300:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.301:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.301:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.302:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.302:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.303:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.303:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.304:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.305:PCI-MSI.67174400-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.306:PCI-MSI.67174400-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.307:PCI-MSI.67176448-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.308:PCI-MSI.67176448-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.308:PCI-MSI.67178496-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.309:PCI-MSI.67178496-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.309:PCI-MSI.67180544-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.310:PCI-MSI.67180544-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.311:PCI-MSI.67182592-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.312:PCI-MSI.67184640-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.313:PCI-MSI.67186688-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.314:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.314:PCI-MSI.67188736-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.315:PCI-MSI.67188736-edge.ioat-msix
    254.33 ±  2%      +0.7%     256.00            +8.0%     274.67 ±  4%  interrupts.35:PCI-MSI.31981568-edge.i40e-0000:3d:00.0:misc
      0.67 ±141%      +0.0%       0.67 ± 70%    +650.0%       5.00 ± 81%  interrupts.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
      2.00 ± 70%     -66.7%       0.67 ±141%     -50.0%       1.00 ± 81%  interrupts.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
    949.00 ±110%     -99.8%       1.67 ±141%    -100.0%       0.00        interrupts.38:PCI-MSI.31981571-edge.i40e-eth0-TxRx-2
      1.67 ±101%     -40.0%       1.00         +2360.0%      41.00 ±136%  interrupts.39:PCI-MSI.31981572-edge.i40e-eth0-TxRx-3
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.3:IO-APIC.3-edge
    228.67 ±140%     -99.7%       0.67 ±141%    -100.0%       0.00        interrupts.40:PCI-MSI.31981573-edge.i40e-eth0-TxRx-4
      0.00         +2e+102%       2.00 ± 81% +3.3e+101%       0.33 ±141%  interrupts.41:PCI-MSI.31981574-edge.i40e-eth0-TxRx-5
     13.67 ±141%     -95.1%       0.67 ± 70%     -97.6%       0.33 ±141%  interrupts.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
      0.33 ±141%    +400.0%       1.67 ±141%   +5000.0%      17.00 ±141%  interrupts.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
      0.33 ±141%  +52500.0%     175.33 ±141%    -100.0%       0.00        interrupts.44:PCI-MSI.31981577-edge.i40e-eth0-TxRx-8
     13.33 ±141%     -90.0%       1.33 ±141%    -100.0%       0.00        interrupts.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9
      1.00 ±141%     +33.3%       1.33 ± 70%  +10566.7%     106.67 ±141%  interrupts.46:PCI-MSI.31981579-edge.i40e-eth0-TxRx-10
      0.67 ±141%    +350.0%       3.00 ±141%    -100.0%       0.00        interrupts.47:PCI-MSI.31981580-edge.i40e-eth0-TxRx-11
      0.33 ±141%    +100.0%       0.67 ±141%      +0.0%       0.33 ±141%  interrupts.48:PCI-MSI.31981581-edge.i40e-eth0-TxRx-12
      1.00 ± 81%     -33.3%       0.67 ±141%    +500.0%       6.00 ±141%  interrupts.49:PCI-MSI.31981582-edge.i40e-eth0-TxRx-13
     51.00           -57.5%      21.67 ±141%     -66.7%      17.00 ±141%  interrupts.4:IO-APIC.4-edge.ttyS0
      1.33 ± 70%    +900.0%      13.33 ±141%    -100.0%       0.00        interrupts.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
    138.67 ±139%     -99.3%       1.00 ±141%     -99.5%       0.67 ±141%  interrupts.51:PCI-MSI.31981584-edge.i40e-eth0-TxRx-15
      2.67 ± 35%    +262.5%       9.67 ±141%     -37.5%       1.67 ± 74%  interrupts.52:PCI-MSI.31981585-edge.i40e-eth0-TxRx-16
      3.33 ±120%     -70.0%       1.00 ±141%   +3710.0%     127.00 ±140%  interrupts.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
      1.67 ±101%    -100.0%       0.00          -100.0%       0.00        interrupts.54:PCI-MSI.31981587-edge.i40e-eth0-TxRx-18
      2.00 ± 81%  +44283.3%     887.67 ±141%     -33.3%       1.33 ± 70%  interrupts.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
      0.00       +1.7e+104%     173.00 ±141%   +1e+102%       1.00 ±141%  interrupts.56:PCI-MSI.31981589-edge.i40e-eth0-TxRx-20
      1.67 ±141%     -80.0%       0.33 ±141%    -100.0%       0.00        interrupts.57:PCI-MSI.31981590-edge.i40e-eth0-TxRx-21
      3.33 ± 70%     -80.0%       0.67 ±141%     -90.0%       0.33 ±141%  interrupts.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
      3.33 ±141%     -90.0%       0.33 ±141%    -100.0%       0.00        interrupts.59:PCI-MSI.31981592-edge.i40e-eth0-TxRx-23
      0.00       +3.1e+103%      30.67 ±141%    -100.0%       0.00        interrupts.60:PCI-MSI.31981593-edge.i40e-eth0-TxRx-24
      0.00       +3.8e+103%      38.33 ± 84% +6.7e+101%       0.67 ±141%  interrupts.61:PCI-MSI.31981594-edge.i40e-eth0-TxRx-25
      1.33 ± 93%   +7425.0%     100.33 ±141%     -25.0%       1.00 ±141%  interrupts.62:PCI-MSI.31981595-edge.i40e-eth0-TxRx-26
      0.00       +2.3e+102%       2.33 ± 88% +3.3e+101%       0.33 ±141%  interrupts.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
      0.00          -100.0%       0.00       +3.7e+102%       3.67 ± 46%  interrupts.64:PCI-MSI.31981597-edge.i40e-eth0-TxRx-28
      0.00       +1.1e+104%     106.00 ±115%    -100.0%       0.00        interrupts.65:PCI-MSI.31981598-edge.i40e-eth0-TxRx-29
      2.00 ±141%    +100.0%       4.00 ±141%   +1216.7%      26.33 ±136%  interrupts.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
     16.00 ±128%    -100.0%       0.00           -81.2%       3.00 ± 81%  interrupts.67:PCI-MSI.31981600-edge.i40e-eth0-TxRx-31
      2.67 ±141%    -100.0%       0.00           +25.0%       3.33 ±101%  interrupts.68:PCI-MSI.31981601-edge.i40e-eth0-TxRx-32
     16.00 ±141%   +4533.3%     741.33 ±141%      +0.0%      16.00 ±115%  interrupts.69:PCI-MSI.31981602-edge.i40e-eth0-TxRx-33
      0.67 ±141%    -100.0%       0.00            +0.0%       0.67 ± 70%  interrupts.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34
    346.33 ±141%     -99.5%       1.67 ±141%     -99.2%       2.67 ± 93%  interrupts.71:PCI-MSI.31981604-edge.i40e-eth0-TxRx-35
      0.33 ±141%    -100.0%       0.00         +9800.0%      33.00 ±139%  interrupts.72:PCI-MSI.31981605-edge.i40e-eth0-TxRx-36
      0.00         +2e+102%       2.00 ± 81%   +1e+102%       1.00 ±141%  interrupts.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
      0.00       +3.3e+101%       0.33 ±141%   +2e+104%     203.00 ±140%  interrupts.74:PCI-MSI.31981607-edge.i40e-eth0-TxRx-38
      5.33 ±141%   +2225.0%     124.00 ±133%    +112.5%      11.33 ±129%  interrupts.75:PCI-MSI.31981608-edge.i40e-eth0-TxRx-39
      1.00 ±141%    -100.0%       0.00           -33.3%       0.67 ±141%  interrupts.76:PCI-MSI.31981609-edge.i40e-eth0-TxRx-40
      0.00       +2.8e+103%      28.33 ±141%    -100.0%       0.00        interrupts.77:PCI-MSI.31981610-edge.i40e-eth0-TxRx-41
     13.33 ±141%    -100.0%       0.00          +125.0%      30.00 ± 71%  interrupts.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
     17.67 ±141%     -90.6%       1.67 ±141%    -100.0%       0.00        interrupts.79:PCI-MSI.31981612-edge.i40e-eth0-TxRx-43
      0.00       +6.7e+101%       0.67 ±141% +6.7e+101%       0.67 ±141%  interrupts.80:PCI-MSI.31981613-edge.i40e-eth0-TxRx-44
    165.33 ±141%     -99.4%       1.00 ± 81%     -99.6%       0.67 ±141%  interrupts.81:PCI-MSI.31981614-edge.i40e-eth0-TxRx-45
      0.00          -100.0%       0.00         +1e+103%      10.00 ± 64%  interrupts.82:PCI-MSI.31981615-edge.i40e-eth0-TxRx-46
      0.00       +1.7e+102%       1.67 ± 74%   +1e+102%       1.00 ±141%  interrupts.83:PCI-MSI.31981616-edge.i40e-eth0-TxRx-47
      9874 ±141%    -100.0%       0.67 ±141%    -100.0%       1.00 ±141%  interrupts.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
      0.00         +2e+105%       2013 ±141% +1.3e+102%       1.33 ±141%  interrupts.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
    278.33 ±133%    -100.0%       0.00           -99.3%       2.00 ± 81%  interrupts.86:PCI-MSI.31981619-edge.i40e-eth0-TxRx-50
      3.33 ±120%   +1460.0%      52.00 ±137%     -80.0%       0.67 ±141%  interrupts.87:PCI-MSI.31981620-edge.i40e-eth0-TxRx-51
     28.33 ±141%     -97.6%       0.67 ±141%     -98.8%       0.33 ±141%  interrupts.88:PCI-MSI.31981621-edge.i40e-eth0-TxRx-52
     25.33 ±141%    -100.0%       0.00           +31.6%      33.33 ±139%  interrupts.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.8:IO-APIC.8-edge.rtc0
     38.33 ± 47%     -21.7%      30.00 ±127%     -64.3%      13.67 ±141%  interrupts.90:PCI-MSI.31981623-edge.i40e-eth0-TxRx-54
      0.00       +1.5e+103%      15.00 ±123% +6.7e+101%       0.67 ± 70%  interrupts.91:PCI-MSI.31981624-edge.i40e-eth0-TxRx-55
      0.33 ±141%    +500.0%       2.00 ±141%      +0.0%       0.33 ±141%  interrupts.92:PCI-MSI.31981625-edge.i40e-eth0-TxRx-56
      1.00 ± 81%    +600.0%       7.00 ±141%    +133.3%       2.33 ± 72%  interrupts.93:PCI-MSI.31981626-edge.i40e-eth0-TxRx-57
     11.67 ±129%     -65.7%       4.00 ±141%    -100.0%       0.00        interrupts.94:PCI-MSI.31981627-edge.i40e-eth0-TxRx-58
    202.33 ±141%    -100.0%       0.00           -92.9%      14.33 ±126%  interrupts.95:PCI-MSI.31981628-edge.i40e-eth0-TxRx-59
     25.67 ±138%     -96.1%       1.00 ± 81%    -100.0%       0.00        interrupts.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
      1.33 ±141%     +75.0%       2.33 ±141%    -100.0%       0.00        interrupts.97:PCI-MSI.31981630-edge.i40e-eth0-TxRx-61
      2.00 ± 81%    -100.0%       0.00        +29100.0%     584.00 ±141%  interrupts.98:PCI-MSI.31981631-edge.i40e-eth0-TxRx-62
      1.67 ± 74%    -100.0%       0.00            +0.0%       1.67 ±141%  interrupts.99:PCI-MSI.31981632-edge.i40e-eth0-TxRx-63
  44400026 ±  2%     -34.7%   29014465 ±  4%      -7.0%   41301128        interrupts.CAL:Function_call_interrupts
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU0.0:IO-APIC.2-edge.timer
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU0.119:PCI-MSI.31981652-edge.i40e-eth0-TxRx-83
      0.33 ±141%    +100.0%       0.67 ± 70%   +1200.0%       4.33 ± 84%  interrupts.CPU0.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU0.71:PCI-MSI.31981604-edge.i40e-eth0-TxRx-35
    283657 ± 20%      -9.4%     256976 ± 10%     +24.1%     351971 ± 39%  interrupts.CPU0.CAL:Function_call_interrupts
     19.67 ± 65%    +116.9%      42.67 ± 51%     -57.6%       8.33 ± 46%  interrupts.CPU0.IWI:IRQ_work_interrupts
    406071            -4.4%     388293 ±  3%      -0.7%     403259        interrupts.CPU0.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU0.MCP:Machine_check_polls
     10126 ± 25%     +47.7%      14953 ± 26%     -34.0%       6681 ± 19%  interrupts.CPU0.NMI:Non-maskable_interrupts
     10126 ± 25%     +47.7%      14953 ± 26%     -34.0%       6681 ± 19%  interrupts.CPU0.PMI:Performance_monitoring_interrupts
    364.67 ±  8%     +16.4%     424.33 ± 13%     -26.9%     266.67 ± 27%  interrupts.CPU0.RES:Rescheduling_interrupts
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU0.RTR:APIC_ICR_read_retries
    339733 ± 20%      -5.2%     322171 ± 11%     +28.0%     434790 ± 39%  interrupts.CPU0.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU1.120:PCI-MSI.31981653-edge.i40e-eth0-TxRx-84
      2.00 ± 70%     -66.7%       0.67 ±141%     -50.0%       1.00 ± 81%  interrupts.CPU1.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU1.72:PCI-MSI.31981605-edge.i40e-eth0-TxRx-36
    367667 ± 22%     -21.0%     290475 ± 33%     +23.2%     453123 ± 15%  interrupts.CPU1.CAL:Function_call_interrupts
     46.33 ± 76%      +3.6%      48.00 ± 35%      -7.2%      43.00 ± 66%  interrupts.CPU1.IWI:IRQ_work_interrupts
    405981            -6.0%     381457 ±  7%      -1.3%     400689        interrupts.CPU1.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU1.MCP:Machine_check_polls
     15433 ± 44%      +7.4%      16571 ± 21%      -5.7%      14553 ± 35%  interrupts.CPU1.NMI:Non-maskable_interrupts
     15433 ± 44%      +7.4%      16571 ± 21%      -5.7%      14553 ± 35%  interrupts.CPU1.PMI:Performance_monitoring_interrupts
    488.67 ± 25%      -5.5%     461.67 ± 17%     -21.5%     383.67        interrupts.CPU1.RES:Rescheduling_interrupts
    442026 ± 21%     -16.4%     369476 ± 34%     +26.0%     556889 ± 15%  interrupts.CPU1.TLB:TLB_shootdowns
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU10.129:PCI-MSI.31981662-edge.i40e-eth0-TxRx-93
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU10.293:PCI-MSI.327680-edge.xhci_hcd
      1.00 ±141%     +33.3%       1.33 ± 70%  +10566.7%     106.67 ±141%  interrupts.CPU10.46:PCI-MSI.31981579-edge.i40e-eth0-TxRx-10
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU10.81:PCI-MSI.31981614-edge.i40e-eth0-TxRx-45
    396415 ± 21%     -39.8%     238582 ± 29%      -2.0%     388354 ± 22%  interrupts.CPU10.CAL:Function_call_interrupts
     34.00 ± 74%     -56.9%      14.67 ±112%     +35.3%      46.00 ± 62%  interrupts.CPU10.IWI:IRQ_work_interrupts
    405976            -3.8%     390689 ±  2%      -1.3%     400589        interrupts.CPU10.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU10.MCP:Machine_check_polls
     14276 ± 42%     -36.1%       9119 ± 39%      -1.4%      14077 ± 39%  interrupts.CPU10.NMI:Non-maskable_interrupts
     14276 ± 42%     -36.1%       9119 ± 39%      -1.4%      14077 ± 39%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
    443.00 ± 25%      -7.1%     411.67 ± 38%      -8.1%     407.00 ± 40%  interrupts.CPU10.RES:Rescheduling_interrupts
    478632 ± 21%     -36.7%     303071 ± 30%      -0.3%     477055 ± 22%  interrupts.CPU10.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU11.297:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU11.298:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU11.299:PCI-MSI.71680-edge.ioat-msix
      0.67 ±141%    +300.0%       2.67 ±141%    -100.0%       0.00        interrupts.CPU11.47:PCI-MSI.31981580-edge.i40e-eth0-TxRx-11
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ± 70%  interrupts.CPU11.82:PCI-MSI.31981615-edge.i40e-eth0-TxRx-46
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU11.8:IO-APIC.8-edge.rtc0
    431957 ± 22%     -45.4%     235711 ± 14%     +16.6%     503679 ± 27%  interrupts.CPU11.CAL:Function_call_interrupts
     35.33 ± 81%     -59.4%      14.33 ±111%     +53.8%      54.33 ± 35%  interrupts.CPU11.IWI:IRQ_work_interrupts
    406106            -4.8%     386741 ±  4%      -1.6%     399776        interrupts.CPU11.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU11.MCP:Machine_check_polls
     13693 ± 43%     -31.3%       9402 ± 35%     +21.1%      16577 ± 26%  interrupts.CPU11.NMI:Non-maskable_interrupts
     13693 ± 43%     -31.3%       9402 ± 35%     +21.1%      16577 ± 26%  interrupts.CPU11.PMI:Performance_monitoring_interrupts
    625.33 ± 30%     -49.3%     317.33 ± 14%     -37.5%     391.00 ± 28%  interrupts.CPU11.RES:Rescheduling_interrupts
    519094 ± 22%     -42.3%     299492 ± 14%     +19.2%     618914 ± 27%  interrupts.CPU11.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU12.298:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU12.299:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU12.299:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU12.300:PCI-MSI.73728-edge.ioat-msix
      0.33 ±141%    +100.0%       0.67 ±141%    -100.0%       0.00        interrupts.CPU12.48:PCI-MSI.31981581-edge.i40e-eth0-TxRx-12
      0.00       +6.7e+101%       0.67 ± 70%    -100.0%       0.00        interrupts.CPU12.83:PCI-MSI.31981616-edge.i40e-eth0-TxRx-47
    407872 ± 22%      -9.2%     370181 ± 25%      +2.5%     418228 ± 31%  interrupts.CPU12.CAL:Function_call_interrupts
     19.33 ± 63%     -39.7%      11.67 ± 61%    +224.1%      62.67 ± 32%  interrupts.CPU12.IWI:IRQ_work_interrupts
    406318            -5.5%     384051 ±  3%      -1.2%     401550        interrupts.CPU12.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU12.MCP:Machine_check_polls
     10237 ± 22%     -27.5%       7423 ±  8%     +79.5%      18379 ± 20%  interrupts.CPU12.NMI:Non-maskable_interrupts
     10237 ± 22%     -27.5%       7423 ±  8%     +79.5%      18379 ± 20%  interrupts.CPU12.PMI:Performance_monitoring_interrupts
    535.00 ± 10%      +4.5%     559.00 ± 43%     -35.3%     346.33 ± 20%  interrupts.CPU12.RES:Rescheduling_interrupts
    491323 ± 21%      -4.8%     467840 ± 26%      +4.7%     514580 ± 31%  interrupts.CPU12.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU13.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU13.298:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU13.299:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU13.300:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU13.300:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU13.301:PCI-MSI.75776-edge.ioat-msix
      0.33 ±141%    -100.0%       0.00          +100.0%       0.67 ± 70%  interrupts.CPU13.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
      0.67 ± 70%      +0.0%       0.67 ±141%    +800.0%       6.00 ±141%  interrupts.CPU13.49:PCI-MSI.31981582-edge.i40e-eth0-TxRx-13
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU13.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
    494664 ± 29%     -31.7%     338043 ± 39%      +0.5%     497024 ± 13%  interrupts.CPU13.CAL:Function_call_interrupts
     35.33 ± 69%     -17.0%      29.33 ± 84%      +0.0%      35.33 ± 71%  interrupts.CPU13.IWI:IRQ_work_interrupts
    405940            -7.5%     375579 ±  8%      -1.3%     400478        interrupts.CPU13.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU13.MCP:Machine_check_polls
     13375 ± 42%      -3.8%      12867 ± 45%      -8.1%      12287 ± 37%  interrupts.CPU13.NMI:Non-maskable_interrupts
     13375 ± 42%      -3.8%      12867 ± 45%      -8.1%      12287 ± 37%  interrupts.CPU13.PMI:Performance_monitoring_interrupts
    628.67 ± 24%     -30.9%     434.67 ± 32%     -38.5%     386.67 ±  6%  interrupts.CPU13.RES:Rescheduling_interrupts
    594215 ± 28%     -27.6%     430176 ± 38%      +2.8%     611002 ± 13%  interrupts.CPU13.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU14.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU14.299:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU14.300:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU14.301:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU14.301:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU14.302:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU14.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
     34.00 ± 70%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU14.4:IO-APIC.4-edge.ttyS0
      1.00 ± 81%   +1233.3%      13.33 ±141%    -100.0%       0.00        interrupts.CPU14.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU14.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
    429908 ± 45%     -31.4%     294961 ± 40%     +17.3%     504403 ± 13%  interrupts.CPU14.CAL:Function_call_interrupts
     41.00 ± 39%      -9.8%      37.00 ± 74%     +54.5%      63.33 ± 26%  interrupts.CPU14.IWI:IRQ_work_interrupts
    405953            -6.7%     378674 ±  7%      -1.8%     398752        interrupts.CPU14.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU14.MCP:Machine_check_polls
     14767 ± 26%      -2.8%      14360 ± 41%     +22.6%      18108 ± 17%  interrupts.CPU14.NMI:Non-maskable_interrupts
     14767 ± 26%      -2.8%      14360 ± 41%     +22.6%      18108 ± 17%  interrupts.CPU14.PMI:Performance_monitoring_interrupts
    607.33 ± 29%     -16.5%     507.33 ± 28%     -22.3%     472.00 ± 42%  interrupts.CPU14.RES:Rescheduling_interrupts
    517489 ± 45%     -27.3%     376184 ± 40%     +19.6%     618675 ± 13%  interrupts.CPU14.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU15.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU15.300:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU15.301:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU15.302:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU15.302:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU15.303:PCI-MSI.79872-edge.ioat-msix
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU15.38:PCI-MSI.31981571-edge.i40e-eth0-TxRx-2
     17.00 ±141%    -100.0%       0.00            +0.0%      17.00 ±141%  interrupts.CPU15.4:IO-APIC.4-edge.ttyS0
    138.67 ±139%     -99.3%       1.00 ±141%     -99.5%       0.67 ±141%  interrupts.CPU15.51:PCI-MSI.31981584-edge.i40e-eth0-TxRx-15
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ± 70%  interrupts.CPU15.86:PCI-MSI.31981619-edge.i40e-eth0-TxRx-50
    465405 ± 12%     -23.4%     356420 ±  8%     -10.6%     416247 ± 22%  interrupts.CPU15.CAL:Function_call_interrupts
     52.67 ± 55%     -48.7%      27.00 ± 30%     -13.9%      45.33 ± 66%  interrupts.CPU15.IWI:IRQ_work_interrupts
    405874            -6.2%     380728 ±  4%      -1.1%     401458        interrupts.CPU15.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU15.MCP:Machine_check_polls
     17292 ± 37%     -31.0%      11937 ± 14%     -18.0%      14174 ± 42%  interrupts.CPU15.NMI:Non-maskable_interrupts
     17292 ± 37%     -31.0%      11937 ± 14%     -18.0%      14174 ± 42%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
    545.67 ± 18%      +8.2%     590.67 ± 28%     -36.2%     348.00 ± 28%  interrupts.CPU15.RES:Rescheduling_interrupts
    560304 ± 11%     -19.2%     452556 ±  8%      -8.7%     511541 ± 22%  interrupts.CPU15.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU16.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU16.301:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU16.302:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU16.303:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU16.303:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU16.304:PCI-MSI.79872-edge.ioat-msix
      0.33 ±141%      +0.0%       0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU16.39:PCI-MSI.31981572-edge.i40e-eth0-TxRx-3
      0.00       +2.2e+103%      21.67 ±141%    -100.0%       0.00        interrupts.CPU16.4:IO-APIC.4-edge.ttyS0
      2.33 ± 53%    +314.3%       9.67 ±141%     -42.9%       1.33 ± 93%  interrupts.CPU16.52:PCI-MSI.31981585-edge.i40e-eth0-TxRx-16
      0.33 ±141%      +0.0%       0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU16.87:PCI-MSI.31981620-edge.i40e-eth0-TxRx-51
    452155 ± 17%     -45.2%     247563 ± 14%     -25.6%     336433 ± 27%  interrupts.CPU16.CAL:Function_call_interrupts
     38.67 ± 81%     -30.2%      27.00 ± 78%     +47.4%      57.00 ± 40%  interrupts.CPU16.IWI:IRQ_work_interrupts
    405978            -4.4%     388008 ±  3%      -1.0%     402086        interrupts.CPU16.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU16.MCP:Machine_check_polls
     14316 ± 40%     -19.5%      11529 ± 42%     +20.8%      17286 ± 28%  interrupts.CPU16.NMI:Non-maskable_interrupts
     14316 ± 40%     -19.5%      11529 ± 42%     +20.8%      17286 ± 28%  interrupts.CPU16.PMI:Performance_monitoring_interrupts
    605.33           -24.6%     456.33 ± 24%     -53.8%     279.67 ± 13%  interrupts.CPU16.RES:Rescheduling_interrupts
    543705 ± 17%     -41.9%     315853 ± 15%     -24.3%     411397 ± 28%  interrupts.CPU16.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU17.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU17.302:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU17.303:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU17.304:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU17.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.33 ±141%      +0.0%       0.33 ±141%    -100.0%       0.00        interrupts.CPU17.40:PCI-MSI.31981573-edge.i40e-eth0-TxRx-4
      2.67 ±141%     -75.0%       0.67 ±141%   +4637.5%     126.33 ±141%  interrupts.CPU17.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU17.88:PCI-MSI.31981621-edge.i40e-eth0-TxRx-52
    360610 ± 26%     -13.9%     310546 ± 21%     +28.0%     461533 ± 41%  interrupts.CPU17.CAL:Function_call_interrupts
     20.00 ± 99%     -10.0%      18.00 ± 74%    +116.7%      43.33 ± 69%  interrupts.CPU17.IWI:IRQ_work_interrupts
    405962            -5.2%     384737 ±  4%      -1.3%     400806        interrupts.CPU17.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU17.MCP:Machine_check_polls
     10569 ± 36%      -5.4%      10001 ± 29%     +34.4%      14200 ± 45%  interrupts.CPU17.NMI:Non-maskable_interrupts
     10569 ± 36%      -5.4%      10001 ± 29%     +34.4%      14200 ± 45%  interrupts.CPU17.PMI:Performance_monitoring_interrupts
    479.00 ± 33%     -19.2%     387.00 ±  5%     -24.0%     364.00 ± 33%  interrupts.CPU17.RES:Rescheduling_interrupts
    435283 ± 26%      -9.0%     396264 ± 21%     +30.4%     567766 ± 41%  interrupts.CPU17.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU18.303:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU18.314:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU18.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00       +6.7e+101%       0.67 ± 70% +3.3e+101%       0.33 ±141%  interrupts.CPU18.41:PCI-MSI.31981574-edge.i40e-eth0-TxRx-5
      1.00 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU18.54:PCI-MSI.31981587-edge.i40e-eth0-TxRx-18
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU18.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
    395462 ± 11%     -16.7%     329268 ± 15%      +6.9%     422919 ± 27%  interrupts.CPU18.CAL:Function_call_interrupts
     27.67 ± 99%     +30.1%      36.00 ± 72%    +136.1%      65.33 ± 25%  interrupts.CPU18.IWI:IRQ_work_interrupts
    405927            -6.6%     379114 ±  6%      -1.0%     402006        interrupts.CPU18.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU18.MCP:Machine_check_polls
     12029 ± 51%     +16.9%      14066 ± 42%     +58.3%      19042 ± 18%  interrupts.CPU18.NMI:Non-maskable_interrupts
     12029 ± 51%     +16.9%      14066 ± 42%     +58.3%      19042 ± 18%  interrupts.CPU18.PMI:Performance_monitoring_interrupts
    505.33 ± 12%      -2.3%     493.67 ± 32%     -29.9%     354.00 ± 23%  interrupts.CPU18.RES:Rescheduling_interrupts
    475837 ± 10%     -11.8%     419517 ± 14%      +9.6%     521656 ± 27%  interrupts.CPU18.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU19.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU19.3:IO-APIC.3-edge
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU19.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU19.4:IO-APIC.4-edge.ttyS0
      1.33 ± 93%  +66475.0%     887.67 ±141%     -50.0%       0.67 ± 70%  interrupts.CPU19.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU19.90:PCI-MSI.31981623-edge.i40e-eth0-TxRx-54
    590338 ± 10%     -27.9%     425688 ±  8%     -18.6%     480366 ± 14%  interrupts.CPU19.CAL:Function_call_interrupts
     75.33 ± 19%     -11.1%      67.00 ±  7%     -59.7%      30.33 ± 74%  interrupts.CPU19.IWI:IRQ_work_interrupts
    406123            -7.8%     374335 ±  7%      -1.3%     400685        interrupts.CPU19.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU19.MCP:Machine_check_polls
     21659 ± 15%      -6.7%      20207 ±  2%     -45.7%      11770 ± 38%  interrupts.CPU19.NMI:Non-maskable_interrupts
     21659 ± 15%      -6.7%      20207 ±  2%     -45.7%      11770 ± 38%  interrupts.CPU19.PMI:Performance_monitoring_interrupts
    671.33 ± 20%     -18.5%     547.00 ± 12%     -36.7%     424.67 ±  3%  interrupts.CPU19.RES:Rescheduling_interrupts
    711808 ± 10%     -24.1%     540475 ±  8%     -17.3%     588929 ± 15%  interrupts.CPU19.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU2.121:PCI-MSI.31981654-edge.i40e-eth0-TxRx-85
    949.00 ±110%     -99.9%       1.33 ±141%    -100.0%       0.00        interrupts.CPU2.38:PCI-MSI.31981571-edge.i40e-eth0-TxRx-2
      0.00       +3.3e+101%       0.33 ±141% +3.3e+101%       0.33 ±141%  interrupts.CPU2.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
    411168 ± 16%     -33.7%     272520 ± 29%      -4.3%     393383 ± 12%  interrupts.CPU2.CAL:Function_call_interrupts
     31.00 ±127%     -21.5%      24.33 ±112%      -1.1%      30.67 ±116%  interrupts.CPU2.IWI:IRQ_work_interrupts
    405931            -4.8%     386630 ±  4%      -1.4%     400119        interrupts.CPU2.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU2.MCP:Machine_check_polls
     11993 ± 75%     +16.0%      13908 ± 31%      +1.0%      12110 ± 60%  interrupts.CPU2.NMI:Non-maskable_interrupts
     11993 ± 75%     +16.0%      13908 ± 31%      +1.0%      12110 ± 60%  interrupts.CPU2.PMI:Performance_monitoring_interrupts
    539.33 ± 28%     -26.8%     395.00 ±  8%     -36.2%     344.00 ± 26%  interrupts.CPU2.RES:Rescheduling_interrupts
    494494 ± 15%     -29.8%     347147 ± 29%      -2.5%     482047 ± 13%  interrupts.CPU2.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU20.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.33 ±141%      +0.0%       0.33 ±141%    -100.0%       0.00        interrupts.CPU20.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
      0.00       +1.7e+104%     173.00 ±141%   +1e+102%       1.00 ±141%  interrupts.CPU20.56:PCI-MSI.31981589-edge.i40e-eth0-TxRx-20
      0.00       +3.3e+101%       0.33 ±141% +3.3e+101%       0.33 ±141%  interrupts.CPU20.91:PCI-MSI.31981624-edge.i40e-eth0-TxRx-55
    493806 ±  9%     -30.4%     343541 ± 18%      -7.4%     457350 ± 21%  interrupts.CPU20.CAL:Function_call_interrupts
     52.67 ± 26%      +0.6%      53.00 ± 40%     +27.2%      67.00 ± 37%  interrupts.CPU20.IWI:IRQ_work_interrupts
    405941            -7.3%     376506 ±  6%      -1.0%     401805        interrupts.CPU20.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU20.MCP:Machine_check_polls
     19248 ± 15%     -10.3%      17257 ± 24%      +2.9%      19803 ± 24%  interrupts.CPU20.NMI:Non-maskable_interrupts
     19248 ± 15%     -10.3%      17257 ± 24%      +2.9%      19803 ± 24%  interrupts.CPU20.PMI:Performance_monitoring_interrupts
    551.33 ± 10%      -8.6%     504.00 ± 31%     -32.9%     370.00 ± 25%  interrupts.CPU20.RES:Rescheduling_interrupts
    595289 ±  9%     -26.6%     436974 ± 18%      -5.3%     563830 ± 20%  interrupts.CPU20.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU21.3:IO-APIC.3-edge
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU21.44:PCI-MSI.31981577-edge.i40e-eth0-TxRx-8
      1.67 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU21.57:PCI-MSI.31981590-edge.i40e-eth0-TxRx-21
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU21.92:PCI-MSI.31981625-edge.i40e-eth0-TxRx-56
    369712 ± 22%     -19.2%     298636 ± 25%     +49.9%     554264 ± 22%  interrupts.CPU21.CAL:Function_call_interrupts
     27.33 ±100%     +79.3%      49.00 ± 43%    +202.4%      82.67 ±  4%  interrupts.CPU21.IWI:IRQ_work_interrupts
    406295            -6.2%     380959 ±  6%      -1.6%     399836        interrupts.CPU21.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU21.MCP:Machine_check_polls
     15671 ± 33%      +4.9%      16433 ± 32%     +45.2%      22759 ±  3%  interrupts.CPU21.NMI:Non-maskable_interrupts
     15671 ± 33%      +4.9%      16433 ± 32%     +45.2%      22759 ±  3%  interrupts.CPU21.PMI:Performance_monitoring_interrupts
    438.00 ± 27%      +4.5%     457.67 ± 31%     +10.3%     483.00 ± 29%  interrupts.CPU21.RES:Rescheduling_interrupts
    448885 ± 22%     -15.7%     378279 ± 25%     +52.3%     683715 ± 22%  interrupts.CPU21.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU22.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9
      3.33 ± 70%     -80.0%       0.67 ±141%    -100.0%       0.00        interrupts.CPU22.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ± 70%  interrupts.CPU22.93:PCI-MSI.31981626-edge.i40e-eth0-TxRx-57
    390922 ± 25%     -13.4%     338503 ± 33%      +4.2%     407239 ± 28%  interrupts.CPU22.CAL:Function_call_interrupts
     53.00 ± 41%     -17.6%      43.67 ± 70%      +3.8%      55.00 ± 31%  interrupts.CPU22.IWI:IRQ_work_interrupts
    405987            -7.5%     375589 ±  6%      -1.3%     400885        interrupts.CPU22.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU22.MCP:Machine_check_polls
     17138 ± 29%     -13.1%      14884 ± 46%     +11.2%      19059 ± 13%  interrupts.CPU22.NMI:Non-maskable_interrupts
     17138 ± 29%     -13.1%      14884 ± 46%     +11.2%      19059 ± 13%  interrupts.CPU22.PMI:Performance_monitoring_interrupts
    555.33 ± 43%      -2.6%     540.67 ± 40%     -34.1%     366.00 ± 22%  interrupts.CPU22.RES:Rescheduling_interrupts
    470886 ± 25%      -9.0%     428590 ± 32%      +6.4%     501133 ± 27%  interrupts.CPU22.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU23.46:PCI-MSI.31981579-edge.i40e-eth0-TxRx-10
      3.00 ±141%     -88.9%       0.33 ±141%    -100.0%       0.00        interrupts.CPU23.59:PCI-MSI.31981592-edge.i40e-eth0-TxRx-23
      0.33 ±141%      +0.0%       0.33 ±141%    -100.0%       0.00        interrupts.CPU23.94:PCI-MSI.31981627-edge.i40e-eth0-TxRx-58
    526486 ±  8%     -43.1%     299585 ± 32%     -12.4%     461167 ± 15%  interrupts.CPU23.CAL:Function_call_interrupts
     53.00 ± 64%     -52.8%      25.00 ±127%     +21.4%      64.33 ± 23%  interrupts.CPU23.IWI:IRQ_work_interrupts
    406207            -6.9%     378081 ±  7%      -1.6%     399585        interrupts.CPU23.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU23.MCP:Machine_check_polls
     17383 ± 43%     -33.2%      11608 ± 60%     +11.1%      19320 ± 15%  interrupts.CPU23.NMI:Non-maskable_interrupts
     17383 ± 43%     -33.2%      11608 ± 60%     +11.1%      19320 ± 15%  interrupts.CPU23.PMI:Performance_monitoring_interrupts
    592.67 ± 11%     -16.3%     496.00 ± 37%     -36.3%     377.33 ± 33%  interrupts.CPU23.RES:Rescheduling_interrupts
    634502 ±  7%     -39.9%     381622 ± 32%     -10.5%     567846 ± 15%  interrupts.CPU23.TLB:TLB_shootdowns
      0.00       +3.1e+103%      30.67 ±141%    -100.0%       0.00        interrupts.CPU24.60:PCI-MSI.31981593-edge.i40e-eth0-TxRx-24
    626186 ±  8%     -36.6%     397180 ± 17%     -21.3%     492858 ± 20%  interrupts.CPU24.CAL:Function_call_interrupts
     49.67 ± 58%     +34.9%      67.00 ± 20%      +7.4%      53.33 ± 26%  interrupts.CPU24.IWI:IRQ_work_interrupts
    405954            -7.2%     376928 ±  6%      -1.6%     399622        interrupts.CPU24.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU24.MCP:Machine_check_polls
     17118 ± 22%     +19.4%      20442 ± 11%      -3.1%      16586 ± 17%  interrupts.CPU24.NMI:Non-maskable_interrupts
     17118 ± 22%     +19.4%      20442 ± 11%      -3.1%      16586 ± 17%  interrupts.CPU24.PMI:Performance_monitoring_interrupts
    541.33 ±  7%     -10.6%     484.00 ± 20%     -35.0%     352.00 ± 19%  interrupts.CPU24.RES:Rescheduling_interrupts
    742092 ±  7%     -32.3%     502742 ± 17%     -19.5%     597663 ± 19%  interrupts.CPU24.TLB:TLB_shootdowns
      0.00       +3.8e+103%      38.33 ± 84% +6.7e+101%       0.67 ±141%  interrupts.CPU25.61:PCI-MSI.31981594-edge.i40e-eth0-TxRx-25
    631634 ± 12%     -38.8%     386787 ± 22%     -21.2%     497497 ±  8%  interrupts.CPU25.CAL:Function_call_interrupts
     58.00 ± 49%     -35.1%      37.67 ± 76%      +0.6%      58.33 ±  7%  interrupts.CPU25.IWI:IRQ_work_interrupts
    405937            -6.4%     380097 ±  4%      -1.4%     400147        interrupts.CPU25.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU25.MCP:Machine_check_polls
     18304 ± 30%     -24.2%      13875 ± 41%      -1.2%      18084 ±  8%  interrupts.CPU25.NMI:Non-maskable_interrupts
     18304 ± 30%     -24.2%      13875 ± 41%      -1.2%      18084 ±  8%  interrupts.CPU25.PMI:Performance_monitoring_interrupts
    532.67 ± 15%      -5.3%     504.33 ± 36%     -31.7%     363.67 ± 19%  interrupts.CPU25.RES:Rescheduling_interrupts
    748513 ± 12%     -35.1%     486042 ± 22%     -19.0%     606520 ±  7%  interrupts.CPU25.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU26.305:PCI-MSI.67174400-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU26.306:PCI-MSI.67174400-edge.ioat-msix
      0.67 ±141%  +14950.0%     100.33 ±141%     +50.0%       1.00 ±141%  interrupts.CPU26.62:PCI-MSI.31981595-edge.i40e-eth0-TxRx-26
    614818 ±  2%     -39.3%     373169 ± 21%     -20.6%     488325 ±  6%  interrupts.CPU26.CAL:Function_call_interrupts
     39.67 ± 68%     -58.8%      16.33 ±115%     +33.6%      53.00 ± 44%  interrupts.CPU26.IWI:IRQ_work_interrupts
    405965            -7.1%     376998 ±  7%      -1.4%     400471        interrupts.CPU26.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU26.MCP:Machine_check_polls
     14483 ± 42%     -34.5%       9482 ± 43%     +13.4%      16418 ± 24%  interrupts.CPU26.NMI:Non-maskable_interrupts
     14483 ± 42%     -34.5%       9482 ± 43%     +13.4%      16418 ± 24%  interrupts.CPU26.PMI:Performance_monitoring_interrupts
    429.33 ±  8%      +9.6%     470.67 ± 29%      -9.1%     390.33 ± 11%  interrupts.CPU26.RES:Rescheduling_interrupts
    726518           -35.1%     471845 ± 21%     -18.2%     594355 ±  6%  interrupts.CPU26.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU27.307:PCI-MSI.67176448-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU27.308:PCI-MSI.67176448-edge.ioat-msix
      0.00         +2e+102%       2.00 ± 81%    -100.0%       0.00        interrupts.CPU27.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
    626552 ± 10%     -48.6%     321780 ±  5%     -23.3%     480801 ± 28%  interrupts.CPU27.CAL:Function_call_interrupts
     71.33 ± 25%     -23.4%      54.67 ± 22%     -42.5%      41.00 ± 53%  interrupts.CPU27.IWI:IRQ_work_interrupts
    405925            -5.8%     382267 ±  5%      -1.6%     399501        interrupts.CPU27.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU27.MCP:Machine_check_polls
     21779 ± 18%     -18.8%      17676 ± 15%     -36.4%      13850 ± 34%  interrupts.CPU27.NMI:Non-maskable_interrupts
     21779 ± 18%     -18.8%      17676 ± 15%     -36.4%      13850 ± 34%  interrupts.CPU27.PMI:Performance_monitoring_interrupts
    538.00 ± 15%      -0.2%     536.67 ± 26%     -22.3%     418.00 ± 29%  interrupts.CPU27.RES:Rescheduling_interrupts
    739486 ± 10%     -45.4%     403473 ±  5%     -21.1%     583527 ± 27%  interrupts.CPU27.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU28.308:PCI-MSI.67178496-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU28.309:PCI-MSI.67178496-edge.ioat-msix
      0.00          -100.0%       0.00         +3e+102%       3.00 ± 54%  interrupts.CPU28.64:PCI-MSI.31981597-edge.i40e-eth0-TxRx-28
    688450 ±  3%     -40.5%     409849 ±  7%     -42.9%     393403 ± 43%  interrupts.CPU28.CAL:Function_call_interrupts
     57.00 ± 33%     -47.4%      30.00 ± 82%     -10.5%      51.00 ± 69%  interrupts.CPU28.IWI:IRQ_work_interrupts
    406019            -6.9%     378187 ±  5%      -1.2%     401184        interrupts.CPU28.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU28.MCP:Machine_check_polls
     20813 ±  8%     -39.7%      12554 ± 42%     -23.8%      15869 ± 53%  interrupts.CPU28.NMI:Non-maskable_interrupts
     20813 ±  8%     -39.7%      12554 ± 42%     -23.8%      15869 ± 53%  interrupts.CPU28.PMI:Performance_monitoring_interrupts
    556.00 ± 27%     -15.3%     470.67 ± 18%     -47.6%     291.33 ± 52%  interrupts.CPU28.RES:Rescheduling_interrupts
    815172 ±  3%     -36.7%     515995 ±  7%     -41.4%     477423 ± 42%  interrupts.CPU28.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU29.309:PCI-MSI.67180544-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU29.310:PCI-MSI.67180544-edge.ioat-msix
      0.00       +1.1e+104%     106.00 ±115%    -100.0%       0.00        interrupts.CPU29.65:PCI-MSI.31981598-edge.i40e-eth0-TxRx-29
    601839 ± 19%     -36.5%     382381 ±  8%     -25.3%     449606 ± 11%  interrupts.CPU29.CAL:Function_call_interrupts
     66.00 ± 19%     -39.9%      39.67 ± 73%     -70.7%      19.33 ± 79%  interrupts.CPU29.IWI:IRQ_work_interrupts
    405810            -6.3%     380266 ±  5%      -1.3%     400622        interrupts.CPU29.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU29.MCP:Machine_check_polls
     20318 ± 14%     -30.2%      14175 ± 47%     -43.5%      11473 ± 10%  interrupts.CPU29.NMI:Non-maskable_interrupts
     20318 ± 14%     -30.2%      14175 ± 47%     -43.5%      11473 ± 10%  interrupts.CPU29.PMI:Performance_monitoring_interrupts
    508.00 ± 27%      +9.7%     557.33 ± 22%     -32.2%     344.67 ± 14%  interrupts.CPU29.RES:Rescheduling_interrupts
    712470 ± 19%     -32.8%     478606 ±  8%     -23.4%     546074 ± 11%  interrupts.CPU29.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU3.122:PCI-MSI.31981655-edge.i40e-eth0-TxRx-86
      1.33 ± 93%     -50.0%       0.67 ± 70%   +2950.0%      40.67 ±137%  interrupts.CPU3.39:PCI-MSI.31981572-edge.i40e-eth0-TxRx-3
      0.00       +3.3e+101%       0.33 ±141% +3.3e+101%       0.33 ±141%  interrupts.CPU3.74:PCI-MSI.31981607-edge.i40e-eth0-TxRx-38
    391271 ± 24%     -30.6%     271459 ± 28%     +14.7%     448877 ± 19%  interrupts.CPU3.CAL:Function_call_interrupts
     39.33 ± 69%     -44.1%      22.00 ± 87%     +46.6%      57.67 ± 57%  interrupts.CPU3.IWI:IRQ_work_interrupts
    405991            -4.7%     387035 ±  3%      -1.3%     400903        interrupts.CPU3.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU3.MCP:Machine_check_polls
     14440 ± 43%     -26.3%      10638 ± 34%     +22.0%      17620 ± 40%  interrupts.CPU3.NMI:Non-maskable_interrupts
     14440 ± 43%     -26.3%      10638 ± 34%     +22.0%      17620 ± 40%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    509.67 ± 32%      +0.6%     512.67 ±  7%     -20.9%     403.00 ± 15%  interrupts.CPU3.RES:Rescheduling_interrupts
    473147 ± 23%     -27.4%     343271 ± 28%     +16.7%     552061 ± 19%  interrupts.CPU3.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU30.311:PCI-MSI.67182592-edge.ioat-msix
      1.67 ±141%    +120.0%       3.67 ±141%   +1460.0%      26.00 ±138%  interrupts.CPU30.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
    505014 ±  8%     -36.2%     322110 ± 18%      +2.1%     515840 ±  8%  interrupts.CPU30.CAL:Function_call_interrupts
     39.67 ± 70%     -21.8%      31.00 ± 76%     +47.9%      58.67 ± 31%  interrupts.CPU30.IWI:IRQ_work_interrupts
    405943            -6.1%     381239 ±  5%      -1.3%     400574        interrupts.CPU30.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU30.MCP:Machine_check_polls
     14481 ± 45%     -15.5%      12231 ± 49%     +23.4%      17864 ± 23%  interrupts.CPU30.NMI:Non-maskable_interrupts
     14481 ± 45%     -15.5%      12231 ± 49%     +23.4%      17864 ± 23%  interrupts.CPU30.PMI:Performance_monitoring_interrupts
    454.67 ± 20%     -18.7%     369.67 ± 32%      -8.9%     414.00 ± 12%  interrupts.CPU30.RES:Rescheduling_interrupts
    596818 ±  8%     -32.1%     405465 ± 18%      +5.2%     627937 ±  9%  interrupts.CPU30.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU31.312:PCI-MSI.67184640-edge.ioat-msix
     15.67 ±132%    -100.0%       0.00           -80.9%       3.00 ± 81%  interrupts.CPU31.67:PCI-MSI.31981600-edge.i40e-eth0-TxRx-31
    691541 ± 14%     -56.4%     301829 ± 20%     -23.0%     532315 ± 40%  interrupts.CPU31.CAL:Function_call_interrupts
     23.00 ± 69%    +147.8%      57.00 ±  6%    +202.9%      69.67 ± 23%  interrupts.CPU31.IWI:IRQ_work_interrupts
    405963            -5.6%     383080 ±  5%      -1.7%     399138        interrupts.CPU31.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU31.MCP:Machine_check_polls
     10189 ± 38%     +92.5%      19610 ± 11%     +99.0%      20278 ± 17%  interrupts.CPU31.NMI:Non-maskable_interrupts
     10189 ± 38%     +92.5%      19610 ± 11%     +99.0%      20278 ± 17%  interrupts.CPU31.PMI:Performance_monitoring_interrupts
    531.33 ±  8%     -22.1%     414.00 ± 36%     -24.6%     400.67 ± 29%  interrupts.CPU31.RES:Rescheduling_interrupts
    819425 ± 13%     -53.7%     379582 ± 20%     -20.7%     650057 ± 40%  interrupts.CPU31.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU32.313:PCI-MSI.67186688-edge.ioat-msix
      2.33 ±141%    -100.0%       0.00           +28.6%       3.00 ± 98%  interrupts.CPU32.68:PCI-MSI.31981601-edge.i40e-eth0-TxRx-32
    655825 ± 10%     -66.1%     222139 ± 27%     -38.3%     404610 ± 26%  interrupts.CPU32.CAL:Function_call_interrupts
     47.33 ± 17%     -23.2%      36.33 ± 66%     -42.3%      27.33 ±123%  interrupts.CPU32.IWI:IRQ_work_interrupts
    406701            -4.7%     387456 ±  4%      -1.6%     400349        interrupts.CPU32.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU32.MCP:Machine_check_polls
     16035 ± 10%      -4.4%      15328 ± 31%     -26.9%      11720 ± 67%  interrupts.CPU32.NMI:Non-maskable_interrupts
     16035 ± 10%      -4.4%      15328 ± 31%     -26.9%      11720 ± 67%  interrupts.CPU32.PMI:Performance_monitoring_interrupts
    528.67 ± 20%     -43.4%     299.33 ± 30%     -43.4%     299.00 ± 26%  interrupts.CPU32.RES:Rescheduling_interrupts
    777089 ± 10%     -64.1%     278648 ± 27%     -36.9%     490622 ± 25%  interrupts.CPU32.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU33.314:PCI-MSI.67188736-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU33.315:PCI-MSI.67188736-edge.ioat-msix
     16.00 ±141%   +4533.3%     741.33 ±141%      -2.1%      15.67 ±119%  interrupts.CPU33.69:PCI-MSI.31981602-edge.i40e-eth0-TxRx-33
    613666 ±  6%     -37.0%     386460 ± 14%     -29.5%     432490 ±  8%  interrupts.CPU33.CAL:Function_call_interrupts
     33.00 ± 86%     +58.6%      52.33 ± 38%     +49.5%      49.33 ± 19%  interrupts.CPU33.IWI:IRQ_work_interrupts
    405886            -5.3%     384373 ±  3%      -1.2%     401023        interrupts.CPU33.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU33.MCP:Machine_check_polls
     13418 ± 48%     +22.4%      16430 ± 26%     +19.2%      15993 ± 14%  interrupts.CPU33.NMI:Non-maskable_interrupts
     13418 ± 48%     +22.4%      16430 ± 26%     +19.2%      15993 ± 14%  interrupts.CPU33.PMI:Performance_monitoring_interrupts
    466.00 ± 17%     -18.9%     378.00 ±  5%     -20.1%     372.33 ± 21%  interrupts.CPU33.RES:Rescheduling_interrupts
    726114 ±  6%     -32.7%     488738 ± 15%     -27.6%     525486 ±  9%  interrupts.CPU33.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU34.314:PCI-MSI.67188736-edge.ioat-msix
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU34.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34
    595589 ± 14%     -47.9%     310122 ± 28%     -36.3%     379289 ± 36%  interrupts.CPU34.CAL:Function_call_interrupts
     40.33 ± 81%     +12.4%      45.33 ± 64%     -13.2%      35.00 ± 60%  interrupts.CPU34.IWI:IRQ_work_interrupts
    406087            -6.5%     379508 ±  6%      -1.3%     400803        interrupts.CPU34.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU34.MCP:Machine_check_polls
     14479 ± 53%     +17.5%      17014 ± 41%     -10.3%      12991 ± 34%  interrupts.CPU34.NMI:Non-maskable_interrupts
     14479 ± 53%     +17.5%      17014 ± 41%     -10.3%      12991 ± 34%  interrupts.CPU34.PMI:Performance_monitoring_interrupts
    455.00 ± 12%     -29.4%     321.33 ± 43%     -40.8%     269.33 ± 55%  interrupts.CPU34.RES:Rescheduling_interrupts
    703599 ± 14%     -44.3%     391636 ± 29%     -34.3%     462123 ± 36%  interrupts.CPU34.TLB:TLB_shootdowns
    346.33 ±141%     -99.5%       1.67 ±141%     -99.3%       2.33 ± 88%  interrupts.CPU35.71:PCI-MSI.31981604-edge.i40e-eth0-TxRx-35
    620006 ± 33%     -40.5%     368973 ± 17%     -25.7%     460416 ±  2%  interrupts.CPU35.CAL:Function_call_interrupts
     41.33 ± 83%     -17.7%      34.00 ± 82%     +10.5%      45.67 ± 57%  interrupts.CPU35.IWI:IRQ_work_interrupts
    405870            -5.0%     385556 ±  3%      -1.2%     400905        interrupts.CPU35.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU35.MCP:Machine_check_polls
     16220 ± 50%     -16.7%      13504 ± 46%      -4.8%      15438 ± 38%  interrupts.CPU35.NMI:Non-maskable_interrupts
     16220 ± 50%     -16.7%      13504 ± 46%      -4.8%      15438 ± 38%  interrupts.CPU35.PMI:Performance_monitoring_interrupts
    537.00 ± 13%     -31.4%     368.33 ± 22%     -37.0%     338.33 ±  4%  interrupts.CPU35.RES:Rescheduling_interrupts
    730810 ± 33%     -36.3%     465606 ± 17%     -23.1%     562201 ±  3%  interrupts.CPU35.TLB:TLB_shootdowns
      0.33 ±141%    -100.0%       0.00         +9700.0%      32.67 ±141%  interrupts.CPU36.72:PCI-MSI.31981605-edge.i40e-eth0-TxRx-36
    651736 ±  4%     -64.2%     233413 ± 17%     -32.6%     439558 ± 11%  interrupts.CPU36.CAL:Function_call_interrupts
     45.67 ± 59%     +21.2%      55.33 ± 40%     -35.8%      29.33 ±102%  interrupts.CPU36.IWI:IRQ_work_interrupts
    405865            -4.2%     388962 ±  3%      -1.3%     400699        interrupts.CPU36.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU36.MCP:Machine_check_polls
     16219 ± 37%      +6.5%      17268 ± 30%     -35.1%      10521 ± 53%  interrupts.CPU36.NMI:Non-maskable_interrupts
     16219 ± 37%      +6.5%      17268 ± 30%     -35.1%      10521 ± 53%  interrupts.CPU36.PMI:Performance_monitoring_interrupts
    522.33 ± 18%     -33.5%     347.33 ± 24%     -31.3%     359.00 ± 13%  interrupts.CPU36.RES:Rescheduling_interrupts
    770327 ±  4%     -61.6%     296137 ± 18%     -30.6%     534663 ± 10%  interrupts.CPU36.TLB:TLB_shootdowns
      0.00       +1.7e+102%       1.67 ± 74% +6.7e+101%       0.67 ±141%  interrupts.CPU37.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
    475052 ± 20%     -35.9%     304583 ± 22%      -8.4%     434947 ± 31%  interrupts.CPU37.CAL:Function_call_interrupts
     61.67 ± 30%     -90.3%       6.00 ± 49%     -39.5%      37.33 ± 34%  interrupts.CPU37.IWI:IRQ_work_interrupts
    405937            -4.5%     387773 ±  3%      -1.5%     400025        interrupts.CPU37.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU37.MCP:Machine_check_polls
     20070 ± 20%     -58.0%       8438 ± 28%     -34.8%      13086 ± 24%  interrupts.CPU37.NMI:Non-maskable_interrupts
     20070 ± 20%     -58.0%       8438 ± 28%     -34.8%      13086 ± 24%  interrupts.CPU37.PMI:Performance_monitoring_interrupts
    456.67 ± 23%      -9.1%     415.00 ± 17%     -20.3%     364.00 ± 34%  interrupts.CPU37.RES:Rescheduling_interrupts
    561117 ± 20%     -32.0%     381463 ± 22%      -5.9%     528084 ± 30%  interrupts.CPU37.TLB:TLB_shootdowns
      0.00          -100.0%       0.00         +2e+104%     202.67 ±141%  interrupts.CPU38.74:PCI-MSI.31981607-edge.i40e-eth0-TxRx-38
    534257 ± 24%     -16.5%     446207 ± 13%      -8.2%     490379 ± 25%  interrupts.CPU38.CAL:Function_call_interrupts
     34.00 ± 67%     +79.4%      61.00 ±  6%     -64.7%      12.00 ± 64%  interrupts.CPU38.IWI:IRQ_work_interrupts
    406052            -7.9%     374160 ±  7%      -1.2%     401199        interrupts.CPU38.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU38.MCP:Machine_check_polls
     14549 ± 37%     +33.4%      19415           -43.6%       8211 ± 26%  interrupts.CPU38.NMI:Non-maskable_interrupts
     14549 ± 37%     +33.4%      19415           -43.6%       8211 ± 26%  interrupts.CPU38.PMI:Performance_monitoring_interrupts
    454.67 ±  6%     +32.6%     602.67 ± 18%     -19.6%     365.67 ± 12%  interrupts.CPU38.RES:Rescheduling_interrupts
    632492 ± 24%     -11.3%     560746 ± 13%      -5.5%     597811 ± 25%  interrupts.CPU38.TLB:TLB_shootdowns
      5.33 ±141%   +2212.5%     123.33 ±134%    +112.5%      11.33 ±129%  interrupts.CPU39.75:PCI-MSI.31981608-edge.i40e-eth0-TxRx-39
    525210 ± 23%     -29.7%     369392 ± 14%      -0.2%     524256 ± 15%  interrupts.CPU39.CAL:Function_call_interrupts
     18.33 ±125%    +112.7%      39.00 ± 75%    +123.6%      41.00 ± 42%  interrupts.CPU39.IWI:IRQ_work_interrupts
    406025            -5.3%     384600 ±  3%      -1.2%     400964        interrupts.CPU39.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU39.MCP:Machine_check_polls
     10294 ± 46%     +39.8%      14389 ± 42%     +41.2%      14539 ± 28%  interrupts.CPU39.NMI:Non-maskable_interrupts
     10294 ± 46%     +39.8%      14389 ± 42%     +41.2%      14539 ± 28%  interrupts.CPU39.PMI:Performance_monitoring_interrupts
    403.33 ± 21%     +20.5%     486.00 ± 24%      +5.0%     423.67 ± 14%  interrupts.CPU39.RES:Rescheduling_interrupts
    619108 ± 23%     -24.7%     465907 ± 15%      +3.6%     641554 ± 15%  interrupts.CPU39.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU4.123:PCI-MSI.31981656-edge.i40e-eth0-TxRx-87
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU4.295:PCI-MSI.65536-edge.ioat-msix
    228.33 ±140%     -99.9%       0.33 ±141%    -100.0%       0.00        interrupts.CPU4.40:PCI-MSI.31981573-edge.i40e-eth0-TxRx-4
      0.00       +6.7e+101%       0.67 ± 70%    -100.0%       0.00        interrupts.CPU4.75:PCI-MSI.31981608-edge.i40e-eth0-TxRx-39
    412315 ± 22%     -78.2%      90040 ± 41%     -17.3%     341137 ± 14%  interrupts.CPU4.CAL:Function_call_interrupts
     25.33 ±121%     -82.9%       4.33 ± 76%     -34.2%      16.67 ± 76%  interrupts.CPU4.IWI:IRQ_work_interrupts
    406072            -1.5%     400064            -1.3%     400832        interrupts.CPU4.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU4.MCP:Machine_check_polls
     11552 ± 61%     -36.8%       7301 ±  9%     -29.0%       8200 ± 26%  interrupts.CPU4.NMI:Non-maskable_interrupts
     11552 ± 61%     -36.8%       7301 ±  9%     -29.0%       8200 ± 26%  interrupts.CPU4.PMI:Performance_monitoring_interrupts
    504.00 ± 37%     -67.0%     166.33 ± 39%     -44.0%     282.00 ± 47%  interrupts.CPU4.RES:Rescheduling_interrupts
    496838 ± 21%     -77.1%     113875 ± 41%     -15.8%     418465 ± 14%  interrupts.CPU4.TLB:TLB_shootdowns
      1.00 ±141%    -100.0%       0.00           -66.7%       0.33 ±141%  interrupts.CPU40.76:PCI-MSI.31981609-edge.i40e-eth0-TxRx-40
    637502 ± 26%     -34.4%     418301 ± 11%     -40.3%     380609 ± 14%  interrupts.CPU40.CAL:Function_call_interrupts
     56.33 ± 68%      +8.3%      61.00 ± 17%     -63.3%      20.67 ± 16%  interrupts.CPU40.IWI:IRQ_work_interrupts
    405938            -6.2%     380677 ±  5%      -1.1%     401616        interrupts.CPU40.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU40.MCP:Machine_check_polls
     17750 ± 51%      +9.1%      19358 ± 12%     -44.0%       9933 ± 16%  interrupts.CPU40.NMI:Non-maskable_interrupts
     17750 ± 51%      +9.1%      19358 ± 12%     -44.0%       9933 ± 16%  interrupts.CPU40.PMI:Performance_monitoring_interrupts
    513.00 ± 13%      -7.3%     475.33 ±  3%     -41.3%     301.00 ± 19%  interrupts.CPU40.RES:Rescheduling_interrupts
    754779 ± 25%     -30.2%     526890 ± 11%     -38.5%     464230 ± 14%  interrupts.CPU40.TLB:TLB_shootdowns
      0.00       +2.8e+103%      28.33 ±141%    -100.0%       0.00        interrupts.CPU41.77:PCI-MSI.31981610-edge.i40e-eth0-TxRx-41
    677934 ±  7%     -41.5%     396844 ± 27%     -10.5%     606626 ±  6%  interrupts.CPU41.CAL:Function_call_interrupts
     55.67 ± 42%     +12.6%      62.67 ± 12%     +15.6%      64.33 ± 47%  interrupts.CPU41.IWI:IRQ_work_interrupts
    406071            -6.0%     381844 ±  4%      -1.7%     399087        interrupts.CPU41.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU41.MCP:Machine_check_polls
     17693 ± 27%     +16.9%      20680 ±  7%      +9.0%      19294 ± 38%  interrupts.CPU41.NMI:Non-maskable_interrupts
     17693 ± 27%     +16.9%      20680 ±  7%      +9.0%      19294 ± 38%  interrupts.CPU41.PMI:Performance_monitoring_interrupts
    534.67 ± 11%      +2.0%     545.33 ± 27%     -11.4%     473.67 ± 24%  interrupts.CPU41.RES:Rescheduling_interrupts
    801438 ±  7%     -37.6%     500167 ± 27%      -7.7%     739377 ±  6%  interrupts.CPU41.TLB:TLB_shootdowns
     13.33 ±141%    -100.0%       0.00          +122.5%      29.67 ± 71%  interrupts.CPU42.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
    592278 ± 22%     -29.5%     417438 ± 21%     -16.6%     494172 ± 17%  interrupts.CPU42.CAL:Function_call_interrupts
     51.33 ± 53%     -40.9%      30.33 ±113%     -34.4%      33.67 ± 85%  interrupts.CPU42.IWI:IRQ_work_interrupts
    406054            -6.4%     380011 ±  6%      -1.3%     400733        interrupts.CPU42.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU42.MCP:Machine_check_polls
     18373 ± 24%     -32.1%      12476 ± 55%     -30.5%      12773 ± 52%  interrupts.CPU42.NMI:Non-maskable_interrupts
     18373 ± 24%     -32.1%      12476 ± 55%     -30.5%      12773 ± 52%  interrupts.CPU42.PMI:Performance_monitoring_interrupts
    547.67 ± 26%     -14.0%     471.00 ±  8%     -36.3%     348.67 ± 18%  interrupts.CPU42.RES:Rescheduling_interrupts
    700185 ± 22%     -24.7%     527165 ± 21%     -14.1%     601242 ± 17%  interrupts.CPU42.TLB:TLB_shootdowns
     17.67 ±141%     -90.6%       1.67 ±141%    -100.0%       0.00        interrupts.CPU43.79:PCI-MSI.31981612-edge.i40e-eth0-TxRx-43
    735529 ± 14%     -49.1%     374248 ± 14%     -23.4%     563492 ± 10%  interrupts.CPU43.CAL:Function_call_interrupts
     64.33 ± 14%     -28.0%      46.33 ± 47%     -36.8%      40.67 ± 80%  interrupts.CPU43.IWI:IRQ_work_interrupts
    405941            -5.2%     384655 ±  3%      -1.5%     399808        interrupts.CPU43.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU43.MCP:Machine_check_polls
     18679 ± 10%      -5.1%      17735 ± 19%     -27.0%      13644 ± 58%  interrupts.CPU43.NMI:Non-maskable_interrupts
     18679 ± 10%      -5.1%      17735 ± 19%     -27.0%      13644 ± 58%  interrupts.CPU43.PMI:Performance_monitoring_interrupts
    606.33 ± 21%     -31.4%     415.67 ± 11%     -32.3%     410.67 ± 12%  interrupts.CPU43.RES:Rescheduling_interrupts
    869529 ± 14%     -45.8%     471427 ± 14%     -20.9%     688141 ± 10%  interrupts.CPU43.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141% +3.3e+101%       0.33 ±141%  interrupts.CPU44.80:PCI-MSI.31981613-edge.i40e-eth0-TxRx-44
    668953 ±  5%     -42.3%     385700 ±  9%     -25.0%     501953 ±  9%  interrupts.CPU44.CAL:Function_call_interrupts
     47.67 ± 73%     -76.9%      11.00 ± 80%     -67.8%      15.33 ± 77%  interrupts.CPU44.IWI:IRQ_work_interrupts
    406637            -6.2%     381527 ±  4%      -1.7%     399885        interrupts.CPU44.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU44.MCP:Machine_check_polls
     15491 ± 59%     -46.7%       8255 ± 18%     -40.3%       9253 ± 30%  interrupts.CPU44.NMI:Non-maskable_interrupts
     15491 ± 59%     -46.7%       8255 ± 18%     -40.3%       9253 ± 30%  interrupts.CPU44.PMI:Performance_monitoring_interrupts
    531.33 ± 22%      -1.3%     524.67 ± 18%     -38.1%     328.67 ±  6%  interrupts.CPU44.RES:Rescheduling_interrupts
    791112 ±  5%     -38.3%     488045 ±  8%     -22.4%     613748 ±  8%  interrupts.CPU44.TLB:TLB_shootdowns
    165.33 ±141%     -99.6%       0.67 ± 70%     -99.6%       0.67 ±141%  interrupts.CPU45.81:PCI-MSI.31981614-edge.i40e-eth0-TxRx-45
    578029 ± 12%     -32.2%     391983 ±  8%      -3.5%     557547 ± 16%  interrupts.CPU45.CAL:Function_call_interrupts
     41.00 ± 79%     +69.9%      69.67 ± 10%     +39.8%      57.33 ± 56%  interrupts.CPU45.IWI:IRQ_work_interrupts
    405990            -6.0%     381819 ±  4%      -1.3%     400655        interrupts.CPU45.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU45.MCP:Machine_check_polls
     14620 ± 51%     +46.0%      21340 ±  4%     +18.1%      17261 ± 34%  interrupts.CPU45.NMI:Non-maskable_interrupts
     14620 ± 51%     +46.0%      21340 ±  4%     +18.1%      17261 ± 34%  interrupts.CPU45.PMI:Performance_monitoring_interrupts
    492.67 ± 17%     +10.3%     543.33 ±  8%     -26.2%     363.67 ± 13%  interrupts.CPU45.RES:Rescheduling_interrupts
    683300 ± 12%     -27.2%     497474 ±  8%      +0.1%     683962 ± 16%  interrupts.CPU45.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +9.3e+102%       9.33 ± 72%  interrupts.CPU46.82:PCI-MSI.31981615-edge.i40e-eth0-TxRx-46
    549790 ± 11%     -20.5%     437212 ± 13%      -3.8%     529125 ± 21%  interrupts.CPU46.CAL:Function_call_interrupts
     27.33 ± 84%     +50.0%      41.00 ± 72%     +62.2%      44.33 ± 51%  interrupts.CPU46.IWI:IRQ_work_interrupts
    406344            -7.8%     374636 ±  6%      -1.5%     400205        interrupts.CPU46.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU46.MCP:Machine_check_polls
     11344 ± 38%     +31.8%      14953 ± 42%     +38.5%      15710 ± 28%  interrupts.CPU46.NMI:Non-maskable_interrupts
     11344 ± 38%     +31.8%      14953 ± 42%     +38.5%      15710 ± 28%  interrupts.CPU46.PMI:Performance_monitoring_interrupts
    435.33 ± 30%     +24.1%     540.33 ± 27%     -13.1%     378.33 ± 21%  interrupts.CPU46.RES:Rescheduling_interrupts
    650482 ± 12%     -15.1%     551948 ± 13%      -0.9%     644575 ± 20%  interrupts.CPU46.TLB:TLB_shootdowns
      0.00         +1e+102%       1.00 ± 81%   +1e+102%       1.00 ±141%  interrupts.CPU47.83:PCI-MSI.31981616-edge.i40e-eth0-TxRx-47
    672667 ±  6%     -47.2%     355385 ± 16%      -5.7%     634165 ± 11%  interrupts.CPU47.CAL:Function_call_interrupts
     50.00 ± 45%      +1.3%      50.67 ± 34%     +38.7%      69.33 ± 27%  interrupts.CPU47.IWI:IRQ_work_interrupts
    406006            -5.7%     382835 ±  5%      -1.9%     398481 ±  2%  interrupts.CPU47.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU47.MCP:Machine_check_polls
     17340 ± 23%      +1.2%      17545 ± 13%     +22.2%      21185 ± 17%  interrupts.CPU47.NMI:Non-maskable_interrupts
     17340 ± 23%      +1.2%      17545 ± 13%     +22.2%      21185 ± 17%  interrupts.CPU47.PMI:Performance_monitoring_interrupts
    534.33 ± 26%     -26.4%     393.33 ± 11%     -11.0%     475.67 ± 22%  interrupts.CPU47.RES:Rescheduling_interrupts
    795301 ±  6%     -43.7%     448110 ± 16%      -2.9%     772409 ± 10%  interrupts.CPU47.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU48.47:PCI-MSI.31981580-edge.i40e-eth0-TxRx-11
      9874 ±141%    -100.0%       0.33 ±141%    -100.0%       1.00 ±141%  interrupts.CPU48.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU48.95:PCI-MSI.31981628-edge.i40e-eth0-TxRx-59
    582755 ± 10%     -44.7%     322024 ± 14%     -15.0%     495329 ± 22%  interrupts.CPU48.CAL:Function_call_interrupts
     81.67 ±  3%     -58.0%      34.33 ± 69%     -19.2%      66.00 ± 20%  interrupts.CPU48.IWI:IRQ_work_interrupts
    406297            -6.8%     378574 ±  6%      -2.0%     398086 ±  2%  interrupts.CPU48.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU48.MCP:Machine_check_polls
     23897 ±  2%     -47.5%      12551 ± 43%     -18.7%      19417 ± 19%  interrupts.CPU48.NMI:Non-maskable_interrupts
     23897 ±  2%     -47.5%      12551 ± 43%     -18.7%      19417 ± 19%  interrupts.CPU48.PMI:Performance_monitoring_interrupts
    712.67 ± 19%     -25.3%     532.67 ± 25%     -33.6%     473.00 ± 54%  interrupts.CPU48.RES:Rescheduling_interrupts
    704515 ± 10%     -41.7%     410698 ± 13%     -13.5%     609709 ± 22%  interrupts.CPU48.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU49.48:PCI-MSI.31981581-edge.i40e-eth0-TxRx-12
      0.00         +2e+105%       2013 ±141%   +1e+102%       1.00 ±141%  interrupts.CPU49.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
      0.00       +6.7e+101%       0.67 ± 70%    -100.0%       0.00        interrupts.CPU49.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
    489273 ±  8%     -46.9%     259718 ± 41%     -21.4%     384476 ± 13%  interrupts.CPU49.CAL:Function_call_interrupts
     38.67 ± 80%     -69.0%      12.00 ±117%     -32.8%      26.00 ± 67%  interrupts.CPU49.IWI:IRQ_work_interrupts
    406142            -4.3%     388575 ±  3%      -1.3%     400982        interrupts.CPU49.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU49.MCP:Machine_check_polls
     16806 ± 31%     -56.7%       7275 ± 42%     -36.3%      10710 ± 34%  interrupts.CPU49.NMI:Non-maskable_interrupts
     16806 ± 31%     -56.7%       7275 ± 42%     -36.3%      10710 ± 34%  interrupts.CPU49.PMI:Performance_monitoring_interrupts
    548.00 ± 11%     -20.2%     437.33 ± 50%     -38.0%     340.00 ± 47%  interrupts.CPU49.RES:Rescheduling_interrupts
    590674 ±  8%     -44.8%     326075 ± 42%     -19.7%     474553 ± 13%  interrupts.CPU49.TLB:TLB_shootdowns
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU5.124:PCI-MSI.31981657-edge.i40e-eth0-TxRx-88
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU5.297:PCI-MSI.67584-edge.ioat-msix
      0.00       +1.3e+102%       1.33 ± 93%    -100.0%       0.00        interrupts.CPU5.41:PCI-MSI.31981574-edge.i40e-eth0-TxRx-5
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU5.76:PCI-MSI.31981609-edge.i40e-eth0-TxRx-40
    323696 ± 25%     -13.2%     280967 ± 18%     +11.2%     360054 ± 30%  interrupts.CPU5.CAL:Function_call_interrupts
     54.00 ± 44%     -37.0%      34.00 ± 86%     -69.1%      16.67 ± 76%  interrupts.CPU5.IWI:IRQ_work_interrupts
    406016            -5.2%     385063 ±  3%      -1.3%     400914        interrupts.CPU5.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU5.MCP:Machine_check_polls
     17180 ± 34%     -24.2%      13015 ± 52%     -50.6%       8485 ± 33%  interrupts.CPU5.NMI:Non-maskable_interrupts
     17180 ± 34%     -24.2%      13015 ± 52%     -50.6%       8485 ± 33%  interrupts.CPU5.PMI:Performance_monitoring_interrupts
    429.33 ± 18%      -3.0%     416.67 ± 45%     -13.8%     370.00 ± 59%  interrupts.CPU5.RES:Rescheduling_interrupts
    391387 ± 24%      -8.9%     356642 ± 18%     +12.9%     441739 ± 29%  interrupts.CPU5.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU50.295:PCI-MSI.65536-edge.ioat-msix
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU50.49:PCI-MSI.31981582-edge.i40e-eth0-TxRx-13
    278.33 ±133%    -100.0%       0.00           -99.5%       1.33 ± 93%  interrupts.CPU50.86:PCI-MSI.31981619-edge.i40e-eth0-TxRx-50
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU50.97:PCI-MSI.31981630-edge.i40e-eth0-TxRx-61
    456351 ±  9%     -32.7%     307112 ± 33%      -8.8%     416160 ± 16%  interrupts.CPU50.CAL:Function_call_interrupts
     54.67 ± 63%     -22.0%      42.67 ± 58%     -22.6%      42.33 ± 70%  interrupts.CPU50.IWI:IRQ_work_interrupts
    405962            -6.4%     379953 ±  5%      -1.2%     401093        interrupts.CPU50.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU50.MCP:Machine_check_polls
     18331 ± 41%      -6.8%      17083 ±  7%     -20.1%      14638 ± 40%  interrupts.CPU50.NMI:Non-maskable_interrupts
     18331 ± 41%      -6.8%      17083 ±  7%     -20.1%      14638 ± 40%  interrupts.CPU50.PMI:Performance_monitoring_interrupts
    553.33 ±  5%      -6.4%     518.00 ± 32%     -26.7%     405.67 ± 19%  interrupts.CPU50.RES:Rescheduling_interrupts
    549669 ±  9%     -29.4%     387843 ± 33%      -6.2%     515700 ± 17%  interrupts.CPU50.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU51.3:IO-APIC.3-edge
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU51.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
      3.00 ±141%   +1622.2%      51.67 ±138%     -88.9%       0.33 ±141%  interrupts.CPU51.87:PCI-MSI.31981620-edge.i40e-eth0-TxRx-51
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU51.98:PCI-MSI.31981631-edge.i40e-eth0-TxRx-62
    482509 ± 12%     -33.8%     319373 ± 37%     -14.6%     411947 ± 21%  interrupts.CPU51.CAL:Function_call_interrupts
     47.67 ± 54%      -8.4%      43.67 ± 68%     -58.0%      20.00 ± 88%  interrupts.CPU51.IWI:IRQ_work_interrupts
    406250            -7.1%     377396 ±  5%      -1.7%     399497        interrupts.CPU51.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU51.MCP:Machine_check_polls
     16513 ± 33%      -9.1%      15014 ± 45%     -39.6%       9976 ± 33%  interrupts.CPU51.NMI:Non-maskable_interrupts
     16513 ± 33%      -9.1%      15014 ± 45%     -39.6%       9976 ± 33%  interrupts.CPU51.PMI:Performance_monitoring_interrupts
    612.67 ± 18%     -15.8%     515.67 ± 40%     -43.5%     346.00 ± 39%  interrupts.CPU51.RES:Rescheduling_interrupts
    580841 ± 13%     -30.2%     405445 ± 37%     -12.7%     507354 ± 21%  interrupts.CPU51.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU52.297:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU52.51:PCI-MSI.31981584-edge.i40e-eth0-TxRx-15
     28.33 ±141%     -97.6%       0.67 ±141%    -100.0%       0.00        interrupts.CPU52.88:PCI-MSI.31981621-edge.i40e-eth0-TxRx-52
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU52.99:PCI-MSI.31981632-edge.i40e-eth0-TxRx-63
    474637 ± 13%      +5.4%     500351 ± 11%      +4.2%     494380 ± 13%  interrupts.CPU52.CAL:Function_call_interrupts
     60.33 ± 48%      +5.5%      63.67 ±  9%      +1.1%      61.00 ± 23%  interrupts.CPU52.IWI:IRQ_work_interrupts
    406062            -9.5%     367361 ±  8%      -1.4%     400536        interrupts.CPU52.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU52.MCP:Machine_check_polls
     19272 ± 32%      +2.0%      19665 ±  4%      -4.4%      18430 ± 20%  interrupts.CPU52.NMI:Non-maskable_interrupts
     19272 ± 32%      +2.0%      19665 ±  4%      -4.4%      18430 ± 20%  interrupts.CPU52.PMI:Performance_monitoring_interrupts
    599.33 ± 14%     +26.5%     758.33 ± 18%     -28.0%     431.67 ±  7%  interrupts.CPU52.RES:Rescheduling_interrupts
    572909 ± 13%     +10.8%     634553 ± 11%      +6.7%     611048 ± 13%  interrupts.CPU52.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU53.100:PCI-MSI.31981633-edge.i40e-eth0-TxRx-64
      0.33 ±141%    -100.0%       0.00            +0.0%       0.33 ±141%  interrupts.CPU53.52:PCI-MSI.31981585-edge.i40e-eth0-TxRx-16
     25.33 ±141%    -100.0%       0.00           +30.3%      33.00 ±141%  interrupts.CPU53.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
    568183 ±  4%     -45.7%     308623 ± 17%     -12.4%     497869 ± 26%  interrupts.CPU53.CAL:Function_call_interrupts
     33.33 ± 66%     -22.0%      26.00 ± 67%     +60.0%      53.33 ± 20%  interrupts.CPU53.IWI:IRQ_work_interrupts
    405986            -6.2%     380919 ±  5%      -1.2%     400953        interrupts.CPU53.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU53.MCP:Machine_check_polls
     13336 ± 22%     -19.8%      10693 ± 32%     +27.6%      17014 ± 16%  interrupts.CPU53.NMI:Non-maskable_interrupts
     13336 ± 22%     -19.8%      10693 ± 32%     +27.6%      17014 ± 16%  interrupts.CPU53.PMI:Performance_monitoring_interrupts
    680.00 ± 18%     -24.2%     515.33 ± 10%     -39.0%     415.00 ± 13%  interrupts.CPU53.RES:Rescheduling_interrupts
    683513 ±  4%     -42.9%     390555 ± 16%     -10.3%     613284 ± 26%  interrupts.CPU53.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU54.101:PCI-MSI.31981634-edge.i40e-eth0-TxRx-65
      0.67 ± 70%     -50.0%       0.33 ±141%      +0.0%       0.67 ± 70%  interrupts.CPU54.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
     38.00 ± 49%     -21.1%      30.00 ±127%     -64.0%      13.67 ±141%  interrupts.CPU54.90:PCI-MSI.31981623-edge.i40e-eth0-TxRx-54
    476446 ±  5%     -46.9%     253144 ± 42%      +0.3%     477820 ± 26%  interrupts.CPU54.CAL:Function_call_interrupts
     50.00 ± 68%     -20.7%      39.67 ± 73%     -19.3%      40.33 ± 87%  interrupts.CPU54.IWI:IRQ_work_interrupts
    406006            -5.9%     382210 ±  6%      -1.1%     401486        interrupts.CPU54.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU54.MCP:Machine_check_polls
     15852 ± 42%     -11.4%      14045 ± 42%     -10.0%      14260 ± 49%  interrupts.CPU54.NMI:Non-maskable_interrupts
     15852 ± 42%     -11.4%      14045 ± 42%     -10.0%      14260 ± 49%  interrupts.CPU54.PMI:Performance_monitoring_interrupts
    554.33 ±  5%     -24.1%     421.00 ± 22%     -28.7%     395.00 ±  5%  interrupts.CPU54.RES:Rescheduling_interrupts
    573528 ±  6%     -44.1%     320367 ± 41%      +2.5%     587694 ± 26%  interrupts.CPU54.TLB:TLB_shootdowns
      0.33 ±141%    -100.0%       0.00            +0.0%       0.33 ±141%  interrupts.CPU55.102:PCI-MSI.31981635-edge.i40e-eth0-TxRx-66
      0.67 ± 70%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU55.54:PCI-MSI.31981587-edge.i40e-eth0-TxRx-18
      0.00       +1.5e+103%      14.67 ±127% +3.3e+101%       0.33 ±141%  interrupts.CPU55.91:PCI-MSI.31981624-edge.i40e-eth0-TxRx-55
    499688 ± 11%     -35.0%     324925 ± 24%     -23.9%     380328 ± 29%  interrupts.CPU55.CAL:Function_call_interrupts
     38.33 ± 76%     +13.0%      43.33 ± 67%     -44.3%      21.33 ±121%  interrupts.CPU55.IWI:IRQ_work_interrupts
    406037            -5.9%     382156 ±  4%      -1.4%     400555        interrupts.CPU55.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU55.MCP:Machine_check_polls
     13726 ± 52%      +9.3%      15004 ± 39%     -20.0%      10977 ± 49%  interrupts.CPU55.NMI:Non-maskable_interrupts
     13726 ± 52%      +9.3%      15004 ± 39%     -20.0%      10977 ± 49%  interrupts.CPU55.PMI:Performance_monitoring_interrupts
    574.33 ± 24%     -10.3%     515.33 ± 50%     -42.0%     333.00 ± 37%  interrupts.CPU55.RES:Rescheduling_interrupts
    601639 ± 12%     -31.7%     411190 ± 24%     -22.0%     468986 ± 29%  interrupts.CPU55.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU56.103:PCI-MSI.31981636-edge.i40e-eth0-TxRx-67
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU56.297:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU56.3:IO-APIC.3-edge
      0.67 ± 70%    -100.0%       0.00            +0.0%       0.67 ± 70%  interrupts.CPU56.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
      0.33 ±141%    +500.0%       2.00 ±141%      +0.0%       0.33 ±141%  interrupts.CPU56.92:PCI-MSI.31981625-edge.i40e-eth0-TxRx-56
    410250 ±  3%     -38.5%     252320 ± 26%      +5.3%     432085 ± 10%  interrupts.CPU56.CAL:Function_call_interrupts
      2.00         +1916.7%      40.33 ± 51%   +1016.7%      22.33 ± 67%  interrupts.CPU56.IWI:IRQ_work_interrupts
    406271            -6.0%     382066 ±  5%      -1.2%     401193        interrupts.CPU56.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU56.MCP:Machine_check_polls
      5927 ± 16%    +170.4%      16028 ± 24%     +67.4%       9920 ± 34%  interrupts.CPU56.NMI:Non-maskable_interrupts
      5927 ± 16%    +170.4%      16028 ± 24%     +67.4%       9920 ± 34%  interrupts.CPU56.PMI:Performance_monitoring_interrupts
    572.00 ± 15%     -34.8%     373.00 ± 26%     -38.9%     349.33 ± 30%  interrupts.CPU56.RES:Rescheduling_interrupts
    492860 ±  2%     -34.8%     321473 ± 25%      +8.0%     532509 ± 10%  interrupts.CPU56.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU57.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU57.3:IO-APIC.3-edge
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU57.56:PCI-MSI.31981589-edge.i40e-eth0-TxRx-20
      1.00 ± 81%    +600.0%       7.00 ±141%     +66.7%       1.67 ± 74%  interrupts.CPU57.93:PCI-MSI.31981626-edge.i40e-eth0-TxRx-57
    479324 ± 27%     -25.8%     355751 ± 15%     -36.9%     302613 ± 50%  interrupts.CPU57.CAL:Function_call_interrupts
      9.33 ±111%    +189.3%      27.00 ±103%     -82.1%       1.67 ± 28%  interrupts.CPU57.IWI:IRQ_work_interrupts
    406313            -7.1%     377436 ±  6%      -1.4%     400705        interrupts.CPU57.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU57.MCP:Machine_check_polls
      7814 ± 30%     +51.1%      11805 ± 52%     -24.3%       5915        interrupts.CPU57.NMI:Non-maskable_interrupts
      7814 ± 30%     +51.1%      11805 ± 52%     -24.3%       5915        interrupts.CPU57.PMI:Performance_monitoring_interrupts
    550.67 ± 23%     -38.0%     341.33 ± 15%     -43.1%     313.33 ± 60%  interrupts.CPU57.RES:Rescheduling_interrupts
    580825 ± 27%     -22.2%     451600 ± 15%     -35.9%     372037 ± 50%  interrupts.CPU57.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU58.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU58.3:IO-APIC.3-edge
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU58.57:PCI-MSI.31981590-edge.i40e-eth0-TxRx-21
     11.33 ±135%     -67.6%       3.67 ±141%    -100.0%       0.00        interrupts.CPU58.94:PCI-MSI.31981627-edge.i40e-eth0-TxRx-58
    506539 ± 18%     -28.3%     363256 ± 22%      -3.3%     490005 ± 22%  interrupts.CPU58.CAL:Function_call_interrupts
     54.00 ± 55%      +3.1%      55.67 ± 35%     -14.8%      46.00 ± 69%  interrupts.CPU58.IWI:IRQ_work_interrupts
    405991            -7.6%     374956 ±  7%      -1.3%     400845        interrupts.CPU58.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU58.MCP:Machine_check_polls
     17646 ± 32%      -2.5%      17197 ± 31%     -19.5%      14210 ± 47%  interrupts.CPU58.NMI:Non-maskable_interrupts
     17646 ± 32%      -2.5%      17197 ± 31%     -19.5%      14210 ± 47%  interrupts.CPU58.PMI:Performance_monitoring_interrupts
    641.33 ± 14%     -23.0%     493.67 ± 20%     -43.2%     364.33 ± 21%  interrupts.CPU58.RES:Rescheduling_interrupts
    610188 ± 18%     -24.6%     460228 ± 22%      -0.8%     605292 ± 23%  interrupts.CPU58.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU59.106:PCI-MSI.31981639-edge.i40e-eth0-TxRx-70
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU59.297:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU59.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
    202.33 ±141%    -100.0%       0.00           -92.9%      14.33 ±126%  interrupts.CPU59.95:PCI-MSI.31981628-edge.i40e-eth0-TxRx-59
    466674 ±  9%     -21.7%     365350 ±  2%     -18.9%     378506 ± 38%  interrupts.CPU59.CAL:Function_call_interrupts
     37.33 ±103%     +55.4%      58.00 ± 44%     -43.8%      21.00 ± 80%  interrupts.CPU59.IWI:IRQ_work_interrupts
    406023            -6.6%     379413 ±  5%      -1.1%     401592        interrupts.CPU59.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU59.MCP:Machine_check_polls
     16194 ± 38%      +7.6%      17422 ± 34%     -44.0%       9074 ± 32%  interrupts.CPU59.NMI:Non-maskable_interrupts
     16194 ± 38%      +7.6%      17422 ± 34%     -44.0%       9074 ± 32%  interrupts.CPU59.PMI:Performance_monitoring_interrupts
    456.33 ± 26%     +24.0%     565.67 ± 27%     -21.8%     357.00 ± 57%  interrupts.CPU59.RES:Rescheduling_interrupts
    564068 ±  9%     -17.9%     462948 ±  2%     -17.3%     466320 ± 38%  interrupts.CPU59.TLB:TLB_shootdowns
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU6.125:PCI-MSI.31981658-edge.i40e-eth0-TxRx-89
     13.67 ±141%     -97.6%       0.33 ±141%     -97.6%       0.33 ±141%  interrupts.CPU6.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU6.77:PCI-MSI.31981610-edge.i40e-eth0-TxRx-41
    399374 ± 18%     -17.5%     329438 ± 32%      -4.6%     381146 ± 30%  interrupts.CPU6.CAL:Function_call_interrupts
     28.33 ±124%     -12.9%      24.67 ±129%     +36.5%      38.67 ± 77%  interrupts.CPU6.IWI:IRQ_work_interrupts
    406107            -5.2%     384846 ±  3%      -1.6%     399513        interrupts.CPU6.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU6.MCP:Machine_check_polls
     11873 ± 71%      -8.6%      10847 ± 70%     +10.2%      13088 ± 42%  interrupts.CPU6.NMI:Non-maskable_interrupts
     11873 ± 71%      -8.6%      10847 ± 70%     +10.2%      13088 ± 42%  interrupts.CPU6.PMI:Performance_monitoring_interrupts
    556.67 ± 22%     -20.8%     441.00 ± 37%     -31.3%     382.67 ± 58%  interrupts.CPU6.RES:Rescheduling_interrupts
    481684 ± 17%     -13.4%     417322 ± 32%      -2.5%     469682 ± 30%  interrupts.CPU6.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ± 70%  interrupts.CPU60.107:PCI-MSI.31981640-edge.i40e-eth0-TxRx-71
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU60.59:PCI-MSI.31981592-edge.i40e-eth0-TxRx-23
     25.67 ±138%     -98.7%       0.33 ±141%    -100.0%       0.00        interrupts.CPU60.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
    509559 ±  9%     -59.4%     206835 ± 49%     -17.1%     422217 ± 23%  interrupts.CPU60.CAL:Function_call_interrupts
     56.67 ± 21%     -14.1%      48.67 ± 50%     -78.2%      12.33 ±118%  interrupts.CPU60.IWI:IRQ_work_interrupts
    405899            -5.6%     382996 ±  6%      -1.6%     399420        interrupts.CPU60.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU60.MCP:Machine_check_polls
     18240 ± 16%     -12.7%      15923 ± 29%     -59.5%       7395 ± 38%  interrupts.CPU60.NMI:Non-maskable_interrupts
     18240 ± 16%     -12.7%      15923 ± 29%     -59.5%       7395 ± 38%  interrupts.CPU60.PMI:Performance_monitoring_interrupts
    567.67 ± 29%     -42.6%     325.67 ± 48%     -26.2%     419.00 ± 41%  interrupts.CPU60.RES:Rescheduling_interrupts
    614693 ±  9%     -57.3%     262405 ± 49%     -15.7%     518321 ± 23%  interrupts.CPU60.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%    -100.0%       0.00        interrupts.CPU61.108:PCI-MSI.31981641-edge.i40e-eth0-TxRx-72
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU61.3:IO-APIC.3-edge
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU61.60:PCI-MSI.31981593-edge.i40e-eth0-TxRx-24
      1.33 ±141%     +50.0%       2.00 ±141%    -100.0%       0.00        interrupts.CPU61.97:PCI-MSI.31981630-edge.i40e-eth0-TxRx-61
    396610 ± 34%     -37.3%     248695 ± 53%      -7.1%     368315 ± 21%  interrupts.CPU61.CAL:Function_call_interrupts
     43.67 ± 18%      -4.6%      41.67 ± 68%      +8.4%      47.33 ± 59%  interrupts.CPU61.IWI:IRQ_work_interrupts
    405939            -3.7%     390781 ±  2%      -1.3%     400764        interrupts.CPU61.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU61.MCP:Machine_check_polls
     15927            -2.5%      15526 ± 35%      -5.8%      15005 ± 38%  interrupts.CPU61.NMI:Non-maskable_interrupts
     15927            -2.5%      15526 ± 35%      -5.8%      15005 ± 38%  interrupts.CPU61.PMI:Performance_monitoring_interrupts
    418.33 ±  8%     +10.8%     463.33 ± 42%      -9.8%     377.33 ± 44%  interrupts.CPU61.RES:Rescheduling_interrupts
    480579 ± 34%     -34.8%     313486 ± 53%      -5.3%     455212 ± 21%  interrupts.CPU61.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU62.109:PCI-MSI.31981642-edge.i40e-eth0-TxRx-73
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU62.297:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU62.61:PCI-MSI.31981594-edge.i40e-eth0-TxRx-25
      1.67 ±101%    -100.0%       0.00        +34940.0%     584.00 ±141%  interrupts.CPU62.98:PCI-MSI.31981631-edge.i40e-eth0-TxRx-62
    474207 ± 36%     -40.4%     282496 ± 44%     -31.5%     324736 ± 23%  interrupts.CPU62.CAL:Function_call_interrupts
     58.00 ± 41%     -35.1%      37.67 ± 74%     -71.8%      16.33 ± 78%  interrupts.CPU62.IWI:IRQ_work_interrupts
    406078            -4.9%     386332 ±  3%      -1.1%     401522        interrupts.CPU62.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU62.MCP:Machine_check_polls
     18320 ± 24%     -19.3%      14778 ± 37%     -34.3%      12044 ± 36%  interrupts.CPU62.NMI:Non-maskable_interrupts
     18320 ± 24%     -19.3%      14778 ± 37%     -34.3%      12044 ± 36%  interrupts.CPU62.PMI:Performance_monitoring_interrupts
    601.00 ± 22%     -25.6%     447.00 ± 52%     -41.1%     354.00 ± 19%  interrupts.CPU62.RES:Rescheduling_interrupts
    571613 ± 36%     -37.8%     355421 ± 44%     -29.9%     400541 ± 23%  interrupts.CPU62.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU63.110:PCI-MSI.31981643-edge.i40e-eth0-TxRx-74
      0.67 ± 70%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU63.62:PCI-MSI.31981595-edge.i40e-eth0-TxRx-26
      1.67 ± 74%    -100.0%       0.00           -20.0%       1.33 ±141%  interrupts.CPU63.99:PCI-MSI.31981632-edge.i40e-eth0-TxRx-63
    471835 ±  9%     -47.8%     246444 ± 22%      -4.9%     448749 ± 21%  interrupts.CPU63.CAL:Function_call_interrupts
     39.00 ± 68%     +22.2%      47.67 ± 34%     -11.1%      34.67 ± 88%  interrupts.CPU63.IWI:IRQ_work_interrupts
    406023            -5.3%     384514 ±  4%      -1.7%     399143        interrupts.CPU63.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU63.MCP:Machine_check_polls
     14018 ± 47%      +8.2%      15165 ± 23%     -11.5%      12401 ± 44%  interrupts.CPU63.NMI:Non-maskable_interrupts
     14018 ± 47%      +8.2%      15165 ± 23%     -11.5%      12401 ± 44%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
    554.33 ±  7%     -46.3%     297.67 ± 18%     -23.4%     424.67 ± 36%  interrupts.CPU63.RES:Rescheduling_interrupts
    569765 ± 10%     -45.4%     311100 ± 22%      -3.0%     552440 ± 21%  interrupts.CPU63.TLB:TLB_shootdowns
      1.33 ± 93%    +650.0%      10.00 ±141%     -75.0%       0.33 ±141%  interrupts.CPU64.100:PCI-MSI.31981633-edge.i40e-eth0-TxRx-64
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU64.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU64.4:IO-APIC.4-edge.ttyS0
      0.00       +3.3e+101%       0.33 ±141% +3.3e+101%       0.33 ±141%  interrupts.CPU64.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
    443915 ± 15%     -20.8%     351444 ± 20%     +19.7%     531311 ± 20%  interrupts.CPU64.CAL:Function_call_interrupts
     46.67 ± 64%      -5.7%      44.00 ± 40%     -61.4%      18.00 ± 62%  interrupts.CPU64.IWI:IRQ_work_interrupts
    406093            -6.9%     378077 ±  5%      -1.8%     398601 ±  2%  interrupts.CPU64.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU64.MCP:Machine_check_polls
     15752 ± 44%      -5.9%      14823 ± 21%     -39.8%       9478 ± 31%  interrupts.CPU64.NMI:Non-maskable_interrupts
     15752 ± 44%      -5.9%      14823 ± 21%     -39.8%       9478 ± 31%  interrupts.CPU64.PMI:Performance_monitoring_interrupts
    439.33 ± 28%      +8.0%     474.33 ± 21%      +4.6%     459.33 ± 42%  interrupts.CPU64.RES:Rescheduling_interrupts
    536036 ± 14%     -17.1%     444279 ± 21%     +22.7%     657767 ± 20%  interrupts.CPU64.TLB:TLB_shootdowns
      4.33 ± 96%    +207.7%      13.33 ±125%    +192.3%      12.67 ±135%  interrupts.CPU65.101:PCI-MSI.31981634-edge.i40e-eth0-TxRx-65
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU65.112:PCI-MSI.31981645-edge.i40e-eth0-TxRx-76
      0.00          -100.0%       0.00       +6.7e+101%       0.67 ± 70%  interrupts.CPU65.64:PCI-MSI.31981597-edge.i40e-eth0-TxRx-28
    533032 ± 18%     -46.1%     287314 ± 37%     -25.6%     396619 ± 49%  interrupts.CPU65.CAL:Function_call_interrupts
     78.67 ±  7%     -34.3%      51.67 ± 37%     -54.7%      35.67 ± 94%  interrupts.CPU65.IWI:IRQ_work_interrupts
    405870            -6.3%     380458 ±  4%      -1.4%     399985        interrupts.CPU65.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU65.MCP:Machine_check_polls
     22141 ± 12%     -23.5%      16942 ± 21%     -44.1%      12386 ± 49%  interrupts.CPU65.NMI:Non-maskable_interrupts
     22141 ± 12%     -23.5%      16942 ± 21%     -44.1%      12386 ± 49%  interrupts.CPU65.PMI:Performance_monitoring_interrupts
    635.33 ± 11%     -16.7%     529.00 ± 41%     -40.1%     380.33 ± 54%  interrupts.CPU65.RES:Rescheduling_interrupts
    643026 ± 17%     -43.8%     361112 ± 37%     -24.0%     488687 ± 50%  interrupts.CPU65.TLB:TLB_shootdowns
     58.00 ±129%     -89.7%       6.00 ±141%     -84.5%       9.00 ± 74%  interrupts.CPU66.102:PCI-MSI.31981635-edge.i40e-eth0-TxRx-66
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU66.113:PCI-MSI.31981646-edge.i40e-eth0-TxRx-77
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU66.65:PCI-MSI.31981598-edge.i40e-eth0-TxRx-29
    492020 ±  4%     -46.6%     262891 ±  6%     -12.9%     428659 ± 27%  interrupts.CPU66.CAL:Function_call_interrupts
     67.33 ± 33%     -46.5%      36.00 ± 65%     -86.6%       9.00 ±109%  interrupts.CPU66.IWI:IRQ_work_interrupts
    405977            -4.7%     387080 ±  3%      -1.6%     399352        interrupts.CPU66.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU66.MCP:Machine_check_polls
     19988 ± 22%     -33.2%      13360 ± 33%     -63.8%       7229 ± 41%  interrupts.CPU66.NMI:Non-maskable_interrupts
     19988 ± 22%     -33.2%      13360 ± 33%     -63.8%       7229 ± 41%  interrupts.CPU66.PMI:Performance_monitoring_interrupts
    560.33 ± 22%     -31.5%     384.00 ± 37%     -30.5%     389.33 ± 47%  interrupts.CPU66.RES:Rescheduling_interrupts
    594329 ±  4%     -44.2%     331741 ±  7%     -11.2%     527935 ± 26%  interrupts.CPU66.TLB:TLB_shootdowns
    530.00 ±141%     -99.9%       0.33 ±141%     -94.5%      29.00 ±122%  interrupts.CPU67.103:PCI-MSI.31981636-edge.i40e-eth0-TxRx-67
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU67.114:PCI-MSI.31981647-edge.i40e-eth0-TxRx-78
      0.33 ±141%      +0.0%       0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU67.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
    333633 ± 12%     -45.2%     182938 ± 43%      +7.7%     359197 ± 19%  interrupts.CPU67.CAL:Function_call_interrupts
     22.00 ±125%     -34.8%      14.33 ±111%     +92.4%      42.33 ± 76%  interrupts.CPU67.IWI:IRQ_work_interrupts
    406352            -4.0%     389991 ±  2%      -1.4%     400652        interrupts.CPU67.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU67.MCP:Machine_check_polls
     10126 ± 62%     -13.3%       8777 ± 49%     +40.1%      14188 ± 54%  interrupts.CPU67.NMI:Non-maskable_interrupts
     10126 ± 62%     -13.3%       8777 ± 49%     +40.1%      14188 ± 54%  interrupts.CPU67.PMI:Performance_monitoring_interrupts
    487.00 ±  2%     -23.6%     372.00 ± 35%     -33.6%     323.33 ± 57%  interrupts.CPU67.RES:Rescheduling_interrupts
    403225 ± 13%     -43.0%     230032 ± 42%     +10.3%     444640 ± 18%  interrupts.CPU67.TLB:TLB_shootdowns
      0.33 ±141%  +27900.0%      93.33 ±141%   +1000.0%       3.67 ±141%  interrupts.CPU68.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU68.115:PCI-MSI.31981648-edge.i40e-eth0-TxRx-79
      0.33 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU68.67:PCI-MSI.31981600-edge.i40e-eth0-TxRx-31
    410521 ± 13%     -40.3%     244977 ± 13%      -2.7%     399283 ± 21%  interrupts.CPU68.CAL:Function_call_interrupts
     39.67 ± 51%     -49.6%      20.00 ±116%     -88.2%       4.67 ± 66%  interrupts.CPU68.IWI:IRQ_work_interrupts
    406071            -4.1%     389539 ±  2%      -1.5%     400176        interrupts.CPU68.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU68.MCP:Machine_check_polls
     13584 ± 33%     -29.8%       9541 ± 53%     -32.4%       9185 ± 49%  interrupts.CPU68.NMI:Non-maskable_interrupts
     13584 ± 33%     -29.8%       9541 ± 53%     -32.4%       9185 ± 49%  interrupts.CPU68.PMI:Performance_monitoring_interrupts
    579.67 ± 16%     -38.2%     358.33 ± 12%     -37.5%     362.33 ± 49%  interrupts.CPU68.RES:Rescheduling_interrupts
    495148 ± 13%     -37.5%     309667 ± 14%      -0.7%     491466 ± 21%  interrupts.CPU68.TLB:TLB_shootdowns
      2.33 ± 88%     -71.4%       0.67 ± 70%    -100.0%       0.00        interrupts.CPU69.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU69.116:PCI-MSI.31981649-edge.i40e-eth0-TxRx-80
      0.33 ±141%    -100.0%       0.00            +0.0%       0.33 ±141%  interrupts.CPU69.68:PCI-MSI.31981601-edge.i40e-eth0-TxRx-32
    551559 ± 11%     -44.9%     304007 ± 24%     -43.6%     311264 ± 35%  interrupts.CPU69.CAL:Function_call_interrupts
     54.67 ± 41%     -60.4%      21.67 ± 79%     -95.7%       2.33 ± 53%  interrupts.CPU69.IWI:IRQ_work_interrupts
    406054            -5.3%     384622 ±  3%      -1.1%     401528        interrupts.CPU69.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU69.MCP:Machine_check_polls
     17307 ± 29%     -42.1%      10018 ± 33%     -61.3%       6698 ± 28%  interrupts.CPU69.NMI:Non-maskable_interrupts
     17307 ± 29%     -42.1%      10018 ± 33%     -61.3%       6698 ± 28%  interrupts.CPU69.PMI:Performance_monitoring_interrupts
    665.33 ± 11%     -30.9%     459.67 ± 39%     -59.8%     267.67 ± 39%  interrupts.CPU69.RES:Rescheduling_interrupts
    663646 ± 12%     -41.7%     386944 ± 23%     -42.3%     382741 ± 35%  interrupts.CPU69.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU7.126:PCI-MSI.31981659-edge.i40e-eth0-TxRx-90
    254.33 ±  2%      +0.7%     256.00            +8.0%     274.67 ±  4%  interrupts.CPU7.35:PCI-MSI.31981568-edge.i40e-0000:3d:00.0:misc
      0.00       +1.3e+102%       1.33 ±141% +1.7e+103%      17.00 ±141%  interrupts.CPU7.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU7.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
    371965 ± 23%     -28.6%     265737 ± 24%     +29.7%     482488 ± 24%  interrupts.CPU7.CAL:Function_call_interrupts
     37.67 ± 53%     -30.1%      26.33 ±114%     +53.1%      57.67 ± 68%  interrupts.CPU7.IWI:IRQ_work_interrupts
    406037            -5.2%     384735 ±  5%      -1.2%     401178        interrupts.CPU7.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU7.MCP:Machine_check_polls
     14657 ± 22%     -16.1%      12291 ± 55%     +16.4%      17059 ± 45%  interrupts.CPU7.NMI:Non-maskable_interrupts
     14657 ± 22%     -16.1%      12291 ± 55%     +16.4%      17059 ± 45%  interrupts.CPU7.PMI:Performance_monitoring_interrupts
    500.33 ± 18%     -26.1%     369.67 ± 49%     -21.8%     391.33 ± 12%  interrupts.CPU7.RES:Rescheduling_interrupts
    449389 ± 22%     -24.9%     337335 ± 24%     +32.0%     593038 ± 25%  interrupts.CPU7.TLB:TLB_shootdowns
      1.00 ± 81%    -100.0%       0.00           -66.7%       0.33 ±141%  interrupts.CPU70.106:PCI-MSI.31981639-edge.i40e-eth0-TxRx-70
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU70.117:PCI-MSI.31981650-edge.i40e-eth0-TxRx-81
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU70.298:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU70.69:PCI-MSI.31981602-edge.i40e-eth0-TxRx-33
    537913 ± 17%     -50.6%     265635 ± 27%     -21.3%     423367 ± 41%  interrupts.CPU70.CAL:Function_call_interrupts
     32.67 ± 14%     -50.0%      16.33 ±119%     -60.2%      13.00 ±119%  interrupts.CPU70.IWI:IRQ_work_interrupts
    405918            -4.0%     389625 ±  2%      -1.5%     400006        interrupts.CPU70.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU70.MCP:Machine_check_polls
     12582 ± 15%     -31.1%       8670 ± 41%     -37.3%       7892 ± 38%  interrupts.CPU70.NMI:Non-maskable_interrupts
     12582 ± 15%     -31.1%       8670 ± 41%     -37.3%       7892 ± 38%  interrupts.CPU70.PMI:Performance_monitoring_interrupts
    566.33 ± 18%     -42.4%     326.33 ± 21%     -25.7%     420.67 ± 49%  interrupts.CPU70.RES:Rescheduling_interrupts
    649429 ± 18%     -48.1%     337251 ± 27%     -19.8%     520634 ± 41%  interrupts.CPU70.TLB:TLB_shootdowns
      0.00       +1.3e+103%      12.67 ±141% +6.7e+101%       0.67 ±141%  interrupts.CPU71.107:PCI-MSI.31981640-edge.i40e-eth0-TxRx-71
      0.00          -100.0%       0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU71.118:PCI-MSI.31981651-edge.i40e-eth0-TxRx-82
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU71.298:PCI-MSI.69632-edge.ioat-msix
      0.33 ±141%    -100.0%       0.00          +100.0%       0.67 ± 70%  interrupts.CPU71.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34
    401512 ±  6%     -28.0%     289239 ± 28%      -1.9%     393791 ± 18%  interrupts.CPU71.CAL:Function_call_interrupts
     57.00 ± 66%     -12.9%      49.67 ± 53%     -40.9%      33.67 ±105%  interrupts.CPU71.IWI:IRQ_work_interrupts
    406066            -4.6%     387349 ±  2%      -1.2%     401210        interrupts.CPU71.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU71.MCP:Machine_check_polls
     17401 ± 50%      -8.0%      16015 ± 36%     -33.7%      11537 ± 67%  interrupts.CPU71.NMI:Non-maskable_interrupts
     17401 ± 50%      -8.0%      16015 ± 36%     -33.7%      11537 ± 67%  interrupts.CPU71.PMI:Performance_monitoring_interrupts
    497.00 ± 13%      -7.6%     459.00 ± 41%     -28.2%     357.00 ± 17%  interrupts.CPU71.RES:Rescheduling_interrupts
    483544 ±  7%     -24.5%     365284 ± 29%      +0.4%     485325 ± 18%  interrupts.CPU71.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +1.3e+102%       1.33 ± 70%  interrupts.CPU72.108:PCI-MSI.31981641-edge.i40e-eth0-TxRx-72
    391767 ± 19%     -35.1%     254141 ± 23%      -5.6%     369998 ± 15%  interrupts.CPU72.CAL:Function_call_interrupts
     39.67 ± 97%     -66.4%      13.33 ± 96%      +0.0%      39.67 ± 63%  interrupts.CPU72.IWI:IRQ_work_interrupts
    406216            -3.8%     390895 ±  2%      -1.0%     402170        interrupts.CPU72.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU72.MCP:Machine_check_polls
     13818 ± 59%     -42.1%       7994 ± 40%      +7.8%      14895 ± 38%  interrupts.CPU72.NMI:Non-maskable_interrupts
     13818 ± 59%     -42.1%       7994 ± 40%      +7.8%      14895 ± 38%  interrupts.CPU72.PMI:Performance_monitoring_interrupts
    353.33 ± 22%     -13.6%     305.33 ± 22%     -14.6%     301.67 ± 13%  interrupts.CPU72.RES:Rescheduling_interrupts
    464879 ± 20%     -30.8%     321539 ± 23%      -2.8%     452067 ± 16%  interrupts.CPU72.TLB:TLB_shootdowns
      0.00         +1e+102%       1.00 ±141% +3.3e+101%       0.33 ±141%  interrupts.CPU73.109:PCI-MSI.31981642-edge.i40e-eth0-TxRx-73
    375098 ± 26%     -30.8%     259461 ± 25%      +7.1%     401679 ± 10%  interrupts.CPU73.CAL:Function_call_interrupts
     26.33 ±128%     +43.0%      37.67 ± 78%     -49.4%      13.33 ± 53%  interrupts.CPU73.IWI:IRQ_work_interrupts
    406872            -4.4%     388793 ±  4%      -1.3%     401459        interrupts.CPU73.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU73.MCP:Machine_check_polls
     11366 ± 62%     +17.2%      13324 ± 51%      -6.3%      10645 ± 27%  interrupts.CPU73.NMI:Non-maskable_interrupts
     11366 ± 62%     +17.2%      13324 ± 51%      -6.3%      10645 ± 27%  interrupts.CPU73.PMI:Performance_monitoring_interrupts
    313.67 ± 34%      +5.7%     331.67 ± 31%     +16.0%     364.00 ±  2%  interrupts.CPU73.RES:Rescheduling_interrupts
    445257 ± 27%     -25.4%     332038 ± 25%      +9.8%     488679 ± 11%  interrupts.CPU73.TLB:TLB_shootdowns
      0.33 ±141%  +19200.0%      64.33 ±140%    +100.0%       0.67 ± 70%  interrupts.CPU74.110:PCI-MSI.31981643-edge.i40e-eth0-TxRx-74
    367896 ± 11%     -29.7%     258694 ± 29%      +7.4%     395003 ± 15%  interrupts.CPU74.CAL:Function_call_interrupts
     62.00 ± 54%     -14.5%      53.00 ± 37%     -65.6%      21.33 ± 79%  interrupts.CPU74.IWI:IRQ_work_interrupts
    406270            -3.7%     391131 ±  2%      -1.2%     401293        interrupts.CPU74.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU74.MCP:Machine_check_polls
     18187 ± 35%      -9.9%      16381 ± 25%     -41.5%      10643 ± 23%  interrupts.CPU74.NMI:Non-maskable_interrupts
     18187 ± 35%      -9.9%      16381 ± 25%     -41.5%      10643 ± 23%  interrupts.CPU74.PMI:Performance_monitoring_interrupts
    403.33 ± 32%     -14.3%     345.67 ± 35%     -25.6%     300.00 ± 12%  interrupts.CPU74.RES:Rescheduling_interrupts
    436412 ± 11%     -24.6%     329016 ± 29%     +10.4%     481854 ± 15%  interrupts.CPU74.TLB:TLB_shootdowns
      1250 ±141%    -100.0%       0.00           -99.8%       3.00 ±118%  interrupts.CPU75.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
    339144 ± 19%     -21.2%     267312 ±  6%     +12.4%     381364 ± 22%  interrupts.CPU75.CAL:Function_call_interrupts
     16.00 ±123%     +35.4%      21.67 ± 72%    +141.7%      38.67 ± 48%  interrupts.CPU75.IWI:IRQ_work_interrupts
    406125            -4.9%     386289 ±  3%      -0.9%     402607        interrupts.CPU75.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU75.MCP:Machine_check_polls
      9006 ± 50%      +4.6%       9420 ± 40%     +64.1%      14780 ± 25%  interrupts.CPU75.NMI:Non-maskable_interrupts
      9006 ± 50%      +4.6%       9420 ± 40%     +64.1%      14780 ± 25%  interrupts.CPU75.PMI:Performance_monitoring_interrupts
    283.00 ± 27%     +10.2%     312.00 ± 18%     -15.1%     240.33 ± 10%  interrupts.CPU75.RES:Rescheduling_interrupts
    402100 ± 19%     -16.0%     337918 ±  5%     +15.8%     465564 ± 22%  interrupts.CPU75.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU76.112:PCI-MSI.31981645-edge.i40e-eth0-TxRx-76
    309381 ±  6%     -29.2%     218922           +59.0%     491921 ± 27%  interrupts.CPU76.CAL:Function_call_interrupts
      7.33 ± 75%    +445.5%      40.00 ± 58%    +345.5%      32.67 ±104%  interrupts.CPU76.IWI:IRQ_work_interrupts
    406164            -4.2%     389164 ±  3%      -1.0%     402212        interrupts.CPU76.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU76.MCP:Machine_check_polls
      6704 ± 22%     +99.6%      13381 ± 43%     +93.9%      13001 ± 63%  interrupts.CPU76.NMI:Non-maskable_interrupts
      6704 ± 22%     +99.6%      13381 ± 43%     +93.9%      13001 ± 63%  interrupts.CPU76.PMI:Performance_monitoring_interrupts
    257.00 ± 18%     +24.9%     321.00 ±  9%     +42.4%     366.00 ± 12%  interrupts.CPU76.RES:Rescheduling_interrupts
    367450 ±  5%     -24.3%     278039           +63.9%     602166 ± 28%  interrupts.CPU76.TLB:TLB_shootdowns
      0.00       +6.7e+101%       0.67 ±141%    -100.0%       0.00        interrupts.CPU77.113:PCI-MSI.31981646-edge.i40e-eth0-TxRx-77
    334856 ± 38%     -27.1%     243994 ± 21%     +24.4%     416704 ± 15%  interrupts.CPU77.CAL:Function_call_interrupts
     20.33 ± 91%     +73.8%      35.33 ± 89%    +154.1%      51.67 ± 34%  interrupts.CPU77.IWI:IRQ_work_interrupts
    406205            -4.9%     386349 ±  3%      -1.2%     401405        interrupts.CPU77.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU77.MCP:Machine_check_polls
      9580 ± 47%     +29.6%      12415 ± 55%     +67.2%      16016 ± 29%  interrupts.CPU77.NMI:Non-maskable_interrupts
      9580 ± 47%     +29.6%      12415 ± 55%     +67.2%      16016 ± 29%  interrupts.CPU77.PMI:Performance_monitoring_interrupts
    335.00 ± 35%     -10.9%     298.33 ± 28%      +9.0%     365.00 ± 18%  interrupts.CPU77.RES:Rescheduling_interrupts
    395218 ± 38%     -21.5%     310317 ± 20%     +28.8%     509080 ± 15%  interrupts.CPU77.TLB:TLB_shootdowns
      0.00       +6.7e+101%       0.67 ±141% +2.4e+104%     238.00 ±141%  interrupts.CPU78.114:PCI-MSI.31981647-edge.i40e-eth0-TxRx-78
    418010 ± 19%     -33.5%     277840 ± 22%     -19.6%     335933 ± 19%  interrupts.CPU78.CAL:Function_call_interrupts
     42.33 ± 55%     -18.1%      34.67 ± 46%     -66.1%      14.33 ±121%  interrupts.CPU78.IWI:IRQ_work_interrupts
    406365            -5.0%     386138 ±  3%      -1.2%     401325        interrupts.CPU78.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU78.MCP:Machine_check_polls
     15266 ± 25%     -17.8%      12549 ± 24%     -48.0%       7944 ± 37%  interrupts.CPU78.NMI:Non-maskable_interrupts
     15266 ± 25%     -17.8%      12549 ± 24%     -48.0%       7944 ± 37%  interrupts.CPU78.PMI:Performance_monitoring_interrupts
    368.67 ± 21%     +18.7%     437.67 ± 24%     -26.8%     270.00 ± 18%  interrupts.CPU78.RES:Rescheduling_interrupts
    496672 ± 19%     -29.1%     352231 ± 23%     -17.6%     409397 ± 18%  interrupts.CPU78.TLB:TLB_shootdowns
      0.00       +1.7e+102%       1.67 ±101% +3.3e+101%       0.33 ±141%  interrupts.CPU79.115:PCI-MSI.31981648-edge.i40e-eth0-TxRx-79
    244918 ± 55%     +18.5%     290346 ± 28%     +39.3%     341066 ± 52%  interrupts.CPU79.CAL:Function_call_interrupts
     62.00 ± 25%     -89.8%       6.33 ± 96%     -82.3%      11.00 ±115%  interrupts.CPU79.IWI:IRQ_work_interrupts
    406570            -4.9%     386467 ±  3%      -1.0%     402613        interrupts.CPU79.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU79.MCP:Machine_check_polls
     19292 ± 12%     -68.0%       6176 ±  9%     -60.2%       7673 ± 25%  interrupts.CPU79.NMI:Non-maskable_interrupts
     19292 ± 12%     -68.0%       6176 ±  9%     -60.2%       7673 ± 25%  interrupts.CPU79.PMI:Performance_monitoring_interrupts
    298.67 ± 69%     +29.9%     388.00 ± 37%      -2.3%     291.67 ± 39%  interrupts.CPU79.RES:Rescheduling_interrupts
    289855 ± 55%     +27.1%     368288 ± 27%     +42.7%     413528 ± 53%  interrupts.CPU79.TLB:TLB_shootdowns
      0.00       +6.7e+101%       0.67 ± 70% +3.3e+101%       0.33 ±141%  interrupts.CPU8.127:PCI-MSI.31981660-edge.i40e-eth0-TxRx-91
      0.00       +1.8e+104%     175.33 ±141%    -100.0%       0.00        interrupts.CPU8.44:PCI-MSI.31981577-edge.i40e-eth0-TxRx-8
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU8.79:PCI-MSI.31981612-edge.i40e-eth0-TxRx-43
    493612 ±  6%     -32.1%     335243 ± 12%     -12.5%     431711 ±  8%  interrupts.CPU8.CAL:Function_call_interrupts
     83.00           -69.9%      25.00 ± 66%     -24.9%      62.33 ± 16%  interrupts.CPU8.IWI:IRQ_work_interrupts
    405932            -5.4%     383836 ±  3%      -1.5%     400025        interrupts.CPU8.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU8.MCP:Machine_check_polls
     24233           -54.1%      11117 ± 30%     -25.3%      18104 ± 10%  interrupts.CPU8.NMI:Non-maskable_interrupts
     24233           -54.1%      11117 ± 30%     -25.3%      18104 ± 10%  interrupts.CPU8.PMI:Performance_monitoring_interrupts
    572.00 ± 19%      -7.3%     530.33 ± 38%     -33.2%     382.00 ± 20%  interrupts.CPU8.RES:Rescheduling_interrupts
    596825 ±  5%     -28.9%     424179 ± 13%     -11.3%     529365 ±  8%  interrupts.CPU8.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +1.3e+102%       1.33 ±141%  interrupts.CPU80.116:PCI-MSI.31981649-edge.i40e-eth0-TxRx-80
    359457 ± 18%      +9.6%     394073 ± 14%     +40.4%     504603 ± 18%  interrupts.CPU80.CAL:Function_call_interrupts
     34.33 ± 35%      +3.9%      35.67 ± 59%     +60.2%      55.00 ± 58%  interrupts.CPU80.IWI:IRQ_work_interrupts
    406171            -6.4%     379990 ±  5%      -1.2%     401246        interrupts.CPU80.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU80.MCP:Machine_check_polls
     13284 ± 25%      -3.6%      12803 ± 34%     +27.4%      16927 ± 40%  interrupts.CPU80.NMI:Non-maskable_interrupts
     13284 ± 25%      -3.6%      12803 ± 34%     +27.4%      16927 ± 40%  interrupts.CPU80.PMI:Performance_monitoring_interrupts
    304.33 ± 20%     +78.4%     543.00 ± 13%     +19.1%     362.33 ±  9%  interrupts.CPU80.RES:Rescheduling_interrupts
    426030 ± 17%     +17.4%     500211 ± 14%     +44.7%     616450 ± 18%  interrupts.CPU80.TLB:TLB_shootdowns
      0.00       +2.3e+104%     228.33 ±140%    -100.0%       0.00        interrupts.CPU81.117:PCI-MSI.31981650-edge.i40e-eth0-TxRx-81
    363025 ± 12%     -37.7%     226073 ± 37%     +19.6%     434005 ± 12%  interrupts.CPU81.CAL:Function_call_interrupts
     51.67 ± 57%     -58.1%      21.67 ± 81%     -39.4%      31.33 ± 40%  interrupts.CPU81.IWI:IRQ_work_interrupts
    407309            -5.7%     384208 ±  5%      -1.5%     401143        interrupts.CPU81.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU81.MCP:Machine_check_polls
     16904 ± 36%     -39.4%      10236 ± 38%     -23.6%      12918 ± 18%  interrupts.CPU81.NMI:Non-maskable_interrupts
     16904 ± 36%     -39.4%      10236 ± 38%     -23.6%      12918 ± 18%  interrupts.CPU81.PMI:Performance_monitoring_interrupts
    325.67 ± 25%     +28.9%     419.67 ± 32%     -11.2%     289.33 ±  9%  interrupts.CPU81.RES:Rescheduling_interrupts
    430316 ± 12%     -33.5%     286251 ± 37%     +23.6%     531947 ± 12%  interrupts.CPU81.TLB:TLB_shootdowns
      2.00 ±141%     -66.7%       0.67 ±141%  +18900.0%     380.00 ±141%  interrupts.CPU82.118:PCI-MSI.31981651-edge.i40e-eth0-TxRx-82
    329803 ± 29%      -4.3%     315544 ± 26%     +36.7%     450716 ± 36%  interrupts.CPU82.CAL:Function_call_interrupts
     32.67 ± 66%     -24.5%      24.67 ±113%     +38.8%      45.33 ± 50%  interrupts.CPU82.IWI:IRQ_work_interrupts
    406334            -4.1%     389525 ±  2%      -1.2%     401651        interrupts.CPU82.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU82.MCP:Machine_check_polls
     12303 ± 37%     -21.8%       9623 ± 52%     +23.7%      15214 ± 36%  interrupts.CPU82.NMI:Non-maskable_interrupts
     12303 ± 37%     -21.8%       9623 ± 52%     +23.7%      15214 ± 36%  interrupts.CPU82.PMI:Performance_monitoring_interrupts
    347.67 ± 53%     +31.8%     458.33 ± 20%     +16.2%     404.00 ± 11%  interrupts.CPU82.RES:Rescheduling_interrupts
    390955 ± 29%      +1.2%     395612 ± 27%     +40.8%     550522 ± 36%  interrupts.CPU82.TLB:TLB_shootdowns
    202.67 ±141%    -100.0%       0.00           -95.9%       8.33 ±141%  interrupts.CPU83.119:PCI-MSI.31981652-edge.i40e-eth0-TxRx-83
    342981 ± 68%     -28.3%     246050 ± 38%      +7.7%     369320 ± 11%  interrupts.CPU83.CAL:Function_call_interrupts
     36.67 ±102%      +1.8%      37.33 ± 86%     +10.9%      40.67 ± 66%  interrupts.CPU83.IWI:IRQ_work_interrupts
    406001            -5.6%     383303 ±  5%      -1.2%     401295        interrupts.CPU83.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU83.MCP:Machine_check_polls
     13569 ± 58%      -3.7%      13061 ± 52%      +7.2%      14545 ± 46%  interrupts.CPU83.NMI:Non-maskable_interrupts
     13569 ± 58%      -3.7%      13061 ± 52%      +7.2%      14545 ± 46%  interrupts.CPU83.PMI:Performance_monitoring_interrupts
    294.67 ± 74%     +42.6%     420.33 ± 37%     +22.6%     361.33 ± 11%  interrupts.CPU83.RES:Rescheduling_interrupts
    408140 ± 68%     -24.1%     309953 ± 38%     +10.2%     449932 ± 11%  interrupts.CPU83.TLB:TLB_shootdowns
      5.67 ±141%      -5.9%       5.33 ±141%    -100.0%       0.00        interrupts.CPU84.120:PCI-MSI.31981653-edge.i40e-eth0-TxRx-84
    292903 ± 11%     +29.4%     379037 ± 13%     +38.4%     405511 ± 12%  interrupts.CPU84.CAL:Function_call_interrupts
     17.00 ±108%     -41.2%      10.00 ± 57%    +139.2%      40.67 ± 77%  interrupts.CPU84.IWI:IRQ_work_interrupts
    406118            -6.5%     379889 ±  5%      -1.1%     401482        interrupts.CPU84.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU84.MCP:Machine_check_polls
     11652 ± 31%     -34.8%       7600 ± 16%     +28.0%      14909 ± 50%  interrupts.CPU84.NMI:Non-maskable_interrupts
     11652 ± 31%     -34.8%       7600 ± 16%     +28.0%      14909 ± 50%  interrupts.CPU84.PMI:Performance_monitoring_interrupts
    281.67 ± 28%     +68.4%     474.33 ± 16%      +9.1%     307.33 ± 15%  interrupts.CPU84.RES:Rescheduling_interrupts
    347512 ± 12%     +37.6%     478345 ± 13%     +42.4%     495028 ± 12%  interrupts.CPU84.TLB:TLB_shootdowns
      0.67 ±141%    -100.0%       0.00           -50.0%       0.33 ±141%  interrupts.CPU85.121:PCI-MSI.31981654-edge.i40e-eth0-TxRx-85
    457065 ± 13%     -28.4%     327187 ± 29%      -5.6%     431539 ± 27%  interrupts.CPU85.CAL:Function_call_interrupts
     17.67 ±121%    +288.7%      68.67 ± 10%    +139.6%      42.33 ± 25%  interrupts.CPU85.IWI:IRQ_work_interrupts
    406546            -6.7%     379235 ±  5%      -1.2%     401857        interrupts.CPU85.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU85.MCP:Machine_check_polls
      9749 ± 48%    +108.6%      20335 ±  6%     +57.6%      15365 ± 15%  interrupts.CPU85.NMI:Non-maskable_interrupts
      9749 ± 48%    +108.6%      20335 ±  6%     +57.6%      15365 ± 15%  interrupts.CPU85.PMI:Performance_monitoring_interrupts
    388.67 ± 21%      +3.1%     400.67 ± 33%     -13.2%     337.33 ± 11%  interrupts.CPU85.RES:Rescheduling_interrupts
    542336 ± 13%     -23.3%     415950 ± 28%      -2.8%     527349 ± 27%  interrupts.CPU85.TLB:TLB_shootdowns
      0.00          -100.0%       0.00       +6.4e+104%     644.33 ± 70%  interrupts.CPU86.122:PCI-MSI.31981655-edge.i40e-eth0-TxRx-86
    369748 ± 26%     -55.5%     164535 ± 35%      +2.9%     380379 ± 35%  interrupts.CPU86.CAL:Function_call_interrupts
     48.00 ± 50%     -77.1%      11.00 ± 56%     +21.5%      58.33 ±  8%  interrupts.CPU86.IWI:IRQ_work_interrupts
    406020            -2.9%     394410            -1.2%     401010        interrupts.CPU86.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU86.MCP:Machine_check_polls
     15763 ± 30%     -55.4%       7036 ± 23%     +17.5%      18529 ±  7%  interrupts.CPU86.NMI:Non-maskable_interrupts
     15763 ± 30%     -55.4%       7036 ± 23%     +17.5%      18529 ±  7%  interrupts.CPU86.PMI:Performance_monitoring_interrupts
    361.00 ± 33%     -48.8%     185.00 ± 42%     -16.3%     302.33 ± 18%  interrupts.CPU86.RES:Rescheduling_interrupts
    439179 ± 26%     -52.5%     208563 ± 36%      +5.8%     464700 ± 35%  interrupts.CPU86.TLB:TLB_shootdowns
    107.00 ±141%     +23.1%     131.67 ±141%    -100.0%       0.00        interrupts.CPU87.123:PCI-MSI.31981656-edge.i40e-eth0-TxRx-87
    399866 ± 36%     -35.9%     256137 ± 27%     -14.4%     342431 ± 24%  interrupts.CPU87.CAL:Function_call_interrupts
     56.67 ± 50%     -47.1%      30.00 ± 89%     -40.6%      33.67 ± 51%  interrupts.CPU87.IWI:IRQ_work_interrupts
    405899            -5.3%     384468 ±  5%      -1.1%     401377        interrupts.CPU87.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU87.MCP:Machine_check_polls
     17166 ± 34%     -35.1%      11146 ± 55%     -19.8%      13773 ± 27%  interrupts.CPU87.NMI:Non-maskable_interrupts
     17166 ± 34%     -35.1%      11146 ± 55%     -19.8%      13773 ± 27%  interrupts.CPU87.PMI:Performance_monitoring_interrupts
    416.00 ± 38%     -17.4%     343.67 ± 46%     -39.8%     250.33 ± 16%  interrupts.CPU87.RES:Rescheduling_interrupts
    476792 ± 36%     -31.9%     324893 ± 27%     -13.0%     415013 ± 24%  interrupts.CPU87.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%    -100.0%       0.00        interrupts.CPU88.124:PCI-MSI.31981657-edge.i40e-eth0-TxRx-88
    320126 ± 49%     -41.1%     188486 ± 35%     +52.9%     489365 ±  9%  interrupts.CPU88.CAL:Function_call_interrupts
     19.67 ±116%     -42.4%      11.33 ± 57%    +186.4%      56.33 ± 17%  interrupts.CPU88.IWI:IRQ_work_interrupts
    406159            -4.4%     388270 ±  3%      -1.3%     400684        interrupts.CPU88.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU88.MCP:Machine_check_polls
      9508 ± 46%     -27.7%       6875 ± 22%     +91.2%      18184 ± 16%  interrupts.CPU88.NMI:Non-maskable_interrupts
      9508 ± 46%     -27.7%       6875 ± 22%     +91.2%      18184 ± 16%  interrupts.CPU88.PMI:Performance_monitoring_interrupts
    292.33 ± 51%     +10.4%     322.67 ± 50%     +24.9%     365.00 ± 13%  interrupts.CPU88.RES:Rescheduling_interrupts
    379181 ± 49%     -37.1%     238446 ± 34%     +57.2%     596224 ±  9%  interrupts.CPU88.TLB:TLB_shootdowns
      2.00 ±141%    -100.0%       0.00          -100.0%       0.00        interrupts.CPU89.125:PCI-MSI.31981658-edge.i40e-eth0-TxRx-89
    294418 ± 13%     -26.0%     217844 ± 48%      -6.3%     275904 ± 19%  interrupts.CPU89.CAL:Function_call_interrupts
     26.00 ±119%     -50.0%      13.00 ±125%     +12.8%      29.33 ±131%  interrupts.CPU89.IWI:IRQ_work_interrupts
    405931            -4.4%     388170 ±  5%      -0.6%     403340        interrupts.CPU89.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU89.MCP:Machine_check_polls
     12075 ± 49%     -33.6%       8022 ± 51%      +0.8%      12177 ± 66%  interrupts.CPU89.NMI:Non-maskable_interrupts
     12075 ± 49%     -33.6%       8022 ± 51%      +0.8%      12177 ± 66%  interrupts.CPU89.PMI:Performance_monitoring_interrupts
    296.67 ± 50%      -7.5%     274.33 ± 28%     -31.6%     203.00 ±  8%  interrupts.CPU89.RES:Rescheduling_interrupts
    348558 ± 13%     -21.0%     275471 ± 48%      -3.6%     335874 ± 19%  interrupts.CPU89.TLB:TLB_shootdowns
      0.67 ± 70%     -50.0%       0.33 ±141%    -100.0%       0.00        interrupts.CPU9.128:PCI-MSI.31981661-edge.i40e-eth0-TxRx-92
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.CPU9.295:PCI-MSI.65536-edge.ioat-msix
     13.33 ±141%     -92.5%       1.00 ±141%    -100.0%       0.00        interrupts.CPU9.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9
      0.00       +3.3e+101%       0.33 ±141% +3.3e+101%       0.33 ±141%  interrupts.CPU9.80:PCI-MSI.31981613-edge.i40e-eth0-TxRx-44
    448041 ± 35%     -46.2%     241152 ± 18%     +29.5%     580254 ± 22%  interrupts.CPU9.CAL:Function_call_interrupts
     78.33 ±  7%     -38.7%      48.00 ± 53%      -8.5%      71.67 ± 21%  interrupts.CPU9.IWI:IRQ_work_interrupts
    405915            -4.1%     389299 ±  2%      -1.3%     400804        interrupts.CPU9.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU9.MCP:Machine_check_polls
     22746 ±  9%     -28.0%      16386 ± 32%     -13.8%      19611 ± 17%  interrupts.CPU9.NMI:Non-maskable_interrupts
     22746 ±  9%     -28.0%      16386 ± 32%     -13.8%      19611 ± 17%  interrupts.CPU9.PMI:Performance_monitoring_interrupts
    527.00 ± 51%      +8.7%     572.67 ± 26%     -14.1%     452.67 ±  8%  interrupts.CPU9.RES:Rescheduling_interrupts
    538800 ± 34%     -43.2%     305862 ± 18%     +32.4%     713254 ± 22%  interrupts.CPU9.TLB:TLB_shootdowns
      0.00         +4e+102%       4.00 ± 93%    -100.0%       0.00        interrupts.CPU90.126:PCI-MSI.31981659-edge.i40e-eth0-TxRx-90
    344420 ± 35%     -46.0%     186093 ± 56%     +10.6%     381030 ± 28%  interrupts.CPU90.CAL:Function_call_interrupts
     33.33 ± 68%     +17.0%      39.00 ± 72%     +12.0%      37.33 ± 76%  interrupts.CPU90.IWI:IRQ_work_interrupts
    406207            -4.4%     388530 ±  3%      -1.2%     401139        interrupts.CPU90.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU90.MCP:Machine_check_polls
     13141 ± 36%      -1.9%      12887 ± 48%      +2.0%      13409 ± 48%  interrupts.CPU90.NMI:Non-maskable_interrupts
     13141 ± 36%      -1.9%      12887 ± 48%      +2.0%      13409 ± 48%  interrupts.CPU90.PMI:Performance_monitoring_interrupts
    280.33 ± 20%     +30.7%     366.33 ± 45%     +13.9%     319.33 ± 24%  interrupts.CPU90.RES:Rescheduling_interrupts
    407303 ± 34%     -42.4%     234729 ± 57%     +13.8%     463703 ± 28%  interrupts.CPU90.TLB:TLB_shootdowns
      0.00         +5e+102%       5.00 ±127% +3.3e+101%       0.33 ±141%  interrupts.CPU91.127:PCI-MSI.31981660-edge.i40e-eth0-TxRx-91
    211698 ± 49%     +23.4%     261323 ± 23%     +40.7%     297887 ±  9%  interrupts.CPU91.CAL:Function_call_interrupts
      7.67 ± 65%    +243.5%      26.33 ± 57%    +347.8%      34.33 ± 66%  interrupts.CPU91.IWI:IRQ_work_interrupts
    405917            -5.4%     384110 ±  5%      -0.9%     402253        interrupts.CPU91.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU91.MCP:Machine_check_polls
      6708 ± 21%     +57.8%      10588 ± 38%    +101.1%      13488 ± 35%  interrupts.CPU91.NMI:Non-maskable_interrupts
      6708 ± 21%     +57.8%      10588 ± 38%    +101.1%      13488 ± 35%  interrupts.CPU91.PMI:Performance_monitoring_interrupts
    249.33 ± 53%     +62.3%     404.67 ± 31%     +12.0%     279.33 ± 12%  interrupts.CPU91.RES:Rescheduling_interrupts
    250758 ± 49%     +32.1%     331240 ± 24%     +44.3%     361744 ±  9%  interrupts.CPU91.TLB:TLB_shootdowns
      0.67 ± 70%    +100.0%       1.33 ±141%      +0.0%       0.67 ±141%  interrupts.CPU92.128:PCI-MSI.31981661-edge.i40e-eth0-TxRx-92
    243117 ± 36%      -3.1%     235461 ± 14%     +51.8%     368952 ± 10%  interrupts.CPU92.CAL:Function_call_interrupts
     40.00 ± 81%     +33.3%      53.33 ± 16%     +31.7%      52.67 ± 44%  interrupts.CPU92.IWI:IRQ_work_interrupts
    406198            -4.6%     387672 ±  4%      -1.1%     401909        interrupts.CPU92.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU92.MCP:Machine_check_polls
     14086 ± 46%     +19.5%      16827 ± 15%     +18.4%      16681 ± 35%  interrupts.CPU92.NMI:Non-maskable_interrupts
     14086 ± 46%     +19.5%      16827 ± 15%     +18.4%      16681 ± 35%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
    291.00 ± 28%      -3.4%     281.00 ± 25%     +14.8%     334.00 ± 22%  interrupts.CPU92.RES:Rescheduling_interrupts
    287247 ± 36%      +3.2%     296367 ± 14%     +55.9%     447954 ± 11%  interrupts.CPU92.TLB:TLB_shootdowns
      5.33 ±141%  +13800.0%     741.33 ±141%    +118.7%      11.67 ±141%  interrupts.CPU93.129:PCI-MSI.31981662-edge.i40e-eth0-TxRx-93
    369509 ± 20%     -37.3%     231695 ± 22%     -24.9%     277426 ± 30%  interrupts.CPU93.CAL:Function_call_interrupts
     36.00 ± 67%     -87.0%       4.67 ± 96%     -86.1%       5.00 ± 84%  interrupts.CPU93.IWI:IRQ_work_interrupts
    406247            -4.6%     387582 ±  3%      -0.9%     402466        interrupts.CPU93.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU93.MCP:Machine_check_polls
     12481 ± 36%     -51.1%       6101 ± 12%      -7.7%      11521 ± 61%  interrupts.CPU93.NMI:Non-maskable_interrupts
     12481 ± 36%     -51.1%       6101 ± 12%      -7.7%      11521 ± 61%  interrupts.CPU93.PMI:Performance_monitoring_interrupts
    316.00 ± 32%     -14.2%     271.00 ± 45%      -2.5%     308.00 ± 36%  interrupts.CPU93.RES:Rescheduling_interrupts
    439510 ± 20%     -33.2%     293475 ± 22%     -23.4%     336561 ± 30%  interrupts.CPU93.TLB:TLB_shootdowns
    340416 ± 23%     -47.1%     180155 ± 15%      +5.0%     357354 ± 29%  interrupts.CPU94.CAL:Function_call_interrupts
     41.33 ± 62%     -34.7%      27.00 ±128%     -31.5%      28.33 ± 69%  interrupts.CPU94.IWI:IRQ_work_interrupts
    406340            -3.0%     394315 ±  2%      -0.9%     402600        interrupts.CPU94.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU94.MCP:Machine_check_polls
     13098 ± 36%     -14.7%      11174 ± 72%      -8.5%      11980 ± 35%  interrupts.CPU94.NMI:Non-maskable_interrupts
     13098 ± 36%     -14.7%      11174 ± 72%      -8.5%      11980 ± 35%  interrupts.CPU94.PMI:Performance_monitoring_interrupts
    355.67 ± 20%     -25.7%     264.33 ± 16%     -22.6%     275.33 ± 18%  interrupts.CPU94.RES:Rescheduling_interrupts
    402839 ± 24%     -43.6%     227122 ± 14%      +8.0%     434996 ± 30%  interrupts.CPU94.TLB:TLB_shootdowns
    252892 ± 24%      +0.6%     254444 ± 31%     -15.2%     214354 ± 34%  interrupts.CPU95.CAL:Function_call_interrupts
     22.33 ± 16%      +4.5%      23.33 ± 33%     -28.4%      16.00 ± 97%  interrupts.CPU95.IWI:IRQ_work_interrupts
    406420            -5.3%     384975 ±  4%      -0.7%     403538        interrupts.CPU95.LOC:Local_timer_interrupts
      1.00            +0.0%       1.00            +0.0%       1.00        interrupts.CPU95.MCP:Machine_check_polls
      9491 ± 11%     +16.9%      11094 ± 10%     +19.6%      11351 ± 17%  interrupts.CPU95.NMI:Non-maskable_interrupts
      9491 ± 11%     +16.9%      11094 ± 10%     +19.6%      11351 ± 17%  interrupts.CPU95.PMI:Performance_monitoring_interrupts
    299.00 ± 14%     +74.5%     521.67 ± 43%     -11.4%     265.00 ± 15%  interrupts.CPU95.RES:Rescheduling_interrupts
    300146 ± 24%      +7.0%     321152 ± 31%     -12.4%     262989 ± 34%  interrupts.CPU95.TLB:TLB_shootdowns
      4028 ±  4%     -16.0%       3382 ±  4%      -7.6%       3722 ±  3%  interrupts.IWI:IRQ_work_interrupts
  38985876            -5.5%   36830793 ±  4%      -1.3%   38480217        interrupts.LOC:Local_timer_interrupts
     96.00            +0.0%      96.00            +0.0%      96.00        interrupts.MCP:Machine_check_polls
   1440872 ±  6%     -11.0%    1282701 ±  5%      -7.6%    1330904 ±  4%  interrupts.NMI:Non-maskable_interrupts
   1440872 ±  6%     -11.0%    1282701 ±  5%      -7.6%    1330904 ±  4%  interrupts.PMI:Performance_monitoring_interrupts
     46224 ± 15%     -10.2%      41502 ± 19%     -25.6%      34394 ± 18%  interrupts.RES:Rescheduling_interrupts
      0.00          -100.0%       0.00          -100.0%       0.00        interrupts.RTR:APIC_ICR_read_retries
  53033792 ±  2%     -30.8%   36706926 ±  4%      -4.6%   50586704        interrupts.TLB:TLB_shootdowns

Best Regards,
Rong Chen

Re: [PATCH v19 18/20] mm/lru: replace pgdat lru_lock with lruvec lock

[Hugh Dickins]

[-- Attachment #1: Type: TEXT/PLAIN, Size: 14033 bytes --]

On Wed, 20 Oct 2020, Alex Shi wrote:
> 在 2020/9/24 上午11:28, Alex Shi 写道:
> > --- a/include/linux/mmzone.h
> > +++ b/include/linux/mmzone.h
> > @@ -273,6 +273,8 @@ enum lruvec_flags {
> >  };
> >  
> >  struct lruvec {
> > +	/* per lruvec lru_lock for memcg */
> > +	spinlock_t			lru_lock;
> >  	struct list_head		lists[NR_LRU_LISTS];
> >  	/*
> >  	 * These track the cost of reclaiming one LRU - file or anon -
> 
> Hi All,
> 
> Intel Rong Chen, LKP, report a big regression on this patch, about
> 12 ~ 32% performance drop on fio.read_iops and case-lru-file-mmap-read
> case on wide Intel machine with attached kernel config.

Many thanks for the stats that followed: but though I spent many hours
poring over them, I ended up (as all too usual for me) just drowning
in the numbers, less and less able to arrive at any conclusion.

Why is 141% such a common standard deviation? I presume an artifact
of trying to estimate a stddev from only 3 runs? I wanted to ask you
to increase the runs from 3 to 12: too many of the numbers looked
unsafe to rely upon. And perhaps to increase the runtime from 200s
to 1000s, since some of the entries (invalidate_mapping_pages) look
as if they come from test preparation rather than the test itself.
But don't bother unless someone else asks: I would only drown again!

I have come to a tentative conclusion below, I don't see those stats
contradicting it, but I cannot argue how they support it either.

> Hugh Dickins pointed it's a false sharing issue on the lru_lock.

Well, I did suggest that as a possibility at first, before finding
that the slab (or slob) cache is guaranteeing cacheline alignment to
the mem_cgroup_per_node, hence to the lruvec, hence to the lru_lock.
So, I could not then see any false sharing.

> And that could be fixed by move the lru_lock out of busy lists[]
> cacheline,

No, access to those lists[] is always under that lru_lock: they
belong together, and sharing a cacheline between them is very
efficient: that is good sharing, not false sharing.

> like the following patch:

Not really.

> 
> diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h
> index a75e6d0effcb..58b21bffef95 100644
> --- a/include/linux/mmzone.h
> +++ b/include/linux/mmzone.h
> @@ -272,9 +272,9 @@ enum lruvec_flags {
>  };
> 
>  struct lruvec {
> +       struct list_head                lists[NR_LRU_LISTS];
>         /* per lruvec lru_lock for memcg */
>         spinlock_t                      lru_lock;
> -       struct list_head                lists[NR_LRU_LISTS];
>         /*
>          * These track the cost of reclaiming one LRU - file or anon -
>          * over the other. As the observed cost of reclaiming one LRU

Aha, that's a different patch than you showed me before, and it's
wonderfully simple, but rather surprising.  This patch really works
to fix the reported regression?  That's great, so long as it doesn't
turn out to introduce regressions elsewhere.  If it works, it's so
simple that I strongly approve of it, even if I don't understand it.

But (I see it in the lruv20 branch of your github tree) I would much
prefer you to remove my name from the commit message: it's your patch,
all I contributed was misdirection and bafflement.

> 
> Although the problem fixed， But I still no idea of the reasons
> and the gut problem. Any comments for this?

Right, how to explain it?

Well (and I'm assuming a 64-byte cacheline - I do hope the machines
you've been testing on really have that, rather than some greater
size that the slab allocator is unaware of), with your patch in
the first cacheline of the struct lruvec is:

inactive_anon.next inactive_anon.prev active_anon.next active_anon.prev
inactive_file.next inactive_file.prev active_file.next active_file.prev

And the interesting second cacheline of the struct lruvec is:

unevictable.next   unevictable.prev   lru_lock         anon_cost
file_cost          nonresident_age    refaults[anon]   refaults[file]

(I hope I'm not missing some debug option in your config, which would
expand lru_lock from an int plus a pad int, to something much bigger.)

Of those fields, unevictable.next unevictable.prev anon_cost and
file_cost are accessed under lru_lock, so are good to share its
cacheline.  snapshot_refaults() does not take any lock when setting
refaults[2], and they are not atomic; shrink_node() does not take
any lock when reading them.  We could quite easily change the code
to require lru_lock to access them, but it looks to me as if all
that would do is add unnecessary overhead: I could be wrong, but
they don't look worrying to me.

The worrying one is atomic_long_t nonresident_age.

And the advice we would usually give is to keep that in a separate
cacheline from lru_lock and its domain.  But what your patch does is
the opposite: it moves lru_lock into the same cacheline as its "rival";
and testing (so far) has shown that to be a good choice.

That seems audacious and surprising to me, but not impossible:
if it works, go with it.  But I wouldn't know how to write the
justification for the commit.

The image I have in my mind is: trying to get through a door in a
howling gale, while holding a bunch of cacheline kites tied together.
By forcing lru_lock and nonresident_age into the same cacheline,
you're making sure there is one less kite that can blow away in
another direction before you get through the door.

And Yu Zhao (in offline mail) has already drawn our attention to the
inefficient way move_pages_to_lru() calls workingset_age_nonresident()
repeatedly, all while holding lru_lock.  That's not much of a problem
in the base tree, but with per-memcg lru_lock, and more than one level
in the memcg hierarchy, that gets to be nasty - atomically modifying
the cacheline of a parent lruvec while holding the child's lru_lock.
I don't believe there's any deadlock in that, but I would expect
increasingly regressive performance at scale, even with your patch.

Here's a patch I was testing last night, on top of 5.9 and yours: works
for me, but my scale is too small to tell how well it will work for you.
I did consider whether we could use lru_lock on nonresident_age instead
of it being an independent atomic: in other places that looks plausible,
but adding lru_lock into __remove_mapping() feels like a very bad idea.

I'm not saying this or similar patch needs to go in right now
(and we shall certainly want Johannes's opinion before pushing it),
but I think it is going to show up as needed quite soon.

[PATCH] mm/lru: minimize workingset_age_nonresident() interference

1. move_pages_to_lru() batch workingset_age_nonresident() (from Yu Zhao)
2. workingset_age_nonresident() after unlock of lru_lock (from Yu Zhao)
3. lru_note_cost_unlock_irq() to remove an unlock+lock of lru_lock
4. lru_note_cost_unlock_irq() include updates of nonresident_age
5. workingset_refault() use that OR workingset_age_nonresident()

Of those, I expect 1 & 2 (from Yu Zhao) to be the most significant,
increasingly so with more cpus, increasingly so with more levels in
the memcg hierarchy.

Signed-off-by: Hugh Dickins <hughd@google.com>
Cc: Yu Zhao <yuzhao@google.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
---

 include/linux/swap.h |    7 +++----
 mm/swap.c            |   26 ++++++++++++++++----------
 mm/vmscan.c          |   23 +++++++++++++----------
 mm/workingset.c      |   11 +++++++----
 4 files changed, 39 insertions(+), 28 deletions(-)

--- 5.9-alex/include/linux/swap.h	2020-10-24 12:25:17.290383664 -0700
+++ 5.9-hugh/include/linux/swap.h	2020-10-24 18:31:58.396795250 -0700
@@ -332,11 +332,10 @@ extern unsigned long nr_free_buffer_page
 /* Definition of global_zone_page_state not available yet */
 #define nr_free_pages() global_zone_page_state(NR_FREE_PAGES)
 
-
 /* linux/mm/swap.c */
-extern void lru_note_cost(struct lruvec *lruvec, bool file,
-			  unsigned int nr_pages);
-extern void lru_note_cost_page(struct page *);
+extern void lru_note_cost_unlock_irq(struct lruvec *lruvec, bool file,
+		unsigned long nr_pages, unsigned long nr_active)
+		__releases(lruvec->lru_lock);
 extern void lru_cache_add(struct page *);
 extern void activate_page(struct page *);
 extern void mark_page_accessed(struct page *);
--- 5.9-alex/mm/swap.c	2020-10-24 12:25:17.314383732 -0700
+++ 5.9-hugh/mm/swap.c	2020-10-24 18:31:32.524708589 -0700
@@ -259,12 +259,12 @@ void rotate_reclaimable_page(struct page
 	}
 }
 
-void lru_note_cost(struct lruvec *lruvec, bool file, unsigned int nr_pages)
+void lru_note_cost_unlock_irq(struct lruvec *lruvec, bool file,
+		unsigned long nr_pages, unsigned long nr_active)
 {
-	do {
+	for (;;) {
 		unsigned long lrusize;
 
-		spin_lock_irq(&lruvec->lru_lock);
 		/* Record cost event */
 		if (file)
 			lruvec->file_cost += nr_pages;
@@ -288,14 +288,20 @@ void lru_note_cost(struct lruvec *lruvec
 			lruvec->file_cost /= 2;
 			lruvec->anon_cost /= 2;
 		}
-		spin_unlock_irq(&lruvec->lru_lock);
-	} while ((lruvec = parent_lruvec(lruvec)));
-}
 
-void lru_note_cost_page(struct page *page)
-{
-	lru_note_cost(mem_cgroup_page_lruvec(page, page_pgdat(page)),
-		      page_is_file_lru(page), thp_nr_pages(page));
+		/*
+		 * Update nonresident_age like workingset_age_nonresident().
+		 * Better to drop lru_lock first? Or better to do that last?
+		 */
+		if (nr_active)
+			atomic_long_add(nr_active, &lruvec->nonresident_age);
+
+		spin_unlock_irq(&lruvec->lru_lock);
+		lruvec = parent_lruvec(lruvec);
+		if (!lruvec)
+			break;
+		spin_lock_irq(&lruvec->lru_lock);
+	}
 }
 
 static void __activate_page(struct page *page, struct lruvec *lruvec)
--- 5.9-alex/mm/vmscan.c	2020-10-24 12:25:17.318383744 -0700
+++ 5.9-hugh/mm/vmscan.c	2020-10-24 18:37:31.389910659 -0700
@@ -1818,10 +1818,11 @@ static int too_many_isolated(struct pgli
  * move_pages_to_lru() moves pages from private @list to appropriate LRU list.
  * On return, @list is reused as a list of pages to be freed by the caller.
  *
- * Returns the number of pages moved to the given lruvec.
+ * Returns the number of pages moved to the given lruvec,
+ * or the number of pages moved to the active lru if count_actives_only.
  */
 static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
-						     struct list_head *list)
+		struct list_head *list, bool count_actives_only)
 {
 	int nr_pages, nr_moved = 0;
 	LIST_HEAD(pages_to_free);
@@ -1872,9 +1873,8 @@ static unsigned noinline_for_stack move_
 
 		update_lru_size(lruvec, lru, page_zonenum(page), nr_pages);
 		list_add(&page->lru, &lruvec->lists[lru]);
-		nr_moved += nr_pages;
-		if (PageActive(page))
-			workingset_age_nonresident(lruvec, nr_pages);
+		if (!count_actives_only || PageActive(page))
+			nr_moved += nr_pages;
 	}
 
 	/*
@@ -1909,6 +1909,7 @@ shrink_inactive_list(unsigned long nr_to
 	LIST_HEAD(page_list);
 	unsigned long nr_scanned;
 	unsigned int nr_reclaimed = 0;
+	unsigned int nr_active;
 	unsigned long nr_taken;
 	struct reclaim_stat stat;
 	bool file = is_file_lru(lru);
@@ -1952,7 +1953,7 @@ shrink_inactive_list(unsigned long nr_to
 				&stat, false);
 
 	spin_lock_irq(&lruvec->lru_lock);
-	move_pages_to_lru(lruvec, &page_list);
+	nr_active = move_pages_to_lru(lruvec, &page_list, true);
 
 	__mod_node_page_state(pgdat, NR_ISOLATED_ANON + file, -nr_taken);
 	item = current_is_kswapd() ? PGSTEAL_KSWAPD : PGSTEAL_DIRECT;
@@ -1960,9 +1961,8 @@ shrink_inactive_list(unsigned long nr_to
 		__count_vm_events(item, nr_reclaimed);
 	__count_memcg_events(lruvec_memcg(lruvec), item, nr_reclaimed);
 	__count_vm_events(PGSTEAL_ANON + file, nr_reclaimed);
-	spin_unlock_irq(&lruvec->lru_lock);
 
-	lru_note_cost(lruvec, file, stat.nr_pageout);
+	lru_note_cost_unlock_irq(lruvec, file, stat.nr_pageout, nr_active);
 	mem_cgroup_uncharge_list(&page_list);
 	free_unref_page_list(&page_list);
 
@@ -2089,8 +2089,8 @@ static void shrink_active_list(unsigned
 	 */
 	spin_lock_irq(&lruvec->lru_lock);
 
-	nr_activate = move_pages_to_lru(lruvec, &l_active);
-	nr_deactivate = move_pages_to_lru(lruvec, &l_inactive);
+	nr_activate = move_pages_to_lru(lruvec, &l_active, false);
+	nr_deactivate = move_pages_to_lru(lruvec, &l_inactive, false);
 	/* Keep all free pages in l_active list */
 	list_splice(&l_inactive, &l_active);
 
@@ -2100,6 +2100,9 @@ static void shrink_active_list(unsigned
 	__mod_node_page_state(pgdat, NR_ISOLATED_ANON + file, -nr_taken);
 	spin_unlock_irq(&lruvec->lru_lock);
 
+	if (nr_activate)
+		workingset_age_nonresident(lruvec, nr_activate);
+
 	mem_cgroup_uncharge_list(&l_active);
 	free_unref_page_list(&l_active);
 	trace_mm_vmscan_lru_shrink_active(pgdat->node_id, nr_taken, nr_activate,
--- 5.9-alex/mm/workingset.c	2020-10-24 12:25:17.322383755 -0700
+++ 5.9-hugh/mm/workingset.c	2020-10-24 16:55:08.733369734 -0700
@@ -291,6 +291,7 @@ void workingset_refault(struct page *pag
 	unsigned long eviction;
 	struct lruvec *lruvec;
 	unsigned long refault;
+	unsigned int nr_pages;
 	bool workingset;
 	int memcgid;
 
@@ -374,16 +375,18 @@ void workingset_refault(struct page *pag
 		goto out;
 
 	SetPageActive(page);
-	workingset_age_nonresident(lruvec, thp_nr_pages(page));
-	inc_lruvec_state(lruvec, WORKINGSET_ACTIVATE_BASE + file);
+	nr_pages = thp_nr_pages(page);
 
 	/* Page was active prior to eviction */
 	if (workingset) {
 		SetPageWorkingset(page);
-		/* XXX: Move to lru_cache_add() when it supports new vs putback */
-		lru_note_cost_page(page);
+		spin_lock_irq(&lruvec->lru_lock);
+		lru_note_cost_unlock_irq(lruvec, file, nr_pages, nr_pages);
 		inc_lruvec_state(lruvec, WORKINGSET_RESTORE_BASE + file);
+	} else {
+		workingset_age_nonresident(lruvec, nr_pages);
 	}
+	inc_lruvec_state(lruvec, WORKINGSET_ACTIVATE_BASE + file);
 out:
 	rcu_read_unlock();
 }

Re: [PATCH v19 18/20] mm/lru: replace pgdat lru_lock with lruvec lock

[Alex Shi]

在 2020/10/26 上午5:51, Hugh Dickins 写道:
> [PATCH] mm/lru: minimize workingset_age_nonresident() interference
> 
> 1. move_pages_to_lru() batch workingset_age_nonresident() (from Yu Zhao)
> 2. workingset_age_nonresident() after unlock of lru_lock (from Yu Zhao)
> 3. lru_note_cost_unlock_irq() to remove an unlock+lock of lru_lock
> 4. lru_note_cost_unlock_irq() include updates of nonresident_age
> 5. workingset_refault() use that OR workingset_age_nonresident()
> 
> Of those, I expect 1 & 2 (from Yu Zhao) to be the most significant,
> increasingly so with more cpus, increasingly so with more levels in
> the memcg hierarchy.
> 
> Signed-off-by: Hugh Dickins <hughd@google.com>
> Cc: Yu Zhao <yuzhao@google.com>
> Cc: Johannes Weiner <hannes@cmpxchg.org>

Hi Hugh,

Thanks a lot for checking and patch. I am in traveling today. So
just can pick and put it as lruv21 branch on my github tree:
https://github.com/alexshi/linux.git

Hi Rong,

We will very appreciate if you could launch testing on the branch
and it'd better, if you have time to change the test case time as 1k
second as Hugh wanted. Many thanks!

Thanks
Alex

Re: [PATCH v19 18/20] mm/lru: replace pgdat lru_lock with lruvec lock

[Rong Chen]

On Mon, Oct 26, 2020 at 09:41:20AM +0800, Alex Shi wrote:
> 
> 
> 在 2020/10/26 上午5:51, Hugh Dickins 写道:
> > [PATCH] mm/lru: minimize workingset_age_nonresident() interference
> > 
> > 1. move_pages_to_lru() batch workingset_age_nonresident() (from Yu Zhao)
> > 2. workingset_age_nonresident() after unlock of lru_lock (from Yu Zhao)
> > 3. lru_note_cost_unlock_irq() to remove an unlock+lock of lru_lock
> > 4. lru_note_cost_unlock_irq() include updates of nonresident_age
> > 5. workingset_refault() use that OR workingset_age_nonresident()
> > 
> > Of those, I expect 1 & 2 (from Yu Zhao) to be the most significant,
> > increasingly so with more cpus, increasingly so with more levels in
> > the memcg hierarchy.
> > 
> > Signed-off-by: Hugh Dickins <hughd@google.com>
> > Cc: Yu Zhao <yuzhao@google.com>
> > Cc: Johannes Weiner <hannes@cmpxchg.org>
> 
> Hi Hugh,
> 
> Thanks a lot for checking and patch. I am in traveling today. So
> just can pick and put it as lruv21 branch on my github tree:
> https://github.com/alexshi/linux.git
> 
> Hi Rong,
> 
> We will very appreciate if you could launch testing on the branch
> and it'd better, if you have time to change the test case time as 1k
> second as Hugh wanted. Many thanks!
> 

Hi,

I changed the runtime to 1000s and tested the head two commits of branch lruv21,
there's no obvious performance change.


=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
  2M/gcc-9/performance/2pmem/xfs/mmap/x86_64-rhel-8.3/50%/debian-10.4-x86_64-20200603.cgz/1000s/randread/lkp-csl-2sp6/200G/fio-basic/tb/0x5002f01

commit: 
  5ab44845c5ca2a0611772328fdb38ede01027c8f ("mm/lru: revise the comments of lru_lock")
  82a171cb0bbe461d3864bb3e295a8ddc37115139 ("Hugh's patch")

5ab44845c5ca2a06 82a171cb0bbe461d3864bb3e295 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
       2117:3       -23558%        1410:3     dmesg.timestamp:last
       2117:3           43%        2118:3     kmsg.timestamp:last
          0:3            2%           0:3     perf-profile.children.cycles-pp.error_entry
          0:3            1%           0:3     perf-profile.self.cycles-pp.error_entry
         %stddev     %change         %stddev
             \          |                \  
      0.01 ± 70%      +0.0        0.01        fio.latency_1000ms%
      0.11 ± 17%      -0.0        0.10 ±  3%  fio.latency_1000us%
      0.41 ±  2%      +0.0        0.43 ± 20%  fio.latency_100ms%
     48.11            -1.8       46.34        fio.latency_10ms%
      0.01 ± 70%      -0.0        0.00 ±141%  fio.latency_2000ms%
      6.53 ± 12%      +0.9        7.45 ± 10%  fio.latency_20ms%
      0.04 ± 29%      +0.0        0.05 ± 57%  fio.latency_250ms%
      0.01 ±  6%      -0.0        0.01        fio.latency_250us%
      0.02 ± 34%      -0.0        0.01 ± 11%  fio.latency_2ms%
     15.79 ±  2%      +1.7       17.52 ±  7%  fio.latency_4ms%
      0.01            +0.0        0.01 ± 18%  fio.latency_500ms%
      0.40 ±  8%      -0.0        0.38 ±  2%  fio.latency_500us%
     27.73 ±  3%      -0.9       26.86 ±  5%  fio.latency_50ms%
      0.01            +0.0        0.01        fio.latency_750ms%
      0.85            -0.0        0.83        fio.latency_750us%
      0.00 ±141%      +0.0        0.00 ±141%  fio.latency_>=2000ms%
      7495 ±  2%      -0.0%       7495        fio.read_bw_MBps
  26432853 ±  2%      -0.3%   26345472 ±  2%  fio.read_clat_90%_us
  29316437 ±  2%      +0.0%   29316437        fio.read_clat_95%_us
  40108032            +1.7%   40807082 ±  5%  fio.read_clat_99%_us
  12310704 ±  2%      -0.4%   12257079        fio.read_clat_mean_us
  13001646 ± 18%      +3.5%   13462476 ± 21%  fio.read_clat_stddev
      3747 ±  2%      -0.0%       3747        fio.read_iops
      1001            +0.0%       1001        fio.time.elapsed_time
      1001            +0.0%       1001        fio.time.elapsed_time.max
 1.514e+10 ±  2%      +0.0%  1.515e+10        fio.time.file_system_inputs
   2129458           +14.8%    2443796        fio.time.involuntary_context_switches
 1.893e+09 ±  2%      +0.0%  1.893e+09        fio.time.major_page_faults
   1776288 ±  6%      -1.1%    1756372 ±  2%  fio.time.maximum_resident_set_size
     91856 ± 73%     -54.9%      41464 ± 71%  fio.time.minor_page_faults
      4096            +0.0%       4096        fio.time.page_size
      4742            -0.1%       4738        fio.time.percent_of_cpu_this_job_got
     46089            -0.1%      46028        fio.time.system_time
      1400 ±  3%      +2.1%       1429 ±  2%  fio.time.user_time
    112653            +2.5%     115447 ±  2%  fio.time.voluntary_context_switches
   3748168 ±  2%      -0.0%    3747993        fio.workload
      1206            -0.0%       1206        uptime.boot
     65004            -0.1%      64961        uptime.idle
     27.17            -0.1%      27.15        boot-time.boot
     15.64            -0.1%      15.63        boot-time.dhcp
      2245            +0.1%       2248        boot-time.idle
      0.86            -0.0%       0.86        boot-time.smp_boot
     47.86            -0.1%      47.80        iostat.cpu.idle
      0.01 ± 77%     -40.2%       0.01 ±100%  iostat.cpu.iowait
     50.67            +0.1%      50.69        iostat.cpu.system
      1.46 ±  3%      +2.1%       1.50 ±  2%  iostat.cpu.user
     47.76            -0.1       47.71        mpstat.cpu.all.idle%
      0.01 ± 78%      -0.0        0.01 ±100%  mpstat.cpu.all.iowait%
      0.90            +0.0        0.90 ±  2%  mpstat.cpu.all.irq%
      0.04 ±  2%      +0.0        0.04        mpstat.cpu.all.soft%
     49.82            +0.0       49.84        mpstat.cpu.all.sys%
      1.47 ±  3%      +0.0        1.50 ±  2%  mpstat.cpu.all.usr%
   2381530 ± 22%     +16.0%    2762419 ± 16%  cpuidle.C1.time
    147295 ± 13%      -5.6%     139089        cpuidle.C1.usage
 3.274e+10 ± 48%     +16.1%  3.802e+10        cpuidle.C1E.time
  77503135 ± 23%      +8.4%   83999622        cpuidle.C1E.usage
  1.32e+10 ±120%     -40.9%  7.801e+09 ± 10%  cpuidle.C6.time
  15835701 ±115%     -42.3%    9138895        cpuidle.C6.usage
    269540 ±  4%      -6.5%     252055 ±  2%  cpuidle.POLL.time
     86578 ±  4%      -7.3%      80253 ±  3%  cpuidle.POLL.usage
      0.00          -100.0%       0.00        numa-numastat.node0.interleave_hit
 7.231e+08 ±  4%      +0.2%  7.244e+08 ±  3%  numa-numastat.node0.local_node
   2.1e+08 ±  3%      -0.1%  2.098e+08 ±  3%  numa-numastat.node0.numa_foreign
 7.231e+08 ±  4%      +0.2%  7.244e+08 ±  3%  numa-numastat.node0.numa_hit
 2.162e+08 ±  4%      -5.8%  2.037e+08 ±  3%  numa-numastat.node0.numa_miss
 2.163e+08 ±  4%      -5.8%  2.037e+08 ±  3%  numa-numastat.node0.other_node
      0.00          -100.0%       0.00        numa-numastat.node1.interleave_hit
 7.457e+08            +1.6%   7.58e+08 ±  2%  numa-numastat.node1.local_node
 2.162e+08 ±  4%      -5.8%  2.037e+08 ±  3%  numa-numastat.node1.numa_foreign
 7.457e+08            +1.6%   7.58e+08 ±  2%  numa-numastat.node1.numa_hit
   2.1e+08 ±  3%      -0.1%  2.098e+08 ±  3%  numa-numastat.node1.numa_miss
   2.1e+08 ±  3%      -0.1%  2.098e+08 ±  3%  numa-numastat.node1.other_node
      1001            +0.0%       1001        time.elapsed_time
      1001            +0.0%       1001        time.elapsed_time.max
 1.514e+10 ±  2%      +0.0%  1.515e+10        time.file_system_inputs
   2129458           +14.8%    2443796        time.involuntary_context_switches
 1.893e+09 ±  2%      +0.0%  1.893e+09        time.major_page_faults
   1776288 ±  6%      -1.1%    1756372 ±  2%  time.maximum_resident_set_size
     91856 ± 73%     -54.9%      41464 ± 71%  time.minor_page_faults
      4096            +0.0%       4096        time.page_size
      4742            -0.1%       4738        time.percent_of_cpu_this_job_got
     46089            -0.1%      46028        time.system_time
      1400 ±  3%      +2.1%       1429 ±  2%  time.user_time
    112653            +2.5%     115447 ±  2%  time.voluntary_context_switches
     47.33            -0.7%      47.00        vmstat.cpu.id
     50.00            +0.0%      50.00        vmstat.cpu.sy
      1.00            +0.0%       1.00        vmstat.cpu.us
      0.00          -100.0%       0.00        vmstat.cpu.wa
   7531466 ±  2%      +0.1%    7542581        vmstat.io.bi
     10.33 ±  4%      +3.2%      10.67 ±  4%  vmstat.io.bo
      0.00          -100.0%       0.00        vmstat.memory.buff
  43340208            -0.0%   43334775        vmstat.memory.cache
    477452            +6.8%     509884 ±  5%  vmstat.memory.free
      0.00          -100.0%       0.00        vmstat.procs.b
     49.00            +0.0%      49.00        vmstat.procs.r
      6109           +10.4%       6747        vmstat.system.cs
    339248            -3.6%     326966 ±  2%  vmstat.system.in
   2116526            -1.1%    2093850        meminfo.Active
    196886 ±  4%      -3.5%     190029 ±  2%  meminfo.Active(anon)
   1919638            -0.8%    1903820        meminfo.Active(file)
    343278            +0.5%     345049        meminfo.AnonHugePages
    444614 ±  6%      -4.9%     423019 ±  5%  meminfo.AnonPages
      0.00          -100.0%       0.00        meminfo.Buffers
  42942752            -0.0%   42933243        meminfo.Cached
     16232 ± 37%     +98.2%      32164 ± 30%  meminfo.CmaFree
    204800            +0.0%     204800        meminfo.CmaTotal
  24554032            +0.0%   24554032        meminfo.CommitLimit
   6741881            +0.0%    6744732        meminfo.Committed_AS
 2.538e+08            +0.7%  2.555e+08        meminfo.DirectMap1G
  15714986 ±  5%     -11.3%   13942784 ±  3%  meminfo.DirectMap2M
    738069 ±  7%      +3.3%     762645 ±  5%  meminfo.DirectMap4k
      5.00 ± 43%     +73.3%       8.67 ±  5%  meminfo.Dirty
      2048            +0.0%       2048        meminfo.Hugepagesize
  40262123            -0.0%   40254287        meminfo.Inactive
   1578006            -1.3%    1557448        meminfo.Inactive(anon)
  38684117            +0.0%   38696838        meminfo.Inactive(file)
    380179            -0.1%     379931        meminfo.KReclaimable
     15548            -0.0%      15543        meminfo.KernelStack
  41681713            +0.1%   41734197        meminfo.Mapped
  40857814            -0.0%   40843964        meminfo.MemAvailable
    493196            +7.4%     529558 ±  5%  meminfo.MemFree
  49108064            +0.0%   49108064        meminfo.MemTotal
  48614867            -0.1%   48578504        meminfo.Memused
      2230 ±  7%     -10.1%       2004        meminfo.Mlocked
    413143            +0.2%     413857        meminfo.PageTables
     47194            -0.2%      47120        meminfo.Percpu
    380179            -0.1%     379931        meminfo.SReclaimable
    210680            -1.2%     208051        meminfo.SUnreclaim
   1330766            -0.4%    1324924        meminfo.Shmem
    590860            -0.5%     587983        meminfo.Slab
   1002266            -0.0%    1002110        meminfo.Unevictable
 3.436e+10            +0.0%  3.436e+10        meminfo.VmallocTotal
    141540            +0.0%     141586        meminfo.VmallocUsed
      0.33 ±141%    -100.0%       0.00        meminfo.Writeback
     49345            +0.2%      49446        meminfo.max_used_kB
   1004900 ±  2%      -2.0%     984368 ±  2%  numa-meminfo.node0.Active
     47962 ±  7%     -20.4%      38173 ±  8%  numa-meminfo.node0.Active(anon)
    956937 ±  2%      -1.1%     946194 ±  3%  numa-meminfo.node0.Active(file)
    155335 ± 39%     +16.0%     180235 ±  2%  numa-meminfo.node0.AnonHugePages
    202539 ± 30%     +11.4%     225566 ±  7%  numa-meminfo.node0.AnonPages
      1.33 ± 93%    +350.0%       6.00 ± 36%  numa-meminfo.node0.Dirty
  21255962            -0.2%   21213790        numa-meminfo.node0.FilePages
  19943681            -0.0%   19934270        numa-meminfo.node0.Inactive
    580554 ± 83%     +68.8%     980056 ± 56%  numa-meminfo.node0.Inactive(anon)
  19363126 ±  2%      -2.1%   18954212 ±  2%  numa-meminfo.node0.Inactive(file)
    203115 ±  3%      -1.1%     200911 ±  2%  numa-meminfo.node0.KReclaimable
      8273 ±  5%      +7.3%       8879 ±  6%  numa-meminfo.node0.KernelStack
  20670432            -0.1%   20648779        numa-meminfo.node0.Mapped
    288688 ±  5%      +0.0%     288688 ±  7%  numa-meminfo.node0.MemFree
  24375744            +0.0%   24375744        numa-meminfo.node0.MemTotal
  24087054            +0.0%   24087054        numa-meminfo.node0.MemUsed
      1153 ± 12%      -9.0%       1049 ± 13%  numa-meminfo.node0.Mlocked
    219002 ±  9%      +6.4%     232926 ±  2%  numa-meminfo.node0.PageTables
    203115 ±  3%      -1.1%     200911 ±  2%  numa-meminfo.node0.SReclaimable
    107409 ±  6%      +4.3%     111998 ±  7%  numa-meminfo.node0.SUnreclaim
    426256 ±125%     +86.0%     792944 ± 67%  numa-meminfo.node0.Shmem
    310526            +0.8%     312910 ±  2%  numa-meminfo.node0.Slab
    506983 ±  3%      +2.1%     517878        numa-meminfo.node0.Unevictable
      0.00          -100.0%       0.00        numa-meminfo.node0.Writeback
   1111595 ±  3%      -0.1%    1110160 ±  2%  numa-meminfo.node1.Active
    149042 ±  4%      +1.8%     151793 ±  5%  numa-meminfo.node1.Active(anon)
    962552 ±  3%      -0.4%     958366 ±  3%  numa-meminfo.node1.Active(file)
    187949 ± 31%     -12.3%     164813 ±  4%  numa-meminfo.node1.AnonHugePages
    242069 ± 21%     -18.4%     197426 ± 10%  numa-meminfo.node1.AnonPages
      3.33 ±101%     -40.0%       2.00 ±108%  numa-meminfo.node1.Dirty
  21685725            +0.2%   21720795        numa-meminfo.node1.FilePages
  20317717            +0.0%   20320622        numa-meminfo.node1.Inactive
    997352 ± 50%     -42.1%     577386 ± 93%  numa-meminfo.node1.Inactive(anon)
  19320364 ±  2%      +2.2%   19743235 ±  2%  numa-meminfo.node1.Inactive(file)
    176979 ±  4%      +1.1%     178959 ±  2%  numa-meminfo.node1.KReclaimable
      7271 ±  7%      -8.4%       6663 ±  9%  numa-meminfo.node1.KernelStack
  21009777            +0.3%   21073539        numa-meminfo.node1.Mapped
    205643 ± 11%     +17.0%     240617 ±  7%  numa-meminfo.node1.MemFree
  24732320            +0.0%   24732320        numa-meminfo.node1.MemTotal
  24526676            -0.1%   24491701        numa-meminfo.node1.MemUsed
      1077 ± 17%     -11.4%     955.33 ± 14%  numa-meminfo.node1.Mlocked
    194090 ± 10%      -6.9%     180794 ±  2%  numa-meminfo.node1.PageTables
    176979 ±  4%      +1.1%     178959 ±  2%  numa-meminfo.node1.SReclaimable
    103268 ±  6%      -7.0%      96053 ±  9%  numa-meminfo.node1.SUnreclaim
    904534 ± 58%     -41.2%     531937 ±101%  numa-meminfo.node1.Shmem
    280249 ±  2%      -1.9%     275013 ±  2%  numa-meminfo.node1.Slab
    495282 ±  3%      -2.2%     484231        numa-meminfo.node1.Unevictable
      0.00          -100.0%       0.00        numa-meminfo.node1.Writeback
     10.00            +1.2%      10.12 ±  2%  perf-stat.i.MPKI
 9.909e+09            +0.2%  9.928e+09        perf-stat.i.branch-instructions
      0.36            +0.0        0.37        perf-stat.i.branch-miss-rate%
  35992682            +1.4%   36491789        perf-stat.i.branch-misses
     66.00            -0.6       65.38        perf-stat.i.cache-miss-rate%
 3.168e+08            +0.6%  3.188e+08        perf-stat.i.cache-misses
 4.783e+08            +1.7%  4.862e+08        perf-stat.i.cache-references
      6111           +10.4%       6749        perf-stat.i.context-switches
      2.98            +0.3%       2.98        perf-stat.i.cpi
     96004            +0.0%      96006        perf-stat.i.cpu-clock
 1.396e+11            +0.1%  1.397e+11        perf-stat.i.cpu-cycles
    107.73            +0.1%     107.84        perf-stat.i.cpu-migrations
    463.94 ±  2%      +0.5%     466.31 ±  3%  perf-stat.i.cycles-between-cache-misses
      0.36 ±  2%      +0.0        0.36        perf-stat.i.dTLB-load-miss-rate%
  44154472 ±  2%      +0.7%   44454597 ±  2%  perf-stat.i.dTLB-load-misses
   1.2e+10            +0.1%  1.202e+10        perf-stat.i.dTLB-loads
      0.06 ± 13%      -0.0        0.05 ± 12%  perf-stat.i.dTLB-store-miss-rate%
   3458458 ± 15%     -13.9%    2978090 ± 10%  perf-stat.i.dTLB-store-misses
 5.595e+09 ±  2%      +0.1%  5.598e+09        perf-stat.i.dTLB-stores
     88.43            +0.3       88.68        perf-stat.i.iTLB-load-miss-rate%
  18516950 ±  2%      -0.4%   18452098        perf-stat.i.iTLB-load-misses
   2351967            -3.2%    2276210 ±  3%  perf-stat.i.iTLB-loads
 4.757e+10            +0.2%  4.766e+10        perf-stat.i.instructions
      2611 ±  2%      +0.9%       2635        perf-stat.i.instructions-per-iTLB-miss
      0.34            +0.1%       0.34        perf-stat.i.ipc
   1888487 ±  2%      +0.1%    1890563        perf-stat.i.major-faults
      1.45            +0.1%       1.46        perf-stat.i.metric.GHz
      0.10 ±  2%      +6.5%       0.10 ±  3%  perf-stat.i.metric.K/sec
    292.62            +0.2%     293.11        perf-stat.i.metric.M/sec
      2818 ±  2%      -1.8%       2767        perf-stat.i.minor-faults
     60.07 ±  9%      -2.9       57.15 ±  3%  perf-stat.i.node-load-miss-rate%
  15587559 ± 11%      -5.3%   14769098 ±  4%  perf-stat.i.node-load-misses
  10462305 ± 12%      +7.6%   11255055 ±  3%  perf-stat.i.node-loads
     34.30            -0.5       33.80        perf-stat.i.node-store-miss-rate%
  24134386            -1.9%   23678903        perf-stat.i.node-store-misses
  48193903 ±  2%      +1.1%   48737571        perf-stat.i.node-stores
   1891305 ±  2%      +0.1%    1893331        perf-stat.i.page-faults
     96004            +0.0%      96006        perf-stat.i.task-clock
     10.06            +1.5%      10.20 ±  2%  perf-stat.overall.MPKI
      0.36            +0.0        0.37        perf-stat.overall.branch-miss-rate%
     66.24            -0.7       65.58        perf-stat.overall.cache-miss-rate%
      2.94            -0.1%       2.93        perf-stat.overall.cpi
    440.72            -0.5%     438.52        perf-stat.overall.cycles-between-cache-misses
      0.37 ±  2%      +0.0        0.37        perf-stat.overall.dTLB-load-miss-rate%
      0.06 ± 13%      -0.0        0.05 ± 12%  perf-stat.overall.dTLB-store-miss-rate%
     88.72            +0.3       89.02        perf-stat.overall.iTLB-load-miss-rate%
      2570 ±  2%      +0.5%       2583        perf-stat.overall.instructions-per-iTLB-miss
      0.34            +0.0%       0.34        perf-stat.overall.ipc
     59.74 ±  9%      -3.0       56.73 ±  3%  perf-stat.overall.node-load-miss-rate%
     33.38 ±  2%      -0.7       32.71        perf-stat.overall.node-store-miss-rate%
  12713516            +0.1%   12728885        perf-stat.overall.path-length
 9.897e+09            +0.2%  9.915e+09        perf-stat.ps.branch-instructions
  35945816            +1.4%   36441252        perf-stat.ps.branch-misses
 3.164e+08            +0.6%  3.184e+08        perf-stat.ps.cache-misses
 4.777e+08            +1.6%  4.855e+08        perf-stat.ps.cache-references
      6105           +10.4%       6742        perf-stat.ps.context-switches
     95903            +0.0%      95903        perf-stat.ps.cpu-clock
 1.394e+11            +0.1%  1.396e+11        perf-stat.ps.cpu-cycles
    107.66            +0.1%     107.77        perf-stat.ps.cpu-migrations
  44094822 ±  2%      +0.7%   44390837 ±  2%  perf-stat.ps.dTLB-load-misses
 1.199e+10            +0.1%    1.2e+10        perf-stat.ps.dTLB-loads
   3453661 ± 15%     -13.9%    2973891 ± 10%  perf-stat.ps.dTLB-store-misses
 5.588e+09 ±  2%      +0.0%  5.591e+09        perf-stat.ps.dTLB-stores
  18492228 ±  2%      -0.4%   18426219        perf-stat.ps.iTLB-load-misses
   2349163            -3.2%    2273384 ±  3%  perf-stat.ps.iTLB-loads
 4.751e+10            +0.2%  4.759e+10        perf-stat.ps.instructions
   1885948 ±  2%      +0.1%    1887890        perf-stat.ps.major-faults
      2816 ±  2%      -1.8%       2764        perf-stat.ps.minor-faults
  15568897 ± 11%      -5.3%   14750517 ±  4%  perf-stat.ps.node-load-misses
  10447880 ± 12%      +7.6%   11238767 ±  3%  perf-stat.ps.node-loads
  24104368            -1.9%   23650332        perf-stat.ps.node-store-misses
  48128645 ±  2%      +1.1%   48666903        perf-stat.ps.node-stores
   1888764 ±  2%      +0.1%    1890654        perf-stat.ps.page-faults
     95903            +0.0%      95903        perf-stat.ps.task-clock
 4.765e+13            +0.1%  4.771e+13        perf-stat.total.instructions
     11989 ±  7%     -20.3%       9556 ±  8%  numa-vmstat.node0.nr_active_anon
    239216 ±  2%      -1.1%     236607 ±  3%  numa-vmstat.node0.nr_active_file
     50639 ± 30%     +11.4%      56395 ±  7%  numa-vmstat.node0.nr_anon_pages
     75.33 ± 39%     +16.4%      87.67 ±  3%  numa-vmstat.node0.nr_anon_transparent_hugepages
  33816140 ± 68%     +49.3%   50497277 ±  2%  numa-vmstat.node0.nr_dirtied
      0.00       +1.3e+102%       1.33 ± 70%  numa-vmstat.node0.nr_dirty
   5313242            -0.2%    5302912        numa-vmstat.node0.nr_file_pages
     72824 ±  6%      +0.1%      72874 ±  8%  numa-vmstat.node0.nr_free_pages
    145144 ± 83%     +68.8%     245008 ± 56%  numa-vmstat.node0.nr_inactive_anon
   4840025 ±  2%      -2.1%    4737960 ±  2%  numa-vmstat.node0.nr_inactive_file
    158.67 ±  7%     +25.6%     199.33 ±  7%  numa-vmstat.node0.nr_isolated_file
      8274 ±  5%      +7.3%       8878 ±  7%  numa-vmstat.node0.nr_kernel_stack
   5168599            -0.1%    5163354        numa-vmstat.node0.nr_mapped
    288.33 ± 12%      -9.1%     262.00 ± 12%  numa-vmstat.node0.nr_mlock
     54763 ±  9%      +6.4%      58253 ±  2%  numa-vmstat.node0.nr_page_table_pages
    106564 ±125%     +86.0%     198240 ± 67%  numa-vmstat.node0.nr_shmem
     50785 ±  3%      -1.1%      50221 ±  2%  numa-vmstat.node0.nr_slab_reclaimable
     26852 ±  6%      +4.3%      28000 ±  7%  numa-vmstat.node0.nr_slab_unreclaimable
    126745 ±  3%      +2.1%     129469        numa-vmstat.node0.nr_unevictable
     28.67 ±101%    +158.1%      74.00 ± 36%  numa-vmstat.node0.nr_vmscan_immediate_reclaim
      0.00          -100.0%       0.00        numa-vmstat.node0.nr_writeback
  33816139 ± 68%     +49.3%   50497275 ±  2%  numa-vmstat.node0.nr_written
     11989 ±  7%     -20.3%       9557 ±  8%  numa-vmstat.node0.nr_zone_active_anon
    239055 ±  2%      -1.1%     236440 ±  3%  numa-vmstat.node0.nr_zone_active_file
    145174 ± 83%     +68.8%     245032 ± 56%  numa-vmstat.node0.nr_zone_inactive_anon
   4839649 ±  2%      -2.1%    4737625 ±  2%  numa-vmstat.node0.nr_zone_inactive_file
    126745 ±  3%      +2.1%     129469        numa-vmstat.node0.nr_zone_unevictable
      0.00       +1.3e+102%       1.33 ± 70%  numa-vmstat.node0.nr_zone_write_pending
 1.106e+08 ±  4%      -1.6%  1.089e+08 ±  6%  numa-vmstat.node0.numa_foreign
 3.938e+08 ±  6%      +5.3%  4.148e+08 ±  4%  numa-vmstat.node0.numa_hit
    139721            +0.1%     139911        numa-vmstat.node0.numa_interleave
 3.938e+08 ±  6%      +5.3%  4.147e+08 ±  4%  numa-vmstat.node0.numa_local
 1.122e+08 ±  6%      -8.2%   1.03e+08 ±  3%  numa-vmstat.node0.numa_miss
 1.122e+08 ±  6%      -8.2%   1.03e+08 ±  3%  numa-vmstat.node0.numa_other
    798735 ±  5%      -2.6%     777744 ±  6%  numa-vmstat.node0.workingset_activate_file
    168713 ±  3%      -4.7%     160841 ±  2%  numa-vmstat.node0.workingset_nodes
  69574620 ±  6%      -2.7%   67672869 ±  4%  numa-vmstat.node0.workingset_refault_file
     20789 ± 34%     +26.1%      26212 ± 15%  numa-vmstat.node0.workingset_restore_file
     37255 ±  4%      +2.0%      38011 ±  5%  numa-vmstat.node1.nr_active_anon
    240582 ±  3%      -0.4%     239532 ±  2%  numa-vmstat.node1.nr_active_file
     60526 ± 21%     -18.4%      49360 ± 10%  numa-vmstat.node1.nr_anon_pages
     91.00 ± 31%     -12.5%      79.67 ±  4%  numa-vmstat.node1.nr_anon_transparent_hugepages
  18612744 ±123%     -89.6%    1931606 ± 70%  numa-vmstat.node1.nr_dirtied
      0.67 ±141%     -50.0%       0.33 ±141%  numa-vmstat.node1.nr_dirty
   5421155            +0.2%    5429991        numa-vmstat.node1.nr_file_pages
      4101 ± 37%     +96.1%       8044 ± 30%  numa-vmstat.node1.nr_free_cma
     51916 ± 10%     +17.0%      60748 ±  7%  numa-vmstat.node1.nr_free_pages
    249404 ± 50%     -42.1%     144339 ± 93%  numa-vmstat.node1.nr_inactive_anon
   4829812 ±  2%      +2.2%    4935642 ±  2%  numa-vmstat.node1.nr_inactive_file
      0.00          -100.0%       0.00        numa-vmstat.node1.nr_isolated_anon
    150.67 ±  5%     +47.8%     222.67 ±  8%  numa-vmstat.node1.nr_isolated_file
      7272 ±  7%      -8.4%       6661 ±  9%  numa-vmstat.node1.nr_kernel_stack
   5253730            +0.3%    5269746        numa-vmstat.node1.nr_mapped
    269.33 ± 17%     -11.4%     238.67 ± 14%  numa-vmstat.node1.nr_mlock
     48539 ± 10%      -6.9%      45212 ±  2%  numa-vmstat.node1.nr_page_table_pages
    226185 ± 58%     -41.2%     133035 ±101%  numa-vmstat.node1.nr_shmem
     44251 ±  4%      +1.1%      44741 ±  2%  numa-vmstat.node1.nr_slab_reclaimable
     25817 ±  6%      -7.0%      24012 ±  9%  numa-vmstat.node1.nr_slab_unreclaimable
    123820 ±  3%      -2.2%     121057        numa-vmstat.node1.nr_unevictable
     64.33 ± 69%     -35.8%      41.33 ±102%  numa-vmstat.node1.nr_vmscan_immediate_reclaim
      0.00          -100.0%       0.00        numa-vmstat.node1.nr_writeback
  18612743 ±123%     -89.6%    1931605 ± 70%  numa-vmstat.node1.nr_written
     37255 ±  4%      +2.0%      38011 ±  5%  numa-vmstat.node1.nr_zone_active_anon
    240484 ±  3%      -0.4%     239404 ±  2%  numa-vmstat.node1.nr_zone_active_file
    249431 ± 50%     -42.1%     144374 ± 93%  numa-vmstat.node1.nr_zone_inactive_anon
   4829583 ±  2%      +2.2%    4935478 ±  2%  numa-vmstat.node1.nr_zone_inactive_file
    123820 ±  3%      -2.2%     121057        numa-vmstat.node1.nr_zone_unevictable
      0.33 ±141%      +0.0%       0.33 ±141%  numa-vmstat.node1.nr_zone_write_pending
 1.122e+08 ±  6%      -8.2%   1.03e+08 ±  3%  numa-vmstat.node1.numa_foreign
 3.894e+08 ±  6%      -2.4%  3.799e+08 ±  3%  numa-vmstat.node1.numa_hit
    140170            -0.2%     139941        numa-vmstat.node1.numa_interleave
 3.893e+08 ±  6%      -2.4%  3.798e+08 ±  3%  numa-vmstat.node1.numa_local
 1.106e+08 ±  4%      -1.6%  1.089e+08 ±  6%  numa-vmstat.node1.numa_miss
 1.108e+08 ±  4%      -1.6%   1.09e+08 ±  6%  numa-vmstat.node1.numa_other
    830278 ±  4%      +1.4%     842293 ±  4%  numa-vmstat.node1.workingset_activate_file
    140666 ±  4%      +4.7%     147298 ±  2%  numa-vmstat.node1.workingset_nodes
  71513095            +1.4%   72543267 ±  2%  numa-vmstat.node1.workingset_refault_file
     24329 ± 22%     -13.1%      21136 ± 26%  numa-vmstat.node1.workingset_restore_file
   1328293 ±  2%      -0.6%    1320359        proc-vmstat.allocstall_movable
      4213 ±  6%     +20.7%       5084 ± 15%  proc-vmstat.allocstall_normal
   1669423 ± 35%      -1.1%    1650354 ± 37%  proc-vmstat.compact_daemon_free_scanned
   1626775 ±  3%      -3.1%    1575643 ± 12%  proc-vmstat.compact_daemon_migrate_scanned
      6391 ±  7%      -2.0%       6262 ± 12%  proc-vmstat.compact_daemon_wake
    461.67 ±  9%     +37.7%     635.67 ± 24%  proc-vmstat.compact_fail
   1815669 ± 35%      +0.3%    1820877 ± 29%  proc-vmstat.compact_free_scanned
    126044 ± 23%     +20.0%     151299 ± 61%  proc-vmstat.compact_isolated
   1672279 ±  6%      -4.3%    1600778 ± 11%  proc-vmstat.compact_migrate_scanned
    474.00 ± 10%     +37.5%     651.67 ± 24%  proc-vmstat.compact_stall
     12.33 ± 33%     +29.7%      16.00 ± 22%  proc-vmstat.compact_success
     37.67 ± 16%     +18.6%      44.67 ± 27%  proc-vmstat.kswapd_high_wmark_hit_quickly
     16800 ±  5%     -11.2%      14910 ±  8%  proc-vmstat.kswapd_low_wmark_hit_quickly
     49267 ±  4%      -3.5%      47521 ±  2%  proc-vmstat.nr_active_anon
    479759            -0.8%     475967        proc-vmstat.nr_active_file
    111149 ±  6%      -4.9%     105740 ±  5%  proc-vmstat.nr_anon_pages
    167.00            +0.4%     167.67        proc-vmstat.nr_anon_transparent_hugepages
     85.33            -0.8%      84.67        proc-vmstat.nr_dirtied
      1.00 ± 81%    +100.0%       2.00        proc-vmstat.nr_dirty
   1018992            +0.1%    1019764        proc-vmstat.nr_dirty_background_threshold
   2040477            +0.1%    2042024        proc-vmstat.nr_dirty_threshold
  10734329            -0.0%   10732403        proc-vmstat.nr_file_pages
      4100 ± 38%     +95.2%       8004 ± 30%  proc-vmstat.nr_free_cma
    124348            +7.3%     133457 ±  6%  proc-vmstat.nr_free_pages
    394477            -1.3%     389352        proc-vmstat.nr_inactive_anon
   9669876            +0.0%    9673228        proc-vmstat.nr_inactive_file
      0.00          -100.0%       0.00        proc-vmstat.nr_isolated_anon
    310.67           +36.2%     423.00        proc-vmstat.nr_isolated_file
     15546            -0.0%      15544        proc-vmstat.nr_kernel_stack
  10419022            +0.1%   10427348        proc-vmstat.nr_mapped
    557.67 ±  7%     -10.2%     501.00        proc-vmstat.nr_mlock
    103271            +0.2%     103446        proc-vmstat.nr_page_table_pages
    332716            -0.4%     331248        proc-vmstat.nr_shmem
     95048            -0.1%      94992        proc-vmstat.nr_slab_reclaimable
     52669            -1.2%      52013        proc-vmstat.nr_slab_unreclaimable
    250566            -0.0%     250527        proc-vmstat.nr_unevictable
    122.00 ± 20%     +18.9%     145.00 ± 24%  proc-vmstat.nr_vmscan_immediate_reclaim
      0.00          -100.0%       0.00        proc-vmstat.nr_writeback
     84.00            -0.8%      83.33        proc-vmstat.nr_written
     49267 ±  4%      -3.5%      47521 ±  2%  proc-vmstat.nr_zone_active_anon
    479480            -0.8%     475707        proc-vmstat.nr_zone_active_file
    394536            -1.3%     389410        proc-vmstat.nr_zone_inactive_anon
   9669441            +0.0%    9672865        proc-vmstat.nr_zone_inactive_file
    250566            -0.0%     250527        proc-vmstat.nr_zone_unevictable
      1.33 ± 35%     +50.0%       2.00        proc-vmstat.nr_zone_write_pending
 4.262e+08 ±  3%      -3.0%  4.135e+08        proc-vmstat.numa_foreign
     72183 ± 85%     -60.9%      28253 ± 85%  proc-vmstat.numa_hint_faults
     21792 ± 71%     -58.8%       8985 ± 52%  proc-vmstat.numa_hint_faults_local
 1.469e+09 ±  2%      +0.9%  1.482e+09 ±  2%  proc-vmstat.numa_hit
      3539 ±  8%      -3.9%       3399 ±  9%  proc-vmstat.numa_huge_pte_updates
      0.00          -100.0%       0.00        proc-vmstat.numa_interleave
 1.469e+09 ±  2%      +0.9%  1.482e+09 ±  2%  proc-vmstat.numa_local
 4.262e+08 ±  3%      -3.0%  4.135e+08        proc-vmstat.numa_miss
 4.262e+08 ±  3%      -3.0%  4.135e+08        proc-vmstat.numa_other
     36078 ± 10%      -7.7%      33288 ± 38%  proc-vmstat.numa_pages_migrated
   1882435 ± 11%      -6.1%    1768086 ± 10%  proc-vmstat.numa_pte_updates
     16840 ±  5%     -11.2%      14957 ±  8%  proc-vmstat.pageoutrun
  22636558            -2.6%   22058740        proc-vmstat.pgactivate
      0.00          -100.0%       0.00        proc-vmstat.pgalloc_dma
  70612813            +1.5%   71685526        proc-vmstat.pgalloc_dma32
 1.825e+09 ±  2%      -0.0%  1.825e+09        proc-vmstat.pgalloc_normal
  25229094            -2.4%   24631967        proc-vmstat.pgdeactivate
 3.788e+09 ±  2%      +0.0%   3.79e+09        proc-vmstat.pgfault
 1.885e+09 ±  2%      +0.0%  1.886e+09        proc-vmstat.pgfree
 1.892e+09 ±  2%      +0.0%  1.893e+09        proc-vmstat.pgmajfault
     40379 ± 62%     -50.1%      20151 ± 74%  proc-vmstat.pgmigrate_fail
     95356 ± 18%     +10.5%     105340 ± 46%  proc-vmstat.pgmigrate_success
 7.569e+09 ±  2%      +0.0%  7.573e+09        proc-vmstat.pgpgin
    126.67 ± 12%     +10.5%     140.00 ±  8%  proc-vmstat.pgpgout
  25229108            -2.4%   24631987        proc-vmstat.pgrefill
    175459            +1.6%     178350        proc-vmstat.pgreuse
    810.67 ±  9%     +27.6%       1034 ±  3%  proc-vmstat.pgrotated
 3.191e+09 ±  2%      -0.4%   3.18e+09        proc-vmstat.pgscan_direct
    465.33 ±141%    +235.0%       1559 ± 78%  proc-vmstat.pgscan_direct_throttle
 3.789e+09 ±  2%      +0.0%   3.79e+09        proc-vmstat.pgscan_file
 5.976e+08            +2.1%  6.104e+08 ±  2%  proc-vmstat.pgscan_kswapd
 1.692e+09 ±  2%      -0.3%  1.686e+09        proc-vmstat.pgsteal_direct
 1.882e+09 ±  2%      +0.0%  1.883e+09        proc-vmstat.pgsteal_file
 1.907e+08 ±  3%      +3.4%  1.972e+08 ±  4%  proc-vmstat.pgsteal_kswapd
     93123 ± 22%      -1.9%      91356 ±  3%  proc-vmstat.slabs_scanned
      0.33 ±141%      +0.0%       0.33 ±141%  proc-vmstat.thp_collapse_alloc
      0.00       +6.7e+101%       0.67 ± 70%  proc-vmstat.thp_collapse_alloc_failed
     56.33            -0.6%      56.00        proc-vmstat.thp_fault_alloc
      0.00          -100.0%       0.00        proc-vmstat.thp_split_pmd
      0.00          -100.0%       0.00        proc-vmstat.thp_zero_page_alloc
     44.33 ± 90%    +127.1%     100.67        proc-vmstat.unevictable_pgs_culled
    195.33 ±141%    +200.0%     586.00        proc-vmstat.unevictable_pgs_mlocked
   1629023            -0.6%    1618875 ±  3%  proc-vmstat.workingset_activate_file
    309516            -0.4%     308267        proc-vmstat.workingset_nodes
 1.411e+08 ±  2%      -0.7%  1.401e+08        proc-vmstat.workingset_refault_file
     45110 ±  3%      +4.9%      47304 ± 13%  proc-vmstat.workingset_restore_file
    253.01 ± 75%     -54.9%     114.06 ±141%  sched_debug.cfs_rq:/.MIN_vruntime.avg
     20984 ± 71%     -54.1%       9636 ±141%  sched_debug.cfs_rq:/.MIN_vruntime.max
      0.00            +0.0%       0.00        sched_debug.cfs_rq:/.MIN_vruntime.min
      2284 ± 73%     -54.4%       1041 ±141%  sched_debug.cfs_rq:/.MIN_vruntime.stddev
    242278 ±  3%      +2.4%     247984        sched_debug.cfs_rq:/.exec_clock.avg
    368366 ±  3%      -1.6%     362604 ±  4%  sched_debug.cfs_rq:/.exec_clock.max
    115559 ± 14%     +16.3%     134365 ±  7%  sched_debug.cfs_rq:/.exec_clock.min
     53171 ±  7%      -2.1%      52044 ± 16%  sched_debug.cfs_rq:/.exec_clock.stddev
    625415            +3.5%     647073 ±  2%  sched_debug.cfs_rq:/.load.avg
   1132102 ±  6%      -6.8%    1054640 ±  5%  sched_debug.cfs_rq:/.load.max
    476250            -2.5%     464350        sched_debug.cfs_rq:/.load.stddev
    608.03            +4.0%     632.44 ±  2%  sched_debug.cfs_rq:/.load_avg.avg
      1040            -1.0%       1030        sched_debug.cfs_rq:/.load_avg.max
    467.13            -1.7%     459.29        sched_debug.cfs_rq:/.load_avg.stddev
    253.01 ± 75%     -54.9%     114.06 ±141%  sched_debug.cfs_rq:/.max_vruntime.avg
     20984 ± 71%     -54.1%       9636 ±141%  sched_debug.cfs_rq:/.max_vruntime.max
      0.00            +0.0%       0.00        sched_debug.cfs_rq:/.max_vruntime.min
      2284 ± 73%     -54.4%       1041 ±141%  sched_debug.cfs_rq:/.max_vruntime.stddev
    273397 ±  3%      +3.3%     282294        sched_debug.cfs_rq:/.min_vruntime.avg
    407737 ±  2%      -0.4%     405960 ±  3%  sched_debug.cfs_rq:/.min_vruntime.max
    148862 ± 13%     +14.1%     169924 ±  7%  sched_debug.cfs_rq:/.min_vruntime.min
     53656 ±  6%      -2.9%      52125 ± 18%  sched_debug.cfs_rq:/.min_vruntime.stddev
      0.62            +3.4%       0.64 ±  2%  sched_debug.cfs_rq:/.nr_running.avg
      1.10 ±  9%      -5.5%       1.04 ±  5%  sched_debug.cfs_rq:/.nr_running.max
      0.47            -2.0%       0.46        sched_debug.cfs_rq:/.nr_running.stddev
      0.72 ± 10%      -5.2%       0.68 ±  2%  sched_debug.cfs_rq:/.nr_spread_over.avg
      4.17 ± 25%      -3.6%       4.02 ± 20%  sched_debug.cfs_rq:/.nr_spread_over.max
      0.85 ±  7%      +4.0%       0.88 ±  7%  sched_debug.cfs_rq:/.nr_spread_over.stddev
      2.18 ± 65%     -59.9%       0.87 ±141%  sched_debug.cfs_rq:/.removed.load_avg.avg
     60.63 ±  4%     -66.9%      20.08 ±141%  sched_debug.cfs_rq:/.removed.load_avg.max
     10.58 ± 36%     -61.9%       4.03 ±141%  sched_debug.cfs_rq:/.removed.load_avg.stddev
      0.98 ± 81%     -70.4%       0.29 ±141%  sched_debug.cfs_rq:/.removed.runnable_avg.avg
     24.97 ± 26%     -62.2%       9.45 ±141%  sched_debug.cfs_rq:/.removed.runnable_avg.max
      4.49 ± 56%     -68.4%       1.42 ±141%  sched_debug.cfs_rq:/.removed.runnable_avg.stddev
      0.98 ± 81%     -70.4%       0.29 ±141%  sched_debug.cfs_rq:/.removed.util_avg.avg
     24.97 ± 26%     -62.2%       9.45 ±141%  sched_debug.cfs_rq:/.removed.util_avg.max
      4.49 ± 56%     -68.4%       1.42 ±141%  sched_debug.cfs_rq:/.removed.util_avg.stddev
    624.50            +4.1%     650.19 ±  3%  sched_debug.cfs_rq:/.runnable_avg.avg
      1069            -1.5%       1053        sched_debug.cfs_rq:/.runnable_avg.max
    471.87            -1.2%     466.09        sched_debug.cfs_rq:/.runnable_avg.stddev
     -3992          +344.1%     -17730        sched_debug.cfs_rq:/.spread0.avg
    130353 ± 38%     -18.7%     105936 ± 16%  sched_debug.cfs_rq:/.spread0.max
   -128520            +1.2%    -130100        sched_debug.cfs_rq:/.spread0.min
     53657 ±  6%      -2.9%      52125 ± 18%  sched_debug.cfs_rq:/.spread0.stddev
    623.90            +4.1%     649.45 ±  3%  sched_debug.cfs_rq:/.util_avg.avg
      1060            -2.0%       1039        sched_debug.cfs_rq:/.util_avg.max
    471.41            -1.2%     465.65        sched_debug.cfs_rq:/.util_avg.stddev
    590.96            +3.9%     614.13 ±  2%  sched_debug.cfs_rq:/.util_est_enqueued.avg
      1003            -1.1%     993.00        sched_debug.cfs_rq:/.util_est_enqueued.max
    465.44            -1.4%     458.82        sched_debug.cfs_rq:/.util_est_enqueued.stddev
    895285            -1.0%     886431        sched_debug.cpu.avg_idle.avg
   1017734 ±  2%      -1.7%    1000000        sched_debug.cpu.avg_idle.max
    208271 ±  6%     -15.3%     176436 ± 12%  sched_debug.cpu.avg_idle.min
    182123 ±  4%      +8.2%     197027 ±  2%  sched_debug.cpu.avg_idle.stddev
    673375            +1.6%     684119        sched_debug.cpu.clock.avg
    673384            +1.6%     684127        sched_debug.cpu.clock.max
    673366            +1.6%     684110        sched_debug.cpu.clock.min
      5.73 ±  2%      +1.0%       5.79 ± 12%  sched_debug.cpu.clock.stddev
    668803            +1.6%     679444        sched_debug.cpu.clock_task.avg
    669190            +1.6%     679861        sched_debug.cpu.clock_task.max
    663672            +1.6%     674259        sched_debug.cpu.clock_task.min
    621.19 ±  2%      +0.5%     624.30        sched_debug.cpu.clock_task.stddev
      1514            +0.7%       1524        sched_debug.cpu.curr->pid.avg
     14110 ±  2%      +1.3%      14296        sched_debug.cpu.curr->pid.max
      1941            +1.3%       1965        sched_debug.cpu.curr->pid.stddev
    500144            -0.0%     500037        sched_debug.cpu.max_idle_balance_cost.avg
    508648 ±  2%      -1.0%     503634        sched_debug.cpu.max_idle_balance_cost.max
    500000            +0.0%     500000        sched_debug.cpu.max_idle_balance_cost.min
    976.01 ±141%     -62.2%     369.04 ±141%  sched_debug.cpu.max_idle_balance_cost.stddev
      4295            +0.0%       4295        sched_debug.cpu.next_balance.avg
      4295            +0.0%       4295        sched_debug.cpu.next_balance.max
      4295            +0.0%       4295        sched_debug.cpu.next_balance.min
      0.00            -2.1%       0.00        sched_debug.cpu.next_balance.stddev
      0.52            -0.1%       0.51        sched_debug.cpu.nr_running.avg
      1.08 ±  6%      -3.7%       1.04 ±  5%  sched_debug.cpu.nr_running.max
      0.49            -0.6%       0.49        sched_debug.cpu.nr_running.stddev
     86248 ± 13%     +20.4%     103817        sched_debug.cpu.nr_switches.avg
   3331122 ± 55%     -17.4%    2752534 ±  7%  sched_debug.cpu.nr_switches.max
     19837 ±  8%     +12.7%      22363 ±  4%  sched_debug.cpu.nr_switches.min
    352881 ± 49%     -11.8%     311258 ±  7%  sched_debug.cpu.nr_switches.stddev
      0.00 ± 18%      -1.8%       0.00 ± 53%  sched_debug.cpu.nr_uninterruptible.avg
     32.08 ± 54%     +14.3%      36.65 ± 31%  sched_debug.cpu.nr_uninterruptible.max
    -23.37            -6.1%     -21.94        sched_debug.cpu.nr_uninterruptible.min
      7.54 ± 13%      +9.3%       8.24 ±  8%  sched_debug.cpu.nr_uninterruptible.stddev
     30104 ±  4%     +13.0%      34018        sched_debug.cpu.sched_count.avg
     47646 ±  6%     +10.3%      52570 ±  7%  sched_debug.cpu.sched_count.max
     18334 ± 10%     +14.3%      20960 ±  5%  sched_debug.cpu.sched_count.min
      5637 ±  9%      +7.1%       6040 ±  5%  sched_debug.cpu.sched_count.stddev
      4091 ±  3%      +3.4%       4230        sched_debug.cpu.sched_goidle.avg
     13055 ±  5%     +20.9%      15781 ± 21%  sched_debug.cpu.sched_goidle.max
    808.79 ± 11%      +9.2%     883.16 ± 18%  sched_debug.cpu.sched_goidle.min
      2537 ±  3%      +3.5%       2625 ±  6%  sched_debug.cpu.sched_goidle.stddev
     14674 ±  4%     +13.3%      16622        sched_debug.cpu.ttwu_count.avg
     23541 ±  2%     +12.0%      26364 ±  3%  sched_debug.cpu.ttwu_count.max
      8114 ± 18%     +17.7%       9553 ± 10%  sched_debug.cpu.ttwu_count.min
      2790 ±  6%     +12.0%       3123 ±  6%  sched_debug.cpu.ttwu_count.stddev
     12278 ±  4%     +14.1%      14014        sched_debug.cpu.ttwu_local.avg
     18609 ±  3%      +9.2%      20312 ±  3%  sched_debug.cpu.ttwu_local.max
      6654 ± 17%     +20.2%       7997 ± 11%  sched_debug.cpu.ttwu_local.min
      2353 ± 10%      +8.0%       2540 ± 10%  sched_debug.cpu.ttwu_local.stddev
    673366            +1.6%     684110        sched_debug.cpu_clk
    996147            +0.0%     996147        sched_debug.dl_rq:.dl_bw->bw.avg
    996147            +0.0%     996147        sched_debug.dl_rq:.dl_bw->bw.max
    996147            +0.0%     996147        sched_debug.dl_rq:.dl_bw->bw.min
 4.295e+09            +0.0%  4.295e+09        sched_debug.jiffies
    672869            +1.6%     683612        sched_debug.ktime
    950.00            +0.0%     950.00        sched_debug.rt_rq:/.rt_runtime.avg
    950.00            +0.0%     950.00        sched_debug.rt_rq:/.rt_runtime.max
    950.00            +0.0%     950.00        sched_debug.rt_rq:/.rt_runtime.min
      0.00 ±141%    -100.0%       0.00        sched_debug.rt_rq:/.rt_time.avg
      0.02 ±141%    -100.0%       0.00        sched_debug.rt_rq:/.rt_time.max
      0.00 ±141%    -100.0%       0.00        sched_debug.rt_rq:/.rt_time.stddev
    673721            +1.6%     684462        sched_debug.sched_clk
      1.00            +0.0%       1.00        sched_debug.sched_clock_stable()
   4156219            +0.0%    4156219        sched_debug.sysctl_sched.sysctl_sched_features
     24.00            +0.0%      24.00        sched_debug.sysctl_sched.sysctl_sched_latency
      3.00            +0.0%       3.00        sched_debug.sysctl_sched.sysctl_sched_min_granularity
      1.00            +0.0%       1.00        sched_debug.sysctl_sched.sysctl_sched_tunable_scaling
      4.00            +0.0%       4.00        sched_debug.sysctl_sched.sysctl_sched_wakeup_granularity
      3.33 ±141%    -100.0%       0.00        latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7907 ±141%    -100.0%       0.00        latency_stats.avg.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7945 ±141%    -100.0%       0.00        latency_stats.avg.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
      8920 ±141%    -100.0%       0.00        latency_stats.avg.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pte_alloc_one.__pte_alloc.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     90488 ±130%     -99.8%     195.33 ± 21%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup
     17610 ±141%     -99.7%      54.00 ±141%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_access_get_cached.nfs_do_access.nfs_permission.inode_permission.link_path_walk
     35313 ±141%     -97.2%       1005 ± 92%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
     71783 ±141%     -94.2%       4174 ±141%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_openat.do_filp_open
     38383 ±141%     -72.2%      10663 ±141%  latency_stats.avg.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
   4654660 ± 38%     -64.5%    1653160 ± 72%  latency_stats.avg.nfs_page_group_lock_head.nfs_lock_and_join_requests.nfs_writepage_setup.nfs_updatepage.nfs_write_end.generic_perform_write.nfs_file_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
   4654660 ± 38%     -64.1%    1672659 ± 70%  latency_stats.avg.max
      5634 ±141%     -42.5%       3240 ±141%  latency_stats.avg.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.wp_page_copy.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      2612 ± 18%     -31.2%       1798 ± 71%  latency_stats.avg.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     25.00 ± 52%     -24.0%      19.00 ± 87%  latency_stats.avg.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
    521.00 ± 29%     -23.3%     399.67 ± 73%  latency_stats.avg.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe
    787.33 ±  5%     -20.2%     628.00 ±  8%  latency_stats.avg.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
     13069 ±  9%     -20.1%      10442 ± 23%  latency_stats.avg.lru_add_drain_all.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7.67 ±141%     -17.4%       6.33 ±141%  latency_stats.avg.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      2824 ±  5%     -13.8%       2433 ± 16%  latency_stats.avg.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
    933.00 ± 11%     -12.9%     812.33 ±  5%  latency_stats.avg.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
     14.00 ± 15%     -11.9%      12.33 ± 19%  latency_stats.avg.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe
     22076 ±141%     -10.5%      19758 ±138%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      2199 ± 13%      -6.5%       2056 ± 12%  latency_stats.avg.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe
    530.33 ± 16%      -2.8%     515.67 ±  5%  latency_stats.avg.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
    214.67 ±  9%      -2.3%     209.67 ± 16%  latency_stats.avg.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1436 ±  6%      -0.6%       1427        latency_stats.avg.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
    121.67            +3.6%     126.00        latency_stats.avg.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1343            +3.7%       1392        latency_stats.avg.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11385            +3.8%      11822 ±  4%  latency_stats.avg.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     22915 ±138%      +9.4%      25073 ±135%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk
     29.67 ± 16%     +16.9%      34.67 ± 13%  latency_stats.avg.smp_call_on_cpu.lockup_detector_reconfigure.proc_watchdog_common.proc_sys_call_handler.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.33 ± 70%     +25.0%       1.67 ± 74%  latency_stats.avg.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7194 ± 30%     +26.8%       9119 ±  4%  latency_stats.avg.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     53.33 ± 89%     +28.1%      68.33 ± 65%  latency_stats.avg.down.xfs_buf_lock.[xfs].xfs_buf_find.[xfs].xfs_buf_get_map.[xfs].xfs_buf_read_map.[xfs].xfs_trans_read_buf_map.[xfs].xfs_imap_to_bp.[xfs].xfs_trans_log_inode.[xfs].xfs_vn_update_time.[xfs].touch_atime.xfs_file_mmap.[xfs].mmap_region
    132.00 ±141%     +44.9%     191.33 ±141%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_get_acl.get_acl.posix_acl_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2
      5.67 ± 79%     +52.9%       8.67 ± 92%  latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     29.67 ±141%     +88.8%      56.00 ± 23%  latency_stats.avg.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe
     23.00 ± 71%    +105.8%      47.33 ± 73%  latency_stats.avg.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
    369.00 ±141%    +194.1%       1085 ±  2%  latency_stats.avg.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      7682 ±141%    +206.6%      23550 ±  4%  latency_stats.avg.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault.[xfs].__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      4758 ±141%    +230.3%      15719 ± 67%  latency_stats.avg.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.__vmalloc_node_range.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
    972.33 ±141%    +234.5%       3252        latency_stats.avg.msleep_interruptible.uart_wait_until_sent.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
     13.33 ± 86%    +297.5%      53.00 ± 83%  latency_stats.avg.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    +300.0%       1.33 ± 70%  latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    358.33 ±  9%    +376.1%       1706 ± 58%  latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx
      0.00       +6.8e+105%       6768 ±141%  latency_stats.avg.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node.kvmalloc_node.single_open_size.do_dentry_open.path_openat.do_filp_open.do_sys_openat2
      0.00       +9.8e+105%       9826 ± 78%  latency_stats.avg.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.33 ±141%    -100.0%       0.00        latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    -100.0%       0.00        latency_stats.hits.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    -100.0%       0.00        latency_stats.hits.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
      0.33 ±141%    -100.0%       0.00        latency_stats.hits.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pte_alloc_one.__pte_alloc.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      6.00 ± 81%     -55.6%       2.67 ± 17%  latency_stats.hits.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.00 ±141%     -46.7%       2.67 ±141%  latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_access_get_cached.nfs_do_access.nfs_permission.inode_permission.link_path_walk
      6.33 ± 91%     -36.8%       4.00 ± 88%  latency_stats.hits.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.00           -29.6%       6.33 ± 59%  latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup
      4.67 ± 70%     -28.6%       3.33 ± 78%  latency_stats.hits.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
     19.00 ±  4%     -22.8%      14.67 ± 47%  latency_stats.hits.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     13.00 ±  6%     -15.4%      11.00 ± 12%  latency_stats.hits.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe
     24.67 ± 13%     -14.9%      21.00 ± 10%  latency_stats.hits.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     13.67 ± 40%      -7.3%      12.67 ± 75%  latency_stats.hits.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11.33 ±  4%      -2.9%      11.00 ±  7%  latency_stats.hits.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe
     15135            -1.8%      14857        latency_stats.hits.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
    190.00            -0.5%     189.00        latency_stats.hits.smp_call_on_cpu.lockup_detector_reconfigure.proc_watchdog_common.proc_sys_call_handler.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
    243925            -0.0%     243902        latency_stats.hits.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
    243925            -0.0%     243902        latency_stats.hits.max
      1.00            +0.0%       1.00        latency_stats.hits.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.00            +0.0%       1.00        latency_stats.hits.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.33 ± 40%      +0.0%       2.33 ± 40%  latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk
      0.33 ±141%      +0.0%       0.33 ±141%  latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_get_acl.get_acl.posix_acl_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2
      0.33 ±141%      +0.0%       0.33 ±141%  latency_stats.hits.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.00            +0.0%       1.00        latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx
      1.00            +0.0%       1.00        latency_stats.hits.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%      +0.0%       0.33 ±141%  latency_stats.hits.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     50.33 ±  2%      +0.7%      50.67 ±  3%  latency_stats.hits.lru_add_drain_all.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
    350.00 ± 12%      +4.2%     364.67 ± 11%  latency_stats.hits.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.00 ± 27%     +11.1%       3.33 ±101%  latency_stats.hits.nfs_page_group_lock_head.nfs_lock_and_join_requests.nfs_writepage_setup.nfs_updatepage.nfs_write_end.generic_perform_write.nfs_file_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     21.00 ± 43%     +14.3%      24.00 ± 12%  latency_stats.hits.down.xfs_buf_lock.[xfs].xfs_buf_find.[xfs].xfs_buf_get_map.[xfs].xfs_buf_read_map.[xfs].xfs_trans_read_buf_map.[xfs].xfs_imap_to_bp.[xfs].xfs_trans_log_inode.[xfs].xfs_vn_update_time.[xfs].touch_atime.xfs_file_mmap.[xfs].mmap_region
    207.67 ± 15%     +17.5%     244.00 ± 11%  latency_stats.hits.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
     37.00 ± 11%     +18.9%      44.00 ±  3%  latency_stats.hits.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.33 ± 88%     +28.6%       3.00 ± 47%  latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
    129.00 ± 16%     +48.1%     191.00 ± 11%  latency_stats.hits.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.67 ±141%     +50.0%       1.00 ± 81%  latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      0.67 ±141%     +50.0%       1.00 ± 81%  latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      0.67 ± 70%     +50.0%       1.00 ± 81%  latency_stats.hits.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.67 ±141%     +50.0%       1.00 ± 81%  latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.00 ±141%    +200.0%       9.00        latency_stats.hits.msleep_interruptible.uart_wait_until_sent.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    +200.0%       1.00        latency_stats.hits.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.33 ±141%    +200.0%       1.00        latency_stats.hits.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.__vmalloc_node_range.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
     13.00 ±141%    +212.8%      40.67        latency_stats.hits.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
    463.67 ±141%    +235.5%       1555 ± 78%  latency_stats.hits.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault.[xfs].__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      0.33 ±141%    +300.0%       1.33 ±141%  latency_stats.hits.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.wp_page_copy.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.67 ±141%    +800.0%       6.00 ±141%  latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_openat.do_filp_open
      0.00       +3.3e+101%       0.33 ±141%  latency_stats.hits.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node.kvmalloc_node.single_open_size.do_dentry_open.path_openat.do_filp_open.do_sys_openat2
      0.00       +6.7e+101%       0.67 ± 70%  latency_stats.hits.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      3.33 ±141%    -100.0%       0.00        latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7907 ±141%    -100.0%       0.00        latency_stats.max.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7945 ±141%    -100.0%       0.00        latency_stats.max.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
      8920 ±141%    -100.0%       0.00        latency_stats.max.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pte_alloc_one.__pte_alloc.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
    801537 ±130%    -100.0%     254.00 ± 33%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup
    128916 ±141%     -99.9%      68.67 ±141%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_access_get_cached.nfs_do_access.nfs_permission.inode_permission.link_path_walk
     63639 ±141%     -98.1%       1185 ± 98%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
    936.00 ±132%     -73.4%     248.67 ± 71%  latency_stats.max.down.xfs_buf_lock.[xfs].xfs_buf_find.[xfs].xfs_buf_get_map.[xfs].xfs_buf_read_map.[xfs].xfs_trans_read_buf_map.[xfs].xfs_imap_to_bp.[xfs].xfs_trans_log_inode.[xfs].xfs_vn_update_time.[xfs].touch_atime.xfs_file_mmap.[xfs].mmap_region
     38383 ±141%     -72.2%      10663 ±141%  latency_stats.max.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     78559 ±141%     -62.5%      29458 ±141%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_openat.do_filp_open
  12025318 ± 39%     -58.9%    4943858 ± 88%  latency_stats.max.nfs_page_group_lock_head.nfs_lock_and_join_requests.nfs_writepage_setup.nfs_updatepage.nfs_write_end.generic_perform_write.nfs_file_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
  12025318 ± 39%     -58.6%    4982801 ± 87%  latency_stats.max.max
    182392 ±126%     -52.7%      86214 ±113%  latency_stats.max.lru_add_drain_all.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4137 ±  5%     -32.7%       2785 ± 70%  latency_stats.max.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe
     52.67 ± 61%     -27.2%      38.33 ±110%  latency_stats.max.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5634 ±141%     -19.4%       4539 ±141%  latency_stats.max.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.wp_page_copy.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      7.67 ±141%     -17.4%       6.33 ±141%  latency_stats.max.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     19470 ± 49%     -16.5%      16248 ± 23%  latency_stats.max.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3914 ± 33%     -15.5%       3308 ± 70%  latency_stats.max.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3090 ± 32%     -10.3%       2772 ±  7%  latency_stats.max.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
     21624 ± 40%      -7.5%      19998 ± 21%  latency_stats.max.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4888            -5.6%       4616 ± 10%  latency_stats.max.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
    214.67 ±  9%      -2.3%     209.67 ± 16%  latency_stats.max.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1436 ±  6%      -0.6%       1427        latency_stats.max.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4931            +0.0%       4932        latency_stats.max.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4906            +0.0%       4907        latency_stats.max.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4996            +0.0%       4998        latency_stats.max.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
     37884 ±141%      +3.5%      39202 ±140%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
     11385            +3.8%      11822 ±  4%  latency_stats.max.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     27.00 ± 13%     +11.1%      30.00 ± 28%  latency_stats.max.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe
     66723 ±140%     +12.1%      74765 ±136%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk
     95.67 ±  6%     +14.6%     109.67 ± 15%  latency_stats.max.smp_call_on_cpu.lockup_detector_reconfigure.proc_watchdog_common.proc_sys_call_handler.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     13.33 ± 70%     +20.0%      16.00 ± 97%  latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3147 ± 15%     +32.9%       4183 ± 20%  latency_stats.max.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
     49.33 ± 74%     +39.9%      69.00 ± 63%  latency_stats.max.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
    132.00 ±141%     +44.9%     191.33 ±141%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_get_acl.get_acl.posix_acl_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2
      1.33 ± 70%     +50.0%       2.00 ± 70%  latency_stats.max.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     29.67 ±141%     +88.8%      56.00 ± 23%  latency_stats.max.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe
     28.00 ± 86%    +144.0%      68.33 ± 63%  latency_stats.max.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
    450.67 ±141%    +218.5%       1435 ±  7%  latency_stats.max.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      1172 ±141%    +226.7%       3828        latency_stats.max.msleep_interruptible.uart_wait_until_sent.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      4758 ±141%    +230.3%      15719 ± 67%  latency_stats.max.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.__vmalloc_node_range.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
     26079 ±141%    +264.8%      95136 ± 12%  latency_stats.max.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault.[xfs].__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      0.33 ±141%    +300.0%       1.33 ± 70%  latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    358.33 ±  9%    +376.1%       1706 ± 58%  latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx
      0.00       +6.8e+105%       6768 ±141%  latency_stats.max.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node.kvmalloc_node.single_open_size.do_dentry_open.path_openat.do_filp_open.do_sys_openat2
      0.00       +9.8e+105%       9826 ± 78%  latency_stats.max.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      3.33 ±141%    -100.0%       0.00        latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7907 ±141%    -100.0%       0.00        latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7945 ±141%    -100.0%       0.00        latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
      8920 ±141%    -100.0%       0.00        latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pte_alloc_one.__pte_alloc.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
    264160 ±141%     -99.8%     432.00 ±141%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_access_get_cached.nfs_do_access.nfs_permission.inode_permission.link_path_walk
    814401 ±130%     -99.8%       1337 ± 65%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup
     70627 ±141%     -97.5%       1753 ±111%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
     38383 ±141%     -72.2%      10663 ±141%  latency_stats.sum.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
    143566 ±141%     -47.7%      75146 ±141%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_openat.do_filp_open
    203.33 ± 76%     -45.2%     111.33 ± 56%  latency_stats.sum.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
  13879600 ± 50%     -35.7%    8927955 ±109%  latency_stats.sum.nfs_page_group_lock_head.nfs_lock_and_join_requests.nfs_writepage_setup.nfs_updatepage.nfs_write_end.generic_perform_write.nfs_file_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     53734 ±  8%     -28.3%      38529 ± 58%  latency_stats.sum.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
    185.33 ±  7%     -25.0%     139.00 ±  7%  latency_stats.sum.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe
    139.33 ± 71%     -24.2%     105.67 ±129%  latency_stats.sum.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5981 ± 34%     -22.4%       4642 ± 77%  latency_stats.sum.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe
    658731 ± 11%     -19.7%     528730 ± 22%  latency_stats.sum.lru_add_drain_all.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7.67 ±141%     -17.4%       6.33 ±141%  latency_stats.sum.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     44153 ±141%     -11.1%      39258 ±140%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
     38313 ± 50%      -9.6%      34632 ± 78%  latency_stats.sum.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
    162215 ± 10%      -5.1%     153883 ± 15%  latency_stats.sum.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
    214.67 ±  9%      -2.3%     209.67 ± 16%  latency_stats.sum.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
    155.00 ±114%      -1.7%     152.33 ± 84%  latency_stats.sum.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1436 ±  6%      -0.6%       1427        latency_stats.sum.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
  20330143            +1.8%   20697132        latency_stats.sum.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
    182276 ±  8%      +3.1%     187891 ± 11%  latency_stats.sum.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
  29819764            +3.5%   30859144        latency_stats.sum.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11385            +3.8%      11822 ±  4%  latency_stats.sum.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     34104            +5.1%      35828 ±  8%  latency_stats.sum.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
    178788 ± 35%      +6.6%     190624 ±  5%  latency_stats.sum.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     68511 ±139%      +9.6%      75106 ±135%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk
      5768 ± 16%     +14.9%       6629 ± 14%  latency_stats.sum.smp_call_on_cpu.lockup_detector_reconfigure.proc_watchdog_common.proc_sys_call_handler.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1503 ±105%     +17.5%       1766 ± 75%  latency_stats.sum.down.xfs_buf_lock.[xfs].xfs_buf_find.[xfs].xfs_buf_get_map.[xfs].xfs_buf_read_map.[xfs].xfs_trans_read_buf_map.[xfs].xfs_imap_to_bp.[xfs].xfs_trans_log_inode.[xfs].xfs_vn_update_time.[xfs].touch_atime.xfs_file_mmap.[xfs].mmap_region
     18.00 ± 73%     +24.1%      22.33 ± 63%  latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
    288652 ± 29%     +34.4%     387900 ±  4%  latency_stats.sum.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe
  30436080 ±  3%     +44.7%   44032242 ± 42%  latency_stats.sum.max
    132.00 ±141%     +44.9%     191.33 ±141%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_get_acl.get_acl.posix_acl_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2
     29.67 ±141%     +88.8%      56.00 ± 23%  latency_stats.sum.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.33 ± 70%    +100.0%       2.67 ± 77%  latency_stats.sum.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5634 ±141%    +130.0%      12960 ±141%  latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.wp_page_copy.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.67 ±141%    +200.0%       2.00 ± 81%  latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     14397 ±141%    +206.6%      44146 ±  2%  latency_stats.sum.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      4758 ±141%    +230.3%      15719 ± 67%  latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.__vmalloc_node_range.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
  10686074 ±141%    +231.5%   35428527 ± 75%  latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault.[xfs].__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      8751 ±141%    +234.6%      29280        latency_stats.sum.msleep_interruptible.uart_wait_until_sent.tty_wait_until_sent.tty_port_close_start.tty_port_close.tty_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
    358.33 ±  9%    +376.1%       1706 ± 58%  latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx
      0.00       +6.8e+105%       6768 ±141%  latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node.kvmalloc_node.single_open_size.do_dentry_open.path_openat.do_filp_open.do_sys_openat2
      0.00       +9.8e+105%       9826 ± 78%  latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
    194431            -0.1%     194170        slabinfo.Acpi-Operand.active_objs
      3471            -0.1%       3467        slabinfo.Acpi-Operand.active_slabs
    194431            -0.1%     194170        slabinfo.Acpi-Operand.num_objs
      3471            -0.1%       3467        slabinfo.Acpi-Operand.num_slabs
      1533 ± 14%     -12.7%       1338 ±  5%  slabinfo.Acpi-Parse.active_objs
     21.00 ± 14%     -12.7%      18.33 ±  5%  slabinfo.Acpi-Parse.active_slabs
      1533 ± 14%     -12.7%       1338 ±  5%  slabinfo.Acpi-Parse.num_objs
     21.00 ± 14%     -12.7%      18.33 ±  5%  slabinfo.Acpi-Parse.num_slabs
      4992            -0.1%       4986        slabinfo.Acpi-State.active_objs
     97.00            +0.0%      97.00        slabinfo.Acpi-State.active_slabs
      4992            -0.1%       4986        slabinfo.Acpi-State.num_objs
     97.00            +0.0%      97.00        slabinfo.Acpi-State.num_slabs
      2326 ±  2%      -9.9%       2097 ±  7%  slabinfo.PING.active_objs
     72.33 ±  3%      -9.2%      65.67 ±  7%  slabinfo.PING.active_slabs
      2326 ±  2%      -9.9%       2097 ±  7%  slabinfo.PING.num_objs
     72.33 ±  3%      -9.2%      65.67 ±  7%  slabinfo.PING.num_slabs
    192.00            +0.0%     192.00        slabinfo.RAW.active_objs
      6.00            +0.0%       6.00        slabinfo.RAW.active_slabs
    192.00            +0.0%     192.00        slabinfo.RAW.num_objs
      6.00            +0.0%       6.00        slabinfo.RAW.num_slabs
    112.67 ± 10%      +0.0%     112.67 ± 10%  slabinfo.RAWv6.active_objs
      4.33 ± 10%      +0.0%       4.33 ± 10%  slabinfo.RAWv6.active_slabs
    112.67 ± 10%      +0.0%     112.67 ± 10%  slabinfo.RAWv6.num_objs
      4.33 ± 10%      +0.0%       4.33 ± 10%  slabinfo.RAWv6.num_slabs
     98.00            +0.0%      98.00 ± 11%  slabinfo.TCP.active_objs
      7.00            +0.0%       7.00 ± 11%  slabinfo.TCP.active_slabs
     98.00            +0.0%      98.00 ± 11%  slabinfo.TCP.num_objs
      7.00            +0.0%       7.00 ± 11%  slabinfo.TCP.num_slabs
     65.00            +0.0%      65.00        slabinfo.TCPv6.active_objs
      5.00            +0.0%       5.00        slabinfo.TCPv6.active_slabs
     65.00            +0.0%      65.00        slabinfo.TCPv6.num_objs
      5.00            +0.0%       5.00        slabinfo.TCPv6.num_slabs
    286.33 ±  5%      +1.3%     290.00 ± 10%  slabinfo.UDPv6.active_objs
     11.67 ±  4%      -2.9%      11.33 ± 11%  slabinfo.UDPv6.active_slabs
    286.33 ±  5%      +1.3%     290.00 ± 10%  slabinfo.UDPv6.num_objs
     11.67 ±  4%      -2.9%      11.33 ± 11%  slabinfo.UDPv6.num_slabs
     24299            +2.5%      24914        slabinfo.anon_vma.active_objs
    527.67            +2.5%     541.00        slabinfo.anon_vma.active_slabs
     24299            +2.5%      24914        slabinfo.anon_vma.num_objs
    527.67            +2.5%     541.00        slabinfo.anon_vma.num_slabs
     52675            +1.6%      53498        slabinfo.anon_vma_chain.active_objs
    822.33            +1.6%     835.33        slabinfo.anon_vma_chain.active_slabs
     52675            +1.6%      53498        slabinfo.anon_vma_chain.num_objs
    822.33            +1.6%     835.33        slabinfo.anon_vma_chain.num_slabs
    481.00 ± 13%      -5.4%     455.00 ± 10%  slabinfo.bdev_cache.active_objs
     12.33 ± 13%      -5.4%      11.67 ± 10%  slabinfo.bdev_cache.active_slabs
    481.00 ± 13%      -5.4%     455.00 ± 10%  slabinfo.bdev_cache.num_objs
     12.33 ± 13%      -5.4%      11.67 ± 10%  slabinfo.bdev_cache.num_slabs
    449.33 ±  2%      -4.1%     431.00 ±  9%  slabinfo.biovec-128.active_objs
     27.67            -4.8%      26.33 ±  9%  slabinfo.biovec-128.active_slabs
    449.33 ±  2%      -4.1%     431.00 ±  9%  slabinfo.biovec-128.num_objs
     27.67            -4.8%      26.33 ±  9%  slabinfo.biovec-128.num_slabs
    213.33 ± 14%      -5.0%     202.67 ±  7%  slabinfo.biovec-64.active_objs
      6.67 ± 14%      -5.0%       6.33 ±  7%  slabinfo.biovec-64.active_slabs
    213.33 ± 14%      -5.0%     202.67 ±  7%  slabinfo.biovec-64.num_objs
      6.67 ± 14%      -5.0%       6.33 ±  7%  slabinfo.biovec-64.num_slabs
    588.00 ± 26%      -9.4%     532.67 ± 11%  slabinfo.biovec-max.active_objs
     74.67 ± 24%     -10.7%      66.67 ± 11%  slabinfo.biovec-max.active_slabs
    597.33 ± 24%     -10.7%     533.33 ± 11%  slabinfo.biovec-max.num_objs
     74.67 ± 24%     -10.7%      66.67 ± 11%  slabinfo.biovec-max.num_slabs
      2130            -1.8%       2093 ±  3%  slabinfo.blkdev_ioc.active_objs
     54.33            +1.8%      55.33 ±  2%  slabinfo.blkdev_ioc.active_slabs
      2143            +1.8%       2182 ±  2%  slabinfo.blkdev_ioc.num_objs
     54.33            +1.8%      55.33 ±  2%  slabinfo.blkdev_ioc.num_slabs
    108.00           -16.7%      90.00 ± 14%  slabinfo.btrfs_inode.active_objs
      4.00           -16.7%       3.33 ± 14%  slabinfo.btrfs_inode.active_slabs
    108.00           -16.7%      90.00 ± 14%  slabinfo.btrfs_inode.num_objs
      4.00           -16.7%       3.33 ± 14%  slabinfo.btrfs_inode.num_slabs
    312.00 ± 10%      +4.2%     325.00 ±  5%  slabinfo.buffer_head.active_objs
      8.00 ± 10%      +4.2%       8.33 ±  5%  slabinfo.buffer_head.active_slabs
    312.00 ± 10%      +4.2%     325.00 ±  5%  slabinfo.buffer_head.num_objs
      8.00 ± 10%      +4.2%       8.33 ±  5%  slabinfo.buffer_head.num_slabs
      5457            +0.1%       5465        slabinfo.cred_jar.active_objs
    129.33            +0.0%     129.33        slabinfo.cred_jar.active_slabs
      5457            +0.1%       5465        slabinfo.cred_jar.num_objs
    129.33            +0.0%     129.33        slabinfo.cred_jar.num_slabs
     98.00 ± 20%     +14.3%     112.00 ± 17%  slabinfo.dax_cache.active_objs
      2.33 ± 20%     +14.3%       2.67 ± 17%  slabinfo.dax_cache.active_slabs
     98.00 ± 20%     +14.3%     112.00 ± 17%  slabinfo.dax_cache.num_objs
      2.33 ± 20%     +14.3%       2.67 ± 17%  slabinfo.dax_cache.num_slabs
    105175            -0.9%     104185        slabinfo.dentry.active_objs
      2511            -0.9%       2488        slabinfo.dentry.active_slabs
    105473            -0.9%     104480        slabinfo.dentry.num_objs
      2511            -0.9%       2488        slabinfo.dentry.num_slabs
     30.00            +0.0%      30.00        slabinfo.dmaengine-unmap-128.active_objs
      1.00            +0.0%       1.00        slabinfo.dmaengine-unmap-128.active_slabs
     30.00            +0.0%      30.00        slabinfo.dmaengine-unmap-128.num_objs
      1.00            +0.0%       1.00        slabinfo.dmaengine-unmap-128.num_slabs
      4624 ±  3%      +0.6%       4652 ±  7%  slabinfo.dmaengine-unmap-16.active_objs
    109.67 ±  3%      +0.6%     110.33 ±  7%  slabinfo.dmaengine-unmap-16.active_slabs
      4624 ±  3%      +0.6%       4652 ±  7%  slabinfo.dmaengine-unmap-16.num_objs
    109.67 ±  3%      +0.6%     110.33 ±  7%  slabinfo.dmaengine-unmap-16.num_slabs
     15.00            +0.0%      15.00        slabinfo.dmaengine-unmap-256.active_objs
      1.00            +0.0%       1.00        slabinfo.dmaengine-unmap-256.active_slabs
     15.00            +0.0%      15.00        slabinfo.dmaengine-unmap-256.num_objs
      1.00            +0.0%       1.00        slabinfo.dmaengine-unmap-256.num_slabs
      4934            -6.0%       4638 ±  7%  slabinfo.eventpoll_pwq.active_objs
     87.33            -5.7%      82.33 ±  6%  slabinfo.eventpoll_pwq.active_slabs
      4934            -6.0%       4638 ±  7%  slabinfo.eventpoll_pwq.num_objs
     87.33            -5.7%      82.33 ±  6%  slabinfo.eventpoll_pwq.num_slabs
      1240 ±  3%     -10.0%       1116 ±  9%  slabinfo.file_lock_cache.active_objs
     33.00 ±  2%     -11.1%      29.33 ±  9%  slabinfo.file_lock_cache.active_slabs
      1240 ±  3%     -10.0%       1116 ±  9%  slabinfo.file_lock_cache.num_objs
     33.00 ±  2%     -11.1%      29.33 ±  9%  slabinfo.file_lock_cache.num_slabs
      4690            -0.0%       4689        slabinfo.files_cache.active_objs
    102.33            -0.7%     101.67        slabinfo.files_cache.active_slabs
      4690            -0.0%       4689        slabinfo.files_cache.num_objs
    102.33            -0.7%     101.67        slabinfo.files_cache.num_slabs
     36642            +1.1%      37058        slabinfo.filp.active_objs
      1150            +1.0%       1162        slabinfo.filp.active_slabs
     36808            +1.1%      37205        slabinfo.filp.num_objs
      1150            +1.0%       1162        slabinfo.filp.num_slabs
      3174 ± 11%     -13.4%       2747 ±  9%  slabinfo.fsnotify_mark_connector.active_objs
     24.33 ± 10%     -12.3%      21.33 ±  9%  slabinfo.fsnotify_mark_connector.active_slabs
      3174 ± 11%     -13.4%       2747 ±  9%  slabinfo.fsnotify_mark_connector.num_objs
     24.33 ± 10%     -12.3%      21.33 ±  9%  slabinfo.fsnotify_mark_connector.num_slabs
     32243            -0.2%      32186        slabinfo.ftrace_event_field.active_objs
    379.33            -0.2%     378.67        slabinfo.ftrace_event_field.active_slabs
     32243            -0.2%      32186        slabinfo.ftrace_event_field.num_objs
    379.33            -0.2%     378.67        slabinfo.ftrace_event_field.num_slabs
    104.00            +0.0%     104.00        slabinfo.hugetlbfs_inode_cache.active_objs
      2.00            +0.0%       2.00        slabinfo.hugetlbfs_inode_cache.active_slabs
    104.00            +0.0%     104.00        slabinfo.hugetlbfs_inode_cache.num_objs
      2.00            +0.0%       2.00        slabinfo.hugetlbfs_inode_cache.num_slabs
     53469 ±  2%      -0.2%      53378        slabinfo.inode_cache.active_objs
      1002 ±  2%      +0.2%       1004        slabinfo.inode_cache.active_slabs
     54133 ±  2%      -0.3%      53980        slabinfo.inode_cache.num_objs
      1002 ±  2%      +0.2%       1004        slabinfo.inode_cache.num_slabs
      2251 ±  2%      +1.3%       2279 ±  5%  slabinfo.ip6-frags.active_objs
     50.33 ±  2%      +1.3%      51.00 ±  5%  slabinfo.ip6-frags.active_slabs
      2251 ±  2%      +1.3%       2279 ±  5%  slabinfo.ip6-frags.num_objs
     50.33 ±  2%      +1.3%      51.00 ±  5%  slabinfo.ip6-frags.num_slabs
     83778            -0.0%      83750        slabinfo.kernfs_node_cache.active_objs
      2617            -0.0%       2616        slabinfo.kernfs_node_cache.active_slabs
     83778            -0.0%      83750        slabinfo.kernfs_node_cache.num_objs
      2617            -0.0%       2616        slabinfo.kernfs_node_cache.num_slabs
      1787 ±  6%     -10.7%       1595 ±  6%  slabinfo.khugepaged_mm_slot.active_objs
     48.67 ±  6%     -11.0%      43.33 ±  7%  slabinfo.khugepaged_mm_slot.active_slabs
      1787 ±  6%     -10.7%       1595 ±  6%  slabinfo.khugepaged_mm_slot.num_objs
     48.67 ±  6%     -11.0%      43.33 ±  7%  slabinfo.khugepaged_mm_slot.num_slabs
      5221            +0.3%       5238        slabinfo.kmalloc-128.active_objs
    166.67            +0.8%     168.00        slabinfo.kmalloc-128.active_slabs
      5349            +0.8%       5392        slabinfo.kmalloc-128.num_objs
    166.67            +0.8%     168.00        slabinfo.kmalloc-128.num_slabs
     35242            +0.2%      35328        slabinfo.kmalloc-16.active_objs
    137.67            +0.2%     138.00        slabinfo.kmalloc-16.active_slabs
     35242            +0.2%      35328        slabinfo.kmalloc-16.num_objs
    137.67            +0.2%     138.00        slabinfo.kmalloc-16.num_slabs
      5518            +0.1%       5525        slabinfo.kmalloc-192.active_objs
    132.00            +0.3%     132.33        slabinfo.kmalloc-192.active_slabs
      5572            +0.2%       5583        slabinfo.kmalloc-192.num_objs
    132.00            +0.3%     132.33        slabinfo.kmalloc-192.num_slabs
      6016 ±  3%      -1.0%       5954        slabinfo.kmalloc-1k.active_objs
    192.33 ±  3%      -1.2%     190.00        slabinfo.kmalloc-1k.active_slabs
      6164 ±  3%      -1.0%       6101        slabinfo.kmalloc-1k.num_objs
    192.33 ±  3%      -1.2%     190.00        slabinfo.kmalloc-1k.num_slabs
      7454            +1.0%       7531 ±  2%  slabinfo.kmalloc-256.active_objs
    247.00            +1.1%     249.67        slabinfo.kmalloc-256.active_slabs
      7927            +0.9%       7995        slabinfo.kmalloc-256.num_objs
    247.00            +1.1%     249.67        slabinfo.kmalloc-256.num_slabs
      8937 ±  3%      -3.8%       8597 ±  3%  slabinfo.kmalloc-2k.active_objs
    562.67 ±  3%      -3.9%     541.00 ±  3%  slabinfo.kmalloc-2k.active_slabs
      9008 ±  3%      -3.9%       8661 ±  3%  slabinfo.kmalloc-2k.num_objs
    562.67 ±  3%      -3.9%     541.00 ±  3%  slabinfo.kmalloc-2k.num_slabs
     71082            +0.8%      71679        slabinfo.kmalloc-32.active_objs
    556.00            +1.0%     561.33        slabinfo.kmalloc-32.active_slabs
     71257            +1.0%      71944        slabinfo.kmalloc-32.num_objs
    556.00            +1.0%     561.33        slabinfo.kmalloc-32.num_slabs
      1932            +0.0%       1932        slabinfo.kmalloc-4k.active_objs
    252.33 ±  2%      +0.8%     254.33        slabinfo.kmalloc-4k.active_slabs
      2019 ±  2%      +1.0%       2038        slabinfo.kmalloc-4k.num_objs
    252.33 ±  2%      +0.8%     254.33        slabinfo.kmalloc-4k.num_slabs
     32279            +0.2%      32346        slabinfo.kmalloc-512.active_objs
      1123 ±  2%      -1.1%       1111        slabinfo.kmalloc-512.active_slabs
     35945 ±  2%      -1.1%      35560        slabinfo.kmalloc-512.num_objs
      1123 ±  2%      -1.1%       1111        slabinfo.kmalloc-512.num_slabs
     48501            +0.5%      48734        slabinfo.kmalloc-64.active_objs
    783.00            +1.4%     793.67        slabinfo.kmalloc-64.active_slabs
     50150            +1.4%      50837        slabinfo.kmalloc-64.num_objs
    783.00            +1.4%     793.67        slabinfo.kmalloc-64.num_slabs
     54650            +0.9%      55169        slabinfo.kmalloc-8.active_objs
    121.33 ±  2%      +3.6%     125.67 ±  2%  slabinfo.kmalloc-8.active_slabs
     62253 ±  2%      +3.8%      64603 ±  2%  slabinfo.kmalloc-8.num_objs
    121.33 ±  2%      +3.6%     125.67 ±  2%  slabinfo.kmalloc-8.num_slabs
    787.33            -0.3%     785.00        slabinfo.kmalloc-8k.active_objs
    202.00            -0.3%     201.33        slabinfo.kmalloc-8k.active_slabs
    809.33            -0.3%     806.67        slabinfo.kmalloc-8k.num_objs
    202.00            -0.3%     201.33        slabinfo.kmalloc-8k.num_slabs
     10043 ±  2%      -3.7%       9666 ±  4%  slabinfo.kmalloc-96.active_objs
    242.00 ±  2%      -4.0%     232.33 ±  4%  slabinfo.kmalloc-96.active_slabs
     10193 ±  2%      -4.1%       9775 ±  4%  slabinfo.kmalloc-96.num_objs
    242.00 ±  2%      -4.0%     232.33 ±  4%  slabinfo.kmalloc-96.num_slabs
    608.00           -22.8%     469.33 ± 22%  slabinfo.kmalloc-rcl-128.active_objs
     19.00           -22.8%      14.67 ± 22%  slabinfo.kmalloc-rcl-128.active_slabs
    608.00           -22.8%     469.33 ± 22%  slabinfo.kmalloc-rcl-128.num_objs
     19.00           -22.8%      14.67 ± 22%  slabinfo.kmalloc-rcl-128.num_slabs
     42.00            +0.0%      42.00        slabinfo.kmalloc-rcl-192.active_objs
      1.00            +0.0%       1.00        slabinfo.kmalloc-rcl-192.active_slabs
     42.00            +0.0%      42.00        slabinfo.kmalloc-rcl-192.num_objs
      1.00            +0.0%       1.00        slabinfo.kmalloc-rcl-192.num_slabs
     74.67 ± 20%     -14.3%      64.00        slabinfo.kmalloc-rcl-256.active_objs
      2.33 ± 20%     -14.3%       2.00        slabinfo.kmalloc-rcl-256.active_slabs
     74.67 ± 20%     -14.3%      64.00        slabinfo.kmalloc-rcl-256.num_objs
      2.33 ± 20%     -14.3%       2.00        slabinfo.kmalloc-rcl-256.num_slabs
      1664 ±  8%      -6.2%       1560 ±  2%  slabinfo.kmalloc-rcl-512.active_objs
     51.33 ±  8%      -5.8%      48.33 ±  2%  slabinfo.kmalloc-rcl-512.active_slabs
      1664 ±  8%      -6.2%       1560 ±  2%  slabinfo.kmalloc-rcl-512.num_objs
     51.33 ±  8%      -5.8%      48.33 ±  2%  slabinfo.kmalloc-rcl-512.num_slabs
      4654 ±  6%      -8.3%       4267        slabinfo.kmalloc-rcl-64.active_objs
     72.33 ±  6%      -8.3%      66.33        slabinfo.kmalloc-rcl-64.active_slabs
      4654 ±  6%      -8.3%       4267        slabinfo.kmalloc-rcl-64.num_objs
     72.33 ±  6%      -8.3%      66.33        slabinfo.kmalloc-rcl-64.num_slabs
      2214 ±  3%      -5.3%       2097 ±  6%  slabinfo.kmalloc-rcl-96.active_objs
     52.33 ±  3%      -5.1%      49.67 ±  5%  slabinfo.kmalloc-rcl-96.active_slabs
      2214 ±  3%      -5.3%       2097 ±  6%  slabinfo.kmalloc-rcl-96.num_objs
     52.33 ±  3%      -5.1%      49.67 ±  5%  slabinfo.kmalloc-rcl-96.num_slabs
    448.00 ± 11%      -2.4%     437.33 ±  6%  slabinfo.kmem_cache.active_objs
     14.00 ± 11%      -2.4%      13.67 ±  6%  slabinfo.kmem_cache.active_slabs
    448.00 ± 11%      -2.4%     437.33 ±  6%  slabinfo.kmem_cache.num_objs
     14.00 ± 11%      -2.4%      13.67 ±  6%  slabinfo.kmem_cache.num_slabs
    947.33 ±  8%      +0.0%     947.33 ±  8%  slabinfo.kmem_cache_node.active_objs
     15.33 ±  8%      +0.0%      15.33 ±  8%  slabinfo.kmem_cache_node.active_slabs
    981.33 ±  8%      +0.0%     981.33 ±  8%  slabinfo.kmem_cache_node.num_objs
     15.33 ±  8%      +0.0%      15.33 ±  8%  slabinfo.kmem_cache_node.num_slabs
     17169            +0.7%      17282        slabinfo.lsm_file_cache.active_objs
    100.00            +0.7%     100.67        slabinfo.lsm_file_cache.active_slabs
     17169            +0.7%      17282        slabinfo.lsm_file_cache.num_objs
    100.00            +0.7%     100.67        slabinfo.lsm_file_cache.num_slabs
      3119            +0.5%       3134        slabinfo.mm_struct.active_objs
    103.33            +0.3%     103.67        slabinfo.mm_struct.active_slabs
      3119            +0.5%       3134        slabinfo.mm_struct.num_objs
    103.33            +0.3%     103.67        slabinfo.mm_struct.num_slabs
    833.00 ± 15%      +8.2%     901.00 ±  2%  slabinfo.mnt_cache.active_objs
     16.33 ± 15%      +8.2%      17.67 ±  2%  slabinfo.mnt_cache.active_slabs
    833.00 ± 15%      +8.2%     901.00 ±  2%  slabinfo.mnt_cache.num_objs
     16.33 ± 15%      +8.2%      17.67 ±  2%  slabinfo.mnt_cache.num_slabs
     34.00            +0.0%      34.00        slabinfo.mqueue_inode_cache.active_objs
      1.00            +0.0%       1.00        slabinfo.mqueue_inode_cache.active_slabs
     34.00            +0.0%      34.00        slabinfo.mqueue_inode_cache.num_objs
      1.00            +0.0%       1.00        slabinfo.mqueue_inode_cache.num_slabs
    768.00            +0.0%     768.00        slabinfo.names_cache.active_objs
     96.00            +0.0%      96.00        slabinfo.names_cache.active_slabs
    768.00            +0.0%     768.00        slabinfo.names_cache.num_objs
     96.00            +0.0%      96.00        slabinfo.names_cache.num_slabs
    109.67 ± 12%     -18.5%      89.33 ± 26%  slabinfo.nfs_inode_cache.active_objs
      3.33 ± 14%     -30.0%       2.33 ± 20%  slabinfo.nfs_inode_cache.active_slabs
    109.67 ± 12%     -18.5%      89.33 ± 26%  slabinfo.nfs_inode_cache.num_objs
      3.33 ± 14%     -30.0%       2.33 ± 20%  slabinfo.nfs_inode_cache.num_slabs
    433.33 ±  6%      -9.6%     391.67 ±  7%  slabinfo.nfs_read_data.active_objs
     11.67 ±  8%      -8.6%      10.67 ±  8%  slabinfo.nfs_read_data.active_slabs
    433.33 ±  6%      -9.6%     391.67 ±  7%  slabinfo.nfs_read_data.num_objs
     11.67 ±  8%      -8.6%      10.67 ±  8%  slabinfo.nfs_read_data.num_slabs
      2865 ±  6%      -2.9%       2782        slabinfo.numa_policy.active_objs
     45.33 ±  6%      -2.9%      44.00        slabinfo.numa_policy.active_slabs
      2865 ±  6%      -2.9%       2782        slabinfo.numa_policy.num_objs
     45.33 ±  6%      -2.9%      44.00        slabinfo.numa_policy.num_slabs
      9657            +0.1%       9663        slabinfo.pde_opener.active_objs
     94.00            +0.4%      94.33        slabinfo.pde_opener.active_slabs
      9657            +0.1%       9663        slabinfo.pde_opener.num_objs
     94.00            +0.4%      94.33        slabinfo.pde_opener.num_slabs
      4415            +0.3%       4426        slabinfo.pid.active_objs
    137.00            +0.5%     137.67        slabinfo.pid.active_slabs
      4415            +0.3%       4426        slabinfo.pid.num_objs
    137.00            +0.5%     137.67        slabinfo.pid.num_slabs
     92.67 ± 27%     -19.8%      74.33 ± 34%  slabinfo.pid_namespace.active_objs
      1.00            +0.0%       1.00        slabinfo.pid_namespace.active_slabs
     92.67 ± 27%     -19.8%      74.33 ± 34%  slabinfo.pid_namespace.num_objs
      1.00            +0.0%       1.00        slabinfo.pid_namespace.num_slabs
      3025 ± 20%     -16.8%       2516 ±  8%  slabinfo.pool_workqueue.active_objs
     94.00 ± 20%     -17.0%      78.00 ±  8%  slabinfo.pool_workqueue.active_slabs
      3028 ± 20%     -16.9%       2516 ±  8%  slabinfo.pool_workqueue.num_objs
     94.00 ± 20%     -17.0%      78.00 ±  8%  slabinfo.pool_workqueue.num_slabs
      2884            +2.9%       2968 ±  3%  slabinfo.proc_dir_entry.active_objs
     68.67            +2.9%      70.67 ±  3%  slabinfo.proc_dir_entry.active_slabs
      2884            +2.9%       2968 ±  3%  slabinfo.proc_dir_entry.num_objs
     68.67            +2.9%      70.67 ±  3%  slabinfo.proc_dir_entry.num_slabs
      8047 ±  3%     +33.3%      10727 ±  3%  slabinfo.proc_inode_cache.active_objs
    172.33 ±  3%     +33.8%     230.67 ±  3%  slabinfo.proc_inode_cache.active_slabs
      8291 ±  3%     +33.0%      11027 ±  2%  slabinfo.proc_inode_cache.num_objs
    172.33 ±  3%     +33.8%     230.67 ±  3%  slabinfo.proc_inode_cache.num_slabs
    514122            -0.4%     512228        slabinfo.radix_tree_node.active_objs
      9958            +0.5%      10003        slabinfo.radix_tree_node.active_slabs
    555203            -0.4%     553065        slabinfo.radix_tree_node.num_objs
      9958            +0.5%      10003        slabinfo.radix_tree_node.num_slabs
     50.33 ± 13%      +0.0%      50.33 ± 13%  slabinfo.request_queue.active_objs
      3.67 ± 12%      +0.0%       3.67 ± 12%  slabinfo.request_queue.active_slabs
     55.00 ± 12%      +0.0%      55.00 ± 12%  slabinfo.request_queue.num_objs
      3.67 ± 12%      +0.0%       3.67 ± 12%  slabinfo.request_queue.num_slabs
    102.00           +16.7%     119.00 ± 20%  slabinfo.rpc_inode_cache.active_objs
      2.00           +16.7%       2.33 ± 20%  slabinfo.rpc_inode_cache.active_slabs
    102.00           +16.7%     119.00 ± 20%  slabinfo.rpc_inode_cache.num_objs
      2.00           +16.7%       2.33 ± 20%  slabinfo.rpc_inode_cache.num_slabs
    640.00            +0.0%     640.00        slabinfo.scsi_sense_cache.active_objs
     20.00            +0.0%      20.00        slabinfo.scsi_sense_cache.active_slabs
    640.00            +0.0%     640.00        slabinfo.scsi_sense_cache.num_objs
     20.00            +0.0%      20.00        slabinfo.scsi_sense_cache.num_slabs
      3264            +0.0%       3264        slabinfo.seq_file.active_objs
     96.00            +0.0%      96.00        slabinfo.seq_file.active_slabs
      3264            +0.0%       3264        slabinfo.seq_file.num_objs
     96.00            +0.0%      96.00        slabinfo.seq_file.num_slabs
      5450            -3.7%       5247        slabinfo.shmem_inode_cache.active_objs
    117.67            -3.7%     113.33        slabinfo.shmem_inode_cache.active_slabs
      5450            -3.7%       5247        slabinfo.shmem_inode_cache.num_objs
    117.67            -3.7%     113.33        slabinfo.shmem_inode_cache.num_slabs
      2389            -0.6%       2375        slabinfo.sighand_cache.active_objs
    159.00            -0.6%     158.00        slabinfo.sighand_cache.active_slabs
      2389            -0.6%       2375        slabinfo.sighand_cache.num_objs
    159.00            -0.6%     158.00        slabinfo.sighand_cache.num_slabs
      3843            -1.0%       3803        slabinfo.signal_cache.active_objs
    136.67            -1.0%     135.33 ±  2%  slabinfo.signal_cache.active_slabs
      3843            -1.0%       3803        slabinfo.signal_cache.num_objs
    136.67            -1.0%     135.33 ±  2%  slabinfo.signal_cache.num_slabs
    901.33 ±  4%      -4.8%     858.00 ±  9%  slabinfo.skbuff_fclone_cache.active_objs
     28.00 ±  5%      -2.4%      27.33 ±  9%  slabinfo.skbuff_fclone_cache.active_slabs
    901.33 ±  4%      -4.8%     858.00 ±  9%  slabinfo.skbuff_fclone_cache.num_objs
     28.00 ±  5%      -2.4%      27.33 ±  9%  slabinfo.skbuff_fclone_cache.num_slabs
      4339 ±  4%      -6.6%       4053 ±  3%  slabinfo.skbuff_head_cache.active_objs
    135.33 ±  4%      -6.4%     126.67 ±  3%  slabinfo.skbuff_head_cache.active_slabs
      4339 ±  4%      -6.6%       4053 ±  3%  slabinfo.skbuff_head_cache.num_objs
    135.33 ±  4%      -6.4%     126.67 ±  3%  slabinfo.skbuff_head_cache.num_slabs
      3580 ±  3%      -7.2%       3321 ±  4%  slabinfo.sock_inode_cache.active_objs
     91.33 ±  3%      -6.2%      85.67 ±  4%  slabinfo.sock_inode_cache.active_slabs
      3580 ±  3%      -7.2%       3321 ±  4%  slabinfo.sock_inode_cache.num_objs
     91.33 ±  3%      -6.2%      85.67 ±  4%  slabinfo.sock_inode_cache.num_slabs
      6164            -1.2%       6089        slabinfo.task_delay_info.active_objs
    120.33            -1.1%     119.00        slabinfo.task_delay_info.active_slabs
      6164            -1.2%       6089        slabinfo.task_delay_info.num_objs
    120.33            -1.1%     119.00        slabinfo.task_delay_info.num_slabs
      2648 ±  5%      -7.8%       2441 ± 11%  slabinfo.task_group.active_objs
     62.67 ±  4%      -8.5%      57.33 ± 11%  slabinfo.task_group.active_slabs
      2648 ±  5%      -7.8%       2441 ± 11%  slabinfo.task_group.num_objs
     62.67 ±  4%      -8.5%      57.33 ± 11%  slabinfo.task_group.num_slabs
      1231            +0.1%       1233        slabinfo.task_struct.active_objs
      1237            +0.1%       1239        slabinfo.task_struct.active_slabs
      1237            +0.1%       1239        slabinfo.task_struct.num_objs
      1237            +0.1%       1239        slabinfo.task_struct.num_slabs
    144.67 ± 14%     +10.6%     160.00 ± 23%  slabinfo.taskstats.active_objs
      2.67 ± 17%     +12.5%       3.00 ± 27%  slabinfo.taskstats.active_slabs
    144.67 ± 14%     +10.6%     160.00 ± 23%  slabinfo.taskstats.num_objs
      2.67 ± 17%     +12.5%       3.00 ± 27%  slabinfo.taskstats.num_slabs
      3274 ±  5%      -3.8%       3151        slabinfo.trace_event_file.active_objs
     71.00 ±  5%      -3.8%      68.33        slabinfo.trace_event_file.active_slabs
      3274 ±  5%      -3.8%       3151        slabinfo.trace_event_file.num_objs
     71.00 ±  5%      -3.8%      68.33        slabinfo.trace_event_file.num_slabs
     99.00            +0.0%      99.00        slabinfo.tw_sock_TCP.active_objs
      3.00            +0.0%       3.00        slabinfo.tw_sock_TCP.active_slabs
     99.00            +0.0%      99.00        slabinfo.tw_sock_TCP.num_objs
      3.00            +0.0%       3.00        slabinfo.tw_sock_TCP.num_slabs
     66838 ±  5%      -5.7%      63053 ±  3%  slabinfo.vm_area_struct.active_objs
      1673 ±  5%      -5.6%       1579 ±  3%  slabinfo.vm_area_struct.active_slabs
     66962 ±  5%      -5.7%      63174 ±  3%  slabinfo.vm_area_struct.num_objs
      1673 ±  5%      -5.6%       1579 ±  3%  slabinfo.vm_area_struct.num_slabs
     17716            -1.7%      17418        slabinfo.vmap_area.active_objs
    296.33            -0.6%     294.67        slabinfo.vmap_area.active_slabs
     19001            -0.5%      18903        slabinfo.vmap_area.num_objs
    296.33            -0.6%     294.67        slabinfo.vmap_area.num_slabs
    444.00 ± 61%     -32.4%     300.00 ± 20%  slabinfo.xfs_btree_cur.active_objs
     12.33 ± 61%     -32.4%       8.33 ± 20%  slabinfo.xfs_btree_cur.active_slabs
    444.00 ± 61%     -32.4%     300.00 ± 20%  slabinfo.xfs_btree_cur.num_objs
     12.33 ± 61%     -32.4%       8.33 ± 20%  slabinfo.xfs_btree_cur.num_slabs
    322.00 ± 26%      -4.3%     308.00 ± 23%  slabinfo.xfs_buf.active_objs
      7.67 ± 26%      -4.3%       7.33 ± 23%  slabinfo.xfs_buf.active_slabs
    322.00 ± 26%      -4.3%     308.00 ± 23%  slabinfo.xfs_buf.num_objs
      7.67 ± 26%      -4.3%       7.33 ± 23%  slabinfo.xfs_buf.num_slabs
    462.00 ± 70%     -42.4%     266.00 ± 14%  slabinfo.xfs_ili.active_objs
     11.00 ± 70%     -42.4%       6.33 ± 14%  slabinfo.xfs_ili.active_slabs
    462.00 ± 70%     -42.4%     266.00 ± 14%  slabinfo.xfs_ili.num_objs
     11.00 ± 70%     -42.4%       6.33 ± 14%  slabinfo.xfs_ili.num_slabs
    394.67 ± 61%     -37.8%     245.33 ± 16%  slabinfo.xfs_inode.active_objs
     12.33 ± 61%     -37.8%       7.67 ± 16%  slabinfo.xfs_inode.active_slabs
    394.67 ± 61%     -37.8%     245.33 ± 16%  slabinfo.xfs_inode.num_objs
     12.33 ± 61%     -37.8%       7.67 ± 16%  slabinfo.xfs_inode.num_slabs
      9.01 ± 11%      -9.0        0.00        perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node
      8.96 ± 11%      -9.0        0.00        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec
      8.90 ± 10%      -8.9        0.00        perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
     30.38 ± 22%      -4.6       25.80        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     30.47 ± 22%      -4.5       26.02        perf-profile.calltrace.cycles-pp.secondary_startup_64
     30.01 ± 23%      -4.2       25.81        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     30.01 ± 23%      -4.2       25.81        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
     30.01 ± 23%      -4.2       25.81        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     30.01 ± 23%      -4.2       25.81        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
     30.00 ± 23%      -4.2       25.81        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      0.39 ± 70%      -0.4        0.00        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64
      0.39 ± 70%      -0.4        0.00        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
      0.39 ± 70%      -0.4        0.00        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
      0.39 ± 70%      -0.4        0.00        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
      0.39 ± 70%      -0.4        0.00        perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64
      0.34 ± 70%      -0.3        0.00        perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
      0.34 ± 70%      -0.3        0.00        perf-profile.calltrace.cycles-pp.page_referenced_one.rmap_walk_file.page_referenced.shrink_page_list.shrink_inactive_list
      0.17 ±141%      -0.2        0.00        perf-profile.calltrace.cycles-pp.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.pagecache_get_page.filemap_fault
      0.74 ± 10%      +0.0        0.75        perf-profile.calltrace.cycles-pp.rmap_walk_file.page_referenced.shrink_page_list.shrink_inactive_list.shrink_lruvec
      0.84 ± 11%      +0.0        0.86        perf-profile.calltrace.cycles-pp.page_referenced.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
      0.80 ±  9%      +0.0        0.82        perf-profile.calltrace.cycles-pp.isolate_lru_pages.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
      0.73 ±  6%      +0.0        0.76 ±  2%  perf-profile.calltrace.cycles-pp.iomap_apply.iomap_readpage.filemap_fault.__xfs_filemap_fault.__do_fault
      0.61 ± 10%      +0.0        0.64 ±  9%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec
      0.65 ±  5%      +0.1        0.71        perf-profile.calltrace.cycles-pp.rmap_walk_file.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_lruvec
      0.70 ±  5%      +0.1        0.76        perf-profile.calltrace.cycles-pp.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
      0.55 ±  8%      +0.1        0.61 ±  6%  perf-profile.calltrace.cycles-pp.alloc_set_pte.filemap_map_pages.xfs_filemap_map_pages.do_fault.__handle_mm_fault
      3.03 ± 15%      +0.1        3.10 ±  3%  perf-profile.calltrace.cycles-pp.__memcpy_mcsafe.pmem_do_read.pmem_submit_bio.submit_bio_noacct.submit_bio
      3.07 ± 15%      +0.1        3.14 ±  3%  perf-profile.calltrace.cycles-pp.pmem_do_read.pmem_submit_bio.submit_bio_noacct.submit_bio.iomap_readpage
      1.12 ± 12%      +0.1        1.19        perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.filemap_fault.__xfs_filemap_fault
      3.45 ± 14%      +0.1        3.53 ±  3%  perf-profile.calltrace.cycles-pp.pmem_submit_bio.submit_bio_noacct.submit_bio.iomap_readpage.filemap_fault
      1.46 ± 10%      +0.1        1.56 ±  4%  perf-profile.calltrace.cycles-pp.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
      3.71 ± 14%      +0.1        3.82 ±  3%  perf-profile.calltrace.cycles-pp.submit_bio.iomap_readpage.filemap_fault.__xfs_filemap_fault.__do_fault
      3.70 ± 14%      +0.1        3.81 ±  3%  perf-profile.calltrace.cycles-pp.submit_bio_noacct.submit_bio.iomap_readpage.filemap_fault.__xfs_filemap_fault
      2.87 ± 16%      +0.1        3.00 ±  6%  perf-profile.calltrace.cycles-pp.ret_from_fork
      2.87 ± 16%      +0.1        3.00 ±  6%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      4.45 ± 13%      +0.2        4.60 ±  2%  perf-profile.calltrace.cycles-pp.iomap_readpage.filemap_fault.__xfs_filemap_fault.__do_fault.do_fault
      2.75 ± 15%      +0.2        2.91 ±  7%  perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat.kswapd
      2.76 ± 15%      +0.2        2.93 ±  7%  perf-profile.calltrace.cycles-pp.shrink_node.balance_pgdat.kswapd.kthread.ret_from_fork
      2.76 ± 15%      +0.2        2.93 ±  7%  perf-profile.calltrace.cycles-pp.kswapd.kthread.ret_from_fork
      2.76 ± 15%      +0.2        2.93 ±  7%  perf-profile.calltrace.cycles-pp.balance_pgdat.kswapd.kthread.ret_from_fork
      0.38 ± 70%      +0.2        0.55 ±  2%  perf-profile.calltrace.cycles-pp.mem_cgroup_charge.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.filemap_fault
      2.75 ± 15%      +0.2        2.92 ±  7%  perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.balance_pgdat.kswapd.kthread
      2.88 ± 10%      +0.2        3.06        perf-profile.calltrace.cycles-pp.filemap_map_pages.xfs_filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault
      0.44 ± 70%      +0.2        0.62 ±  3%  perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault
      1.14 ± 18%      +0.2        1.33 ±  5%  perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
      0.41 ± 70%      +0.2        0.60 ±  9%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list
      3.07 ± 10%      +0.2        3.26        perf-profile.calltrace.cycles-pp.xfs_filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      0.37 ± 70%      +0.2        0.58 ±  2%  perf-profile.calltrace.cycles-pp.try_to_unmap_one.rmap_walk_file.try_to_unmap.shrink_page_list.shrink_inactive_list
      0.93 ± 13%      +0.4        1.34 ±  9%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
     36.95 ± 10%      +0.6       37.57        perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages
     37.46 ±  9%      +0.7       38.16        perf-profile.calltrace.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
     37.48 ±  9%      +0.7       38.18        perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault
     37.46 ±  9%      +0.7       38.17        perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page
     37.67 ±  9%      +0.7       38.37        perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault
     37.17 ±  9%      +0.7       37.88        perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
     38.35 ±  9%      +0.7       39.07        perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__xfs_filemap_fault.__do_fault
      2.30 ± 25%      +0.7        3.03 ± 21%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.deactivate_file_page
      2.30 ± 25%      +0.7        3.04 ± 21%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.deactivate_file_page.invalidate_mapping_pages
      2.31 ± 25%      +0.7        3.05 ± 21%  perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.pagevec_lru_move_fn.deactivate_file_page.invalidate_mapping_pages.generic_fadvise
      2.38 ± 25%      +0.8        3.14 ± 21%  perf-profile.calltrace.cycles-pp.deactivate_file_page.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64
      2.37 ± 25%      +0.8        3.13 ± 21%  perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.deactivate_file_page.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64
      2.72 ± 25%      +0.8        3.49 ± 21%  perf-profile.calltrace.cycles-pp.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.72 ± 25%      +0.8        3.49 ± 21%  perf-profile.calltrace.cycles-pp.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.72 ± 25%      +0.8        3.49 ± 21%  perf-profile.calltrace.cycles-pp.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.72 ± 25%      +0.8        3.49 ± 21%  perf-profile.calltrace.cycles-pp.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64
      2.75 ± 24%      +0.8        3.53 ± 20%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      2.75 ± 24%      +0.8        3.53 ± 20%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.76 ± 15%      +1.3        5.06        perf-profile.calltrace.cycles-pp.smp_call_function_many_cond.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list
      7.26 ±  9%      +1.3        8.57        perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
      3.92 ± 15%      +1.4        5.29        perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list.shrink_inactive_list
      3.92 ± 15%      +1.4        5.29        perf-profile.calltrace.cycles-pp.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
      3.92 ± 15%      +1.4        5.29        perf-profile.calltrace.cycles-pp.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_lruvec
     13.07 ± 12%      +2.2       15.29 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add
     13.11 ± 12%      +2.2       15.33 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
     13.11 ± 12%      +2.2       15.33 ±  3%  perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.pagecache_get_page
     13.90 ± 12%      +2.3       16.19 ±  3%  perf-profile.calltrace.cycles-pp.lru_cache_add.add_to_page_cache_lru.pagecache_get_page.filemap_fault.__xfs_filemap_fault
     13.85 ± 12%      +2.3       16.15 ±  3%  perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.pagecache_get_page.filemap_fault
     15.10 ± 11%      +2.4       17.48 ±  3%  perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.filemap_fault.__xfs_filemap_fault.__do_fault
     53.68 ± 10%      +3.1       56.78        perf-profile.calltrace.cycles-pp.pagecache_get_page.filemap_fault.__xfs_filemap_fault.__do_fault.do_fault
     58.48 ± 10%      +3.2       61.72        perf-profile.calltrace.cycles-pp.filemap_fault.__xfs_filemap_fault.__do_fault.do_fault.__handle_mm_fault
     58.60 ± 10%      +3.2       61.84        perf-profile.calltrace.cycles-pp.__xfs_filemap_fault.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault
     58.62 ± 10%      +3.3       61.88        perf-profile.calltrace.cycles-pp.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
     61.84 ± 10%      +3.4       65.29        perf-profile.calltrace.cycles-pp.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
     62.08 ± 10%      +3.5       65.54        perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     62.56 ± 10%      +3.5       66.03        perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     62.90 ± 10%      +3.5       66.37        perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault
     62.95 ± 10%      +3.5       66.42        perf-profile.calltrace.cycles-pp.asm_exc_page_fault
     62.85 ± 10%      +3.5       66.33        perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     19.43 ± 10%      +8.0       27.47        perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
     20.31 ± 10%      +8.4       28.76        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node
      9.42 ± 10%      -9.4        0.00        perf-profile.children.cycles-pp.lru_note_cost
     30.47 ± 22%      -4.5       26.02        perf-profile.children.cycles-pp.secondary_startup_64
     30.47 ± 22%      -4.5       26.02        perf-profile.children.cycles-pp.cpu_startup_entry
     30.47 ± 22%      -4.5       26.02        perf-profile.children.cycles-pp.do_idle
     30.47 ± 22%      -4.5       26.02        perf-profile.children.cycles-pp.cpuidle_enter
     30.47 ± 22%      -4.5       26.02        perf-profile.children.cycles-pp.cpuidle_enter_state
     30.46 ± 22%      -4.5       26.01        perf-profile.children.cycles-pp.intel_idle
     30.01 ± 23%      -4.2       25.81        perf-profile.children.cycles-pp.start_secondary
     30.00 ± 10%      -0.7       29.28        perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.46 ± 35%      -0.3        0.21 ± 79%  perf-profile.children.cycles-pp.start_kernel
      0.07 ± 23%      -0.0        0.03 ±141%  perf-profile.children.cycles-pp.worker_thread
      0.14 ± 34%      -0.0        0.10 ± 25%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.05 ± 72%      -0.0        0.02 ±141%  perf-profile.children.cycles-pp.__slab_alloc
      0.05 ± 72%      -0.0        0.02 ±141%  perf-profile.children.cycles-pp.___slab_alloc
      0.05 ± 72%      -0.0        0.02 ±141%  perf-profile.children.cycles-pp.allocate_slab
      0.03 ± 70%      -0.0        0.00        perf-profile.children.cycles-pp.ptep_clear_flush_young
      0.05 ± 71%      -0.0        0.02 ±141%  perf-profile.children.cycles-pp.xas_nomem
      0.03 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.__schedule
      0.03 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.schedule
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.pick_next_task_fair
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.newidle_balance
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.load_balance
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.find_busiest_group
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.update_sd_lb_stats
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.schedule_timeout
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.rcu_gp_kthread
      0.05 ± 78%      -0.0        0.03 ±141%  perf-profile.children.cycles-pp.process_one_work
      0.03 ± 70%      -0.0        0.02 ±141%  perf-profile.children.cycles-pp.__mod_zone_page_state
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.execve
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.__x64_sys_execve
      0.02 ±141%      -0.0        0.00        perf-profile.children.cycles-pp.do_execveat_common
      0.10 ± 17%      -0.0        0.08 ± 71%  perf-profile.children.cycles-pp.ksys_write
      0.09 ± 13%      -0.0        0.08 ± 72%  perf-profile.children.cycles-pp.__libc_write
      0.09 ± 13%      -0.0        0.08 ± 72%  perf-profile.children.cycles-pp.generic_file_write_iter
      0.09 ± 13%      -0.0        0.08 ± 72%  perf-profile.children.cycles-pp.__generic_file_write_iter
      0.09 ± 13%      -0.0        0.08 ± 72%  perf-profile.children.cycles-pp.generic_perform_write
      0.09 ± 13%      -0.0        0.08 ± 71%  perf-profile.children.cycles-pp.vfs_write
      0.09 ± 13%      -0.0        0.08 ± 71%  perf-profile.children.cycles-pp.new_sync_write
      0.25 ± 16%      -0.0        0.24 ±  5%  perf-profile.children.cycles-pp.shrink_slab
      0.44 ± 12%      -0.0        0.43 ±  8%  perf-profile.children.cycles-pp._raw_spin_lock
      0.38 ± 14%      -0.0        0.38 ±  4%  perf-profile.children.cycles-pp.rmqueue_bulk
      0.33 ± 10%      -0.0        0.32 ± 10%  perf-profile.children.cycles-pp.free_pcppages_bulk
      0.13 ±  9%      -0.0        0.12        perf-profile.children.cycles-pp.tick_sched_timer
      0.37 ±  9%      -0.0        0.37 ±  5%  perf-profile.children.cycles-pp.xas_load
      0.49 ± 13%      -0.0        0.49        perf-profile.children.cycles-pp.__count_memcg_events
      0.09 ± 14%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.lock_page_memcg
      0.06 ± 13%      -0.0        0.06 ±  8%  perf-profile.children.cycles-pp.xas_start
      0.06 ± 13%      -0.0        0.06 ±  8%  perf-profile.children.cycles-pp.task_tick_fair
      0.04 ± 71%      -0.0        0.03 ± 70%  perf-profile.children.cycles-pp.percpu_counter_add_batch
      0.12 ± 10%      -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.tick_sched_handle
      0.12 ± 10%      -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.update_process_times
      0.11 ±  4%      -0.0        0.10 ±  4%  perf-profile.children.cycles-pp.xfs_bmapi_read
      0.11 ± 14%      -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.mempool_alloc
      0.10 ± 22%      -0.0        0.10 ±  8%  perf-profile.children.cycles-pp.down_read_trylock
      0.16 ± 10%      +0.0        0.16 ±  5%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.14 ± 11%      +0.0        0.14 ±  3%  perf-profile.children.cycles-pp.xfs_iunlock
      0.09 ±  9%      +0.0        0.09        perf-profile.children.cycles-pp.do_shrink_slab
      0.07 ± 11%      +0.0        0.07        perf-profile.children.cycles-pp.page_counter_try_charge
      0.10 ± 19%      +0.0        0.10 ± 19%  perf-profile.children.cycles-pp.pagevec_lookup_entries
      0.10 ± 19%      +0.0        0.10 ± 19%  perf-profile.children.cycles-pp.find_get_entries
      0.06 ± 13%      +0.0        0.06        perf-profile.children.cycles-pp.bio_associate_blkg
      0.06 ± 14%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.PageHuge
      0.06 ± 13%      +0.0        0.06 ± 72%  perf-profile.children.cycles-pp.shmem_write_begin
      0.06 ± 13%      +0.0        0.06 ± 72%  perf-profile.children.cycles-pp.shmem_getpage_gfp
      0.06 ± 13%      +0.0        0.06        perf-profile.children.cycles-pp.count_shadow_nodes
      0.05            +0.0        0.05        perf-profile.children.cycles-pp._find_next_bit
      0.02 ±141%      +0.0        0.02 ±141%  perf-profile.children.cycles-pp.bio_associate_blkg_from_css
      0.02 ±141%      +0.0        0.02 ±141%  perf-profile.children.cycles-pp.flush_tlb_func_common
      0.03 ±141%      +0.0        0.03 ±141%  perf-profile.children.cycles-pp.drain_local_pages_wq
      0.03 ±141%      +0.0        0.03 ±141%  perf-profile.children.cycles-pp.drain_pages_zone
      0.15 ± 14%      +0.0        0.15 ±  3%  perf-profile.children.cycles-pp.find_get_entry
      0.36 ± 10%      +0.0        0.36 ±  3%  perf-profile.children.cycles-pp.free_unref_page_list
      0.16 ± 10%      +0.0        0.17 ±  7%  perf-profile.children.cycles-pp.bio_alloc_bioset
      0.09 ±  9%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.___perf_sw_event
      0.05 ±  8%      +0.0        0.06 ±  8%  perf-profile.children.cycles-pp.xas_clear_mark
      0.02 ±141%      +0.0        0.02 ±141%  perf-profile.children.cycles-pp.drain_pages
      0.09 ± 18%      +0.0        0.10 ±  4%  perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
      0.08 ± 11%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.scheduler_tick
      0.08 ± 11%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.xfs_ilock_for_iomap
      0.07 ± 11%      +0.0        0.07 ± 12%  perf-profile.children.cycles-pp.workingset_refault
      0.14 ± 15%      +0.0        0.14 ±  3%  perf-profile.children.cycles-pp.__list_add_valid
      0.13 ± 12%      +0.0        0.14 ±  3%  perf-profile.children.cycles-pp.try_charge
      0.51 ±  9%      +0.0        0.51        perf-profile.children.cycles-pp.page_vma_mapped_walk
      0.32 ±  5%      +0.0        0.32        perf-profile.children.cycles-pp.xfs_read_iomap_begin
      0.21 ± 12%      +0.0        0.22 ±  3%  perf-profile.children.cycles-pp.xas_find
      0.07 ±  6%      +0.0        0.08        perf-profile.children.cycles-pp.lru_add_drain
      0.07 ±  6%      +0.0        0.08        perf-profile.children.cycles-pp.lru_add_drain_cpu
      0.12 ± 13%      +0.0        0.13        perf-profile.children.cycles-pp._cond_resched
      0.11 ± 11%      +0.0        0.12 ±  6%  perf-profile.children.cycles-pp.__sysvec_call_function
      0.11 ± 11%      +0.0        0.12 ±  6%  perf-profile.children.cycles-pp.flush_smp_call_function_queue
      0.09 ± 14%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.__might_sleep
      0.09 ± 10%      +0.0        0.09 ± 10%  perf-profile.children.cycles-pp.xas_init_marks
      0.06 ± 14%      +0.0        0.07        perf-profile.children.cycles-pp.rcu_all_qs
      0.06 ±  7%      +0.0        0.07        perf-profile.children.cycles-pp.workingset_update_node
      0.06 ±  8%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.page_counter_uncharge
      0.06 ±  8%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.page_counter_cancel
      0.19 ± 12%      +0.0        0.20        perf-profile.children.cycles-pp.iomap_read_end_io
      0.16 ± 10%      +0.0        0.17        perf-profile.children.cycles-pp.___might_sleep
      0.12 ± 10%      +0.0        0.12 ±  3%  perf-profile.children.cycles-pp.__perf_sw_event
      0.14 ± 10%      +0.0        0.15 ±  3%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.60 ± 13%      +0.0        0.61 ±  3%  perf-profile.children.cycles-pp.rmqueue
      0.29 ± 12%      +0.0        0.30        perf-profile.children.cycles-pp.up_read
      0.14 ± 15%      +0.0        0.15 ±  6%  perf-profile.children.cycles-pp.workingset_age_nonresident
      0.13 ± 12%      +0.0        0.14        perf-profile.children.cycles-pp.iomap_set_range_uptodate
      0.13 ±  9%      +0.0        0.14 ±  3%  perf-profile.children.cycles-pp.sysvec_call_function
      0.12 ± 11%      +0.0        0.13 ±  6%  perf-profile.children.cycles-pp.__mod_node_page_state
      0.09 ±  9%      +0.0        0.10        perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
      0.07 ±  7%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.uncharge_batch
      0.22 ± 13%      +0.0        0.23        perf-profile.children.cycles-pp.xas_create
      0.19 ±  8%      +0.0        0.21 ±  2%  perf-profile.children.cycles-pp.xfs_ilock
      0.10 ±  9%      +0.0        0.12 ±  4%  perf-profile.children.cycles-pp.page_mapping
      0.18 ±  9%      +0.0        0.19 ±  2%  perf-profile.children.cycles-pp.asm_sysvec_call_function
      0.15 ±  8%      +0.0        0.16 ±  5%  perf-profile.children.cycles-pp.__mod_lruvec_state
      0.08 ± 17%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.blk_throtl_bio
      0.18 ± 14%      +0.0        0.19 ±  4%  perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
      0.77 ± 13%      +0.0        0.79 ±  3%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.28 ± 10%      +0.0        0.29 ±  3%  perf-profile.children.cycles-pp.__mod_memcg_state
      0.56 ± 11%      +0.0        0.58        perf-profile.children.cycles-pp.unlock_page
      0.36 ±  6%      +0.0        0.37 ±  3%  perf-profile.children.cycles-pp.iomap_readpage_actor
      0.24 ± 12%      +0.0        0.26        perf-profile.children.cycles-pp.sync_regs
      0.07 ± 11%      +0.0        0.09 ± 10%  perf-profile.children.cycles-pp.release_pages
      0.79 ± 11%      +0.0        0.81        perf-profile.children.cycles-pp.__list_del_entry_valid
      0.46 ± 12%      +0.0        0.48 ±  2%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.28 ±  8%      +0.0        0.30 ±  2%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.02 ±141%      +0.0        0.04 ± 71%  perf-profile.children.cycles-pp.__libc_fork
      0.02 ±141%      +0.0        0.04 ± 71%  perf-profile.children.cycles-pp.__do_sys_clone
      0.02 ±141%      +0.0        0.04 ± 71%  perf-profile.children.cycles-pp._do_fork
      0.02 ±141%      +0.0        0.04 ± 71%  perf-profile.children.cycles-pp.copy_process
      0.58 ± 10%      +0.0        0.60        perf-profile.children.cycles-pp.page_referenced_one
      0.53 ± 13%      +0.0        0.55 ±  2%  perf-profile.children.cycles-pp.mem_cgroup_charge
      0.41 ±  9%      +0.0        0.43 ±  4%  perf-profile.children.cycles-pp.xas_store
      0.22 ±  7%      +0.0        0.24        perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      0.04 ± 71%      +0.0        0.06 ± 13%  perf-profile.children.cycles-pp.read_tsc
      0.03 ± 70%      +0.0        0.06 ± 16%  perf-profile.children.cycles-pp.kmem_cache_free
      0.12            +0.0        0.14 ± 14%  perf-profile.children.cycles-pp.unaccount_page_cache_page
      0.21 ±  9%      +0.0        0.24        perf-profile.children.cycles-pp.hrtimer_interrupt
      0.24 ±  9%      +0.0        0.27        perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      0.20 ± 11%      +0.0        0.23 ±  5%  perf-profile.children.cycles-pp.submit_bio_checks
      0.16 ±  2%      +0.0        0.19 ± 12%  perf-profile.children.cycles-pp.page_remove_rmap
      0.08 ± 14%      +0.0        0.11 ±  8%  perf-profile.children.cycles-pp.ktime_get
      0.73 ±  6%      +0.0        0.76 ±  2%  perf-profile.children.cycles-pp.iomap_apply
      0.54 ± 11%      +0.0        0.57        perf-profile.children.cycles-pp.down_read
      0.36 ± 10%      +0.0        0.39 ±  2%  perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
      0.00            +0.0        0.03 ± 70%  perf-profile.children.cycles-pp.mem_cgroup_update_lru_size
      0.94 ± 10%      +0.0        0.98        perf-profile.children.cycles-pp.isolate_lru_pages
      0.00            +0.0        0.04 ± 71%  perf-profile.children.cycles-pp.clockevents_program_event
      0.26 ± 16%      +0.0        0.29 ±  7%  perf-profile.children.cycles-pp.workingset_eviction
      1.02 ± 11%      +0.0        1.06        perf-profile.children.cycles-pp.page_referenced
      0.45 ±  8%      +0.0        0.50 ±  5%  perf-profile.children.cycles-pp.__delete_from_page_cache
      0.33 ±  6%      +0.0        0.38 ±  9%  perf-profile.children.cycles-pp.page_add_file_rmap
      0.40 ±  8%      +0.1        0.45 ±  2%  perf-profile.children.cycles-pp.move_pages_to_lru
      0.16 ± 13%      +0.1        0.22 ±  5%  perf-profile.children.cycles-pp.smp_call_function_single
      0.62 ±  6%      +0.1        0.68 ±  3%  perf-profile.children.cycles-pp.try_to_unmap_one
      0.56 ±  8%      +0.1        0.62 ±  5%  perf-profile.children.cycles-pp.alloc_set_pte
      3.07 ± 15%      +0.1        3.14 ±  3%  perf-profile.children.cycles-pp.pmem_do_read
      0.81 ±  7%      +0.1        0.88 ±  3%  perf-profile.children.cycles-pp.try_to_unmap
      3.04 ± 15%      +0.1        3.11 ±  3%  perf-profile.children.cycles-pp.__memcpy_mcsafe
      1.12 ± 12%      +0.1        1.19        perf-profile.children.cycles-pp.__add_to_page_cache_locked
      3.45 ± 14%      +0.1        3.53 ±  3%  perf-profile.children.cycles-pp.pmem_submit_bio
      1.66 ±  9%      +0.1        1.75        perf-profile.children.cycles-pp.rmap_walk_file
      3.71 ± 14%      +0.1        3.82 ±  3%  perf-profile.children.cycles-pp.submit_bio
      3.70 ± 14%      +0.1        3.81 ±  3%  perf-profile.children.cycles-pp.submit_bio_noacct
      0.18 ± 28%      +0.1        0.29 ± 19%  perf-profile.children.cycles-pp.shrink_active_list
      0.58 ±  4%      +0.1        0.69 ±  9%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      1.61 ± 11%      +0.1        1.74 ±  4%  perf-profile.children.cycles-pp.__remove_mapping
      2.87 ± 16%      +0.1        3.00 ±  6%  perf-profile.children.cycles-pp.ret_from_fork
      2.87 ± 16%      +0.1        3.00 ±  6%  perf-profile.children.cycles-pp.kthread
      4.46 ± 13%      +0.1        4.60 ±  2%  perf-profile.children.cycles-pp.iomap_readpage
      0.00            +0.2        0.16 ±  7%  perf-profile.children.cycles-pp.lru_note_cost_unlock_irq
      2.76 ± 15%      +0.2        2.93 ±  7%  perf-profile.children.cycles-pp.kswapd
      2.76 ± 15%      +0.2        2.93 ±  7%  perf-profile.children.cycles-pp.balance_pgdat
      2.92 ± 10%      +0.2        3.10        perf-profile.children.cycles-pp.filemap_map_pages
      3.07 ± 10%      +0.2        3.26        perf-profile.children.cycles-pp.xfs_filemap_map_pages
     37.62 ±  9%      +0.7       38.31        perf-profile.children.cycles-pp.try_to_free_pages
     37.81 ±  9%      +0.7       38.50        perf-profile.children.cycles-pp.__alloc_pages_slowpath
     37.61 ±  9%      +0.7       38.30        perf-profile.children.cycles-pp.do_try_to_free_pages
     38.50 ± 10%      +0.7       39.21        perf-profile.children.cycles-pp.__alloc_pages_nodemask
     39.87 ± 10%      +0.8       40.62        perf-profile.children.cycles-pp.shrink_inactive_list
      2.38 ± 25%      +0.8        3.14 ± 21%  perf-profile.children.cycles-pp.deactivate_file_page
      2.37 ± 25%      +0.8        3.13 ± 21%  perf-profile.children.cycles-pp.pagevec_lru_move_fn
      2.72 ± 25%      +0.8        3.49 ± 21%  perf-profile.children.cycles-pp.__x64_sys_fadvise64
      2.72 ± 25%      +0.8        3.49 ± 21%  perf-profile.children.cycles-pp.ksys_fadvise64_64
      2.72 ± 25%      +0.8        3.49 ± 21%  perf-profile.children.cycles-pp.generic_fadvise
      2.72 ± 25%      +0.8        3.49 ± 21%  perf-profile.children.cycles-pp.invalidate_mapping_pages
      2.96 ± 23%      +0.8        3.74 ± 18%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      2.96 ± 23%      +0.8        3.74 ± 18%  perf-profile.children.cycles-pp.do_syscall_64
     40.37 ± 10%      +0.9       41.22        perf-profile.children.cycles-pp.shrink_node
     40.07 ± 10%      +0.9       40.93        perf-profile.children.cycles-pp.shrink_lruvec
      3.92 ± 10%      +1.2        5.09        perf-profile.children.cycles-pp.smp_call_function_many_cond
      4.08 ± 10%      +1.2        5.31        perf-profile.children.cycles-pp.try_to_unmap_flush
      4.08 ± 10%      +1.2        5.31        perf-profile.children.cycles-pp.arch_tlbbatch_flush
      4.07 ± 10%      +1.2        5.30        perf-profile.children.cycles-pp.on_each_cpu_cond_mask
      8.45 ± 10%      +1.5        9.95        perf-profile.children.cycles-pp.shrink_page_list
     46.18 ±  9%      +2.3       48.47        perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
     13.95 ± 11%      +2.3       16.26 ±  3%  perf-profile.children.cycles-pp.lru_cache_add
     13.97 ± 11%      +2.3       16.29 ±  3%  perf-profile.children.cycles-pp.__pagevec_lru_add
     15.10 ± 11%      +2.4       17.48 ±  3%  perf-profile.children.cycles-pp.add_to_page_cache_lru
     15.55 ±  8%      +3.0       18.53        perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
     16.20 ±  8%      +3.0       19.21        perf-profile.children.cycles-pp._raw_spin_lock_irqsave
     53.68 ± 10%      +3.1       56.78        perf-profile.children.cycles-pp.pagecache_get_page
     58.49 ± 10%      +3.2       61.72        perf-profile.children.cycles-pp.filemap_fault
     58.60 ± 10%      +3.2       61.84        perf-profile.children.cycles-pp.__xfs_filemap_fault
     58.63 ± 10%      +3.3       61.88        perf-profile.children.cycles-pp.__do_fault
     61.85 ± 10%      +3.5       65.30        perf-profile.children.cycles-pp.do_fault
     62.59 ± 10%      +3.5       66.05        perf-profile.children.cycles-pp.handle_mm_fault
     62.09 ± 10%      +3.5       65.56        perf-profile.children.cycles-pp.__handle_mm_fault
     62.91 ± 10%      +3.5       66.38        perf-profile.children.cycles-pp.exc_page_fault
     62.88 ± 10%      +3.5       66.35        perf-profile.children.cycles-pp.do_user_addr_fault
     62.97 ± 10%      +3.5       66.45        perf-profile.children.cycles-pp.asm_exc_page_fault
     30.46 ± 22%      -4.5       26.01        perf-profile.self.cycles-pp.intel_idle
      0.03 ± 70%      -0.0        0.00        perf-profile.self.cycles-pp.ptep_clear_flush_young
      0.02 ±141%      -0.0        0.00        perf-profile.self.cycles-pp.update_sd_lb_stats
      0.16 ± 10%      -0.0        0.14 ±  5%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.03 ± 70%      -0.0        0.02 ±141%  perf-profile.self.cycles-pp.lru_cache_add
      0.03 ± 70%      -0.0        0.02 ±141%  perf-profile.self.cycles-pp.xfs_iunlock
      0.03 ± 70%      -0.0        0.02 ±141%  perf-profile.self.cycles-pp.__mod_zone_page_state
      0.02 ±141%      -0.0        0.00        perf-profile.self.cycles-pp.count_shadow_nodes
      0.07 ± 11%      -0.0        0.06        perf-profile.self.cycles-pp.kmem_cache_alloc
      0.49 ± 13%      -0.0        0.49        perf-profile.self.cycles-pp.__count_memcg_events
      0.06 ± 16%      -0.0        0.05        perf-profile.self.cycles-pp.xas_start
      0.32 ±  9%      -0.0        0.31 ±  5%  perf-profile.self.cycles-pp.xas_load
      0.14 ± 15%      -0.0        0.13 ±  3%  perf-profile.self.cycles-pp.__list_add_valid
      0.09 ± 14%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.lock_page_memcg
      0.04 ± 71%      -0.0        0.03 ± 70%  perf-profile.self.cycles-pp.percpu_counter_add_batch
      0.18 ±  9%      -0.0        0.18 ±  4%  perf-profile.self.cycles-pp.filemap_fault
      0.16 ± 10%      +0.0        0.16 ±  5%  perf-profile.self.cycles-pp.free_pcppages_bulk
      0.06 ± 13%      +0.0        0.06 ± 13%  perf-profile.self.cycles-pp.do_user_addr_fault
      0.06 ± 14%      +0.0        0.06 ±  7%  perf-profile.self.cycles-pp.xfs_read_iomap_begin
      0.05 ±  8%      +0.0        0.05 ±  8%  perf-profile.self.cycles-pp.__alloc_pages_nodemask
      0.03 ± 70%      +0.0        0.03 ± 70%  perf-profile.self.cycles-pp.shrink_slab
      0.02 ±141%      +0.0        0.02 ±141%  perf-profile.self.cycles-pp.flush_smp_call_function_queue
      0.02 ±141%      +0.0        0.02 ±141%  perf-profile.self.cycles-pp.bio_associate_blkg_from_css
      0.02 ±141%      +0.0        0.02 ±141%  perf-profile.self.cycles-pp.invalidate_mapping_pages
      0.07 ± 12%      +0.0        0.07 ±  6%  perf-profile.self.cycles-pp.___perf_sw_event
      0.10 ± 21%      +0.0        0.10 ±  8%  perf-profile.self.cycles-pp.down_read_trylock
      0.15 ± 16%      +0.0        0.16 ±  6%  perf-profile.self.cycles-pp.get_page_from_freelist
      0.06 ±  7%      +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.page_counter_try_charge
      0.05 ±  8%      +0.0        0.06 ±  8%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.08 ± 16%      +0.0        0.08        perf-profile.self.cycles-pp.rmap_walk_file
      0.07 ±  7%      +0.0        0.07        perf-profile.self.cycles-pp.do_fault
      0.32 ± 10%      +0.0        0.32        perf-profile.self.cycles-pp.page_vma_mapped_walk
      0.19 ± 11%      +0.0        0.20 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock
      0.10 ±  8%      +0.0        0.11 ±  4%  perf-profile.self.cycles-pp.page_mapping
      0.05 ±  8%      +0.0        0.06        perf-profile.self.cycles-pp.xas_find
      0.08 ± 16%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.__might_sleep
      0.07 ± 11%      +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.rmqueue
      0.06 ± 13%      +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.pmem_submit_bio
      0.07            +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.iomap_readpage_actor
      0.06 ± 14%      +0.0        0.07        perf-profile.self.cycles-pp.try_charge
      0.20 ± 14%      +0.0        0.20 ±  2%  perf-profile.self.cycles-pp.xas_create
      0.08 ±  5%      +0.0        0.09 ±  9%  perf-profile.self.cycles-pp.xas_store
      0.08 ± 24%      +0.0        0.09 ± 18%  perf-profile.self.cycles-pp.find_get_entries
      0.15 ± 14%      +0.0        0.16 ±  3%  perf-profile.self.cycles-pp.handle_mm_fault
      0.29 ± 12%      +0.0        0.30        perf-profile.self.cycles-pp.up_read
      0.16 ± 13%      +0.0        0.17 ±  2%  perf-profile.self.cycles-pp.alloc_set_pte
      0.16 ± 13%      +0.0        0.17 ±  2%  perf-profile.self.cycles-pp.___might_sleep
      0.14 ± 15%      +0.0        0.15 ±  6%  perf-profile.self.cycles-pp.workingset_age_nonresident
      0.14 ± 10%      +0.0        0.15        perf-profile.self.cycles-pp.page_referenced_one
      0.13 ±  9%      +0.0        0.14 ±  3%  perf-profile.self.cycles-pp.iomap_set_range_uptodate
      0.11 ± 14%      +0.0        0.12 ±  3%  perf-profile.self.cycles-pp.mem_cgroup_charge
      0.09 ± 10%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.12 ± 10%      +0.0        0.13 ±  3%  perf-profile.self.cycles-pp.__mod_node_page_state
      0.24 ± 12%      +0.0        0.25        perf-profile.self.cycles-pp.sync_regs
      0.06 ±  7%      +0.0        0.08 ± 16%  perf-profile.self.cycles-pp.page_remove_rmap
      0.04 ± 71%      +0.0        0.05        perf-profile.self.cycles-pp._cond_resched
      0.20 ± 14%      +0.0        0.21 ±  2%  perf-profile.self.cycles-pp.__remove_mapping
      0.18 ± 14%      +0.0        0.19 ±  4%  perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
      0.27 ± 10%      +0.0        0.28 ±  3%  perf-profile.self.cycles-pp.__mod_memcg_state
      0.04 ± 70%      +0.0        0.06 ±  8%  perf-profile.self.cycles-pp.iomap_apply
      0.04 ± 70%      +0.0        0.06 ±  8%  perf-profile.self.cycles-pp.PageHuge
      0.04 ± 70%      +0.0        0.06 ±  8%  perf-profile.self.cycles-pp.page_counter_cancel
      0.02 ±141%      +0.0        0.03 ± 70%  perf-profile.self.cycles-pp._find_next_bit
      0.00            +0.0        0.02 ±141%  perf-profile.self.cycles-pp.lru_note_cost_unlock_irq
      0.00            +0.0        0.02 ±141%  perf-profile.self.cycles-pp.blk_throtl_bio
      0.00            +0.0        0.02 ±141%  perf-profile.self.cycles-pp.xfs_bmapi_read
      0.04 ± 71%      +0.0        0.05 ±  8%  perf-profile.self.cycles-pp.xas_clear_mark
      0.03 ± 70%      +0.0        0.05        perf-profile.self.cycles-pp.rcu_all_qs
      0.54 ± 11%      +0.0        0.56        perf-profile.self.cycles-pp.unlock_page
      0.27 ± 12%      +0.0        0.28        perf-profile.self.cycles-pp.try_to_unmap_one
      0.53 ±  9%      +0.0        0.55 ±  2%  perf-profile.self.cycles-pp.isolate_lru_pages
      0.30 ± 11%      +0.0        0.32        perf-profile.self.cycles-pp.shrink_page_list
      0.03 ± 70%      +0.0        0.05 ±  8%  perf-profile.self.cycles-pp.unaccount_page_cache_page
      0.21 ±  9%      +0.0        0.23 ±  3%  perf-profile.self.cycles-pp.__handle_mm_fault
      0.04 ± 71%      +0.0        0.06 ± 13%  perf-profile.self.cycles-pp.read_tsc
      0.13 ± 16%      +0.0        0.15 ±  8%  perf-profile.self.cycles-pp.workingset_eviction
      0.46 ± 13%      +0.0        0.48 ±  2%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.38 ± 11%      +0.0        0.40        perf-profile.self.cycles-pp.down_read
      0.78 ± 12%      +0.0        0.80        perf-profile.self.cycles-pp.__list_del_entry_valid
      0.11 ±  7%      +0.0        0.14 ± 13%  perf-profile.self.cycles-pp.page_add_file_rmap
      0.00            +0.0        0.03 ± 70%  perf-profile.self.cycles-pp.mem_cgroup_update_lru_size
      0.02 ±141%      +0.0        0.05 ±  8%  perf-profile.self.cycles-pp.release_pages
      0.17 ±  2%      +0.0        0.21 ±  6%  perf-profile.self.cycles-pp.__add_to_page_cache_locked
      0.00            +0.0        0.04 ± 73%  perf-profile.self.cycles-pp.ktime_get
      0.25 ±  9%      +0.0        0.30        perf-profile.self.cycles-pp.move_pages_to_lru
      0.39 ±  8%      +0.1        0.44        perf-profile.self.cycles-pp.__pagevec_lru_add
      0.15 ± 16%      +0.1        0.21 ±  5%  perf-profile.self.cycles-pp.smp_call_function_single
      3.01 ± 15%      +0.1        3.08 ±  3%  perf-profile.self.cycles-pp.__memcpy_mcsafe
      1.76 ± 10%      +0.1        1.86        perf-profile.self.cycles-pp.filemap_map_pages
      0.30 ±  5%      +0.1        0.40 ± 16%  perf-profile.self.cycles-pp.__mod_memcg_lruvec_state
      3.81 ± 10%      +1.2        4.97        perf-profile.self.cycles-pp.smp_call_function_many_cond
     46.18 ±  9%      +2.3       48.47        perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
    352.67            -0.2%     352.00        softirqs.BLOCK
      0.00       +1.6e+103%      16.00 ± 93%  softirqs.CPU0.BLOCK
      1.00            +0.0%       1.00        softirqs.CPU0.HI
      8.67 ± 73%     +34.6%      11.67 ±123%  softirqs.CPU0.NET_RX
     43.00 ±139%      -1.6%      42.33 ±139%  softirqs.CPU0.NET_TX
     32687 ± 21%     +16.5%      38080 ± 11%  softirqs.CPU0.RCU
     88801 ±  2%      +6.5%      94558 ±  3%  softirqs.CPU0.SCHED
    108.33 ±  4%      -1.5%     106.67 ±  2%  softirqs.CPU0.TASKLET
      6472 ± 20%      -8.3%       5933 ±  4%  softirqs.CPU0.TIMER
      0.00       +4.7e+102%       4.67 ±112%  softirqs.CPU1.BLOCK
    545.67 ±140%     -99.5%       3.00 ± 72%  softirqs.CPU1.NET_RX
      0.67 ±141%     +50.0%       1.00        softirqs.CPU1.NET_TX
     29769 ± 18%      +2.0%      30356 ±  7%  softirqs.CPU1.RCU
     71268 ±  5%     +23.7%      88185 ±  4%  softirqs.CPU1.SCHED
      6.67 ±141%     -90.0%       0.67 ± 70%  softirqs.CPU1.TASKLET
      1701 ± 19%     +18.1%       2008 ± 14%  softirqs.CPU1.TIMER
      4.00 ±141%    +250.0%      14.00 ±141%  softirqs.CPU10.BLOCK
      1.33 ± 35%     -25.0%       1.00        softirqs.CPU10.HI
      4.00 ± 93%    -100.0%       0.00        softirqs.CPU10.NET_RX
      1.00 ± 81%    -100.0%       0.00        softirqs.CPU10.NET_TX
     22360 ±  2%     +10.9%      24800        softirqs.CPU10.RCU
     60048 ±  6%      -1.3%      59269 ± 25%  softirqs.CPU10.SCHED
     37.00 ±  3%      -2.7%      36.00        softirqs.CPU10.TASKLET
      1332 ± 36%    +119.9%       2930 ± 74%  softirqs.CPU10.TIMER
      4.67 ±141%     -92.9%       0.33 ±141%  softirqs.CPU11.BLOCK
     54.33 ±107%     -11.0%      48.33 ±132%  softirqs.CPU11.NET_RX
      1.33 ± 93%     -50.0%       0.67 ± 70%  softirqs.CPU11.NET_TX
     22011 ±  2%      +2.4%      22549 ±  2%  softirqs.CPU11.RCU
     69178 ± 15%      -9.5%      62640 ± 11%  softirqs.CPU11.SCHED
      2.00           -33.3%       1.33 ± 70%  softirqs.CPU11.TASKLET
      4545 ±104%     -29.3%       3213 ± 32%  softirqs.CPU11.TIMER
     14.33 ±136%    -100.0%       0.00        softirqs.CPU12.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU12.NET_TX
     22928 ±  8%      -2.1%      22439 ±  4%  softirqs.CPU12.RCU
     59151 ± 14%     +10.0%      65088 ±  7%  softirqs.CPU12.SCHED
      2.00            +0.0%       2.00        softirqs.CPU12.TASKLET
      1219 ±  6%     -14.3%       1044 ± 27%  softirqs.CPU12.TIMER
      0.00       +2.7e+102%       2.67 ±141%  softirqs.CPU13.BLOCK
      2.33 ± 20%     +14.3%       2.67 ± 93%  softirqs.CPU13.NET_RX
      1.00            +0.0%       1.00 ±141%  softirqs.CPU13.NET_TX
     22275 ±  6%      +1.2%      22541 ±  3%  softirqs.CPU13.RCU
     63055 ±  9%     +10.3%      69535 ± 12%  softirqs.CPU13.SCHED
      2.33 ± 20%     +14.3%       2.67 ± 35%  softirqs.CPU13.TASKLET
      2398 ± 53%      -4.8%       2284 ± 83%  softirqs.CPU13.TIMER
     13.33 ± 86%     -95.0%       0.67 ±141%  softirqs.CPU14.BLOCK
      3.67 ± 34%     -27.3%       2.67 ± 77%  softirqs.CPU14.NET_RX
      1.00           +33.3%       1.33 ± 70%  softirqs.CPU14.NET_TX
     21091 ±  5%      +5.7%      22302 ±  5%  softirqs.CPU14.RCU
     71609 ± 11%     -16.9%      59516 ± 19%  softirqs.CPU14.SCHED
      1.33 ± 70%    +125.0%       3.00 ± 27%  softirqs.CPU14.TASKLET
      1833 ± 34%     -22.4%       1422 ± 80%  softirqs.CPU14.TIMER
      2.67 ±141%    -100.0%       0.00        softirqs.CPU15.BLOCK
      5.00 ± 43%     +80.0%       9.00 ± 65%  softirqs.CPU15.NET_RX
      1.33 ± 93%     -50.0%       0.67 ±141%  softirqs.CPU15.NET_TX
     21562 ±  8%      -0.7%      21418 ±  3%  softirqs.CPU15.RCU
     62199 ± 15%     +22.0%      75862 ±  8%  softirqs.CPU15.SCHED
      2.33 ± 20%      +0.0%       2.33 ± 20%  softirqs.CPU15.TASKLET
      1772 ± 24%     +10.5%       1959 ± 13%  softirqs.CPU15.TIMER
      9.33 ±141%    -100.0%       0.00        softirqs.CPU16.BLOCK
      1.67 ±101%     +40.0%       2.33 ±112%  softirqs.CPU16.NET_RX
      1.00 ± 81%     -33.3%       0.67 ±141%  softirqs.CPU16.NET_TX
     20327            +8.2%      21999 ±  6%  softirqs.CPU16.RCU
     68518 ±  8%      +2.5%      70202 ± 17%  softirqs.CPU16.SCHED
      2.00           -33.3%       1.33 ± 70%  softirqs.CPU16.TASKLET
      2310 ± 27%     -30.8%       1598 ± 25%  softirqs.CPU16.TIMER
     66.00 ± 91%     -53.0%      31.00 ±141%  softirqs.CPU17.BLOCK
      4.00 ± 70%    +775.0%      35.00 ±135%  softirqs.CPU17.NET_RX
      1.00 ± 81%      +0.0%       1.00 ± 81%  softirqs.CPU17.NET_TX
     21046 ±  3%      +5.3%      22169 ±  2%  softirqs.CPU17.RCU
     65866            -1.7%      64752 ±  5%  softirqs.CPU17.SCHED
      1.67 ± 74%     -40.0%       1.00 ±141%  softirqs.CPU17.TASKLET
      1087 ±  4%     +95.6%       2127 ± 40%  softirqs.CPU17.TIMER
     38.00 ±141%      +4.4%      39.67 ±141%  softirqs.CPU18.BLOCK
      2.67 ± 46%  +3.2e+05%       8647 ±141%  softirqs.CPU18.NET_RX
      1.00 ± 81%     +33.3%       1.33 ± 70%  softirqs.CPU18.NET_TX
     21598 ±  5%     +15.3%      24902 ± 10%  softirqs.CPU18.RCU
     76140 ±  9%     -13.9%      65570 ±  8%  softirqs.CPU18.SCHED
      0.67 ±141%      +0.0%       0.67 ± 70%  softirqs.CPU18.TASKLET
      1821 ± 15%     +66.2%       3026 ± 99%  softirqs.CPU18.TIMER
     49.67 ±141%     -60.4%      19.67 ±141%  softirqs.CPU19.BLOCK
      9.00 ± 94%     -88.9%       1.00 ±141%  softirqs.CPU19.NET_RX
      1.67 ± 74%     -80.0%       0.33 ±141%  softirqs.CPU19.NET_TX
     21110 ±  7%      +6.6%      22495 ±  6%  softirqs.CPU19.RCU
     61449 ± 15%      -0.5%      61131 ± 12%  softirqs.CPU19.SCHED
      0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU19.TASKLET
      2216 ± 55%      -8.0%       2038 ± 16%  softirqs.CPU19.TIMER
      3.00 ± 94%   +1555.6%      49.67 ±127%  softirqs.CPU2.NET_RX
      0.33 ±141%    +300.0%       1.33 ± 35%  softirqs.CPU2.NET_TX
     21181 ±  5%     +10.4%      23388 ±  4%  softirqs.CPU2.RCU
     79565 ± 11%      -8.5%      72784 ±  7%  softirqs.CPU2.SCHED
      0.67 ±141%    -100.0%       0.00        softirqs.CPU2.TASKLET
      2333 ± 40%     -40.6%       1387 ± 66%  softirqs.CPU2.TIMER
      2.67 ±141%    -100.0%       0.00        softirqs.CPU20.BLOCK
      1.67 ± 56%     -20.0%       1.33 ± 35%  softirqs.CPU20.NET_RX
      1.00 ± 81%     -66.7%       0.33 ±141%  softirqs.CPU20.NET_TX
     22783 ±  4%      +1.5%      23127 ±  2%  softirqs.CPU20.RCU
     55917 ±  7%     +10.7%      61927 ±  6%  softirqs.CPU20.SCHED
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU20.TASKLET
      1043 ± 46%    +217.3%       3311 ± 61%  softirqs.CPU20.TIMER
      5.67 ± 54%   +1817.6%     108.67 ±139%  softirqs.CPU21.NET_RX
      0.67 ± 70%     +50.0%       1.00 ±141%  softirqs.CPU21.NET_TX
     22790            +1.4%      23101        softirqs.CPU21.RCU
     50528 ±  4%     +20.8%      61018 ±  9%  softirqs.CPU21.SCHED
      0.67 ±141%    -100.0%       0.00        softirqs.CPU21.TASKLET
      1175 ± 44%     +69.0%       1985 ± 46%  softirqs.CPU21.TIMER
      2.00 ± 70%   +3433.3%      70.67 ±111%  softirqs.CPU22.NET_RX
      0.67 ± 70%     +50.0%       1.00 ± 81%  softirqs.CPU22.NET_TX
     22012 ±  4%      +6.7%      23479 ±  4%  softirqs.CPU22.RCU
     57664 ±  7%      +6.9%      61668 ± 12%  softirqs.CPU22.SCHED
      0.33 ±141%    +400.0%       1.67 ± 74%  softirqs.CPU22.TASKLET
      1590 ± 21%     +13.4%       1804 ± 43%  softirqs.CPU22.TIMER
      0.00       +5.3e+102%       5.33 ± 70%  softirqs.CPU23.BLOCK
      2.00         +2316.7%      48.33 ±132%  softirqs.CPU23.NET_RX
      0.67 ± 70%    +150.0%       1.67 ± 56%  softirqs.CPU23.NET_TX
     24711 ± 10%      -4.6%      23562 ±  7%  softirqs.CPU23.RCU
     54407 ±  6%      +4.9%      57051 ± 14%  softirqs.CPU23.SCHED
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU23.TASKLET
      1844 ± 58%     +37.1%       2527 ±  6%  softirqs.CPU23.TIMER
      1.00 ±141%    -100.0%       0.00        softirqs.CPU24.BLOCK
     38.33 ±132%    +422.6%     200.33 ± 78%  softirqs.CPU24.NET_RX
      1.33 ±141%     +75.0%       2.33 ± 72%  softirqs.CPU24.NET_TX
     22937 ±  6%      -3.2%      22196 ±  7%  softirqs.CPU24.RCU
     72769 ±  4%      +7.9%      78514 ± 20%  softirqs.CPU24.SCHED
      0.33 ±141%    +900.0%       3.33 ±141%  softirqs.CPU24.TASKLET
      3419 ± 76%     +45.4%       4972 ±100%  softirqs.CPU24.TIMER
      9.00 ±141%    -100.0%       0.00        softirqs.CPU25.BLOCK
      8739 ±138%     -99.8%      14.33 ±122%  softirqs.CPU25.NET_RX
      0.33 ±141%    +100.0%       0.67 ± 70%  softirqs.CPU25.NET_TX
     23915 ±  4%      -1.0%      23678 ±  7%  softirqs.CPU25.RCU
     72022 ± 15%      -7.1%      66891 ±  6%  softirqs.CPU25.SCHED
      0.33 ±141%    -100.0%       0.00        softirqs.CPU25.TASKLET
      1338 ± 50%     +35.4%       1811 ± 73%  softirqs.CPU25.TIMER
      8.33 ± 70%    -100.0%       0.00        softirqs.CPU26.BLOCK
      0.00         +4e+102%       4.00 ±124%  softirqs.CPU26.NET_RX
      0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU26.NET_TX
     21745 ±  6%      +1.0%      21973        softirqs.CPU26.RCU
     68345 ± 23%      +7.0%      73098 ± 10%  softirqs.CPU26.SCHED
      3.00 ± 47%    +144.4%       7.33 ±102%  softirqs.CPU26.TASKLET
      1877 ± 56%      +8.7%       2041 ± 16%  softirqs.CPU26.TIMER
      5.00 ±141%    -100.0%       0.00        softirqs.CPU27.BLOCK
     71.67 ±138%     -97.2%       2.00 ± 40%  softirqs.CPU27.NET_RX
      1.00 ± 81%     -66.7%       0.33 ±141%  softirqs.CPU27.NET_TX
     22462 ±  5%      +0.8%      22637 ±  6%  softirqs.CPU27.RCU
     79157 ± 10%     -17.9%      65014 ±  9%  softirqs.CPU27.SCHED
      2.00          +133.3%       4.67 ± 66%  softirqs.CPU27.TASKLET
      1107 ± 17%     +30.1%       1441 ±  3%  softirqs.CPU27.TIMER
      8.00 ±115%     -87.5%       1.00 ± 81%  softirqs.CPU28.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU28.NET_TX
     21787 ±  7%      +4.1%      22675 ±  2%  softirqs.CPU28.RCU
     79977 ±  4%     -13.7%      69049        softirqs.CPU28.SCHED
      3.00 ± 47%    +311.1%      12.33 ±118%  softirqs.CPU28.TASKLET
      2135 ± 39%     -18.5%       1739 ± 39%  softirqs.CPU28.TIMER
     12.33 ± 53%     -78.4%       2.67 ± 88%  softirqs.CPU29.NET_RX
     42.67 ±138%     -98.4%       0.67 ± 70%  softirqs.CPU29.NET_TX
     22178 ±  6%      +4.7%      23223 ±  6%  softirqs.CPU29.RCU
     78116 ±  8%     -25.4%      58242 ± 15%  softirqs.CPU29.SCHED
      1.33 ± 70%     +50.0%       2.00        softirqs.CPU29.TASKLET
      4898 ±120%     -71.9%       1376 ± 34%  softirqs.CPU29.TIMER
      2.33 ± 53%  +7.1e+05%      16483 ±141%  softirqs.CPU3.NET_RX
      0.67 ± 70%    -100.0%       0.00        softirqs.CPU3.NET_TX
     21693 ±  4%      +4.0%      22565 ±  4%  softirqs.CPU3.RCU
     70992 ±  6%     +11.3%      79042 ±  8%  softirqs.CPU3.SCHED
      3184 ± 26%     -67.0%       1050 ± 44%  softirqs.CPU3.TIMER
      0.67 ±141%    +500.0%       4.00 ±141%  softirqs.CPU30.BLOCK
      3.33 ±141%     -60.0%       1.33 ± 93%  softirqs.CPU30.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU30.NET_TX
     20992 ±  5%      +6.0%      22260 ±  4%  softirqs.CPU30.RCU
     76231 ±  7%      -8.6%      69647 ± 14%  softirqs.CPU30.SCHED
      1.33 ± 70%      +0.0%       1.33 ± 70%  softirqs.CPU30.TASKLET
      1950 ± 47%     +31.5%       2563 ± 40%  softirqs.CPU30.TIMER
      0.33 ±141%    +400.0%       1.67 ± 74%  softirqs.CPU31.NET_RX
      0.33 ±141%      +0.0%       0.33 ±141%  softirqs.CPU31.NET_TX
     24092 ±  3%      -0.9%      23885 ±  5%  softirqs.CPU31.RCU
     47562 ±  7%     +30.6%      62125 ± 10%  softirqs.CPU31.SCHED
      2.00          +100.0%       4.00 ± 70%  softirqs.CPU31.TASKLET
      1119 ±  7%     +73.9%       1946 ± 63%  softirqs.CPU31.TIMER
      8.67 ±141%    -100.0%       0.00        softirqs.CPU32.BLOCK
      4423 ±141%    -100.0%       1.67 ± 74%  softirqs.CPU32.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU32.NET_TX
     23500 ±  6%      +2.7%      24138 ±  2%  softirqs.CPU32.RCU
     59614            -9.2%      54138 ±  3%  softirqs.CPU32.SCHED
      2.33 ± 20%     -14.3%       2.00        softirqs.CPU32.TASKLET
      1947 ± 89%     -37.4%       1218 ± 36%  softirqs.CPU32.TIMER
      4.00 ±141%    -100.0%       0.00        softirqs.CPU33.BLOCK
      0.67 ±141%  +87100.0%     581.33 ±141%  softirqs.CPU33.NET_RX
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU33.NET_TX
     21958            +4.2%      22882        softirqs.CPU33.RCU
     62720 ±  9%      -2.7%      61004 ± 17%  softirqs.CPU33.SCHED
      3.33 ± 56%    +240.0%      11.33 ±129%  softirqs.CPU33.TASKLET
      1701 ± 36%     +35.3%       2301 ± 85%  softirqs.CPU33.TIMER
      4.00 ±141%     -83.3%       0.67 ±141%  softirqs.CPU34.NET_RX
     42.00 ±141%     -99.2%       0.33 ±141%  softirqs.CPU34.NET_TX
     23176 ±  3%      -0.2%      23123 ±  7%  softirqs.CPU34.RCU
     66882 ±  5%     -13.7%      57686 ± 12%  softirqs.CPU34.SCHED
      0.67 ±141%    +100.0%       1.33 ± 70%  softirqs.CPU34.TASKLET
      1437 ± 52%     +45.7%       2094 ± 56%  softirqs.CPU34.TIMER
      2.00 ± 70%     -50.0%       1.00 ± 81%  softirqs.CPU35.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU35.NET_TX
     22195 ±  4%      +8.4%      24068 ±  2%  softirqs.CPU35.RCU
     62312 ±  5%     -19.4%      50217 ± 10%  softirqs.CPU35.SCHED
      1.00 ± 81%    -100.0%       0.00        softirqs.CPU35.TASKLET
      1622 ± 63%     -55.5%     721.33 ± 23%  softirqs.CPU35.TIMER
      3.00 ± 81%     -22.2%       2.33 ±141%  softirqs.CPU36.NET_RX
      1.33 ± 93%     -50.0%       0.67 ±141%  softirqs.CPU36.NET_TX
     22423 ±  4%      +2.5%      22978 ±  3%  softirqs.CPU36.RCU
     57070 ± 21%     +17.4%      67020 ±  3%  softirqs.CPU36.SCHED
      0.00          -100.0%       0.00        softirqs.CPU36.TASKLET
    915.67 ± 21%     +84.8%       1692 ± 58%  softirqs.CPU36.TIMER
      0.00         +1e+102%       1.00 ±141%  softirqs.CPU37.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU37.NET_TX
     22657 ±  8%      -0.4%      22564 ±  3%  softirqs.CPU37.RCU
     61516 ± 21%      -0.0%      61486 ±  7%  softirqs.CPU37.SCHED
      1959 ± 52%     -33.9%       1295 ± 47%  softirqs.CPU37.TIMER
      0.67 ±141%     +50.0%       1.00 ±141%  softirqs.CPU38.NET_RX
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU38.NET_TX
     21523 ± 10%      +9.4%      23557 ±  2%  softirqs.CPU38.RCU
     68089 ± 24%     -14.5%      58220 ±  2%  softirqs.CPU38.SCHED
      1495 ± 40%     +21.4%       1815 ± 30%  softirqs.CPU38.TIMER
      0.00         +9e+102%       9.00 ±141%  softirqs.CPU39.BLOCK
      0.67 ± 70%  +88050.0%     587.67 ±141%  softirqs.CPU39.NET_RX
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU39.NET_TX
     22456 ±  6%      +7.4%      24114 ±  5%  softirqs.CPU39.RCU
     63262 ±  9%     -15.1%      53690 ± 14%  softirqs.CPU39.SCHED
      2215 ± 34%     -48.6%       1138 ± 47%  softirqs.CPU39.TIMER
      4.00 ±141%    -100.0%       0.00        softirqs.CPU4.BLOCK
      1.67 ± 56%      +0.0%       1.67 ± 28%  softirqs.CPU4.NET_RX
      0.67 ± 70%    -100.0%       0.00        softirqs.CPU4.NET_TX
     20911 ±  6%      +8.9%      22781 ±  4%  softirqs.CPU4.RCU
     81029 ±  6%     -28.9%      57637 ±  6%  softirqs.CPU4.SCHED
      0.00         +1e+102%       1.00 ± 81%  softirqs.CPU4.TASKLET
      3961 ± 25%     -64.0%       1427 ± 60%  softirqs.CPU4.TIMER
      0.00       +2.4e+103%      23.67 ±135%  softirqs.CPU40.BLOCK
      0.67 ±141%   +2050.0%      14.33 ±141%  softirqs.CPU40.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU40.NET_TX
     22518 ±  7%      +8.1%      24353 ± 10%  softirqs.CPU40.RCU
     64781 ±  6%      -8.5%      59264 ± 15%  softirqs.CPU40.SCHED
      2601 ± 39%     -24.3%       1968 ± 32%  softirqs.CPU40.TIMER
     22723 ±  3%      -2.7%      22099        softirqs.CPU41.RCU
     62167 ± 10%      -6.7%      58013 ± 10%  softirqs.CPU41.SCHED
      1333 ± 34%     +13.6%       1514 ± 37%  softirqs.CPU41.TIMER
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU42.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU42.NET_TX
     20783 ±  6%      +9.5%      22762 ±  5%  softirqs.CPU42.RCU
     62686 ±  7%      -1.8%      61533 ± 13%  softirqs.CPU42.SCHED
      0.33 ±141%    -100.0%       0.00        softirqs.CPU42.TASKLET
      1978 ± 29%      -0.6%       1966 ± 72%  softirqs.CPU42.TIMER
     14.33 ±141%    -100.0%       0.00        softirqs.CPU43.BLOCK
      0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU43.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU43.NET_TX
     21743 ±  7%      +5.9%      23036 ±  4%  softirqs.CPU43.RCU
     61037 ±  3%      -3.0%      59210 ±  4%  softirqs.CPU43.SCHED
      1.67 ±141%    -100.0%       0.00        softirqs.CPU43.TASKLET
      1105 ± 10%     +17.5%       1298 ± 18%  softirqs.CPU43.TIMER
     37.00 ±141%    -100.0%       0.00        softirqs.CPU44.NET_RX
     22781 ±  2%      +5.6%      24066        softirqs.CPU44.RCU
     56105 ± 13%      -9.4%      50830 ±  3%  softirqs.CPU44.SCHED
      3.67 ±141%    -100.0%       0.00        softirqs.CPU44.TASKLET
    881.00 ± 44%    +112.4%       1871 ± 52%  softirqs.CPU44.TIMER
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU45.NET_RX
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU45.NET_TX
     22253 ±  5%      +8.1%      24054 ±  2%  softirqs.CPU45.RCU
     54797 ±  3%      -5.8%      51616 ±  8%  softirqs.CPU45.SCHED
      1252 ± 56%     +50.5%       1884 ± 35%  softirqs.CPU45.TIMER
     75.67 ±141%     -98.2%       1.33 ± 93%  softirqs.CPU46.NET_RX
      1.33 ±141%    -100.0%       0.00        softirqs.CPU46.NET_TX
     23611 ±  3%      +1.5%      23976        softirqs.CPU46.RCU
     54081 ± 11%      +0.2%      54189        softirqs.CPU46.SCHED
      1.00 ± 81%    +100.0%       2.00 ±141%  softirqs.CPU46.TASKLET
      1378 ± 31%      -9.5%       1247 ± 19%  softirqs.CPU46.TIMER
      0.00       +3.1e+105%       3106 ±141%  softirqs.CPU47.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU47.NET_TX
     23807 ±  6%      -4.0%      22849 ±  4%  softirqs.CPU47.RCU
     50994 ±  7%     +18.0%      60159 ± 10%  softirqs.CPU47.SCHED
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU47.TASKLET
    743.00 ± 24%    +102.6%       1505 ± 17%  softirqs.CPU47.TIMER
     47.67 ±135%     -95.8%       2.00 ± 70%  softirqs.CPU48.NET_RX
      0.67 ± 70%    -100.0%       0.00        softirqs.CPU48.NET_TX
     22887 ±  7%      +4.5%      23917 ±  2%  softirqs.CPU48.RCU
     53357 ±  6%      -9.3%      48379 ±  8%  softirqs.CPU48.SCHED
      0.00       +1.3e+102%       1.33 ± 93%  softirqs.CPU48.TASKLET
      3294 ± 35%     -65.7%       1130 ± 23%  softirqs.CPU48.TIMER
     72.33 ±130%     -92.2%       5.67 ±129%  softirqs.CPU49.NET_RX
      0.00       +1.7e+102%       1.67 ±101%  softirqs.CPU49.NET_TX
     22613 ±  4%      +5.6%      23878 ±  3%  softirqs.CPU49.RCU
     60848 ± 13%     -18.9%      49376 ±  9%  softirqs.CPU49.SCHED
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU49.TASKLET
      2120 ± 20%     +17.9%       2500 ± 70%  softirqs.CPU49.TIMER
      3.33 ± 61%    +160.0%       8.67 ±133%  softirqs.CPU5.NET_RX
      0.67 ± 70%      +0.0%       0.67 ±141%  softirqs.CPU5.NET_TX
     22447 ±  7%      +0.7%      22596 ±  4%  softirqs.CPU5.RCU
     68255 ± 15%      -7.3%      63251 ±  7%  softirqs.CPU5.SCHED
      1959 ± 71%     -16.3%       1639 ± 78%  softirqs.CPU5.TIMER
      3222 ±141%     -99.9%       4.33 ± 66%  softirqs.CPU50.NET_RX
      0.67 ± 70%     +50.0%       1.00        softirqs.CPU50.NET_TX
     24347 ±  3%      -3.1%      23600 ±  2%  softirqs.CPU50.RCU
     49624 ± 11%     +13.2%      56156 ± 14%  softirqs.CPU50.SCHED
      0.33 ±141%    +100.0%       0.67 ±141%  softirqs.CPU50.TASKLET
      3388 ± 45%     -62.8%       1260 ± 27%  softirqs.CPU50.TIMER
      2.67 ±141%    -100.0%       0.00        softirqs.CPU51.BLOCK
      1.33 ± 35%     -50.0%       0.67 ± 70%  softirqs.CPU51.NET_RX
      0.33 ±141%      +0.0%       0.33 ±141%  softirqs.CPU51.NET_TX
     23707            +2.9%      24401        softirqs.CPU51.RCU
     56464 ± 13%     -17.7%      46463 ± 11%  softirqs.CPU51.SCHED
      0.67 ±141%      +0.0%       0.67 ± 70%  softirqs.CPU51.TASKLET
      2563 ± 28%     -73.1%     689.67 ± 28%  softirqs.CPU51.TIMER
      3.00 ± 47%    +300.0%      12.00 ±129%  softirqs.CPU52.NET_RX
      1.33 ± 35%     +25.0%       1.67 ±101%  softirqs.CPU52.NET_TX
     23518 ±  3%      -5.2%      22284 ±  3%  softirqs.CPU52.RCU
     45486 ± 19%     +47.7%      67185 ±  4%  softirqs.CPU52.SCHED
      0.00       +1.7e+102%       1.67 ± 74%  softirqs.CPU52.TASKLET
      1324 ± 44%     -32.9%     889.33 ± 41%  softirqs.CPU52.TIMER
     10.67 ± 93%     -75.0%       2.67 ±141%  softirqs.CPU53.BLOCK
      2.33 ± 20%     -42.9%       1.33 ± 35%  softirqs.CPU53.NET_RX
      2.00 ± 40%     -83.3%       0.33 ±141%  softirqs.CPU53.NET_TX
     22553 ±  8%      -1.8%      22138 ±  3%  softirqs.CPU53.RCU
     58468 ± 20%      +3.5%      60543 ±  7%  softirqs.CPU53.SCHED
      0.00       +6.7e+101%       0.67 ± 70%  softirqs.CPU53.TASKLET
      1432 ± 58%     +35.2%       1937 ± 48%  softirqs.CPU53.TIMER
      1.00 ± 81%    +766.7%       8.67 ±141%  softirqs.CPU54.BLOCK
    141.67 ±138%     -99.3%       1.00 ± 81%  softirqs.CPU54.NET_RX
      1.00          -100.0%       0.00        softirqs.CPU54.NET_TX
     22157 ±  9%      +3.5%      22934 ±  3%  softirqs.CPU54.RCU
     54355 ± 21%      +9.1%      59277 ± 12%  softirqs.CPU54.SCHED
      0.33 ±141%    +100.0%       0.67 ±141%  softirqs.CPU54.TASKLET
      2532 ± 67%     -49.7%       1272 ± 62%  softirqs.CPU54.TIMER
      2.67 ±141%    -100.0%       0.00        softirqs.CPU55.BLOCK
      2.00 ± 40%    +200.0%       6.00 ± 82%  softirqs.CPU55.NET_RX
      1.00            +0.0%       1.00        softirqs.CPU55.NET_TX
     22879 ±  2%      -2.2%      22383 ±  2%  softirqs.CPU55.RCU
     54998 ±  4%      +3.5%      56917 ±  6%  softirqs.CPU55.SCHED
      0.00         +2e+102%       2.00 ± 81%  softirqs.CPU55.TASKLET
      3573 ± 23%     -59.2%       1459 ± 28%  softirqs.CPU55.TIMER
      0.00         +8e+102%       8.00 ±141%  softirqs.CPU56.BLOCK
     10.67 ± 88%     -90.6%       1.00 ± 81%  softirqs.CPU56.NET_RX
      0.67 ± 70%     -50.0%       0.33 ±141%  softirqs.CPU56.NET_TX
     20559 ±  3%      +9.5%      22509 ±  7%  softirqs.CPU56.RCU
     70517 ±  3%      -7.0%      65562 ± 18%  softirqs.CPU56.SCHED
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU56.TASKLET
      2116 ± 25%     +29.9%       2749 ± 18%  softirqs.CPU56.TIMER
     76.33 ±136%      -6.1%      71.67 ±134%  softirqs.CPU57.NET_RX
      2.00 ± 81%     -16.7%       1.67 ±141%  softirqs.CPU57.NET_TX
     22553 ± 12%      +2.2%      23040 ±  3%  softirqs.CPU57.RCU
     63432 ± 18%     -12.5%      55507 ± 14%  softirqs.CPU57.SCHED
      0.33 ±141%      +0.0%       0.33 ±141%  softirqs.CPU57.TASKLET
      2040 ± 35%     -58.4%     848.67 ± 16%  softirqs.CPU57.TIMER
      0.33 ±141%    -100.0%       0.00        softirqs.CPU58.BLOCK
      3.67 ± 64%     -27.3%       2.67 ± 63%  softirqs.CPU58.NET_RX
      1.00 ± 81%     +33.3%       1.33 ± 35%  softirqs.CPU58.NET_TX
     21470 ±  3%      +1.6%      21815 ±  9%  softirqs.CPU58.RCU
     66477 ±  2%      +2.4%      68063 ± 21%  softirqs.CPU58.SCHED
      0.00       +1.3e+102%       1.33 ± 93%  softirqs.CPU58.TASKLET
      2465 ±  3%     -51.2%       1203 ± 56%  softirqs.CPU58.TIMER
      3.33 ±120%   +1410.0%      50.33 ±138%  softirqs.CPU59.NET_RX
      1.33 ± 93%      +0.0%       1.33 ± 93%  softirqs.CPU59.NET_TX
     22027 ±  5%      +4.9%      23111        softirqs.CPU59.RCU
     58512 ± 11%      +8.5%      63491 ±  8%  softirqs.CPU59.SCHED
      0.00         +1e+103%      10.00 ±134%  softirqs.CPU59.TASKLET
      1199 ± 59%     +44.3%       1731 ± 29%  softirqs.CPU59.TIMER
      5.00 ±127%    -100.0%       0.00        softirqs.CPU6.BLOCK
      4.00 ± 70%     -41.7%       2.33 ± 80%  softirqs.CPU6.NET_RX
      0.67 ± 70%     -50.0%       0.33 ±141%  softirqs.CPU6.NET_TX
     21567 ±  2%      +3.8%      22394 ±  3%  softirqs.CPU6.RCU
     71047 ± 14%      -8.3%      65155 ±  8%  softirqs.CPU6.SCHED
      0.00         +1e+102%       1.00 ±141%  softirqs.CPU6.TASKLET
      1604 ± 22%     +13.1%       1815 ± 16%  softirqs.CPU6.TIMER
     15.67 ±127%     -42.6%       9.00 ± 79%  softirqs.CPU60.NET_RX
      0.67 ± 70%    +200.0%       2.00 ± 40%  softirqs.CPU60.NET_TX
     21190 ±  4%      +6.8%      22629 ±  2%  softirqs.CPU60.RCU
     65318 ± 18%      -7.9%      60164 ±  9%  softirqs.CPU60.SCHED
      0.00       +4.7e+102%       4.67 ± 70%  softirqs.CPU60.TASKLET
      1147 ± 22%     +58.6%       1819 ± 47%  softirqs.CPU60.TIMER
     18.00 ±107%     -81.5%       3.33 ± 98%  softirqs.CPU61.NET_RX
      1.00 ± 81%      +0.0%       1.00 ± 81%  softirqs.CPU61.NET_TX
     20522            +6.1%      21766 ±  3%  softirqs.CPU61.RCU
     62797 ±  6%     -11.7%      55422 ± 10%  softirqs.CPU61.SCHED
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU61.TASKLET
    984.67 ± 13%     +76.4%       1736 ± 23%  softirqs.CPU61.TIMER
      8.00 ±141%     -41.7%       4.67 ±141%  softirqs.CPU62.BLOCK
      1.33 ± 70%    +125.0%       3.00 ± 54%  softirqs.CPU62.NET_RX
      0.33 ±141%    +100.0%       0.67 ± 70%  softirqs.CPU62.NET_TX
     22767 ±  3%      -3.4%      21992 ±  8%  softirqs.CPU62.RCU
     54663 ± 13%     +13.8%      62187 ± 21%  softirqs.CPU62.SCHED
      0.00       +6.7e+101%       0.67 ± 70%  softirqs.CPU62.TASKLET
      1650 ± 14%      -3.1%       1599 ± 14%  softirqs.CPU62.TIMER
     11.67 ± 93%    +580.0%      79.33 ±136%  softirqs.CPU63.NET_RX
      1.67 ± 56%     -40.0%       1.00 ± 81%  softirqs.CPU63.NET_TX
     20882 ±  3%     +15.1%      24029 ±  2%  softirqs.CPU63.RCU
     64097 ±  8%     -22.0%      50025 ± 10%  softirqs.CPU63.SCHED
      0.00       +2.7e+102%       2.67 ± 77%  softirqs.CPU63.TASKLET
      1214 ± 20%     +16.1%       1409 ± 47%  softirqs.CPU63.TIMER
      0.00         +6e+102%       6.00 ±141%  softirqs.CPU64.BLOCK
     37.00 ±124%     -54.1%      17.00 ±112%  softirqs.CPU64.NET_RX
      1.00            +0.0%       1.00 ± 81%  softirqs.CPU64.NET_TX
     22074 ±  3%     +11.2%      24536 ± 13%  softirqs.CPU64.RCU
     55954 ± 20%      +5.6%      59106 ± 20%  softirqs.CPU64.SCHED
     14.33 ±141%     -97.7%       0.33 ±141%  softirqs.CPU64.TASKLET
      2854 ± 30%     -46.9%       1517 ± 46%  softirqs.CPU64.TIMER
      4.67 ±141%    -100.0%       0.00        softirqs.CPU65.BLOCK
      3.33 ±120%    +970.0%      35.67 ±137%  softirqs.CPU65.NET_RX
      0.33 ±141%    +200.0%       1.00 ± 81%  softirqs.CPU65.NET_TX
     22638 ±  3%      +5.3%      23828 ±  3%  softirqs.CPU65.RCU
     60505 ±  6%      +0.3%      60698 ±  5%  softirqs.CPU65.SCHED
      0.67 ±141%    -100.0%       0.00        softirqs.CPU65.TASKLET
      1418 ± 50%     +92.3%       2727 ± 46%  softirqs.CPU65.TIMER
      0.00       +5.3e+102%       5.33 ±141%  softirqs.CPU66.BLOCK
      6.67 ± 88%     -60.0%       2.67 ± 63%  softirqs.CPU66.NET_RX
      2.00 ± 40%     -50.0%       1.00        softirqs.CPU66.NET_TX
     23949            -9.8%      21614 ±  4%  softirqs.CPU66.RCU
     49792 ± 11%     +31.3%      65388 ±  7%  softirqs.CPU66.SCHED
      0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU66.TASKLET
      1020 ± 40%     +98.0%       2021 ±  6%  softirqs.CPU66.TIMER
      0.67 ±141%   +1450.0%      10.33 ±134%  softirqs.CPU67.BLOCK
     43.00 ±139%     -96.9%       1.33 ± 70%  softirqs.CPU67.NET_RX
      2.00 ±141%     -83.3%       0.33 ±141%  softirqs.CPU67.NET_TX
     21580 ±  6%      +5.3%      22726 ±  4%  softirqs.CPU67.RCU
     64054 ± 19%      -8.8%      58412 ± 18%  softirqs.CPU67.SCHED
      0.67 ±141%    +100.0%       1.33 ±141%  softirqs.CPU67.TASKLET
      1585 ± 47%     -23.6%       1211 ± 34%  softirqs.CPU67.TIMER
      1.00 ± 81%     +33.3%       1.33 ± 35%  softirqs.CPU68.NET_RX
      0.33 ±141%    +100.0%       0.67 ± 70%  softirqs.CPU68.NET_TX
     21076 ±  4%      +9.9%      23167 ±  9%  softirqs.CPU68.RCU
     70434 ± 12%     -11.3%      62492 ± 10%  softirqs.CPU68.SCHED
      0.67 ±141%     -50.0%       0.33 ±141%  softirqs.CPU68.TASKLET
      1632 ± 50%     +78.8%       2919 ± 30%  softirqs.CPU68.TIMER
    859.67 ±140%    +570.8%       5767 ±141%  softirqs.CPU69.NET_RX
      0.67 ± 70%      +0.0%       0.67 ±141%  softirqs.CPU69.NET_TX
     20945 ±  4%     +17.5%      24605 ± 12%  softirqs.CPU69.RCU
     75220 ±  8%      -8.1%      69114 ± 19%  softirqs.CPU69.SCHED
      0.00         +1e+102%       1.00 ±141%  softirqs.CPU69.TASKLET
      1339 ± 14%    +307.4%       5457 ± 67%  softirqs.CPU69.TIMER
      2.67 ± 63%     +25.0%       3.33 ± 50%  softirqs.CPU7.NET_RX
      1.00            +0.0%       1.00        softirqs.CPU7.NET_TX
     22142            +2.4%      22671 ±  5%  softirqs.CPU7.RCU
     70413            -2.1%      68903 ±  6%  softirqs.CPU7.SCHED
      2088 ± 53%     -22.1%       1627 ± 30%  softirqs.CPU7.TIMER
      0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU70.BLOCK
      2.33 ± 20%     +42.9%       3.33 ± 98%  softirqs.CPU70.NET_RX
      0.67 ± 70%    -100.0%       0.00        softirqs.CPU70.NET_TX
     20984 ±  4%      +7.3%      22516 ±  5%  softirqs.CPU70.RCU
     69373 ±  5%      -8.5%      63448 ± 14%  softirqs.CPU70.SCHED
      0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU70.TASKLET
      1874 ± 27%      -8.9%       1707 ± 14%  softirqs.CPU70.TIMER
      2.67 ±141%    -100.0%       0.00        softirqs.CPU71.BLOCK
      1.33 ± 35%  +79000.0%       1054 ±141%  softirqs.CPU71.NET_RX
      1.00 ± 81%    -100.0%       0.00        softirqs.CPU71.NET_TX
     20381 ±  3%      +7.1%      21835 ±  5%  softirqs.CPU71.RCU
     68348 ±  9%      +4.6%      71485 ± 10%  softirqs.CPU71.SCHED
      0.67 ±141%    -100.0%       0.00        softirqs.CPU71.TASKLET
      1565 ± 31%      +8.7%       1702 ± 29%  softirqs.CPU71.TIMER
     10.33 ±141%    -100.0%       0.00        softirqs.CPU72.BLOCK
      0.33 ±141%    +300.0%       1.33 ±141%  softirqs.CPU72.NET_RX
      0.33 ±141%      +0.0%       0.33 ±141%  softirqs.CPU72.NET_TX
     22366 ±  7%      +4.7%      23424        softirqs.CPU72.RCU
     58299 ± 10%      -6.8%      54357 ± 18%  softirqs.CPU72.SCHED
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU72.TASKLET
      1141 ± 50%     +81.6%       2073 ± 63%  softirqs.CPU72.TIMER
      2.33 ± 80%     -57.1%       1.00 ± 81%  softirqs.CPU73.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU73.NET_TX
     23711 ±  5%      -2.6%      23086 ±  4%  softirqs.CPU73.RCU
     57497 ± 19%      +4.4%      60035 ±  6%  softirqs.CPU73.SCHED
      1142          +185.5%       3261 ± 85%  softirqs.CPU73.TIMER
      4.67 ±141%    -100.0%       0.00        softirqs.CPU74.BLOCK
      8.67 ±117%     +30.8%      11.33 ± 82%  softirqs.CPU74.NET_RX
      0.67 ±141%   +6300.0%      42.67 ±138%  softirqs.CPU74.NET_TX
     22381 ±  6%      +7.7%      24100 ±  6%  softirqs.CPU74.RCU
     64133 ± 32%     -13.2%      55647 ± 11%  softirqs.CPU74.SCHED
      1692 ± 77%      -3.0%       1641 ± 18%  softirqs.CPU74.TIMER
      4.67 ±141%    -100.0%       0.00        softirqs.CPU75.BLOCK
     37.33 ±141%     -95.5%       1.67 ± 74%  softirqs.CPU75.NET_RX
      0.33 ±141%    -100.0%       0.00        softirqs.CPU75.NET_TX
     22754 ±  4%      +0.1%      22785 ±  4%  softirqs.CPU75.RCU
     50023 ± 17%     +26.0%      63022 ± 11%  softirqs.CPU75.SCHED
      1492 ± 55%     -39.4%     904.33 ± 42%  softirqs.CPU75.TIMER
      1.00 ±141%   +2266.7%      23.67 ±141%  softirqs.CPU76.BLOCK
     45.67 ±141%     -98.5%       0.67 ± 70%  softirqs.CPU76.NET_RX
      0.00       +6.7e+101%       0.67 ± 70%  softirqs.CPU76.NET_TX
     23177 ±  4%      -1.9%      22739 ±  8%  softirqs.CPU76.RCU
     48812 ± 15%     +21.0%      59045 ±  5%  softirqs.CPU76.SCHED
    761.67 ±  9%    +185.7%       2176 ± 61%  softirqs.CPU76.TIMER
      0.00       +3.3e+102%       3.33 ±141%  softirqs.CPU77.BLOCK
      7979 ±141%     -99.9%       4.67 ± 96%  softirqs.CPU77.NET_RX
      0.33 ±141%  +12500.0%      42.00 ±141%  softirqs.CPU77.NET_TX
     23705 ±  2%      -4.9%      22542 ±  5%  softirqs.CPU77.RCU
     57151 ± 17%     +20.0%      68579 ±  7%  softirqs.CPU77.SCHED
      1626 ± 33%      -9.9%       1465 ± 41%  softirqs.CPU77.TIMER
      0.00       +9.3e+102%       9.33 ±141%  softirqs.CPU78.BLOCK
      5.33 ± 93%     -43.8%       3.00 ± 81%  softirqs.CPU78.NET_RX
      1.00 ± 81%     -66.7%       0.33 ±141%  softirqs.CPU78.NET_TX
     22582 ±  7%      +3.6%      23396 ±  4%  softirqs.CPU78.RCU
     51854 ± 16%     +16.7%      60490 ± 13%  softirqs.CPU78.SCHED
      1764 ± 20%     +74.0%       3069 ± 81%  softirqs.CPU78.TIMER
      0.00       +9.3e+102%       9.33 ±141%  softirqs.CPU79.BLOCK
      0.33 ±141%    +700.0%       2.67 ± 46%  softirqs.CPU79.NET_RX
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU79.NET_TX
     20048            +7.0%      21452 ±  2%  softirqs.CPU79.RCU
     80114 ±  5%     -15.9%      67391 ± 11%  softirqs.CPU79.SCHED
      1289 ± 36%     +69.0%       2180 ± 32%  softirqs.CPU79.TIMER
      0.00       +4.7e+102%       4.67 ±141%  softirqs.CPU8.BLOCK
      3.67 ± 56%     -45.5%       2.00 ± 40%  softirqs.CPU8.NET_RX
      0.33 ±141%      +0.0%       0.33 ±141%  softirqs.CPU8.NET_TX
     22698 ±  2%      +0.2%      22737 ±  6%  softirqs.CPU8.RCU
     56494 ±  2%      +7.0%      60446 ± 17%  softirqs.CPU8.SCHED
    639.33 ± 11%    +221.6%       2056 ± 54%  softirqs.CPU8.TIMER
      0.00       +2.3e+103%      23.00 ±141%  softirqs.CPU80.BLOCK
      0.00       +2.5e+103%      25.33 ±138%  softirqs.CPU80.NET_RX
      0.00       +1.7e+102%       1.67 ±141%  softirqs.CPU80.NET_TX
     21338 ±  2%      +1.4%      21628        softirqs.CPU80.RCU
     67863 ±  9%      +8.9%      73889 ±  5%  softirqs.CPU80.SCHED
      0.33 ±141%      +0.0%       0.33 ±141%  softirqs.CPU80.TASKLET
      1148 ± 44%      +9.5%       1258 ± 16%  softirqs.CPU80.TIMER
      3.33 ±141%     +40.0%       4.67 ±141%  softirqs.CPU81.BLOCK
     31.67 ±141%     -98.9%       0.33 ±141%  softirqs.CPU81.NET_RX
     22495 ±  2%      +0.6%      22635 ±  4%  softirqs.CPU81.RCU
     66479 ±  6%      +0.6%      66908 ± 11%  softirqs.CPU81.SCHED
      6.67 ±141%    -100.0%       0.00        softirqs.CPU81.TASKLET
      1325 ± 15%     +22.0%       1616 ± 29%  softirqs.CPU81.TIMER
      0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU82.BLOCK
      9.00 ± 86%     +66.7%      15.00 ±141%  softirqs.CPU82.NET_RX
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU82.NET_TX
     22393            -2.8%      21772 ±  5%  softirqs.CPU82.RCU
     62623 ± 12%     +13.0%      70783 ±  8%  softirqs.CPU82.SCHED
      0.67 ±141%    -100.0%       0.00        softirqs.CPU82.TASKLET
      2318 ± 48%     -10.9%       2065 ± 33%  softirqs.CPU82.TIMER
      1.33 ±141%     +50.0%       2.00 ± 81%  softirqs.CPU83.NET_RX
      0.67 ±141%    -100.0%       0.00        softirqs.CPU83.NET_TX
     22326 ±  3%      -6.7%      20824 ±  2%  softirqs.CPU83.RCU
     67444 ±  6%     +17.1%      78997 ±  7%  softirqs.CPU83.SCHED
      0.00       +6.7e+101%       0.67 ± 70%  softirqs.CPU83.TASKLET
      2190 ± 37%     +26.0%       2759 ± 29%  softirqs.CPU83.TIMER
     24.00 ±141%     -47.2%      12.67 ± 80%  softirqs.CPU84.BLOCK
      1796 ±141%     -99.8%       3.00 ± 81%  softirqs.CPU84.NET_RX
      0.33 ±141%      +0.0%       0.33 ±141%  softirqs.CPU84.NET_TX
     21584 ±  7%      +5.7%      22816 ±  3%  softirqs.CPU84.RCU
     76430 ±  9%     -22.0%      59601 ±  5%  softirqs.CPU84.SCHED
      6724 ±101%     -73.6%       1774 ±  8%  softirqs.CPU84.TIMER
      1.67 ±141%   +4060.0%      69.33 ±134%  softirqs.CPU85.NET_RX
      0.00         +1e+102%       1.00 ± 81%  softirqs.CPU85.NET_TX
     21261 ±  6%      +5.2%      22360 ±  3%  softirqs.CPU85.RCU
     65095 ± 22%      +4.9%      68261 ±  9%  softirqs.CPU85.SCHED
      1760 ± 50%     +91.9%       3377 ± 56%  softirqs.CPU85.TIMER
      0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU86.BLOCK
      0.33 ±141%  +10400.0%      35.00 ±133%  softirqs.CPU86.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU86.NET_TX
     22224 ± 11%      -2.2%      21732 ±  5%  softirqs.CPU86.RCU
     61315 ± 23%     +16.2%      71242 ±  5%  softirqs.CPU86.SCHED
      0.00         +3e+102%       3.00 ±118%  softirqs.CPU86.TASKLET
      1469 ± 39%     +67.4%       2459 ± 27%  softirqs.CPU86.TIMER
      0.33 ±141%  +1.2e+05%     387.67 ±140%  softirqs.CPU87.NET_RX
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU87.NET_TX
     21997 ±  4%      -2.3%      21484        softirqs.CPU87.RCU
     67095 ± 11%     +13.1%      75893 ± 12%  softirqs.CPU87.SCHED
      0.00       +6.7e+101%       0.67 ±141%  softirqs.CPU87.TASKLET
      1440 ± 69%     +61.4%       2325 ± 44%  softirqs.CPU87.TIMER
      6.00 ±118%    -100.0%       0.00        softirqs.CPU88.BLOCK
     69.00 ±133%     -98.6%       1.00 ± 81%  softirqs.CPU88.NET_RX
      1.00 ± 81%     -66.7%       0.33 ±141%  softirqs.CPU88.NET_TX
     22312 ±  5%      -2.1%      21852 ±  9%  softirqs.CPU88.RCU
     63281 ± 12%      +7.2%      67824 ± 13%  softirqs.CPU88.SCHED
      1345 ± 30%     +31.5%       1768 ± 39%  softirqs.CPU88.TIMER
      4.33 ± 78%     -76.9%       1.00 ± 81%  softirqs.CPU89.NET_RX
      1.00 ± 81%    -100.0%       0.00        softirqs.CPU89.NET_TX
     21573 ±  4%      +1.5%      21906 ±  6%  softirqs.CPU89.RCU
     66546 ± 14%      +5.1%      69960 ± 13%  softirqs.CPU89.SCHED
      0.33 ±141%    +600.0%       2.33 ±141%  softirqs.CPU89.TASKLET
      1040 ± 40%     +72.1%       1791 ± 20%  softirqs.CPU89.TIMER
      2.00 ± 70%      +0.0%       2.00 ±108%  softirqs.CPU9.NET_RX
      0.00       +3.3e+101%       0.33 ±141%  softirqs.CPU9.NET_TX
     21515 ±  3%      +6.3%      22867 ±  5%  softirqs.CPU9.RCU
     63076 ± 14%     +12.8%      71161 ± 10%  softirqs.CPU9.SCHED
      1831 ± 17%      +0.0%       1832 ± 23%  softirqs.CPU9.TIMER
      5.33 ±128%    -100.0%       0.00        softirqs.CPU90.NET_RX
      0.00          -100.0%       0.00        softirqs.CPU90.NET_TX
     22135            -1.9%      21717 ±  4%  softirqs.CPU90.RCU
     64291 ±  8%      +4.4%      67124 ± 11%  softirqs.CPU90.SCHED
      0.67 ±141%    -100.0%       0.00        softirqs.CPU90.TASKLET
      1428 ±  6%     +79.4%       2561 ± 31%  softirqs.CPU90.TIMER
      0.67 ±141%     +50.0%       1.00 ± 81%  softirqs.CPU91.BLOCK
      0.67 ± 70%    +150.0%       1.67 ±141%  softirqs.CPU91.NET_RX
      0.33 ±141%      +0.0%       0.33 ±141%  softirqs.CPU91.NET_TX
     22339            +2.0%      22780        softirqs.CPU91.RCU
     66812 ± 10%      +2.7%      68632 ±  4%  softirqs.CPU91.SCHED
      0.33 ±141%    +500.0%       2.00 ±141%  softirqs.CPU91.TASKLET
      1211 ± 25%     +23.2%       1492 ± 30%  softirqs.CPU91.TIMER
     10.33 ±141%      -9.7%       9.33 ±141%  softirqs.CPU92.BLOCK
      0.67 ±141%    +100.0%       1.33 ±141%  softirqs.CPU92.NET_RX
     21483 ±  3%      -3.5%      20729        softirqs.CPU92.RCU
     71070 ±  8%      +6.7%      75809 ±  4%  softirqs.CPU92.SCHED
      2.00 ±141%    -100.0%       0.00        softirqs.CPU92.TASKLET
      1313 ± 50%    +109.2%       2747 ± 40%  softirqs.CPU92.TIMER
      3.33 ±141%    +170.0%       9.00 ±141%  softirqs.CPU93.BLOCK
      5.33 ±104%     -87.5%       0.67 ±141%  softirqs.CPU93.NET_RX
      0.67 ±141%    -100.0%       0.00        softirqs.CPU93.NET_TX
     20984 ±  4%      +0.9%      21162 ±  4%  softirqs.CPU93.RCU
     72302 ±  2%      +5.9%      76593 ± 10%  softirqs.CPU93.SCHED
      0.33 ±141%    -100.0%       0.00        softirqs.CPU93.TASKLET
      1222 ± 10%     +10.4%       1348 ± 25%  softirqs.CPU93.TIMER
      0.00       +2.4e+103%      23.67 ±141%  softirqs.CPU94.BLOCK
      0.67 ±141%    -100.0%       0.00        softirqs.CPU94.NET_RX
     21564 ±  3%      +2.2%      22041 ±  2%  softirqs.CPU94.RCU
     76560 ± 13%      -1.9%      75129 ±  5%  softirqs.CPU94.SCHED
      1.67 ±141%     -80.0%       0.33 ±141%  softirqs.CPU94.TASKLET
      1993 ± 51%     -25.3%       1489 ± 79%  softirqs.CPU94.TIMER
      0.67 ±141%    -100.0%       0.00        softirqs.CPU95.BLOCK
      0.00          -100.0%       0.00        softirqs.CPU95.NET_TX
     21727 ±  4%      +4.4%      22687 ±  2%  softirqs.CPU95.RCU
     74850 ±  5%      -6.5%      70001 ± 12%  softirqs.CPU95.SCHED
     11.33 ±141%     -97.1%       0.33 ±141%  softirqs.CPU95.TASKLET
      1300 ± 54%      -9.8%       1172 ±  8%  softirqs.CPU95.TIMER
      2.33 ± 20%     -14.3%       2.00        softirqs.HI
     28720 ± 65%     +31.6%      37796 ± 46%  softirqs.NET_RX
    195.33 ±  3%      -1.7%     192.00 ±  3%  softirqs.NET_TX
   2146202            +3.1%    2213420        softirqs.RCU
   6150050            -0.2%    6137341        softirqs.SCHED
    239.67 ±  5%      +8.3%     259.67        softirqs.TASKLET
    180878 ±  2%      +3.8%     187774 ±  3%  softirqs.TIMER
      0.00          -100.0%       0.00        interrupts.0:IO-APIC.2-edge.timer
      5.33 ± 77%    +231.3%      17.67 ±141%  interrupts.100:PCI-MSI.31981633-edge.i40e-eth0-TxRx-64
      0.67 ±141%   +7800.0%      52.67 ±137%  interrupts.101:PCI-MSI.31981634-edge.i40e-eth0-TxRx-65
      3.00 ± 72%    -100.0%       0.00        interrupts.102:PCI-MSI.31981635-edge.i40e-eth0-TxRx-66
     69.33 ±141%     -99.0%       0.67 ±141%  interrupts.103:PCI-MSI.31981636-edge.i40e-eth0-TxRx-67
      1.00 ±141%     +66.7%       1.67 ±141%  interrupts.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68
      1697 ±140%    +111.9%       3597 ±141%  interrupts.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69
      4.00 ± 20%     +33.3%       5.33 ±128%  interrupts.106:PCI-MSI.31981639-edge.i40e-eth0-TxRx-70
      1.33 ± 70%  +1.4e+05%       1852 ±141%  interrupts.107:PCI-MSI.31981640-edge.i40e-eth0-TxRx-71
      0.00       +3.7e+102%       3.67 ±105%  interrupts.108:PCI-MSI.31981641-edge.i40e-eth0-TxRx-72
      2.00 ±141%     -33.3%       1.33 ±141%  interrupts.109:PCI-MSI.31981642-edge.i40e-eth0-TxRx-73
      0.33 ±141%    +400.0%       1.67 ± 74%  interrupts.110:PCI-MSI.31981643-edge.i40e-eth0-TxRx-74
     62.67 ±141%     -96.8%       2.00 ± 81%  interrupts.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
     66.67 ±141%     -98.5%       1.00 ±141%  interrupts.112:PCI-MSI.31981645-edge.i40e-eth0-TxRx-76
     15573 ±141%    -100.0%       2.33 ± 88%  interrupts.113:PCI-MSI.31981646-edge.i40e-eth0-TxRx-77
      3.67 ±105%     +36.4%       5.00 ± 90%  interrupts.114:PCI-MSI.31981647-edge.i40e-eth0-TxRx-78
      0.00         +7e+102%       7.00 ± 42%  interrupts.115:PCI-MSI.31981648-edge.i40e-eth0-TxRx-79
      1.33 ± 70%   +2875.0%      39.67 ±134%  interrupts.116:PCI-MSI.31981649-edge.i40e-eth0-TxRx-80
     48.33 ±138%     -99.3%       0.33 ±141%  interrupts.117:PCI-MSI.31981650-edge.i40e-eth0-TxRx-81
      6.33 ±119%    +215.8%      20.00 ±137%  interrupts.118:PCI-MSI.31981651-edge.i40e-eth0-TxRx-82
      1.00 ±141%    +333.3%       4.33 ± 96%  interrupts.119:PCI-MSI.31981652-edge.i40e-eth0-TxRx-83
      2655 ±141%     -99.9%       3.33 ±101%  interrupts.120:PCI-MSI.31981653-edge.i40e-eth0-TxRx-84
      4.00 ±124%   +2400.0%     100.00 ±132%  interrupts.121:PCI-MSI.31981654-edge.i40e-eth0-TxRx-85
      1.00 ± 81%   +4766.7%      48.67 ±127%  interrupts.122:PCI-MSI.31981655-edge.i40e-eth0-TxRx-86
      1.00 ±141%  +70500.0%     706.00 ±140%  interrupts.123:PCI-MSI.31981656-edge.i40e-eth0-TxRx-87
     95.67 ±141%     -97.2%       2.67 ± 70%  interrupts.124:PCI-MSI.31981657-edge.i40e-eth0-TxRx-88
      6.33 ±119%     -52.6%       3.00 ± 72%  interrupts.125:PCI-MSI.31981658-edge.i40e-eth0-TxRx-89
      6.67 ±141%     -90.0%       0.67 ±141%  interrupts.126:PCI-MSI.31981659-edge.i40e-eth0-TxRx-90
      2.00 ± 81%     -16.7%       1.67 ±101%  interrupts.127:PCI-MSI.31981660-edge.i40e-eth0-TxRx-91
      2.67 ± 93%     +25.0%       3.33 ±120%  interrupts.128:PCI-MSI.31981661-edge.i40e-eth0-TxRx-92
      2.33 ±141%     -14.3%       2.00 ±141%  interrupts.129:PCI-MSI.31981662-edge.i40e-eth0-TxRx-93
      0.00          -100.0%       0.00        interrupts.293:PCI-MSI.327680-edge.xhci_hcd
      0.00          -100.0%       0.00        interrupts.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.297:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.298:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.298:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.299:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.299:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.300:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.300:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.301:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.301:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.302:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.302:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.303:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.303:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.304:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.305:PCI-MSI.67174400-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.306:PCI-MSI.67174400-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.307:PCI-MSI.67176448-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.308:PCI-MSI.67176448-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.308:PCI-MSI.67178496-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.309:PCI-MSI.67178496-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.309:PCI-MSI.67180544-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.310:PCI-MSI.67180544-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.310:PCI-MSI.67182592-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.311:PCI-MSI.67182592-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.311:PCI-MSI.67184640-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.312:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00          -100.0%       0.00        interrupts.312:PCI-MSI.67184640-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.313:PCI-MSI.67184640-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.313:PCI-MSI.67186688-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.314:PCI-MSI.67186688-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.314:PCI-MSI.67188736-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00          -100.0%       0.00        interrupts.315:PCI-MSI.67188736-edge.ioat-msix
      1332            +2.1%       1360 ±  3%  interrupts.35:PCI-MSI.31981568-edge.i40e-0000:3d:00.0:misc
      7.33 ±103%     -86.4%       1.00 ±141%  interrupts.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
    638.00 ±140%     -99.9%       0.67 ±141%  interrupts.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
      6.00 ±106%   +1038.9%      68.33 ±136%  interrupts.38:PCI-MSI.31981571-edge.i40e-eth0-TxRx-2
      1.33 ±141%  +9.9e+05%      13207 ±141%  interrupts.39:PCI-MSI.31981572-edge.i40e-eth0-TxRx-3
      0.00          -100.0%       0.00        interrupts.3:IO-APIC.3-edge
      2.33 ± 88%     +14.3%       2.67 ± 63%  interrupts.40:PCI-MSI.31981573-edge.i40e-eth0-TxRx-4
      4.67 ± 70%     -92.9%       0.33 ±141%  interrupts.41:PCI-MSI.31981574-edge.i40e-eth0-TxRx-5
      6.33 ± 73%     -63.2%       2.33 ± 88%  interrupts.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
      3.33 ±141%     +20.0%       4.00 ± 93%  interrupts.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
      5.33 ± 31%     -62.5%       2.00 ± 81%  interrupts.44:PCI-MSI.31981577-edge.i40e-eth0-TxRx-8
      3.00 ±118%     +22.2%       3.67 ±141%  interrupts.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9
      6.67 ±120%    -100.0%       0.00        interrupts.46:PCI-MSI.31981579-edge.i40e-eth0-TxRx-10
     71.33 ±130%      -4.2%      68.33 ±139%  interrupts.47:PCI-MSI.31981580-edge.i40e-eth0-TxRx-11
     17.67 ±141%     -96.2%       0.67 ±141%  interrupts.48:PCI-MSI.31981581-edge.i40e-eth0-TxRx-12
      3.67 ± 12%     +27.3%       4.67 ± 88%  interrupts.49:PCI-MSI.31981582-edge.i40e-eth0-TxRx-13
     17.00 ±141%    +229.4%      56.00 ± 11%  interrupts.4:IO-APIC.4-edge.ttyS0
      1.33 ± 70%     +50.0%       2.00 ± 81%  interrupts.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
      4.00 ± 20%     +41.7%       5.67 ±141%  interrupts.51:PCI-MSI.31981584-edge.i40e-eth0-TxRx-15
      2.33 ± 20%     +57.1%       3.67 ±122%  interrupts.52:PCI-MSI.31981585-edge.i40e-eth0-TxRx-16
      6.67 ± 88%    +660.0%      50.67 ±133%  interrupts.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
      1.00 ±141%  +1.3e+06%      13326 ±141%  interrupts.54:PCI-MSI.31981587-edge.i40e-eth0-TxRx-18
     13.00 ±103%     -89.7%       1.33 ±141%  interrupts.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
      2.00 ±108%     -33.3%       1.33 ± 70%  interrupts.56:PCI-MSI.31981589-edge.i40e-eth0-TxRx-20
      7.33 ± 65%   +1590.9%     124.00 ±140%  interrupts.57:PCI-MSI.31981590-edge.i40e-eth0-TxRx-21
      2.67 ±115%   +4612.5%     125.67 ±133%  interrupts.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
      1.67 ±141%   +4040.0%      69.00 ±140%  interrupts.59:PCI-MSI.31981592-edge.i40e-eth0-TxRx-23
     13.67 ± 87%   +1529.3%     222.67 ± 80%  interrupts.60:PCI-MSI.31981593-edge.i40e-eth0-TxRx-24
     14740 ±137%    -100.0%       4.33 ± 84%  interrupts.61:PCI-MSI.31981594-edge.i40e-eth0-TxRx-25
      1.00 ± 81%    +133.3%       2.33 ± 72%  interrupts.62:PCI-MSI.31981595-edge.i40e-eth0-TxRx-26
    100.67 ±137%     -94.4%       5.67 ± 29%  interrupts.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
      4.33 ± 71%     -30.8%       3.00 ± 72%  interrupts.64:PCI-MSI.31981597-edge.i40e-eth0-TxRx-28
      2.33 ± 72%      +0.0%       2.33 ± 20%  interrupts.65:PCI-MSI.31981598-edge.i40e-eth0-TxRx-29
      2.67 ± 93%     -37.5%       1.67 ±101%  interrupts.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
      0.67 ±141%    +550.0%       4.33 ± 76%  interrupts.67:PCI-MSI.31981600-edge.i40e-eth0-TxRx-31
      4574 ±141%     -99.9%       3.33 ± 70%  interrupts.68:PCI-MSI.31981601-edge.i40e-eth0-TxRx-32
      1.67 ±141%  +19380.0%     324.67 ±139%  interrupts.69:PCI-MSI.31981602-edge.i40e-eth0-TxRx-33
      1.33 ± 93%     +75.0%       2.33 ± 88%  interrupts.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34
      0.00       +2.3e+102%       2.33 ± 88%  interrupts.71:PCI-MSI.31981604-edge.i40e-eth0-TxRx-35
      2.00 ± 81%     +33.3%       2.67 ± 93%  interrupts.72:PCI-MSI.31981605-edge.i40e-eth0-TxRx-36
      0.00         +3e+102%       3.00 ± 98%  interrupts.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
      2.00 ± 81%     +16.7%       2.33 ±141%  interrupts.74:PCI-MSI.31981607-edge.i40e-eth0-TxRx-38
      1.33 ±141%  +87875.0%       1173 ±141%  interrupts.75:PCI-MSI.31981608-edge.i40e-eth0-TxRx-39
      1.67 ±141%   +1020.0%      18.67 ±133%  interrupts.76:PCI-MSI.31981609-edge.i40e-eth0-TxRx-40
      0.00       +3.3e+101%       0.33 ±141%  interrupts.77:PCI-MSI.31981610-edge.i40e-eth0-TxRx-41
      0.67 ±141%    +150.0%       1.67 ± 74%  interrupts.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
      0.00       +2.3e+102%       2.33 ±112%  interrupts.79:PCI-MSI.31981612-edge.i40e-eth0-TxRx-43
     54.33 ±138%    -100.0%       0.00        interrupts.80:PCI-MSI.31981613-edge.i40e-eth0-TxRx-44
      0.00       +1.3e+102%       1.33 ±141%  interrupts.81:PCI-MSI.31981614-edge.i40e-eth0-TxRx-45
    111.67 ±141%     -97.9%       2.33 ±141%  interrupts.82:PCI-MSI.31981615-edge.i40e-eth0-TxRx-46
      0.33 ±141%  +1.9e+06%       6213 ±141%  interrupts.83:PCI-MSI.31981616-edge.i40e-eth0-TxRx-47
     68.67 ±136%     -95.1%       3.33 ±101%  interrupts.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
    142.00 ±132%     -98.1%       2.67 ±141%  interrupts.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
      5581 ±141%     -99.9%       8.33 ± 59%  interrupts.86:PCI-MSI.31981619-edge.i40e-eth0-TxRx-50
      1.33 ± 70%     -50.0%       0.67 ±141%  interrupts.87:PCI-MSI.31981620-edge.i40e-eth0-TxRx-51
      1.67 ±101%     -40.0%       1.00 ±141%  interrupts.88:PCI-MSI.31981621-edge.i40e-eth0-TxRx-52
      1.00 ± 81%    -100.0%       0.00        interrupts.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
      0.00          -100.0%       0.00        interrupts.8:IO-APIC.8-edge.rtc0
     49.67 ±137%     -98.7%       0.67 ±141%  interrupts.90:PCI-MSI.31981623-edge.i40e-eth0-TxRx-54
      1.67 ± 74%     -60.0%       0.67 ±141%  interrupts.91:PCI-MSI.31981624-edge.i40e-eth0-TxRx-55
      7.67 ± 22%     -91.3%       0.67 ±141%  interrupts.92:PCI-MSI.31981625-edge.i40e-eth0-TxRx-56
     99.33 ±138%     -20.1%      79.33 ±128%  interrupts.93:PCI-MSI.31981626-edge.i40e-eth0-TxRx-57
      4.33 ± 76%     -76.9%       1.00        interrupts.94:PCI-MSI.31981627-edge.i40e-eth0-TxRx-58
      2.67 ± 93%   +2450.0%      68.00 ±141%  interrupts.95:PCI-MSI.31981628-edge.i40e-eth0-TxRx-59
     19.67 ±123%     -76.3%       4.67 ± 80%  interrupts.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
     19.33 ±130%     -79.3%       4.00 ±141%  interrupts.97:PCI-MSI.31981630-edge.i40e-eth0-TxRx-61
      0.00         +5e+102%       5.00 ± 71%  interrupts.98:PCI-MSI.31981631-edge.i40e-eth0-TxRx-62
      3.67 ±105%   +3172.7%     120.00 ±136%  interrupts.99:PCI-MSI.31981632-edge.i40e-eth0-TxRx-63
 1.485e+08 ±  2%      -2.3%  1.451e+08        interrupts.CAL:Function_call_interrupts
      0.00          -100.0%       0.00        interrupts.CPU0.0:IO-APIC.2-edge.timer
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU0.119:PCI-MSI.31981652-edge.i40e-eth0-TxRx-83
      7.00 ±112%     -85.7%       1.00 ±141%  interrupts.CPU0.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU0.71:PCI-MSI.31981604-edge.i40e-eth0-TxRx-35
   1283224 ±  6%     -15.1%    1088946 ±  6%  interrupts.CPU0.CAL:Function_call_interrupts
      1.67 ± 74%    +480.0%       9.67 ± 21%  interrupts.CPU0.IWI:IRQ_work_interrupts
   1994188            -3.8%    1918506 ±  2%  interrupts.CPU0.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU0.MCP:Machine_check_polls
      3245 ±  7%     +47.6%       4789 ± 16%  interrupts.CPU0.NMI:Non-maskable_interrupts
      3245 ±  7%     +47.6%       4789 ± 16%  interrupts.CPU0.PMI:Performance_monitoring_interrupts
    981.00 ±  5%      -4.0%     941.67 ±  5%  interrupts.CPU0.RES:Rescheduling_interrupts
      0.00          -100.0%       0.00        interrupts.CPU0.RTR:APIC_ICR_read_retries
   1647458 ±  6%     -12.9%    1434640 ±  6%  interrupts.CPU0.TLB:TLB_shootdowns
      0.00       +6.7e+101%       0.67 ± 70%  interrupts.CPU1.120:PCI-MSI.31981653-edge.i40e-eth0-TxRx-84
    637.33 ±140%     -99.9%       0.67 ±141%  interrupts.CPU1.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU1.72:PCI-MSI.31981605-edge.i40e-eth0-TxRx-36
   1441294 ± 10%     -23.5%    1102827 ± 15%  interrupts.CPU1.CAL:Function_call_interrupts
      5.33 ±104%     -12.5%       4.67 ±112%  interrupts.CPU1.IWI:IRQ_work_interrupts
   1994402            -3.7%    1921568 ±  2%  interrupts.CPU1.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU1.MCP:Machine_check_polls
      4412 ± 43%      -0.4%       4393 ± 37%  interrupts.CPU1.NMI:Non-maskable_interrupts
      4412 ± 43%      -0.4%       4393 ± 37%  interrupts.CPU1.PMI:Performance_monitoring_interrupts
      1144 ±  4%      -6.2%       1073 ± 21%  interrupts.CPU1.RES:Rescheduling_interrupts
   1850166 ± 11%     -21.6%    1450742 ± 15%  interrupts.CPU1.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU10.129:PCI-MSI.31981662-edge.i40e-eth0-TxRx-93
      0.00          -100.0%       0.00        interrupts.CPU10.293:PCI-MSI.327680-edge.xhci_hcd
      6.33 ±119%    -100.0%       0.00        interrupts.CPU10.46:PCI-MSI.31981579-edge.i40e-eth0-TxRx-10
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU10.81:PCI-MSI.31981614-edge.i40e-eth0-TxRx-45
   1625671 ±  7%      +0.9%    1640988 ± 22%  interrupts.CPU10.CAL:Function_call_interrupts
      5.00 ±127%      +6.7%       5.33 ± 70%  interrupts.CPU10.IWI:IRQ_work_interrupts
   1989033            -5.2%    1885937 ±  4%  interrupts.CPU10.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU10.MCP:Machine_check_polls
      5423 ± 36%     -30.1%       3789 ± 49%  interrupts.CPU10.NMI:Non-maskable_interrupts
      5423 ± 36%     -30.1%       3789 ± 49%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
      1207 ± 10%     +21.1%       1461 ± 26%  interrupts.CPU10.RES:Rescheduling_interrupts
   2094627 ±  6%      +3.6%    2170903 ± 22%  interrupts.CPU10.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU11.297:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU11.298:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU11.299:PCI-MSI.69632-edge.ioat-msix
     71.33 ±130%      -4.7%      68.00 ±140%  interrupts.CPU11.47:PCI-MSI.31981580-edge.i40e-eth0-TxRx-11
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU11.82:PCI-MSI.31981615-edge.i40e-eth0-TxRx-46
      0.00          -100.0%       0.00        interrupts.CPU11.8:IO-APIC.8-edge.rtc0
   1395041 ±  8%      +4.6%    1459208 ± 12%  interrupts.CPU11.CAL:Function_call_interrupts
      9.00 ± 56%     -25.9%       6.67 ± 74%  interrupts.CPU11.IWI:IRQ_work_interrupts
   1993458            -4.6%    1901666 ±  3%  interrupts.CPU11.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU11.MCP:Machine_check_polls
      5832 ± 36%      -6.5%       5453 ± 36%  interrupts.CPU11.NMI:Non-maskable_interrupts
      5832 ± 36%      -6.5%       5453 ± 36%  interrupts.CPU11.PMI:Performance_monitoring_interrupts
      1049 ± 10%     +25.6%       1317 ± 25%  interrupts.CPU11.RES:Rescheduling_interrupts
   1792099 ±  8%      +7.8%    1932201 ± 11%  interrupts.CPU11.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU12.298:PCI-MSI.69632-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU12.299:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU12.300:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU12.300:PCI-MSI.73728-edge.ioat-msix
     17.67 ±141%     -98.1%       0.33 ±141%  interrupts.CPU12.48:PCI-MSI.31981581-edge.i40e-eth0-TxRx-12
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU12.83:PCI-MSI.31981616-edge.i40e-eth0-TxRx-47
   1618248 ± 19%     -14.1%    1390301 ± 10%  interrupts.CPU12.CAL:Function_call_interrupts
      7.33 ± 78%      -4.5%       7.00 ± 95%  interrupts.CPU12.IWI:IRQ_work_interrupts
   1990725            -4.4%    1903734 ±  3%  interrupts.CPU12.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU12.MCP:Machine_check_polls
      4849 ± 43%      +2.8%       4983 ± 41%  interrupts.CPU12.NMI:Non-maskable_interrupts
      4849 ± 43%      +2.8%       4983 ± 41%  interrupts.CPU12.PMI:Performance_monitoring_interrupts
      1150 ± 10%      +2.7%       1180 ± 17%  interrupts.CPU12.RES:Rescheduling_interrupts
   2081751 ± 19%     -11.7%    1837981 ±  9%  interrupts.CPU12.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU13.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU13.299:PCI-MSI.71680-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU13.300:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU13.301:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU13.301:PCI-MSI.75776-edge.ioat-msix
      0.33 ±141%    -100.0%       0.00        interrupts.CPU13.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
      2.67 ± 17%     +50.0%       4.00 ± 93%  interrupts.CPU13.49:PCI-MSI.31981582-edge.i40e-eth0-TxRx-13
      0.00          -100.0%       0.00        interrupts.CPU13.4:IO-APIC.4-edge.ttyS0
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU13.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
   1537516 ± 12%     -12.8%    1340073 ± 14%  interrupts.CPU13.CAL:Function_call_interrupts
      8.00 ± 46%     -16.7%       6.67 ±101%  interrupts.CPU13.IWI:IRQ_work_interrupts
   1989768            -3.8%    1915141 ±  2%  interrupts.CPU13.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU13.MCP:Machine_check_polls
      6201 ± 14%      -3.4%       5987 ± 36%  interrupts.CPU13.NMI:Non-maskable_interrupts
      6201 ± 14%      -3.4%       5987 ± 36%  interrupts.CPU13.PMI:Performance_monitoring_interrupts
      1124 ± 16%      +4.0%       1169 ± 23%  interrupts.CPU13.RES:Rescheduling_interrupts
   1976342 ± 12%     -10.5%    1769190 ± 14%  interrupts.CPU13.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU14.297:PCI-MSI.67584-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU14.300:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU14.301:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU14.302:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU14.302:PCI-MSI.77824-edge.ioat-msix
      0.67 ± 70%    -100.0%       0.00        interrupts.CPU14.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
      0.00          -100.0%       0.00        interrupts.CPU14.3:IO-APIC.3-edge
      0.00       +1.7e+103%      17.00 ±141%  interrupts.CPU14.4:IO-APIC.4-edge.ttyS0
      1.33 ± 70%     +25.0%       1.67 ± 74%  interrupts.CPU14.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
      0.67 ± 70%    -100.0%       0.00        interrupts.CPU14.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
   1296970 ± 18%     +18.2%    1533485 ± 24%  interrupts.CPU14.CAL:Function_call_interrupts
      5.00 ±141%    +120.0%      11.00 ± 51%  interrupts.CPU14.IWI:IRQ_work_interrupts
   1992017            -5.2%    1888723 ±  4%  interrupts.CPU14.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU14.MCP:Machine_check_polls
      4535 ± 50%     +42.0%       6438 ± 28%  interrupts.CPU14.NMI:Non-maskable_interrupts
      4535 ± 50%     +42.0%       6438 ± 28%  interrupts.CPU14.PMI:Performance_monitoring_interrupts
    967.33 ± 21%     +30.9%       1266 ± 20%  interrupts.CPU14.RES:Rescheduling_interrupts
   1668585 ± 18%     +21.6%    2029594 ± 23%  interrupts.CPU14.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU15.301:PCI-MSI.73728-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU15.301:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU15.302:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU15.303:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU15.303:PCI-MSI.79872-edge.ioat-msix
      1.00           -66.7%       0.33 ±141%  interrupts.CPU15.38:PCI-MSI.31981571-edge.i40e-eth0-TxRx-2
     17.00 ±141%    -100.0%       0.00        interrupts.CPU15.4:IO-APIC.4-edge.ttyS0
      3.67 ± 34%     +54.5%       5.67 ±141%  interrupts.CPU15.51:PCI-MSI.31981584-edge.i40e-eth0-TxRx-15
      0.33 ±141%    +200.0%       1.00        interrupts.CPU15.86:PCI-MSI.31981619-edge.i40e-eth0-TxRx-50
   1620707 ± 15%     -27.7%    1171309 ±  9%  interrupts.CPU15.CAL:Function_call_interrupts
      7.67 ± 79%     -56.5%       3.33 ±101%  interrupts.CPU15.IWI:IRQ_work_interrupts
   1989328            -3.6%    1917458 ±  2%  interrupts.CPU15.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU15.MCP:Machine_check_polls
      4826 ± 42%      -6.3%       4521 ± 26%  interrupts.CPU15.NMI:Non-maskable_interrupts
      4826 ± 42%      -6.3%       4521 ± 26%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
      1178 ± 17%      -9.5%       1066 ± 16%  interrupts.CPU15.RES:Rescheduling_interrupts
   2083846 ± 15%     -25.8%    1546396 ±  9%  interrupts.CPU15.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU16.302:PCI-MSI.75776-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU16.302:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU16.303:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU16.304:PCI-MSI.79872-edge.ioat-msix
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU16.39:PCI-MSI.31981572-edge.i40e-eth0-TxRx-3
      1.67 ± 56%    +100.0%       3.33 ±141%  interrupts.CPU16.52:PCI-MSI.31981585-edge.i40e-eth0-TxRx-16
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU16.87:PCI-MSI.31981620-edge.i40e-eth0-TxRx-51
   1338190 ± 15%      -6.0%    1257595 ± 30%  interrupts.CPU16.CAL:Function_call_interrupts
      6.67 ± 78%     -60.0%       2.67 ±115%  interrupts.CPU16.IWI:IRQ_work_interrupts
   1995772            -3.7%    1922250 ±  2%  interrupts.CPU16.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU16.MCP:Machine_check_polls
      5845 ± 26%     -45.2%       3201 ± 41%  interrupts.CPU16.NMI:Non-maskable_interrupts
      5845 ± 26%     -45.2%       3201 ± 41%  interrupts.CPU16.PMI:Performance_monitoring_interrupts
      1030 ± 11%     +25.6%       1293 ± 24%  interrupts.CPU16.RES:Rescheduling_interrupts
   1719649 ± 15%      -3.4%    1661282 ± 30%  interrupts.CPU16.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU17.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU17.303:PCI-MSI.77824-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU17.303:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU17.312:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00          -100.0%       0.00        interrupts.CPU17.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.33 ±141%    +200.0%       1.00        interrupts.CPU17.40:PCI-MSI.31981573-edge.i40e-eth0-TxRx-4
      6.00 ±106%    +733.3%      50.00 ±135%  interrupts.CPU17.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
      0.33 ±141%    -100.0%       0.00        interrupts.CPU17.88:PCI-MSI.31981621-edge.i40e-eth0-TxRx-52
   1444496 ±  4%      -3.8%    1389394 ±  8%  interrupts.CPU17.CAL:Function_call_interrupts
     11.67 ± 42%     -54.3%       5.33 ±141%  interrupts.CPU17.IWI:IRQ_work_interrupts
   1993115            -4.7%    1898483 ±  3%  interrupts.CPU17.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU17.MCP:Machine_check_polls
      6333 ± 17%     -26.5%       4657 ± 47%  interrupts.CPU17.NMI:Non-maskable_interrupts
      6333 ± 17%     -26.5%       4657 ± 47%  interrupts.CPU17.PMI:Performance_monitoring_interrupts
      1045 ±  8%     +14.4%       1196 ±  7%  interrupts.CPU17.RES:Rescheduling_interrupts
   1857647 ±  4%      -1.4%    1832203 ±  8%  interrupts.CPU17.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU18.304:PCI-MSI.79872-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU18.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00          -100.0%       0.00        interrupts.CPU18.41:PCI-MSI.31981574-edge.i40e-eth0-TxRx-5
      0.67 ±141%    +2e+06%      13326 ±141%  interrupts.CPU18.54:PCI-MSI.31981587-edge.i40e-eth0-TxRx-18
      0.33 ±141%    -100.0%       0.00        interrupts.CPU18.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
   1177104 ± 15%     +34.7%    1585576 ±  7%  interrupts.CPU18.CAL:Function_call_interrupts
      4.67 ± 78%    +100.0%       9.33 ± 70%  interrupts.CPU18.IWI:IRQ_work_interrupts
   1993097            -5.5%    1882740 ±  4%  interrupts.CPU18.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU18.MCP:Machine_check_polls
      4919 ± 29%     +20.8%       5942 ± 37%  interrupts.CPU18.NMI:Non-maskable_interrupts
      4919 ± 29%     +20.8%       5942 ± 37%  interrupts.CPU18.PMI:Performance_monitoring_interrupts
    882.67 ± 10%     +49.8%       1322 ± 16%  interrupts.CPU18.RES:Rescheduling_interrupts
   1514086 ± 15%     +38.1%    2090275 ±  7%  interrupts.CPU18.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU19.315:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.00          -100.0%       0.00        interrupts.CPU19.3:IO-APIC.3-edge
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU19.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
     12.67 ±108%     -92.1%       1.00 ±141%  interrupts.CPU19.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU19.90:PCI-MSI.31981623-edge.i40e-eth0-TxRx-54
   1561977 ± 18%      -7.2%    1449390 ± 18%  interrupts.CPU19.CAL:Function_call_interrupts
     14.33 ± 16%     -65.1%       5.00 ±114%  interrupts.CPU19.IWI:IRQ_work_interrupts
   1993851            -4.9%    1896679 ±  3%  interrupts.CPU19.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU19.MCP:Machine_check_polls
      7425 ±  6%     -39.0%       4529 ± 44%  interrupts.CPU19.NMI:Non-maskable_interrupts
      7425 ±  6%     -39.0%       4529 ± 44%  interrupts.CPU19.PMI:Performance_monitoring_interrupts
      1145 ± 13%     +21.0%       1385 ± 23%  interrupts.CPU19.RES:Rescheduling_interrupts
   2008922 ± 18%      -4.7%    1913691 ± 18%  interrupts.CPU19.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU2.121:PCI-MSI.31981654-edge.i40e-eth0-TxRx-85
      5.00 ±127%   +1260.0%      68.00 ±137%  interrupts.CPU2.38:PCI-MSI.31981571-edge.i40e-eth0-TxRx-2
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU2.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
   1147375 ± 20%     +11.1%    1274389 ± 13%  interrupts.CPU2.CAL:Function_call_interrupts
      1.67 ±141%    +280.0%       6.33 ± 77%  interrupts.CPU2.IWI:IRQ_work_interrupts
   1997979            -4.7%    1903836 ±  3%  interrupts.CPU2.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU2.MCP:Machine_check_polls
      3377 ± 21%     +32.7%       4481 ± 36%  interrupts.CPU2.NMI:Non-maskable_interrupts
      3377 ± 21%     +32.7%       4481 ± 36%  interrupts.CPU2.PMI:Performance_monitoring_interrupts
    858.67 ± 19%     +26.5%       1086 ± 14%  interrupts.CPU2.RES:Rescheduling_interrupts
   1474507 ± 20%     +13.9%    1678829 ± 13%  interrupts.CPU2.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU20.3:IO-APIC.3-edge
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU20.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
      1.67 ±141%     -60.0%       0.67 ± 70%  interrupts.CPU20.56:PCI-MSI.31981589-edge.i40e-eth0-TxRx-20
      0.33 ±141%    -100.0%       0.00        interrupts.CPU20.91:PCI-MSI.31981624-edge.i40e-eth0-TxRx-55
   1691403 ± 10%     -11.8%    1492098 ± 10%  interrupts.CPU20.CAL:Function_call_interrupts
      8.33 ± 73%     +40.0%      11.67 ± 14%  interrupts.CPU20.IWI:IRQ_work_interrupts
   1991561            -5.3%    1886034 ±  4%  interrupts.CPU20.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU20.MCP:Machine_check_polls
      5837 ± 27%     +18.1%       6892 ±  9%  interrupts.CPU20.NMI:Non-maskable_interrupts
      5837 ± 27%     +18.1%       6892 ±  9%  interrupts.CPU20.PMI:Performance_monitoring_interrupts
      1258 ±  5%      +5.4%       1326 ± 15%  interrupts.CPU20.RES:Rescheduling_interrupts
   2178393 ± 10%      -9.4%    1974448 ± 10%  interrupts.CPU20.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU21.295:PCI-MSI.65536-edge.ioat-msix
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU21.44:PCI-MSI.31981577-edge.i40e-eth0-TxRx-8
      7.33 ± 65%   +1590.9%     124.00 ±140%  interrupts.CPU21.57:PCI-MSI.31981590-edge.i40e-eth0-TxRx-21
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU21.92:PCI-MSI.31981625-edge.i40e-eth0-TxRx-56
   1830276 ±  6%     -17.1%    1516390 ±  7%  interrupts.CPU21.CAL:Function_call_interrupts
      3.67 ± 78%      +9.1%       4.00 ± 93%  interrupts.CPU21.IWI:IRQ_work_interrupts
   1989018            -4.7%    1894771 ±  3%  interrupts.CPU21.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU21.MCP:Machine_check_polls
      4101 ± 51%     +10.3%       4524 ± 26%  interrupts.CPU21.NMI:Non-maskable_interrupts
      4101 ± 51%     +10.3%       4524 ± 26%  interrupts.CPU21.PMI:Performance_monitoring_interrupts
      1308 ±  4%      +7.1%       1402 ± 18%  interrupts.CPU21.RES:Rescheduling_interrupts
   2354242 ±  6%     -15.0%    2000536 ±  7%  interrupts.CPU21.TLB:TLB_shootdowns
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU22.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9
      2.00 ±141%   +6150.0%     125.00 ±133%  interrupts.CPU22.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU22.93:PCI-MSI.31981626-edge.i40e-eth0-TxRx-57
   1675054 ±  7%      -9.9%    1508895 ± 14%  interrupts.CPU22.CAL:Function_call_interrupts
      8.00 ± 77%     -37.5%       5.00 ±114%  interrupts.CPU22.IWI:IRQ_work_interrupts
   1988457            -4.8%    1893025 ±  4%  interrupts.CPU22.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU22.MCP:Machine_check_polls
      6157 ± 19%     -32.9%       4133 ± 60%  interrupts.CPU22.NMI:Non-maskable_interrupts
      6157 ± 19%     -32.9%       4133 ± 60%  interrupts.CPU22.PMI:Performance_monitoring_interrupts
      1262 ± 11%      +0.3%       1265 ± 23%  interrupts.CPU22.RES:Rescheduling_interrupts
   2152987 ±  6%      -7.3%    1995588 ± 14%  interrupts.CPU22.TLB:TLB_shootdowns
      0.33 ±141%    -100.0%       0.00        interrupts.CPU23.46:PCI-MSI.31981579-edge.i40e-eth0-TxRx-10
      1.33 ±141%   +5075.0%      69.00 ±140%  interrupts.CPU23.59:PCI-MSI.31981592-edge.i40e-eth0-TxRx-23
      0.67 ± 70%      +0.0%       0.67 ± 70%  interrupts.CPU23.94:PCI-MSI.31981627-edge.i40e-eth0-TxRx-58
   1696874 ± 11%      -2.7%    1650487 ± 13%  interrupts.CPU23.CAL:Function_call_interrupts
      4.67 ±141%    +228.6%      15.33 ±  6%  interrupts.CPU23.IWI:IRQ_work_interrupts
   1988736            -5.1%    1888060 ±  3%  interrupts.CPU23.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU23.MCP:Machine_check_polls
      4509 ± 51%     +72.9%       7795        interrupts.CPU23.NMI:Non-maskable_interrupts
      4509 ± 51%     +72.9%       7795        interrupts.CPU23.PMI:Performance_monitoring_interrupts
      1280 ± 12%      +5.2%       1347 ± 19%  interrupts.CPU23.RES:Rescheduling_interrupts
   2183128 ± 11%      +0.0%    2183294 ± 13%  interrupts.CPU23.TLB:TLB_shootdowns
     13.33 ± 91%   +1570.0%     222.67 ± 80%  interrupts.CPU24.60:PCI-MSI.31981593-edge.i40e-eth0-TxRx-24
   1463182 ± 13%      -9.0%    1331815 ± 19%  interrupts.CPU24.CAL:Function_call_interrupts
      5.00 ±127%    -100.0%       0.00        interrupts.CPU24.IWI:IRQ_work_interrupts
   1991001            -4.3%    1905975 ±  3%  interrupts.CPU24.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU24.MCP:Machine_check_polls
      5482 ± 36%     -44.4%       3046 ±  7%  interrupts.CPU24.NMI:Non-maskable_interrupts
      5482 ± 36%     -44.4%       3046 ±  7%  interrupts.CPU24.PMI:Performance_monitoring_interrupts
    975.33 ± 14%     +10.9%       1081 ±  6%  interrupts.CPU24.RES:Rescheduling_interrupts
   1874140 ± 13%      -6.8%    1746145 ± 20%  interrupts.CPU24.TLB:TLB_shootdowns
     14740 ±137%    -100.0%       4.00 ± 81%  interrupts.CPU25.61:PCI-MSI.31981594-edge.i40e-eth0-TxRx-25
   1468546 ± 22%      +2.0%    1498192 ± 10%  interrupts.CPU25.CAL:Function_call_interrupts
      9.33 ± 35%     +10.7%      10.33 ± 50%  interrupts.CPU25.IWI:IRQ_work_interrupts
   1990968            -4.6%    1899327 ±  3%  interrupts.CPU25.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU25.MCP:Machine_check_polls
      6012 ± 21%      +7.4%       6454 ± 29%  interrupts.CPU25.NMI:Non-maskable_interrupts
      6012 ± 21%      +7.4%       6454 ± 29%  interrupts.CPU25.PMI:Performance_monitoring_interrupts
      1057 ± 24%      +1.8%       1076 ± 11%  interrupts.CPU25.RES:Rescheduling_interrupts
   1886599 ± 22%      +4.1%    1963140 ± 10%  interrupts.CPU25.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU26.305:PCI-MSI.67174400-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU26.306:PCI-MSI.67174400-edge.ioat-msix
      0.33 ±141%    +500.0%       2.00 ± 70%  interrupts.CPU26.62:PCI-MSI.31981595-edge.i40e-eth0-TxRx-26
   1502439 ± 30%      -9.8%    1354664 ± 14%  interrupts.CPU26.CAL:Function_call_interrupts
      4.33 ± 71%    +123.1%       9.67 ± 70%  interrupts.CPU26.IWI:IRQ_work_interrupts
   1986642            -3.7%    1912869 ±  3%  interrupts.CPU26.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU26.MCP:Machine_check_polls
      4252 ± 50%     +44.7%       6150 ± 37%  interrupts.CPU26.NMI:Non-maskable_interrupts
      4252 ± 50%     +44.7%       6150 ± 37%  interrupts.CPU26.PMI:Performance_monitoring_interrupts
      1049 ± 26%      +0.1%       1050 ± 22%  interrupts.CPU26.RES:Rescheduling_interrupts
   1926881 ± 30%      -8.0%    1771893 ± 14%  interrupts.CPU26.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU27.307:PCI-MSI.67176448-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU27.308:PCI-MSI.67176448-edge.ioat-msix
    100.33 ±138%     -95.3%       4.67 ± 36%  interrupts.CPU27.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
   1237723 ± 20%     +25.3%    1550313 ± 10%  interrupts.CPU27.CAL:Function_call_interrupts
      9.67 ± 46%      -3.4%       9.33 ± 70%  interrupts.CPU27.IWI:IRQ_work_interrupts
   1992540            -4.8%    1896087 ±  3%  interrupts.CPU27.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU27.MCP:Machine_check_polls
      6119 ± 19%      -2.9%       5939 ± 36%  interrupts.CPU27.NMI:Non-maskable_interrupts
      6119 ± 19%      -2.9%       5939 ± 36%  interrupts.CPU27.PMI:Performance_monitoring_interrupts
    921.33 ± 11%     +28.3%       1181 ±  8%  interrupts.CPU27.RES:Rescheduling_interrupts
   1587131 ± 20%     +28.3%    2036749 ± 10%  interrupts.CPU27.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU28.308:PCI-MSI.67178496-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU28.309:PCI-MSI.67178496-edge.ioat-msix
      4.00 ± 70%     -41.7%       2.33 ± 72%  interrupts.CPU28.64:PCI-MSI.31981597-edge.i40e-eth0-TxRx-28
   1240423 ± 12%     +15.5%    1432419 ±  2%  interrupts.CPU28.CAL:Function_call_interrupts
      9.67 ± 70%     -44.8%       5.33 ±141%  interrupts.CPU28.IWI:IRQ_work_interrupts
   1993926            -4.4%    1906611 ±  3%  interrupts.CPU28.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU28.MCP:Machine_check_polls
      5792 ± 36%     -22.2%       4507 ± 51%  interrupts.CPU28.NMI:Non-maskable_interrupts
      5792 ± 36%     -22.2%       4507 ± 51%  interrupts.CPU28.PMI:Performance_monitoring_interrupts
    848.33 ±  6%     +25.2%       1062 ±  9%  interrupts.CPU28.RES:Rescheduling_interrupts
   1590102 ± 12%     +18.2%    1880052 ±  2%  interrupts.CPU28.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU29.309:PCI-MSI.67180544-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU29.310:PCI-MSI.67180544-edge.ioat-msix
      2.33 ± 72%      +0.0%       2.33 ± 20%  interrupts.CPU29.65:PCI-MSI.31981598-edge.i40e-eth0-TxRx-29
   1344495 ± 16%     +30.0%    1748149 ± 13%  interrupts.CPU29.CAL:Function_call_interrupts
      9.33 ± 66%     +10.7%      10.33 ± 70%  interrupts.CPU29.IWI:IRQ_work_interrupts
   1993317            -5.4%    1885368 ±  4%  interrupts.CPU29.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU29.MCP:Machine_check_polls
      6714 ± 12%      -8.9%       6119 ± 34%  interrupts.CPU29.NMI:Non-maskable_interrupts
      6714 ± 12%      -8.9%       6119 ± 34%  interrupts.CPU29.PMI:Performance_monitoring_interrupts
      1002 ± 16%     +30.1%       1304 ± 21%  interrupts.CPU29.RES:Rescheduling_interrupts
   1722844 ± 16%     +33.0%    2291363 ± 12%  interrupts.CPU29.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU3.122:PCI-MSI.31981655-edge.i40e-eth0-TxRx-86
      1.00 ±141%  +1.3e+06%      13206 ±141%  interrupts.CPU3.39:PCI-MSI.31981572-edge.i40e-eth0-TxRx-3
      0.33 ±141%    -100.0%       0.00        interrupts.CPU3.74:PCI-MSI.31981607-edge.i40e-eth0-TxRx-38
   1335983 ± 14%     -20.1%    1067579 ± 15%  interrupts.CPU3.CAL:Function_call_interrupts
     10.33 ± 38%      -6.5%       9.67 ± 65%  interrupts.CPU3.IWI:IRQ_work_interrupts
   1995119            -3.4%    1927081 ±  2%  interrupts.CPU3.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU3.MCP:Machine_check_polls
      6055 ± 29%      +2.5%       6203 ± 24%  interrupts.CPU3.NMI:Non-maskable_interrupts
      6055 ± 29%      +2.5%       6203 ± 24%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    995.00 ± 11%      -1.6%     978.67 ± 29%  interrupts.CPU3.RES:Rescheduling_interrupts
   1721781 ± 14%     -18.1%    1409480 ± 15%  interrupts.CPU3.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU30.310:PCI-MSI.67182592-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU30.311:PCI-MSI.67182592-edge.ioat-msix
      2.33 ±112%     -28.6%       1.67 ±101%  interrupts.CPU30.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
   1286556 ± 17%     +12.0%    1440688 ± 15%  interrupts.CPU30.CAL:Function_call_interrupts
     12.67 ± 26%    -100.0%       0.00        interrupts.CPU30.IWI:IRQ_work_interrupts
   1992654            -3.9%    1915837 ±  2%  interrupts.CPU30.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU30.MCP:Machine_check_polls
      7066 ± 14%     -66.4%       2377 ± 28%  interrupts.CPU30.NMI:Non-maskable_interrupts
      7066 ± 14%     -66.4%       2377 ± 28%  interrupts.CPU30.PMI:Performance_monitoring_interrupts
    952.67 ± 14%     +18.2%       1125 ± 27%  interrupts.CPU30.RES:Rescheduling_interrupts
   1647271 ± 17%     +14.6%    1887415 ± 15%  interrupts.CPU30.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU31.310:PCI-MSI.67180544-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU31.311:PCI-MSI.67182592-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU31.311:PCI-MSI.67184640-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU31.312:PCI-MSI.67184640-edge.ioat-msix
      0.33 ±141%   +1000.0%       3.67 ± 78%  interrupts.CPU31.67:PCI-MSI.31981600-edge.i40e-eth0-TxRx-31
   2057353 ±  5%     -21.6%    1612737 ± 13%  interrupts.CPU31.CAL:Function_call_interrupts
     16.00           -56.2%       7.00 ± 72%  interrupts.CPU31.IWI:IRQ_work_interrupts
   1988101            -4.9%    1889733 ±  4%  interrupts.CPU31.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU31.MCP:Machine_check_polls
      7791           -32.8%       5238 ± 35%  interrupts.CPU31.NMI:Non-maskable_interrupts
      7791           -32.8%       5238 ± 35%  interrupts.CPU31.PMI:Performance_monitoring_interrupts
      1323 ±  2%      -6.6%       1236 ± 15%  interrupts.CPU31.RES:Rescheduling_interrupts
   2637037 ±  5%     -19.8%    2114244 ± 13%  interrupts.CPU31.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU32.311:PCI-MSI.67182592-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU32.312:PCI-MSI.67184640-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU32.313:PCI-MSI.67186688-edge.ioat-msix
      4574 ±141%     -99.9%       3.00 ± 72%  interrupts.CPU32.68:PCI-MSI.31981601-edge.i40e-eth0-TxRx-32
   1725454 ±  6%      +7.3%    1852009 ±  3%  interrupts.CPU32.CAL:Function_call_interrupts
     16.00           -62.5%       6.00 ± 72%  interrupts.CPU32.IWI:IRQ_work_interrupts
   1990490            -5.6%    1879138 ±  4%  interrupts.CPU32.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU32.MCP:Machine_check_polls
      7791           -38.6%       4781 ± 28%  interrupts.CPU32.NMI:Non-maskable_interrupts
      7791           -38.6%       4781 ± 28%  interrupts.CPU32.PMI:Performance_monitoring_interrupts
      1192 ±  6%     +12.0%       1336 ±  9%  interrupts.CPU32.RES:Rescheduling_interrupts
   2213826 ±  6%      +9.7%    2429118 ±  3%  interrupts.CPU32.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU33.313:PCI-MSI.67184640-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU33.313:PCI-MSI.67186688-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU33.314:PCI-MSI.67188736-edge.ioat-msix
      1.33 ±141%  +24200.0%     324.00 ±140%  interrupts.CPU33.69:PCI-MSI.31981602-edge.i40e-eth0-TxRx-33
   1644554 ±  7%      +1.7%    1672276 ± 13%  interrupts.CPU33.CAL:Function_call_interrupts
      8.67 ± 66%      -7.7%       8.00 ± 66%  interrupts.CPU33.IWI:IRQ_work_interrupts
   1994828            -4.8%    1898886 ±  3%  interrupts.CPU33.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU33.MCP:Machine_check_polls
      5463 ± 44%      -7.0%       5083 ± 48%  interrupts.CPU33.NMI:Non-maskable_interrupts
      5463 ± 44%      -7.0%       5083 ± 48%  interrupts.CPU33.PMI:Performance_monitoring_interrupts
      1087 ±  4%     +19.9%       1303 ± 24%  interrupts.CPU33.RES:Rescheduling_interrupts
   2110273 ±  6%      +3.7%    2188459 ± 13%  interrupts.CPU33.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU34.314:PCI-MSI.67186688-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU34.314:PCI-MSI.67188736-edge.ioat-msix
      1.00 ±141%     +66.7%       1.67 ±101%  interrupts.CPU34.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34
   1527781 ± 11%     +10.3%    1684904 ± 13%  interrupts.CPU34.CAL:Function_call_interrupts
      3.67 ± 68%     +45.5%       5.33 ±141%  interrupts.CPU34.IWI:IRQ_work_interrupts
   1990610            -5.2%    1887747 ±  4%  interrupts.CPU34.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU34.MCP:Machine_check_polls
      4974 ± 14%     -18.1%       4076 ± 66%  interrupts.CPU34.NMI:Non-maskable_interrupts
      4974 ± 14%     -18.1%       4076 ± 66%  interrupts.CPU34.PMI:Performance_monitoring_interrupts
      1075 ± 14%     +26.9%       1364 ± 25%  interrupts.CPU34.RES:Rescheduling_interrupts
   1958180 ± 12%     +12.7%    2206294 ± 13%  interrupts.CPU34.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU35.315:PCI-MSI.67188736-edge.ioat-msix
      0.00         +2e+102%       2.00 ± 81%  interrupts.CPU35.71:PCI-MSI.31981604-edge.i40e-eth0-TxRx-35
   1662564 ±  7%     +16.8%    1941183 ±  7%  interrupts.CPU35.CAL:Function_call_interrupts
     11.33 ± 58%     -11.8%      10.00 ± 45%  interrupts.CPU35.IWI:IRQ_work_interrupts
   1990589            -6.1%    1868728 ±  4%  interrupts.CPU35.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU35.MCP:Machine_check_polls
      7079 ± 14%     -14.6%       6045 ± 25%  interrupts.CPU35.NMI:Non-maskable_interrupts
      7079 ± 14%     -14.6%       6045 ± 25%  interrupts.CPU35.PMI:Performance_monitoring_interrupts
      1096 ±  8%     +26.1%       1383 ± 14%  interrupts.CPU35.RES:Rescheduling_interrupts
   2128713 ±  7%     +19.7%    2548542 ±  7%  interrupts.CPU35.TLB:TLB_shootdowns
      2.00 ± 81%     +16.7%       2.33 ±112%  interrupts.CPU36.72:PCI-MSI.31981605-edge.i40e-eth0-TxRx-36
   1767839 ± 20%     -17.6%    1457064 ±  7%  interrupts.CPU36.CAL:Function_call_interrupts
      7.67 ± 74%      -4.3%       7.33 ± 75%  interrupts.CPU36.IWI:IRQ_work_interrupts
   1990955            -4.5%    1900896 ±  3%  interrupts.CPU36.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU36.MCP:Machine_check_polls
      6227 ± 15%     -23.1%       4791 ± 47%  interrupts.CPU36.NMI:Non-maskable_interrupts
      6227 ± 15%     -23.1%       4791 ± 47%  interrupts.CPU36.PMI:Performance_monitoring_interrupts
      1126 ± 18%      +4.2%       1173 ± 12%  interrupts.CPU36.RES:Rescheduling_interrupts
   2270173 ± 21%     -16.0%    1906743 ±  7%  interrupts.CPU36.TLB:TLB_shootdowns
      0.00       +2.7e+102%       2.67 ±115%  interrupts.CPU37.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
   1643441 ± 22%      +1.3%    1664414 ±  9%  interrupts.CPU37.CAL:Function_call_interrupts
      9.00 ± 74%     -85.2%       1.33 ±141%  interrupts.CPU37.IWI:IRQ_work_interrupts
   1989272            -5.0%    1888923 ±  3%  interrupts.CPU37.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU37.MCP:Machine_check_polls
      5801 ± 33%     -43.4%       3281 ± 17%  interrupts.CPU37.NMI:Non-maskable_interrupts
      5801 ± 33%     -43.4%       3281 ± 17%  interrupts.CPU37.PMI:Performance_monitoring_interrupts
      1104 ± 18%     +19.2%       1316 ± 13%  interrupts.CPU37.RES:Rescheduling_interrupts
   2106730 ± 22%      +3.6%    2183317 ±  9%  interrupts.CPU37.TLB:TLB_shootdowns
      1.67 ±101%     +40.0%       2.33 ±141%  interrupts.CPU38.74:PCI-MSI.31981607-edge.i40e-eth0-TxRx-38
   1505266 ± 26%     +14.5%    1723663 ±  3%  interrupts.CPU38.CAL:Function_call_interrupts
      6.00 ± 95%     +94.4%      11.67 ± 28%  interrupts.CPU38.IWI:IRQ_work_interrupts
   1991279            -5.2%    1887924 ±  3%  interrupts.CPU38.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU38.MCP:Machine_check_polls
      5178 ± 36%     +27.9%       6623 ± 12%  interrupts.CPU38.NMI:Non-maskable_interrupts
      5178 ± 36%     +27.9%       6623 ± 12%  interrupts.CPU38.PMI:Performance_monitoring_interrupts
    999.33 ± 23%     +30.3%       1302 ± 17%  interrupts.CPU38.RES:Rescheduling_interrupts
   1929390 ± 26%     +17.3%    2263185 ±  3%  interrupts.CPU38.TLB:TLB_shootdowns
      1.00 ±141%  +1.2e+05%       1172 ±141%  interrupts.CPU39.75:PCI-MSI.31981608-edge.i40e-eth0-TxRx-39
   1633753 ± 13%     +13.1%    1847040 ± 11%  interrupts.CPU39.CAL:Function_call_interrupts
      8.00 ± 81%     -58.3%       3.33 ± 74%  interrupts.CPU39.IWI:IRQ_work_interrupts
   1989619            -5.1%    1887275 ±  3%  interrupts.CPU39.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU39.MCP:Machine_check_polls
      4845 ± 53%     -24.7%       3647 ± 43%  interrupts.CPU39.NMI:Non-maskable_interrupts
      4845 ± 53%     -24.7%       3647 ± 43%  interrupts.CPU39.PMI:Performance_monitoring_interrupts
      1098 ± 10%     +26.0%       1383 ± 22%  interrupts.CPU39.RES:Rescheduling_interrupts
   2097391 ± 13%     +15.5%    2423173 ± 11%  interrupts.CPU39.TLB:TLB_shootdowns
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU4.123:PCI-MSI.31981656-edge.i40e-eth0-TxRx-87
      0.00          -100.0%       0.00        interrupts.CPU4.297:PCI-MSI.67584-edge.ioat-msix
      2.00 ±108%     -16.7%       1.67 ±101%  interrupts.CPU4.40:PCI-MSI.31981573-edge.i40e-eth0-TxRx-4
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU4.75:PCI-MSI.31981608-edge.i40e-eth0-TxRx-39
   1077374 ± 21%     +48.8%    1603060        interrupts.CPU4.CAL:Function_call_interrupts
      2.33 ± 72%    +471.4%      13.33 ± 28%  interrupts.CPU4.IWI:IRQ_work_interrupts
   1998250            -5.9%    1879625 ±  3%  interrupts.CPU4.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU4.MCP:Machine_check_polls
      4172 ± 30%     +55.7%       6495 ± 28%  interrupts.CPU4.NMI:Non-maskable_interrupts
      4172 ± 30%     +55.7%       6495 ± 28%  interrupts.CPU4.PMI:Performance_monitoring_interrupts
    859.33 ± 13%     +57.3%       1351 ± 19%  interrupts.CPU4.RES:Rescheduling_interrupts
   1386214 ± 21%     +52.6%    2114757        interrupts.CPU4.TLB:TLB_shootdowns
      1.33 ±141%   +1275.0%      18.33 ±137%  interrupts.CPU40.76:PCI-MSI.31981609-edge.i40e-eth0-TxRx-40
   1568390 ± 12%      +7.7%    1688730 ± 14%  interrupts.CPU40.CAL:Function_call_interrupts
      8.33 ± 65%     -36.0%       5.33 ±128%  interrupts.CPU40.IWI:IRQ_work_interrupts
   1990487            -5.4%    1882230 ±  4%  interrupts.CPU40.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU40.MCP:Machine_check_polls
      6466 ± 12%     -28.9%       4596 ± 47%  interrupts.CPU40.NMI:Non-maskable_interrupts
      6466 ± 12%     -28.9%       4596 ± 47%  interrupts.CPU40.PMI:Performance_monitoring_interrupts
      1079 ± 14%     +14.5%       1235 ± 12%  interrupts.CPU40.RES:Rescheduling_interrupts
   2011469 ± 12%     +10.3%    2219108 ± 14%  interrupts.CPU40.TLB:TLB_shootdowns
   1618803 ± 13%      +6.6%    1725687 ±  9%  interrupts.CPU41.CAL:Function_call_interrupts
     10.67 ± 70%     +15.6%      12.33 ± 36%  interrupts.CPU41.IWI:IRQ_work_interrupts
   1988954            -5.1%    1888087 ±  3%  interrupts.CPU41.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU41.MCP:Machine_check_polls
      6146 ± 37%      +8.7%       6680 ± 21%  interrupts.CPU41.NMI:Non-maskable_interrupts
      6146 ± 37%      +8.7%       6680 ± 21%  interrupts.CPU41.PMI:Performance_monitoring_interrupts
      1149 ± 13%      +9.5%       1257 ± 11%  interrupts.CPU41.RES:Rescheduling_interrupts
   2077013 ± 13%      +9.0%    2262977 ±  9%  interrupts.CPU41.TLB:TLB_shootdowns
      0.33 ±141%    +200.0%       1.00 ± 81%  interrupts.CPU42.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
   1627649 ±  8%      -0.6%    1618093 ± 11%  interrupts.CPU42.CAL:Function_call_interrupts
      8.67 ± 66%     -69.2%       2.67 ±141%  interrupts.CPU42.IWI:IRQ_work_interrupts
   1991940            -4.6%    1901174 ±  2%  interrupts.CPU42.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU42.MCP:Machine_check_polls
      5457 ± 33%     -41.1%       3216 ± 14%  interrupts.CPU42.NMI:Non-maskable_interrupts
      5457 ± 33%     -41.1%       3216 ± 14%  interrupts.CPU42.PMI:Performance_monitoring_interrupts
      1127 ±  4%      +9.6%       1235 ± 25%  interrupts.CPU42.RES:Rescheduling_interrupts
   2082468 ±  8%      +1.9%    2121689 ± 11%  interrupts.CPU42.TLB:TLB_shootdowns
      0.00       +1.7e+102%       1.67 ±141%  interrupts.CPU43.79:PCI-MSI.31981612-edge.i40e-eth0-TxRx-43
   1644748 ±  4%      +2.1%    1678906 ±  7%  interrupts.CPU43.CAL:Function_call_interrupts
      4.67 ± 72%     +21.4%       5.67 ± 71%  interrupts.CPU43.IWI:IRQ_work_interrupts
   1990667            -5.2%    1887499 ±  4%  interrupts.CPU43.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU43.MCP:Machine_check_polls
      3993 ± 53%     +30.6%       5215 ± 37%  interrupts.CPU43.NMI:Non-maskable_interrupts
      3993 ± 53%     +30.6%       5215 ± 37%  interrupts.CPU43.PMI:Performance_monitoring_interrupts
      1140 ±  7%     +13.4%       1294 ± 15%  interrupts.CPU43.RES:Rescheduling_interrupts
   2107486 ±  4%      +4.6%    2204759 ±  7%  interrupts.CPU43.TLB:TLB_shootdowns
     54.00 ±140%    -100.0%       0.00        interrupts.CPU44.80:PCI-MSI.31981613-edge.i40e-eth0-TxRx-44
   1795845 ± 12%      +3.8%    1864364 ±  2%  interrupts.CPU44.CAL:Function_call_interrupts
      2.00 ± 40%    +400.0%      10.00 ± 63%  interrupts.CPU44.IWI:IRQ_work_interrupts
   1990784            -5.8%    1874542 ±  4%  interrupts.CPU44.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU44.MCP:Machine_check_polls
      3810 ± 52%     +57.6%       6006 ± 31%  interrupts.CPU44.NMI:Non-maskable_interrupts
      3810 ± 52%     +57.6%       6006 ± 31%  interrupts.CPU44.PMI:Performance_monitoring_interrupts
      1188 ±  9%     +16.5%       1385 ± 13%  interrupts.CPU44.RES:Rescheduling_interrupts
   2306580 ± 12%      +6.1%    2447879 ±  2%  interrupts.CPU44.TLB:TLB_shootdowns
      0.00         +1e+102%       1.00 ±141%  interrupts.CPU45.81:PCI-MSI.31981614-edge.i40e-eth0-TxRx-45
   1851022 ±  2%      +4.0%    1924428 ±  4%  interrupts.CPU45.CAL:Function_call_interrupts
     10.33 ± 25%     -32.3%       7.00 ± 88%  interrupts.CPU45.IWI:IRQ_work_interrupts
   1990639            -5.9%    1873605 ±  4%  interrupts.CPU45.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU45.MCP:Machine_check_polls
      6169 ± 17%     -17.2%       5105 ± 39%  interrupts.CPU45.NMI:Non-maskable_interrupts
      6169 ± 17%     -17.2%       5105 ± 39%  interrupts.CPU45.PMI:Performance_monitoring_interrupts
      1222 ±  5%     +13.6%       1388 ±  8%  interrupts.CPU45.RES:Rescheduling_interrupts
   2377566 ±  2%      +6.3%    2527078 ±  4%  interrupts.CPU45.TLB:TLB_shootdowns
    111.67 ±141%     -98.2%       2.00 ±141%  interrupts.CPU46.82:PCI-MSI.31981615-edge.i40e-eth0-TxRx-46
   1855562 ± 14%      -2.9%    1801318 ±  3%  interrupts.CPU46.CAL:Function_call_interrupts
      9.00 ± 68%      +0.0%       9.00 ± 70%  interrupts.CPU46.IWI:IRQ_work_interrupts
   1987637            -5.4%    1880667 ±  4%  interrupts.CPU46.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU46.MCP:Machine_check_polls
      6558 ± 13%      -7.9%       6037 ± 37%  interrupts.CPU46.NMI:Non-maskable_interrupts
      6558 ± 13%      -7.9%       6037 ± 37%  interrupts.CPU46.PMI:Performance_monitoring_interrupts
      1218 ±  9%     +10.4%       1345 ± 11%  interrupts.CPU46.RES:Rescheduling_interrupts
   2381071 ± 14%      -0.6%    2367883 ±  3%  interrupts.CPU46.TLB:TLB_shootdowns
      0.00       +6.2e+105%       6212 ±141%  interrupts.CPU47.83:PCI-MSI.31981616-edge.i40e-eth0-TxRx-47
   1888209 ±  2%     -12.4%    1654759 ± 10%  interrupts.CPU47.CAL:Function_call_interrupts
      8.00 ± 54%     -16.7%       6.67 ± 67%  interrupts.CPU47.IWI:IRQ_work_interrupts
   1990332            -4.9%    1893311 ±  3%  interrupts.CPU47.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU47.MCP:Machine_check_polls
      5052 ± 36%     -12.0%       4445 ± 35%  interrupts.CPU47.NMI:Non-maskable_interrupts
      5052 ± 36%     -12.0%       4445 ± 35%  interrupts.CPU47.PMI:Performance_monitoring_interrupts
      1261 ±  3%      +0.5%       1267 ± 14%  interrupts.CPU47.RES:Rescheduling_interrupts
   2421573 ±  2%     -10.4%    2170145 ± 10%  interrupts.CPU47.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU48.47:PCI-MSI.31981580-edge.i40e-eth0-TxRx-11
     68.33 ±137%     -96.1%       2.67 ±115%  interrupts.CPU48.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
      0.33 ±141%    -100.0%       0.00        interrupts.CPU48.95:PCI-MSI.31981628-edge.i40e-eth0-TxRx-59
   1772004 ± 11%      +1.9%    1805371 ±  6%  interrupts.CPU48.CAL:Function_call_interrupts
     12.33 ± 19%     -64.9%       4.33 ±125%  interrupts.CPU48.IWI:IRQ_work_interrupts
   1989127            -5.9%    1871684 ±  4%  interrupts.CPU48.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU48.MCP:Machine_check_polls
      7269 ±  5%     -30.5%       5050 ± 31%  interrupts.CPU48.NMI:Non-maskable_interrupts
      7269 ±  5%     -30.5%       5050 ± 31%  interrupts.CPU48.PMI:Performance_monitoring_interrupts
      1274 ±  7%     +19.0%       1516 ± 19%  interrupts.CPU48.RES:Rescheduling_interrupts
   2276860 ± 11%      +4.9%    2387584 ±  6%  interrupts.CPU48.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU49.48:PCI-MSI.31981581-edge.i40e-eth0-TxRx-12
    141.33 ±133%     -98.1%       2.67 ±141%  interrupts.CPU49.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU49.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
   1565131 ± 15%     +20.0%    1878765 ±  6%  interrupts.CPU49.CAL:Function_call_interrupts
      8.67 ± 57%     +30.8%      11.33 ± 46%  interrupts.CPU49.IWI:IRQ_work_interrupts
   1988653            -6.1%    1866654 ±  4%  interrupts.CPU49.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU49.MCP:Machine_check_polls
      5648 ± 43%     +11.3%       6287 ± 26%  interrupts.CPU49.NMI:Non-maskable_interrupts
      5648 ± 43%     +11.3%       6287 ± 26%  interrupts.CPU49.PMI:Performance_monitoring_interrupts
      1171 ±  9%     +19.8%       1402 ± 13%  interrupts.CPU49.RES:Rescheduling_interrupts
   2015187 ± 15%     +23.4%    2486969 ±  6%  interrupts.CPU49.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU5.124:PCI-MSI.31981657-edge.i40e-eth0-TxRx-88
      4.67 ± 70%     -92.9%       0.33 ±141%  interrupts.CPU5.41:PCI-MSI.31981574-edge.i40e-eth0-TxRx-5
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU5.76:PCI-MSI.31981609-edge.i40e-eth0-TxRx-40
   1416243 ± 24%      +1.1%    1431285 ±  7%  interrupts.CPU5.CAL:Function_call_interrupts
     14.33 ± 16%    -100.0%       0.00        interrupts.CPU5.IWI:IRQ_work_interrupts
   1994770            -5.1%    1893179 ±  3%  interrupts.CPU5.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU5.MCP:Machine_check_polls
      7308 ±  9%     -60.6%       2877        interrupts.CPU5.NMI:Non-maskable_interrupts
      7308 ±  9%     -60.6%       2877        interrupts.CPU5.PMI:Performance_monitoring_interrupts
      1113 ± 24%     +14.6%       1275 ± 11%  interrupts.CPU5.RES:Rescheduling_interrupts
   1821547 ± 24%      +3.7%    1889355 ±  7%  interrupts.CPU5.TLB:TLB_shootdowns
      1.00           -33.3%       0.67 ± 70%  interrupts.CPU50.49:PCI-MSI.31981582-edge.i40e-eth0-TxRx-13
      5580 ±141%     -99.9%       7.33 ± 67%  interrupts.CPU50.86:PCI-MSI.31981619-edge.i40e-eth0-TxRx-50
      0.00          -100.0%       0.00        interrupts.CPU50.97:PCI-MSI.31981630-edge.i40e-eth0-TxRx-61
   1881287 ±  5%     -10.9%    1676765 ± 11%  interrupts.CPU50.CAL:Function_call_interrupts
     13.33 ±  7%     -50.0%       6.67 ±101%  interrupts.CPU50.IWI:IRQ_work_interrupts
   1985701            -5.0%    1887101 ±  3%  interrupts.CPU50.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU50.MCP:Machine_check_polls
      7392 ±  7%     -40.6%       4394 ± 59%  interrupts.CPU50.NMI:Non-maskable_interrupts
      7392 ±  7%     -40.6%       4394 ± 59%  interrupts.CPU50.PMI:Performance_monitoring_interrupts
      1408 ± 14%      -6.2%       1322 ± 21%  interrupts.CPU50.RES:Rescheduling_interrupts
   2418647 ±  5%      -8.2%    2221010 ± 11%  interrupts.CPU50.TLB:TLB_shootdowns
      0.00          -100.0%       0.00        interrupts.CPU51.3:IO-APIC.3-edge
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU51.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU51.87:PCI-MSI.31981620-edge.i40e-eth0-TxRx-51
      0.00       +6.7e+101%       0.67 ± 70%  interrupts.CPU51.98:PCI-MSI.31981631-edge.i40e-eth0-TxRx-62
   1707928 ±  9%     +11.5%    1904613 ±  4%  interrupts.CPU51.CAL:Function_call_interrupts
      8.00 ± 87%     -16.7%       6.67 ±101%  interrupts.CPU51.IWI:IRQ_work_interrupts
   1987380            -6.4%    1859794 ±  4%  interrupts.CPU51.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU51.MCP:Machine_check_polls
      5738 ± 36%     -23.5%       4389 ± 59%  interrupts.CPU51.NMI:Non-maskable_interrupts
      5738 ± 36%     -23.5%       4389 ± 59%  interrupts.CPU51.PMI:Performance_monitoring_interrupts
      1239 ± 15%     +20.7%       1495 ±  4%  interrupts.CPU51.RES:Rescheduling_interrupts
   2197586 ±  9%     +14.6%    2519494 ±  5%  interrupts.CPU51.TLB:TLB_shootdowns
      0.33 ±141%    -100.0%       0.00        interrupts.CPU52.51:PCI-MSI.31981584-edge.i40e-eth0-TxRx-15
      1.33 ± 93%     -25.0%       1.00 ±141%  interrupts.CPU52.88:PCI-MSI.31981621-edge.i40e-eth0-TxRx-52
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU52.99:PCI-MSI.31981632-edge.i40e-eth0-TxRx-63
   1951868 ±  9%     -31.6%    1335127 ±  6%  interrupts.CPU52.CAL:Function_call_interrupts
     11.00 ± 37%    -100.0%       0.00        interrupts.CPU52.IWI:IRQ_work_interrupts
   1984053            -3.9%    1905842 ±  3%  interrupts.CPU52.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU52.MCP:Machine_check_polls
      6104 ± 30%     -68.7%       1909 ± 35%  interrupts.CPU52.NMI:Non-maskable_interrupts
      6104 ± 30%     -68.7%       1909 ± 35%  interrupts.CPU52.PMI:Performance_monitoring_interrupts
      1400 ± 16%     -18.6%       1139 ±  4%  interrupts.CPU52.RES:Rescheduling_interrupts
   2510848 ±  9%     -29.8%    1762600 ±  6%  interrupts.CPU52.TLB:TLB_shootdowns
      0.33 ±141%    -100.0%       0.00        interrupts.CPU53.100:PCI-MSI.31981633-edge.i40e-eth0-TxRx-64
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU53.52:PCI-MSI.31981585-edge.i40e-eth0-TxRx-16
      0.67 ± 70%    -100.0%       0.00        interrupts.CPU53.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
   1665531 ± 14%     -10.1%    1497069 ±  9%  interrupts.CPU53.CAL:Function_call_interrupts
      5.67 ±129%    +158.8%      14.67 ±  6%  interrupts.CPU53.IWI:IRQ_work_interrupts
   1988491            -4.7%    1895183 ±  3%  interrupts.CPU53.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU53.MCP:Machine_check_polls
      5442 ± 36%     +43.2%       7793        interrupts.CPU53.NMI:Non-maskable_interrupts
      5442 ± 36%     +43.2%       7793        interrupts.CPU53.PMI:Performance_monitoring_interrupts
      1204 ± 21%      +4.8%       1262 ± 15%  interrupts.CPU53.RES:Rescheduling_interrupts
   2142103 ± 14%      -7.6%    1979081 ±  9%  interrupts.CPU53.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU54.101:PCI-MSI.31981634-edge.i40e-eth0-TxRx-65
      0.67 ± 70%      +0.0%       0.67 ± 70%  interrupts.CPU54.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
     49.67 ±137%     -99.3%       0.33 ±141%  interrupts.CPU54.90:PCI-MSI.31981623-edge.i40e-eth0-TxRx-54
   1739173 ± 19%     -12.7%    1517479 ±  9%  interrupts.CPU54.CAL:Function_call_interrupts
      6.33 ± 96%     +84.2%      11.67 ± 47%  interrupts.CPU54.IWI:IRQ_work_interrupts
   1985944            -4.7%    1893171 ±  3%  interrupts.CPU54.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU54.MCP:Machine_check_polls
      4291 ± 58%     +51.8%       6513 ± 27%  interrupts.CPU54.NMI:Non-maskable_interrupts
      4291 ± 58%     +51.8%       6513 ± 27%  interrupts.CPU54.PMI:Performance_monitoring_interrupts
      1286 ± 25%      -0.4%       1281 ± 12%  interrupts.CPU54.RES:Rescheduling_interrupts
   2235542 ± 19%     -10.0%    2011666 ±  9%  interrupts.CPU54.TLB:TLB_shootdowns
      0.67 ± 70%    -100.0%       0.00        interrupts.CPU55.102:PCI-MSI.31981635-edge.i40e-eth0-TxRx-66
      0.00          -100.0%       0.00        interrupts.CPU55.298:PCI-MSI.69632-edge.ioat-msix
      0.33 ±141%    -100.0%       0.00        interrupts.CPU55.54:PCI-MSI.31981587-edge.i40e-eth0-TxRx-18
      1.33 ± 70%     -50.0%       0.67 ±141%  interrupts.CPU55.91:PCI-MSI.31981624-edge.i40e-eth0-TxRx-55
   1697032 ±  4%      -2.8%    1650239 ±  7%  interrupts.CPU55.CAL:Function_call_interrupts
      3.67 ± 89%    +127.3%       8.33 ± 70%  interrupts.CPU55.IWI:IRQ_work_interrupts
   1988525            -5.4%    1881925 ±  4%  interrupts.CPU55.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU55.MCP:Machine_check_polls
      4343 ± 33%     +31.2%       5696 ± 35%  interrupts.CPU55.NMI:Non-maskable_interrupts
      4343 ± 33%     +31.2%       5696 ± 35%  interrupts.CPU55.PMI:Performance_monitoring_interrupts
      1227 ±  5%      +5.1%       1289 ± 12%  interrupts.CPU55.RES:Rescheduling_interrupts
   2182447 ±  4%      -0.1%    2179254 ±  7%  interrupts.CPU55.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU56.103:PCI-MSI.31981636-edge.i40e-eth0-TxRx-67
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU56.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
      7.00 ± 30%     -95.2%       0.33 ±141%  interrupts.CPU56.92:PCI-MSI.31981625-edge.i40e-eth0-TxRx-56
   1347182 ±  3%      +5.6%    1422355 ± 21%  interrupts.CPU56.CAL:Function_call_interrupts
      4.33 ±141%     +30.8%       5.67 ± 73%  interrupts.CPU56.IWI:IRQ_work_interrupts
   1992404            -4.3%    1907688 ±  3%  interrupts.CPU56.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU56.MCP:Machine_check_polls
      3955 ± 65%     +18.7%       4694 ± 29%  interrupts.CPU56.NMI:Non-maskable_interrupts
      3955 ± 65%     +18.7%       4694 ± 29%  interrupts.CPU56.PMI:Performance_monitoring_interrupts
      1036 ± 13%      +7.1%       1109 ± 24%  interrupts.CPU56.RES:Rescheduling_interrupts
   1731707 ±  3%      +8.6%    1880374 ± 21%  interrupts.CPU56.TLB:TLB_shootdowns
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU57.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU57.56:PCI-MSI.31981589-edge.i40e-eth0-TxRx-20
     99.33 ±138%     -20.5%      79.00 ±129%  interrupts.CPU57.93:PCI-MSI.31981626-edge.i40e-eth0-TxRx-57
   1524315 ± 19%      +7.1%    1632324 ± 11%  interrupts.CPU57.CAL:Function_call_interrupts
      0.33 ±141%   +1400.0%       5.00 ±141%  interrupts.CPU57.IWI:IRQ_work_interrupts
   1986609            -5.6%    1874378 ±  4%  interrupts.CPU57.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU57.MCP:Machine_check_polls
      3863 ± 35%     +16.5%       4501 ± 51%  interrupts.CPU57.NMI:Non-maskable_interrupts
      3863 ± 35%     +16.5%       4501 ± 51%  interrupts.CPU57.PMI:Performance_monitoring_interrupts
      1110 ± 22%     +13.0%       1254 ±  5%  interrupts.CPU57.RES:Rescheduling_interrupts
   1961817 ± 19%     +10.1%    2160652 ± 11%  interrupts.CPU57.TLB:TLB_shootdowns
      0.67 ± 70%    -100.0%       0.00        interrupts.CPU58.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69
      0.00          -100.0%       0.00        interrupts.CPU58.57:PCI-MSI.31981590-edge.i40e-eth0-TxRx-21
      3.67 ±102%     -90.9%       0.33 ±141%  interrupts.CPU58.94:PCI-MSI.31981627-edge.i40e-eth0-TxRx-58
   1420152 ±  6%      -7.5%    1313862 ± 26%  interrupts.CPU58.CAL:Function_call_interrupts
      9.67 ± 70%     -24.1%       7.33 ± 83%  interrupts.CPU58.IWI:IRQ_work_interrupts
   1993604            -4.4%    1904903 ±  3%  interrupts.CPU58.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU58.MCP:Machine_check_polls
      6106 ± 37%     -13.8%       5264 ± 37%  interrupts.CPU58.NMI:Non-maskable_interrupts
      6106 ± 37%     -13.8%       5264 ± 37%  interrupts.CPU58.PMI:Performance_monitoring_interrupts
      1093 ±  6%      -5.4%       1034 ± 18%  interrupts.CPU58.RES:Rescheduling_interrupts
   1827186 ±  6%      -4.9%    1737722 ± 27%  interrupts.CPU58.TLB:TLB_shootdowns
      1.00           -33.3%       0.67 ± 70%  interrupts.CPU59.106:PCI-MSI.31981639-edge.i40e-eth0-TxRx-70
      0.67 ± 70%      +0.0%       0.67 ± 70%  interrupts.CPU59.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
      2.33 ±112%   +2814.3%      68.00 ±141%  interrupts.CPU59.95:PCI-MSI.31981628-edge.i40e-eth0-TxRx-59
   1626244 ± 14%     -10.5%    1455439 ±  7%  interrupts.CPU59.CAL:Function_call_interrupts
      3.33 ± 61%    +120.0%       7.33 ± 65%  interrupts.CPU59.IWI:IRQ_work_interrupts
   1990254            -5.0%    1890811 ±  3%  interrupts.CPU59.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU59.MCP:Machine_check_polls
      4361 ± 30%     +21.8%       5309 ± 33%  interrupts.CPU59.NMI:Non-maskable_interrupts
      4361 ± 30%     +21.8%       5309 ± 33%  interrupts.CPU59.PMI:Performance_monitoring_interrupts
      1214 ±  9%      +0.7%       1223 ±  6%  interrupts.CPU59.RES:Rescheduling_interrupts
   2092260 ± 14%      -8.1%    1923117 ±  7%  interrupts.CPU59.TLB:TLB_shootdowns
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU6.125:PCI-MSI.31981658-edge.i40e-eth0-TxRx-89
      6.00 ± 72%     -66.7%       2.00 ±108%  interrupts.CPU6.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU6.77:PCI-MSI.31981610-edge.i40e-eth0-TxRx-41
   1304275 ± 17%      +8.4%    1413391 ± 14%  interrupts.CPU6.CAL:Function_call_interrupts
      7.00 ± 72%     +19.0%       8.33 ± 70%  interrupts.CPU6.IWI:IRQ_work_interrupts
   1996479            -5.1%    1894730 ±  3%  interrupts.CPU6.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU6.MCP:Machine_check_polls
      5417 ± 33%      -8.0%       4986 ± 31%  interrupts.CPU6.NMI:Non-maskable_interrupts
      5417 ± 33%      -8.0%       4986 ± 31%  interrupts.CPU6.PMI:Performance_monitoring_interrupts
    989.33 ± 16%     +29.8%       1283 ± 20%  interrupts.CPU6.RES:Rescheduling_interrupts
   1674991 ± 17%     +11.1%    1860964 ± 14%  interrupts.CPU6.TLB:TLB_shootdowns
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU60.107:PCI-MSI.31981640-edge.i40e-eth0-TxRx-71
      0.33 ±141%    -100.0%       0.00        interrupts.CPU60.59:PCI-MSI.31981592-edge.i40e-eth0-TxRx-23
     19.33 ±127%     -77.6%       4.33 ± 76%  interrupts.CPU60.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
   1448317 ± 14%      +5.1%    1522493 ±  7%  interrupts.CPU60.CAL:Function_call_interrupts
      6.00 ± 94%     +55.6%       9.33 ± 72%  interrupts.CPU60.IWI:IRQ_work_interrupts
   1989734            -5.3%    1884400 ±  4%  interrupts.CPU60.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU60.MCP:Machine_check_polls
      5660 ± 32%      +2.1%       5777 ± 36%  interrupts.CPU60.NMI:Non-maskable_interrupts
      5660 ± 32%      +2.1%       5777 ± 36%  interrupts.CPU60.PMI:Performance_monitoring_interrupts
      1139 ± 18%     +13.0%       1288 ±  8%  interrupts.CPU60.RES:Rescheduling_interrupts
   1861801 ± 14%      +7.9%    2008779 ±  8%  interrupts.CPU60.TLB:TLB_shootdowns
      0.00       +6.7e+101%       0.67 ± 70%  interrupts.CPU61.108:PCI-MSI.31981641-edge.i40e-eth0-TxRx-72
      0.33 ±141%    -100.0%       0.00        interrupts.CPU61.60:PCI-MSI.31981593-edge.i40e-eth0-TxRx-24
     19.33 ±130%     -79.3%       4.00 ±141%  interrupts.CPU61.97:PCI-MSI.31981630-edge.i40e-eth0-TxRx-61
   1506234 ±  4%      +7.4%    1618239 ± 10%  interrupts.CPU61.CAL:Function_call_interrupts
      4.67 ±111%     +35.7%       6.33 ± 73%  interrupts.CPU61.IWI:IRQ_work_interrupts
   1993170            -5.8%    1877071 ±  4%  interrupts.CPU61.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU61.MCP:Machine_check_polls
      5799 ± 17%     -24.5%       4376 ± 33%  interrupts.CPU61.NMI:Non-maskable_interrupts
      5799 ± 17%     -24.5%       4376 ± 33%  interrupts.CPU61.PMI:Performance_monitoring_interrupts
      1154 ±  4%     +11.8%       1291 ±  6%  interrupts.CPU61.RES:Rescheduling_interrupts
   1937605 ±  5%     +10.2%    2135377 ± 10%  interrupts.CPU61.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU62.109:PCI-MSI.31981642-edge.i40e-eth0-TxRx-73
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU62.61:PCI-MSI.31981594-edge.i40e-eth0-TxRx-25
      0.00       +4.3e+102%       4.33 ± 71%  interrupts.CPU62.98:PCI-MSI.31981631-edge.i40e-eth0-TxRx-62
   1718088 ±  7%     -17.8%    1411772 ± 26%  interrupts.CPU62.CAL:Function_call_interrupts
     11.00 ± 64%     -75.8%       2.67 ± 93%  interrupts.CPU62.IWI:IRQ_work_interrupts
   1990645            -4.7%    1897068 ±  3%  interrupts.CPU62.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU62.MCP:Machine_check_polls
      7119 ± 13%     -54.5%       3242 ±  9%  interrupts.CPU62.NMI:Non-maskable_interrupts
      7119 ± 13%     -54.5%       3242 ±  9%  interrupts.CPU62.PMI:Performance_monitoring_interrupts
      1287 ±  3%      -2.7%       1252 ± 16%  interrupts.CPU62.RES:Rescheduling_interrupts
   2210870 ±  7%     -15.8%    1862361 ± 26%  interrupts.CPU62.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU63.110:PCI-MSI.31981643-edge.i40e-eth0-TxRx-74
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU63.62:PCI-MSI.31981595-edge.i40e-eth0-TxRx-26
      3.00 ±118%   +3888.9%     119.67 ±137%  interrupts.CPU63.99:PCI-MSI.31981632-edge.i40e-eth0-TxRx-63
   1444706 ±  6%     +26.2%    1823494 ±  8%  interrupts.CPU63.CAL:Function_call_interrupts
      5.67 ±129%    +100.0%      11.33 ± 27%  interrupts.CPU63.IWI:IRQ_work_interrupts
   1992010            -6.2%    1869127 ±  4%  interrupts.CPU63.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU63.MCP:Machine_check_polls
      5440 ± 37%     +11.2%       6052 ± 26%  interrupts.CPU63.NMI:Non-maskable_interrupts
      5440 ± 37%     +11.2%       6052 ± 26%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
      1140 ±  5%     +21.7%       1387 ± 14%  interrupts.CPU63.RES:Rescheduling_interrupts
   1861023 ±  6%     +29.6%    2411566 ±  8%  interrupts.CPU63.TLB:TLB_shootdowns
      5.00 ± 74%    +253.3%      17.67 ±141%  interrupts.CPU64.100:PCI-MSI.31981633-edge.i40e-eth0-TxRx-64
      0.00          -100.0%       0.00        interrupts.CPU64.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
      0.00       +2.2e+103%      21.67 ±141%  interrupts.CPU64.4:IO-APIC.4-edge.ttyS0
      0.33 ±141%    +200.0%       1.00        interrupts.CPU64.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
   1656048 ± 15%      +2.1%    1690357 ± 17%  interrupts.CPU64.CAL:Function_call_interrupts
      8.33 ± 72%     +20.0%      10.00 ± 42%  interrupts.CPU64.IWI:IRQ_work_interrupts
   1985853            -6.1%    1865618 ±  4%  interrupts.CPU64.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU64.MCP:Machine_check_polls
      5301 ± 49%      +5.9%       5612 ± 30%  interrupts.CPU64.NMI:Non-maskable_interrupts
      5301 ± 49%      +5.9%       5612 ± 30%  interrupts.CPU64.PMI:Performance_monitoring_interrupts
      1262 ± 21%      +2.6%       1294 ±  9%  interrupts.CPU64.RES:Rescheduling_interrupts
   2131295 ± 15%      +5.0%    2238706 ± 18%  interrupts.CPU64.TLB:TLB_shootdowns
      0.33 ±141%  +15600.0%      52.33 ±138%  interrupts.CPU65.101:PCI-MSI.31981634-edge.i40e-eth0-TxRx-65
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU65.112:PCI-MSI.31981645-edge.i40e-eth0-TxRx-76
      0.00       +1.7e+103%      17.33 ±141%  interrupts.CPU65.4:IO-APIC.4-edge.ttyS0
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU65.64:PCI-MSI.31981597-edge.i40e-eth0-TxRx-28
   1609735 ±  5%      -2.1%    1575604 ±  5%  interrupts.CPU65.CAL:Function_call_interrupts
      5.67 ± 44%     +41.2%       8.00 ± 81%  interrupts.CPU65.IWI:IRQ_work_interrupts
   1988636            -5.1%    1886938 ±  3%  interrupts.CPU65.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU65.MCP:Machine_check_polls
      5467 ±  9%     -11.3%       4851 ± 43%  interrupts.CPU65.NMI:Non-maskable_interrupts
      5467 ±  9%     -11.3%       4851 ± 43%  interrupts.CPU65.PMI:Performance_monitoring_interrupts
      1218 ± 16%      +9.9%       1339 ± 18%  interrupts.CPU65.RES:Rescheduling_interrupts
   2072400 ±  5%      +0.5%    2083033 ±  5%  interrupts.CPU65.TLB:TLB_shootdowns
      2.33 ± 80%    -100.0%       0.00        interrupts.CPU66.102:PCI-MSI.31981635-edge.i40e-eth0-TxRx-66
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU66.113:PCI-MSI.31981646-edge.i40e-eth0-TxRx-77
      0.00          -100.0%       0.00        interrupts.CPU66.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU66.3:IO-APIC.3-edge
      0.00          -100.0%       0.00        interrupts.CPU66.65:PCI-MSI.31981598-edge.i40e-eth0-TxRx-29
   1850434 ±  2%     -24.5%    1396653 ±  9%  interrupts.CPU66.CAL:Function_call_interrupts
     12.67 ±  9%     -57.9%       5.33 ±128%  interrupts.CPU66.IWI:IRQ_work_interrupts
   1989034            -4.3%    1903537 ±  2%  interrupts.CPU66.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU66.MCP:Machine_check_polls
      7494 ±  2%     -52.2%       3583 ± 78%  interrupts.CPU66.NMI:Non-maskable_interrupts
      7494 ±  2%     -52.2%       3583 ± 78%  interrupts.CPU66.PMI:Performance_monitoring_interrupts
      1372 ±  7%     -13.1%       1192 ± 13%  interrupts.CPU66.RES:Rescheduling_interrupts
   2377993 ±  3%     -22.3%    1847264 ±  9%  interrupts.CPU66.TLB:TLB_shootdowns
     69.33 ±141%     -99.5%       0.33 ±141%  interrupts.CPU67.103:PCI-MSI.31981636-edge.i40e-eth0-TxRx-67
      0.00          -100.0%       0.00        interrupts.CPU67.114:PCI-MSI.31981647-edge.i40e-eth0-TxRx-78
      0.00          -100.0%       0.00        interrupts.CPU67.295:PCI-MSI.65536-edge.ioat-msix
      0.00          -100.0%       0.00        interrupts.CPU67.298:PCI-MSI.67584-edge.ioat-msix
      0.33 ±141%    -100.0%       0.00        interrupts.CPU67.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
   1435568 ± 21%      +5.4%    1512991 ± 11%  interrupts.CPU67.CAL:Function_call_interrupts
      0.67 ± 70%   +1100.0%       8.00 ± 77%  interrupts.CPU67.IWI:IRQ_work_interrupts
   1987002            -4.9%    1888746 ±  3%  interrupts.CPU67.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU67.MCP:Machine_check_polls
      4477 ± 26%      +9.6%       4909 ± 41%  interrupts.CPU67.NMI:Non-maskable_interrupts
      4477 ± 26%      +9.6%       4909 ± 41%  interrupts.CPU67.PMI:Performance_monitoring_interrupts
      1081 ± 26%     +10.6%       1195 ± 14%  interrupts.CPU67.RES:Rescheduling_interrupts
   1842392 ± 21%      +8.4%    1997208 ± 10%  interrupts.CPU67.TLB:TLB_shootdowns
      0.67 ±141%    +100.0%       1.33 ±141%  interrupts.CPU68.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68
      0.00         +1e+102%       1.00        interrupts.CPU68.115:PCI-MSI.31981648-edge.i40e-eth0-TxRx-79
      0.00          -100.0%       0.00        interrupts.CPU68.295:PCI-MSI.65536-edge.ioat-msix
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU68.67:PCI-MSI.31981600-edge.i40e-eth0-TxRx-31
   1340238 ± 13%     +10.5%    1480768 ± 11%  interrupts.CPU68.CAL:Function_call_interrupts
      5.33 ±141%     -56.2%       2.33 ± 72%  interrupts.CPU68.IWI:IRQ_work_interrupts
   1989988            -4.4%    1902719 ±  2%  interrupts.CPU68.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU68.MCP:Machine_check_polls
      4045 ± 67%      -8.5%       3701 ± 16%  interrupts.CPU68.NMI:Non-maskable_interrupts
      4045 ± 67%      -8.5%       3701 ± 16%  interrupts.CPU68.PMI:Performance_monitoring_interrupts
    984.67 ± 22%     +14.8%       1130 ± 12%  interrupts.CPU68.RES:Rescheduling_interrupts
   1725006 ± 13%     +13.5%    1957457 ± 11%  interrupts.CPU68.TLB:TLB_shootdowns
      1697 ±140%    +112.0%       3597 ±141%  interrupts.CPU69.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU69.116:PCI-MSI.31981649-edge.i40e-eth0-TxRx-80
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU69.68:PCI-MSI.31981601-edge.i40e-eth0-TxRx-32
   1233321 ± 10%     +22.0%    1505117 ±  6%  interrupts.CPU69.CAL:Function_call_interrupts
     11.67 ± 26%      -5.7%      11.00 ± 51%  interrupts.CPU69.IWI:IRQ_work_interrupts
   1993381            -5.4%    1885918 ±  3%  interrupts.CPU69.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU69.MCP:Machine_check_polls
      6971 ±  9%     -16.8%       5797 ± 41%  interrupts.CPU69.NMI:Non-maskable_interrupts
      6971 ±  9%     -16.8%       5797 ± 41%  interrupts.CPU69.PMI:Performance_monitoring_interrupts
    934.00 ± 19%     +24.0%       1158 ±  2%  interrupts.CPU69.RES:Rescheduling_interrupts
   1589896 ± 10%     +25.0%    1987282 ±  6%  interrupts.CPU69.TLB:TLB_shootdowns
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU7.126:PCI-MSI.31981659-edge.i40e-eth0-TxRx-90
      1332            +2.1%       1360 ±  3%  interrupts.CPU7.35:PCI-MSI.31981568-edge.i40e-0000:3d:00.0:misc
      3.00 ±141%     +22.2%       3.67 ± 89%  interrupts.CPU7.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU7.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
   1352572 ±  5%      -3.4%    1306327 ±  4%  interrupts.CPU7.CAL:Function_call_interrupts
      7.33 ± 89%     +22.7%       9.00 ± 63%  interrupts.CPU7.IWI:IRQ_work_interrupts
   1994785            -4.3%    1908020 ±  2%  interrupts.CPU7.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU7.MCP:Machine_check_polls
      4718 ± 46%     +20.8%       5701 ± 29%  interrupts.CPU7.NMI:Non-maskable_interrupts
      4718 ± 46%     +20.8%       5701 ± 29%  interrupts.CPU7.PMI:Performance_monitoring_interrupts
      1043 ±  7%     +13.5%       1184 ± 18%  interrupts.CPU7.RES:Rescheduling_interrupts
   1740346 ±  5%      -0.9%    1725223 ±  3%  interrupts.CPU7.TLB:TLB_shootdowns
      3.00 ± 27%     +55.6%       4.67 ±141%  interrupts.CPU70.106:PCI-MSI.31981639-edge.i40e-eth0-TxRx-70
      0.33 ±141%      +0.0%       0.33 ±141%  interrupts.CPU70.117:PCI-MSI.31981650-edge.i40e-eth0-TxRx-81
      0.00          -100.0%       0.00        interrupts.CPU70.299:PCI-MSI.71680-edge.ioat-msix
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU70.69:PCI-MSI.31981602-edge.i40e-eth0-TxRx-33
   1342525 ± 10%      +9.7%    1472356 ± 13%  interrupts.CPU70.CAL:Function_call_interrupts
      8.33 ± 78%      -8.0%       7.67 ± 85%  interrupts.CPU70.IWI:IRQ_work_interrupts
   1994078            -4.8%    1897450 ±  3%  interrupts.CPU70.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU70.MCP:Machine_check_polls
      5411 ± 36%     -12.1%       4756 ± 45%  interrupts.CPU70.NMI:Non-maskable_interrupts
      5411 ± 36%     -12.1%       4756 ± 45%  interrupts.CPU70.PMI:Performance_monitoring_interrupts
      1019 ±  7%     +24.7%       1270 ± 15%  interrupts.CPU70.RES:Rescheduling_interrupts
   1728567 ± 10%     +12.4%    1942269 ± 13%  interrupts.CPU70.TLB:TLB_shootdowns
      0.67 ± 70%  +2.8e+05%       1852 ±141%  interrupts.CPU71.107:PCI-MSI.31981640-edge.i40e-eth0-TxRx-71
      0.00       +3.3e+101%       0.33 ±141%  interrupts.CPU71.118:PCI-MSI.31981651-edge.i40e-eth0-TxRx-82
      0.00          -100.0%       0.00        interrupts.CPU71.297:PCI-MSI.67584-edge.ioat-msix
      0.33 ±141%    +100.0%       0.67 ± 70%  interrupts.CPU71.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34
   1316357 ±  9%      -1.8%    1292152 ± 15%  interrupts.CPU71.CAL:Function_call_interrupts
     10.67 ± 70%    -100.0%       0.00        interrupts.CPU71.IWI:IRQ_work_interrupts
   1992286            -4.6%    1899979 ±  3%  interrupts.CPU71.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU71.MCP:Machine_check_polls
      6145 ± 37%     -53.1%       2882        interrupts.CPU71.NMI:Non-maskable_interrupts
      6145 ± 37%     -53.1%       2882        interrupts.CPU71.PMI:Performance_monitoring_interrupts
      1028 ± 13%     +11.3%       1144 ± 17%  interrupts.CPU71.RES:Rescheduling_interrupts
   1690792 ±  9%      +0.7%    1702712 ± 14%  interrupts.CPU71.TLB:TLB_shootdowns
      0.00         +3e+102%       3.00 ±118%  interrupts.CPU72.108:PCI-MSI.31981641-edge.i40e-eth0-TxRx-72
   1626843 ± 11%      +4.8%    1704121 ± 12%  interrupts.CPU72.CAL:Function_call_interrupts
      7.33 ± 78%     +68.2%      12.33 ± 25%  interrupts.CPU72.IWI:IRQ_work_interrupts
   1993580            -5.2%    1890802 ±  3%  interrupts.CPU72.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU72.MCP:Machine_check_polls
      4847 ± 43%     +33.7%       6482 ± 28%  interrupts.CPU72.NMI:Non-maskable_interrupts
      4847 ± 43%     +33.7%       6482 ± 28%  interrupts.CPU72.PMI:Performance_monitoring_interrupts
      1182 ±  4%      +7.2%       1267 ± 20%  interrupts.CPU72.RES:Rescheduling_interrupts
   2083105 ± 11%      +7.4%    2237698 ± 12%  interrupts.CPU72.TLB:TLB_shootdowns
      2.00 ±141%     -50.0%       1.00 ±141%  interrupts.CPU73.109:PCI-MSI.31981642-edge.i40e-eth0-TxRx-73
   1768492 ± 16%      -9.3%    1603296 ± 12%  interrupts.CPU73.CAL:Function_call_interrupts
      4.33 ± 78%     -61.5%       1.67 ±141%  interrupts.CPU73.IWI:IRQ_work_interrupts
   1994198            -4.8%    1899180 ±  3%  interrupts.CPU73.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU73.MCP:Machine_check_polls
      5564 ±  2%     -45.2%       3052 ±  8%  interrupts.CPU73.NMI:Non-maskable_interrupts
      5564 ±  2%     -45.2%       3052 ±  8%  interrupts.CPU73.PMI:Performance_monitoring_interrupts
      1189 ± 16%      +5.0%       1248 ± 16%  interrupts.CPU73.RES:Rescheduling_interrupts
   2269340 ± 16%      -7.2%    2105564 ± 13%  interrupts.CPU73.TLB:TLB_shootdowns
      0.33 ±141%    +300.0%       1.33 ± 93%  interrupts.CPU74.110:PCI-MSI.31981643-edge.i40e-eth0-TxRx-74
   1662997 ± 26%      +5.5%    1754378 ±  8%  interrupts.CPU74.CAL:Function_call_interrupts
      8.33 ± 73%     -68.0%       2.67 ±141%  interrupts.CPU74.IWI:IRQ_work_interrupts
   1996584            -5.5%    1885933 ±  3%  interrupts.CPU74.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU74.MCP:Machine_check_polls
      6882 ±  9%     -60.5%       2721 ± 36%  interrupts.CPU74.NMI:Non-maskable_interrupts
      6882 ±  9%     -60.5%       2721 ± 36%  interrupts.CPU74.PMI:Performance_monitoring_interrupts
      1209 ± 12%      +7.6%       1301 ± 12%  interrupts.CPU74.RES:Rescheduling_interrupts
   2133946 ± 27%      +8.1%    2307065 ±  8%  interrupts.CPU74.TLB:TLB_shootdowns
     62.67 ±141%     -96.8%       2.00 ± 81%  interrupts.CPU75.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
   1938717 ± 13%     -18.6%    1579075 ± 14%  interrupts.CPU75.CAL:Function_call_interrupts
      4.33 ± 78%     +38.5%       6.00 ±118%  interrupts.CPU75.IWI:IRQ_work_interrupts
   1991512            -4.6%    1900583 ±  3%  interrupts.CPU75.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU75.MCP:Machine_check_polls
      4630 ± 31%      +1.0%       4677 ± 47%  interrupts.CPU75.NMI:Non-maskable_interrupts
      4630 ± 31%      +1.0%       4677 ± 47%  interrupts.CPU75.PMI:Performance_monitoring_interrupts
      1307 ±  7%      -4.9%       1243 ± 30%  interrupts.CPU75.RES:Rescheduling_interrupts
   2488418 ± 13%     -16.7%    2073013 ± 14%  interrupts.CPU75.TLB:TLB_shootdowns
     66.67 ±141%     -99.0%       0.67 ±141%  interrupts.CPU76.112:PCI-MSI.31981645-edge.i40e-eth0-TxRx-76
   1964044 ±  9%     -16.5%    1640313 ±  4%  interrupts.CPU76.CAL:Function_call_interrupts
      9.33 ± 66%     -28.6%       6.67 ± 79%  interrupts.CPU76.IWI:IRQ_work_interrupts
   1990673            -5.0%    1891339 ±  3%  interrupts.CPU76.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU76.MCP:Machine_check_polls
      6392 ± 15%     -25.9%       4739 ± 41%  interrupts.CPU76.NMI:Non-maskable_interrupts
      6392 ± 15%     -25.9%       4739 ± 41%  interrupts.CPU76.PMI:Performance_monitoring_interrupts
      1326 ±  2%      -4.7%       1263 ± 18%  interrupts.CPU76.RES:Rescheduling_interrupts
   2519550 ±  9%     -14.3%    2159066 ±  4%  interrupts.CPU76.TLB:TLB_shootdowns
     15573 ±141%    -100.0%       2.00 ± 81%  interrupts.CPU77.113:PCI-MSI.31981646-edge.i40e-eth0-TxRx-77
   1822826 ± 12%     -23.2%    1399502 ± 17%  interrupts.CPU77.CAL:Function_call_interrupts
      5.67 ±106%      -5.9%       5.33 ±141%  interrupts.CPU77.IWI:IRQ_work_interrupts
   1992466            -4.2%    1908509 ±  2%  interrupts.CPU77.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU77.MCP:Machine_check_polls
      4889 ± 43%      -8.5%       4475 ± 52%  interrupts.CPU77.NMI:Non-maskable_interrupts
      4889 ± 43%      -8.5%       4475 ± 52%  interrupts.CPU77.PMI:Performance_monitoring_interrupts
      1212 ±  6%      -9.6%       1096 ± 16%  interrupts.CPU77.RES:Rescheduling_interrupts
   2337249 ± 12%     -21.3%    1839786 ± 17%  interrupts.CPU77.TLB:TLB_shootdowns
      3.67 ±105%     +36.4%       5.00 ± 90%  interrupts.CPU78.114:PCI-MSI.31981647-edge.i40e-eth0-TxRx-78
   1845588 ± 15%      -8.1%    1696223 ± 14%  interrupts.CPU78.CAL:Function_call_interrupts
      3.00 ±118%    +322.2%      12.67 ± 37%  interrupts.CPU78.IWI:IRQ_work_interrupts
   1993324            -5.7%    1879316 ±  4%  interrupts.CPU78.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU78.MCP:Machine_check_polls
      4615 ± 26%     +40.1%       6468 ± 29%  interrupts.CPU78.NMI:Non-maskable_interrupts
      4615 ± 26%     +40.1%       6468 ± 29%  interrupts.CPU78.PMI:Performance_monitoring_interrupts
      1230 ±  5%      -0.0%       1230 ±  6%  interrupts.CPU78.RES:Rescheduling_interrupts
   2367244 ± 15%      -5.9%    2228282 ± 14%  interrupts.CPU78.TLB:TLB_shootdowns
      0.00         +6e+102%       6.00 ± 49%  interrupts.CPU79.115:PCI-MSI.31981648-edge.i40e-eth0-TxRx-79
   1115671 ±  9%     +22.0%    1361253 ± 12%  interrupts.CPU79.CAL:Function_call_interrupts
      0.33 ±141%   +2600.0%       9.00 ± 74%  interrupts.CPU79.IWI:IRQ_work_interrupts
   1998129            -4.2%    1913218 ±  2%  interrupts.CPU79.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU79.MCP:Machine_check_polls
      3823 ± 34%     +52.0%       5811 ± 36%  interrupts.CPU79.NMI:Non-maskable_interrupts
      3823 ± 34%     +52.0%       5811 ± 36%  interrupts.CPU79.PMI:Performance_monitoring_interrupts
    838.33 ±  5%     +36.8%       1146 ± 18%  interrupts.CPU79.RES:Rescheduling_interrupts
   1432491 ±  9%     +24.9%    1788814 ± 12%  interrupts.CPU79.TLB:TLB_shootdowns
      0.67 ± 70%     -50.0%       0.33 ±141%  interrupts.CPU8.127:PCI-MSI.31981660-edge.i40e-eth0-TxRx-91
      4.67 ± 40%     -64.3%       1.67 ±101%  interrupts.CPU8.44:PCI-MSI.31981577-edge.i40e-eth0-TxRx-8
      0.00       +6.7e+101%       0.67 ± 70%  interrupts.CPU8.79:PCI-MSI.31981612-edge.i40e-eth0-TxRx-43
   1692194 ±  4%      -7.5%    1564685 ± 16%  interrupts.CPU8.CAL:Function_call_interrupts
     10.67 ± 50%      -9.4%       9.67 ± 50%  interrupts.CPU8.IWI:IRQ_work_interrupts
   1990830            -5.6%    1880106 ±  3%  interrupts.CPU8.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU8.MCP:Machine_check_polls
      7184 ± 11%     -16.9%       5967 ± 22%  interrupts.CPU8.NMI:Non-maskable_interrupts
      7184 ± 11%     -16.9%       5967 ± 22%  interrupts.CPU8.PMI:Performance_monitoring_interrupts
      1191 ±  3%     +14.2%       1361 ±  8%  interrupts.CPU8.RES:Rescheduling_interrupts
   2178171 ±  4%      -5.2%    2064613 ± 16%  interrupts.CPU8.TLB:TLB_shootdowns
      0.67 ± 70%   +5800.0%      39.33 ±136%  interrupts.CPU80.116:PCI-MSI.31981649-edge.i40e-eth0-TxRx-80
   1466419 ±  9%     -12.9%    1277068 ±  6%  interrupts.CPU80.CAL:Function_call_interrupts
      0.33 ±141%   +1900.0%       6.67 ± 99%  interrupts.CPU80.IWI:IRQ_work_interrupts
   1995234            -3.8%    1919686 ±  2%  interrupts.CPU80.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU80.MCP:Machine_check_polls
      3819 ± 35%     +32.4%       5054 ± 43%  interrupts.CPU80.NMI:Non-maskable_interrupts
      3819 ± 35%     +32.4%       5054 ± 43%  interrupts.CPU80.PMI:Performance_monitoring_interrupts
    963.33 ±  7%      +6.9%       1030 ± 25%  interrupts.CPU80.RES:Rescheduling_interrupts
   1884158 ±  9%     -10.7%    1682683 ±  6%  interrupts.CPU80.TLB:TLB_shootdowns
     48.00 ±139%    -100.0%       0.00        interrupts.CPU81.117:PCI-MSI.31981650-edge.i40e-eth0-TxRx-81
   1522480 ±  5%      -6.1%    1429709 ± 11%  interrupts.CPU81.CAL:Function_call_interrupts
      9.00 ± 72%     -33.3%       6.00 ± 98%  interrupts.CPU81.IWI:IRQ_work_interrupts
   1990965            -4.6%    1898917 ±  3%  interrupts.CPU81.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU81.MCP:Machine_check_polls
      5734 ± 35%      -1.7%       5634 ± 36%  interrupts.CPU81.NMI:Non-maskable_interrupts
      5734 ± 35%      -1.7%       5634 ± 36%  interrupts.CPU81.PMI:Performance_monitoring_interrupts
      1125 ±  7%      -8.9%       1025 ±  6%  interrupts.CPU81.RES:Rescheduling_interrupts
   1951989 ±  5%      -3.6%    1881563 ± 11%  interrupts.CPU81.TLB:TLB_shootdowns
      6.33 ±119%    +210.5%      19.67 ±141%  interrupts.CPU82.118:PCI-MSI.31981651-edge.i40e-eth0-TxRx-82
   1583902 ± 12%     -17.0%    1314628 ± 11%  interrupts.CPU82.CAL:Function_call_interrupts
     11.67 ± 46%     -14.3%      10.00 ± 71%  interrupts.CPU82.IWI:IRQ_work_interrupts
   1995233            -4.1%    1913521 ±  2%  interrupts.CPU82.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU82.MCP:Machine_check_polls
      6003 ± 40%      +2.4%       6147 ± 37%  interrupts.CPU82.NMI:Non-maskable_interrupts
      6003 ± 40%      +2.4%       6147 ± 37%  interrupts.CPU82.PMI:Performance_monitoring_interrupts
      1139 ± 10%     -17.9%     935.00 ± 12%  interrupts.CPU82.RES:Rescheduling_interrupts
   2032459 ± 12%     -15.0%    1727431 ± 11%  interrupts.CPU82.TLB:TLB_shootdowns
      1.00 ±141%    +300.0%       4.00 ± 93%  interrupts.CPU83.119:PCI-MSI.31981652-edge.i40e-eth0-TxRx-83
   1470273 ±  3%     -25.5%    1095804 ± 13%  interrupts.CPU83.CAL:Function_call_interrupts
      4.33 ±141%      +0.0%       4.33 ±125%  interrupts.CPU83.IWI:IRQ_work_interrupts
   1993907            -3.1%    1932309 ±  2%  interrupts.CPU83.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU83.MCP:Machine_check_polls
      4452 ± 45%      +1.1%       4500 ± 34%  interrupts.CPU83.NMI:Non-maskable_interrupts
      4452 ± 45%      +1.1%       4500 ± 34%  interrupts.CPU83.PMI:Performance_monitoring_interrupts
      1081 ± 11%     -15.4%     915.33 ± 22%  interrupts.CPU83.RES:Rescheduling_interrupts
   1882092 ±  4%     -23.6%    1437424 ± 13%  interrupts.CPU83.TLB:TLB_shootdowns
      2655 ±141%     -99.9%       2.67 ±115%  interrupts.CPU84.120:PCI-MSI.31981653-edge.i40e-eth0-TxRx-84
   1366827 ± 23%     +23.1%    1682339 ±  4%  interrupts.CPU84.CAL:Function_call_interrupts
      6.00 ±108%     -61.1%       2.33 ±112%  interrupts.CPU84.IWI:IRQ_work_interrupts
   1995590            -5.1%    1893737 ±  3%  interrupts.CPU84.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU84.MCP:Machine_check_polls
      3874 ± 70%      +5.7%       4095 ± 36%  interrupts.CPU84.NMI:Non-maskable_interrupts
      3874 ± 70%      +5.7%       4095 ± 36%  interrupts.CPU84.PMI:Performance_monitoring_interrupts
    991.33 ± 15%     +21.4%       1203 ± 13%  interrupts.CPU84.RES:Rescheduling_interrupts
   1753368 ± 23%     +26.2%    2212594 ±  4%  interrupts.CPU84.TLB:TLB_shootdowns
      3.67 ±122%   +2618.2%      99.67 ±133%  interrupts.CPU85.121:PCI-MSI.31981654-edge.i40e-eth0-TxRx-85
   1421551 ± 27%      +4.8%    1489842 ± 11%  interrupts.CPU85.CAL:Function_call_interrupts
      7.00 ± 92%    +109.5%      14.67 ± 12%  interrupts.CPU85.IWI:IRQ_work_interrupts
   1997326            -4.3%    1911432 ±  3%  interrupts.CPU85.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU85.MCP:Machine_check_polls
      5916 ± 24%     +24.8%       7385 ±  7%  interrupts.CPU85.NMI:Non-maskable_interrupts
      5916 ± 24%     +24.8%       7385 ±  7%  interrupts.CPU85.PMI:Performance_monitoring_interrupts
      1042 ± 19%      -0.9%       1032 ± 16%  interrupts.CPU85.RES:Rescheduling_interrupts
   1823928 ± 27%      +7.6%    1961658 ± 11%  interrupts.CPU85.TLB:TLB_shootdowns
      0.67 ±141%   +7150.0%      48.33 ±128%  interrupts.CPU86.122:PCI-MSI.31981655-edge.i40e-eth0-TxRx-86
   1649788 ± 22%     -14.1%    1416926 ±  7%  interrupts.CPU86.CAL:Function_call_interrupts
      7.67 ± 79%      -4.3%       7.33 ± 89%  interrupts.CPU86.IWI:IRQ_work_interrupts
   1993103            -4.2%    1908908 ±  3%  interrupts.CPU86.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU86.MCP:Machine_check_polls
      5487 ± 34%      -6.9%       5105 ± 39%  interrupts.CPU86.NMI:Non-maskable_interrupts
      5487 ± 34%      -6.9%       5105 ± 39%  interrupts.CPU86.PMI:Performance_monitoring_interrupts
      1100 ± 24%      -7.2%       1020 ± 13%  interrupts.CPU86.RES:Rescheduling_interrupts
   2119077 ± 22%     -12.1%    1863687 ±  7%  interrupts.CPU86.TLB:TLB_shootdowns
      0.67 ±141%  +1.1e+05%     705.33 ±140%  interrupts.CPU87.123:PCI-MSI.31981656-edge.i40e-eth0-TxRx-87
   1543288 ± 12%     -24.6%    1162893 ±  7%  interrupts.CPU87.CAL:Function_call_interrupts
      8.33 ± 73%     +28.0%      10.67 ± 30%  interrupts.CPU87.IWI:IRQ_work_interrupts
   1995446            -4.0%    1914999 ±  3%  interrupts.CPU87.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU87.MCP:Machine_check_polls
      6320 ± 16%      +0.3%       6342 ± 13%  interrupts.CPU87.NMI:Non-maskable_interrupts
      6320 ± 16%      +0.3%       6342 ± 13%  interrupts.CPU87.PMI:Performance_monitoring_interrupts
      1047 ± 10%     -17.0%     868.67 ± 15%  interrupts.CPU87.RES:Rescheduling_interrupts
   1981925 ± 12%     -22.8%    1529267 ±  7%  interrupts.CPU87.TLB:TLB_shootdowns
     95.67 ±141%     -97.6%       2.33 ± 72%  interrupts.CPU88.124:PCI-MSI.31981657-edge.i40e-eth0-TxRx-88
   1624770 ± 12%     -15.2%    1377338 ± 20%  interrupts.CPU88.CAL:Function_call_interrupts
      7.00 ± 95%      +9.5%       7.67 ± 85%  interrupts.CPU88.IWI:IRQ_work_interrupts
   1995347            -3.9%    1916975 ±  2%  interrupts.CPU88.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU88.MCP:Machine_check_polls
      4523 ± 57%      +6.7%       4824 ± 44%  interrupts.CPU88.NMI:Non-maskable_interrupts
      4523 ± 57%      +6.7%       4824 ± 44%  interrupts.CPU88.PMI:Performance_monitoring_interrupts
      1083 ± 10%      +3.3%       1119 ± 24%  interrupts.CPU88.RES:Rescheduling_interrupts
   2087318 ± 12%     -13.3%    1809967 ± 20%  interrupts.CPU88.TLB:TLB_shootdowns
      6.00 ±129%     -61.1%       2.33 ± 72%  interrupts.CPU89.125:PCI-MSI.31981658-edge.i40e-eth0-TxRx-89
   1481606 ± 22%      -7.1%    1376917 ± 19%  interrupts.CPU89.CAL:Function_call_interrupts
      3.00 ±118%     -88.9%       0.33 ±141%  interrupts.CPU89.IWI:IRQ_work_interrupts
   1998901            -4.6%    1906160 ±  3%  interrupts.CPU89.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU89.MCP:Machine_check_polls
      4186 ± 27%     -28.2%       3006 ±  7%  interrupts.CPU89.NMI:Non-maskable_interrupts
      4186 ± 27%     -28.2%       3006 ±  7%  interrupts.CPU89.PMI:Performance_monitoring_interrupts
      1020 ±  7%      +7.4%       1095 ± 24%  interrupts.CPU89.RES:Rescheduling_interrupts
   1899438 ± 22%      -4.8%    1807856 ± 19%  interrupts.CPU89.TLB:TLB_shootdowns
      0.67 ± 70%      +0.0%       0.67 ± 70%  interrupts.CPU9.128:PCI-MSI.31981661-edge.i40e-eth0-TxRx-92
      2.33 ±141%     +42.9%       3.33 ±141%  interrupts.CPU9.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9
      0.33 ±141%    -100.0%       0.00        interrupts.CPU9.80:PCI-MSI.31981613-edge.i40e-eth0-TxRx-44
   1521854 ± 16%     -15.0%    1293417 ± 16%  interrupts.CPU9.CAL:Function_call_interrupts
     13.00 ± 27%     -23.1%      10.00 ± 71%  interrupts.CPU9.IWI:IRQ_work_interrupts
   1995275            -4.0%    1915569 ±  2%  interrupts.CPU9.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU9.MCP:Machine_check_polls
      6492 ± 28%      -5.6%       6128 ± 37%  interrupts.CPU9.NMI:Non-maskable_interrupts
      6492 ± 28%      -5.6%       6128 ± 37%  interrupts.CPU9.PMI:Performance_monitoring_interrupts
      1165 ±  8%      +4.5%       1218 ± 24%  interrupts.CPU9.RES:Rescheduling_interrupts
   1958387 ± 17%     -12.6%    1711409 ± 16%  interrupts.CPU9.TLB:TLB_shootdowns
      6.67 ±141%     -95.0%       0.33 ±141%  interrupts.CPU90.126:PCI-MSI.31981659-edge.i40e-eth0-TxRx-90
   1419100 ±  6%      +3.9%    1474450 ± 16%  interrupts.CPU90.CAL:Function_call_interrupts
      2.67 ±115%    +275.0%      10.00 ± 70%  interrupts.CPU90.IWI:IRQ_work_interrupts
   1994124            -4.7%    1900006 ±  3%  interrupts.CPU90.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU90.MCP:Machine_check_polls
      5082 ± 33%     +20.1%       6105 ± 37%  interrupts.CPU90.NMI:Non-maskable_interrupts
      5082 ± 33%     +20.1%       6105 ± 37%  interrupts.CPU90.PMI:Performance_monitoring_interrupts
      1020 ±  2%      +4.3%       1064 ± 14%  interrupts.CPU90.RES:Rescheduling_interrupts
   1823165 ±  6%      +6.4%    1940759 ± 16%  interrupts.CPU90.TLB:TLB_shootdowns
      1.33 ± 93%      +0.0%       1.33 ±141%  interrupts.CPU91.127:PCI-MSI.31981660-edge.i40e-eth0-TxRx-91
   1508920 ± 12%      -4.9%    1434710 ±  4%  interrupts.CPU91.CAL:Function_call_interrupts
      6.33 ±109%      +5.3%       6.67 ± 74%  interrupts.CPU91.IWI:IRQ_work_interrupts
   1995137            -4.3%    1909670 ±  2%  interrupts.CPU91.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU91.MCP:Machine_check_polls
      5776 ± 36%     -23.8%       4401 ± 58%  interrupts.CPU91.NMI:Non-maskable_interrupts
      5776 ± 36%     -23.8%       4401 ± 58%  interrupts.CPU91.PMI:Performance_monitoring_interrupts
      1063 ±  7%      -1.8%       1044 ± 21%  interrupts.CPU91.RES:Rescheduling_interrupts
   1937394 ± 12%      -2.6%    1887820 ±  4%  interrupts.CPU91.TLB:TLB_shootdowns
      2.00 ±108%     +33.3%       2.67 ±141%  interrupts.CPU92.128:PCI-MSI.31981661-edge.i40e-eth0-TxRx-92
   1309595 ± 19%      -3.8%    1259916 ±  9%  interrupts.CPU92.CAL:Function_call_interrupts
      9.00 ± 32%     -37.0%       5.67 ±104%  interrupts.CPU92.IWI:IRQ_work_interrupts
   1993503            -3.6%    1921571 ±  2%  interrupts.CPU92.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU92.MCP:Machine_check_polls
      5514 ± 31%     -17.4%       4555 ± 38%  interrupts.CPU92.NMI:Non-maskable_interrupts
      5514 ± 31%     -17.4%       4555 ± 38%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
    983.67 ±  6%      +1.8%       1001 ± 22%  interrupts.CPU92.RES:Rescheduling_interrupts
   1679709 ± 19%      -1.5%    1654983 ±  9%  interrupts.CPU92.TLB:TLB_shootdowns
      2.00 ±141%     -16.7%       1.67 ±141%  interrupts.CPU93.129:PCI-MSI.31981662-edge.i40e-eth0-TxRx-93
   1358155 ±  2%      -7.7%    1254119 ± 16%  interrupts.CPU93.CAL:Function_call_interrupts
      4.00 ± 73%    +108.3%       8.33 ± 74%  interrupts.CPU93.IWI:IRQ_work_interrupts
   1996033            -3.8%    1920095 ±  3%  interrupts.CPU93.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU93.MCP:Machine_check_polls
      4559 ± 32%     +20.3%       5485 ± 36%  interrupts.CPU93.NMI:Non-maskable_interrupts
      4559 ± 32%     +20.3%       5485 ± 36%  interrupts.CPU93.PMI:Performance_monitoring_interrupts
    995.67 ± 12%      -6.4%     932.00 ± 17%  interrupts.CPU93.RES:Rescheduling_interrupts
   1741282 ±  2%      -5.3%    1648816 ± 16%  interrupts.CPU93.TLB:TLB_shootdowns
   1273916 ± 17%      +0.7%    1282571 ± 10%  interrupts.CPU94.CAL:Function_call_interrupts
      6.67 ±101%     -25.0%       5.00 ±141%  interrupts.CPU94.IWI:IRQ_work_interrupts
   1998510            -3.9%    1920039 ±  2%  interrupts.CPU94.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU94.MCP:Machine_check_polls
      4580 ± 56%     -10.2%       4112 ± 64%  interrupts.CPU94.NMI:Non-maskable_interrupts
      4580 ± 56%     -10.2%       4112 ± 64%  interrupts.CPU94.PMI:Performance_monitoring_interrupts
    932.33 ± 12%      +3.2%     962.00 ± 23%  interrupts.CPU94.RES:Rescheduling_interrupts
   1634267 ± 17%      +3.2%    1685930 ±  9%  interrupts.CPU94.TLB:TLB_shootdowns
   1293402 ±  5%      +0.4%    1298616 ± 13%  interrupts.CPU95.CAL:Function_call_interrupts
      8.33 ± 63%     -68.0%       2.67 ±115%  interrupts.CPU95.IWI:IRQ_work_interrupts
   2000316            -4.5%    1910356 ±  3%  interrupts.CPU95.LOC:Local_timer_interrupts
      3.00            +0.0%       3.00        interrupts.CPU95.MCP:Machine_check_polls
      6121 ± 29%     -40.8%       3623 ±  3%  interrupts.CPU95.NMI:Non-maskable_interrupts
      6121 ± 29%     -40.8%       3623 ±  3%  interrupts.CPU95.PMI:Performance_monitoring_interrupts
      1042 ± 14%     +10.3%       1149 ± 22%  interrupts.CPU95.RES:Rescheduling_interrupts
   1658511 ±  5%      +3.2%    1711315 ± 13%  interrupts.CPU95.TLB:TLB_shootdowns
    707.00 ±  5%      -4.1%     678.33 ±  2%  interrupts.IWI:IRQ_work_interrupts
 1.912e+08            -4.8%  1.821e+08 ±  3%  interrupts.LOC:Local_timer_interrupts
    288.00            +0.0%     288.00        interrupts.MCP:Machine_check_polls
    526867 ± 13%      -8.8%     480494 ±  2%  interrupts.NMI:Non-maskable_interrupts
    526867 ± 13%      -8.8%     480494 ±  2%  interrupts.PMI:Performance_monitoring_interrupts
    106938 ±  5%      +8.8%     116314 ± 13%  interrupts.RES:Rescheduling_interrupts
      0.00          -100.0%       0.00        interrupts.RTR:APIC_ICR_read_retries
 1.907e+08 ±  2%      +0.2%   1.91e+08        interrupts.TLB:TLB_shootdowns

Best Regards,
Rong Chen

[PATCH v19 19/20] mm/lru: introduce the relock_page_lruvec function

[Alex Shi]

From: Alexander Duyck <alexander.h.duyck@linux.intel.com>

Use this new function to replace repeated same code, no func change.

When testing for relock we can avoid the need for RCU locking if we simply
compare the page pgdat and memcg pointers versus those that the lruvec is
holding. By doing this we can avoid the extra pointer walks and accesses of
the memory cgroup.

In addition we can avoid the checks entirely if lruvec is currently NULL.

Signed-off-by: Alexander Duyck <alexander.h.duyck@linux.intel.com>
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Acked-by: Hugh Dickins <hughd@google.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Thomas Gleixner <tglx@linutronix.de>
Cc: Andrey Ryabinin <aryabinin@virtuozzo.com>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Mel Gorman <mgorman@techsingularity.net>
Cc: Konstantin Khlebnikov <khlebnikov@yandex-team.ru>
Cc: Hugh Dickins <hughd@google.com>
Cc: Tejun Heo <tj@kernel.org>
Cc: linux-kernel@vger.kernel.org
Cc: cgroups@vger.kernel.org
Cc: linux-mm@kvack.org
---
 include/linux/memcontrol.h | 52 ++++++++++++++++++++++++++++++++++++++++++++++
 mm/mlock.c                 | 11 +---------
 mm/swap.c                  | 33 +++++++----------------------
 mm/vmscan.c                | 12 ++---------
 4 files changed, 62 insertions(+), 46 deletions(-)

diff --git a/include/linux/memcontrol.h b/include/linux/memcontrol.h
index 7b170e9028b5..bd8fdeccf6b5 100644
--- a/include/linux/memcontrol.h
+++ b/include/linux/memcontrol.h
@@ -488,6 +488,22 @@ static inline struct lruvec *mem_cgroup_lruvec(struct mem_cgroup *memcg,
 
 struct lruvec *mem_cgroup_page_lruvec(struct page *, struct pglist_data *);
 
+static inline bool lruvec_holds_page_lru_lock(struct page *page,
+					      struct lruvec *lruvec)
+{
+	pg_data_t *pgdat = page_pgdat(page);
+	const struct mem_cgroup *memcg;
+	struct mem_cgroup_per_node *mz;
+
+	if (mem_cgroup_disabled())
+		return lruvec == &pgdat->__lruvec;
+
+	mz = container_of(lruvec, struct mem_cgroup_per_node, lruvec);
+	memcg = page->mem_cgroup ? : root_mem_cgroup;
+
+	return lruvec->pgdat == pgdat && mz->memcg == memcg;
+}
+
 struct mem_cgroup *mem_cgroup_from_task(struct task_struct *p);
 
 struct mem_cgroup *get_mem_cgroup_from_mm(struct mm_struct *mm);
@@ -1023,6 +1039,14 @@ static inline struct lruvec *mem_cgroup_page_lruvec(struct page *page,
 	return &pgdat->__lruvec;
 }
 
+static inline bool lruvec_holds_page_lru_lock(struct page *page,
+					      struct lruvec *lruvec)
+{
+	pg_data_t *pgdat = page_pgdat(page);
+
+	return lruvec == &pgdat->__lruvec;
+}
+
 static inline struct mem_cgroup *parent_mem_cgroup(struct mem_cgroup *memcg)
 {
 	return NULL;
@@ -1469,6 +1493,34 @@ static inline void unlock_page_lruvec_irqrestore(struct lruvec *lruvec,
 	spin_unlock_irqrestore(&lruvec->lru_lock, flags);
 }
 
+/* Don't lock again iff page's lruvec locked */
+static inline struct lruvec *relock_page_lruvec_irq(struct page *page,
+		struct lruvec *locked_lruvec)
+{
+	if (locked_lruvec) {
+		if (lruvec_holds_page_lru_lock(page, locked_lruvec))
+			return locked_lruvec;
+
+		unlock_page_lruvec_irq(locked_lruvec);
+	}
+
+	return lock_page_lruvec_irq(page);
+}
+
+/* Don't lock again iff page's lruvec locked */
+static inline struct lruvec *relock_page_lruvec_irqsave(struct page *page,
+		struct lruvec *locked_lruvec, unsigned long *flags)
+{
+	if (locked_lruvec) {
+		if (lruvec_holds_page_lru_lock(page, locked_lruvec))
+			return locked_lruvec;
+
+		unlock_page_lruvec_irqrestore(locked_lruvec, *flags);
+	}
+
+	return lock_page_lruvec_irqsave(page, flags);
+}
+
 #ifdef CONFIG_CGROUP_WRITEBACK
 
 struct wb_domain *mem_cgroup_wb_domain(struct bdi_writeback *wb);
diff --git a/mm/mlock.c b/mm/mlock.c
index ab164a675c25..55b3b3672977 100644
--- a/mm/mlock.c
+++ b/mm/mlock.c
@@ -277,16 +277,7 @@ static void __munlock_pagevec(struct pagevec *pvec, struct zone *zone)
 			 * so we can spare the get_page() here.
 			 */
 			if (TestClearPageLRU(page)) {
-				struct lruvec *new_lruvec;
-
-				new_lruvec = mem_cgroup_page_lruvec(page,
-						page_pgdat(page));
-				if (new_lruvec != lruvec) {
-					if (lruvec)
-						unlock_page_lruvec_irq(lruvec);
-					lruvec = lock_page_lruvec_irq(page);
-				}
-
+				lruvec = relock_page_lruvec_irq(page, lruvec);
 				del_page_from_lru_list(page, lruvec,
 							page_lru(page));
 				continue;
diff --git a/mm/swap.c b/mm/swap.c
index 622218bd18e5..375fb2e0683a 100644
--- a/mm/swap.c
+++ b/mm/swap.c
@@ -210,19 +210,12 @@ static void pagevec_lru_move_fn(struct pagevec *pvec,
 
 	for (i = 0; i < pagevec_count(pvec); i++) {
 		struct page *page = pvec->pages[i];
-		struct lruvec *new_lruvec;
 
 		/* block memcg migration during page moving between lru */
 		if (!TestClearPageLRU(page))
 			continue;
 
-		new_lruvec = mem_cgroup_page_lruvec(page, page_pgdat(page));
-		if (lruvec != new_lruvec) {
-			if (lruvec)
-				unlock_page_lruvec_irqrestore(lruvec, flags);
-			lruvec = lock_page_lruvec_irqsave(page, &flags);
-		}
-
+		lruvec = relock_page_lruvec_irqsave(page, lruvec, &flags);
 		(*move_fn)(page, lruvec);
 
 		SetPageLRU(page);
@@ -865,17 +858,12 @@ void release_pages(struct page **pages, int nr)
 		}
 
 		if (PageLRU(page)) {
-			struct lruvec *new_lruvec;
-
-			new_lruvec = mem_cgroup_page_lruvec(page,
-							page_pgdat(page));
-			if (new_lruvec != lruvec) {
-				if (lruvec)
-					unlock_page_lruvec_irqrestore(lruvec,
-									flags);
+			struct lruvec *prev_lruvec = lruvec;
+
+			lruvec = relock_page_lruvec_irqsave(page, lruvec,
+									&flags);
+			if (prev_lruvec != lruvec)
 				lock_batch = 0;
-				lruvec = lock_page_lruvec_irqsave(page, &flags);
-			}
 
 			VM_BUG_ON_PAGE(!PageLRU(page), page);
 			__ClearPageLRU(page);
@@ -982,15 +970,8 @@ void __pagevec_lru_add(struct pagevec *pvec)
 
 	for (i = 0; i < pagevec_count(pvec); i++) {
 		struct page *page = pvec->pages[i];
-		struct lruvec *new_lruvec;
-
-		new_lruvec = mem_cgroup_page_lruvec(page, page_pgdat(page));
-		if (lruvec != new_lruvec) {
-			if (lruvec)
-				unlock_page_lruvec_irqrestore(lruvec, flags);
-			lruvec = lock_page_lruvec_irqsave(page, &flags);
-		}
 
+		lruvec = relock_page_lruvec_irqsave(page, lruvec, &flags);
 		__pagevec_lru_add_fn(page, lruvec);
 	}
 	if (lruvec)
diff --git a/mm/vmscan.c b/mm/vmscan.c
index d789d098e4dd..68ec8a631242 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -1878,8 +1878,7 @@ static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
 			continue;
 		}
 
-		VM_BUG_ON_PAGE(mem_cgroup_page_lruvec(page, page_pgdat(page))
-							!= lruvec, page);
+		VM_BUG_ON_PAGE(!lruvec_holds_page_lru_lock(page, lruvec), page);
 		lru = page_lru(page);
 		nr_pages = thp_nr_pages(page);
 
@@ -4271,7 +4270,6 @@ void check_move_unevictable_pages(struct pagevec *pvec)
 	for (i = 0; i < pvec->nr; i++) {
 		struct page *page = pvec->pages[i];
 		int nr_pages;
-		struct lruvec *new_lruvec;
 
 		if (PageTransTail(page))
 			continue;
@@ -4283,13 +4281,7 @@ void check_move_unevictable_pages(struct pagevec *pvec)
 		if (!TestClearPageLRU(page))
 			continue;
 
-		new_lruvec = mem_cgroup_page_lruvec(page, page_pgdat(page));
-		if (lruvec != new_lruvec) {
-			if (lruvec)
-				unlock_page_lruvec_irq(lruvec);
-			lruvec = lock_page_lruvec_irq(page);
-		}
-
+		lruvec = relock_page_lruvec_irq(page, lruvec);
 		if (page_evictable(page) && PageUnevictable(page)) {
 			enum lru_list lru = page_lru_base_type(page);
 
-- 
1.8.3.1

[PATCH v19 20/20] mm/lru: revise the comments of lru_lock

[Alex Shi]

From: Hugh Dickins <hughd@google.com>

Since we changed the pgdat->lru_lock to lruvec->lru_lock, it's time to
fix the incorrect comments in code. Also fixed some zone->lru_lock comment
error from ancient time. etc.

I struggled to understand the comment above move_pages_to_lru() (surely
it never calls page_referenced()), and eventually realized that most of
it had got separated from shrink_active_list(): move that comment back.

Signed-off-by: Hugh Dickins <hughd@google.com>
Signed-off-by: Alex Shi <alex.shi@linux.alibaba.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Tejun Heo <tj@kernel.org>
Cc: Andrey Ryabinin <aryabinin@virtuozzo.com>
Cc: Jann Horn <jannh@google.com>
Cc: Mel Gorman <mgorman@techsingularity.net>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Cc: Matthew Wilcox <willy@infradead.org>
Cc: Hugh Dickins <hughd@google.com>
Cc: cgroups@vger.kernel.org
Cc: linux-kernel@vger.kernel.org
Cc: linux-mm@kvack.org
---
 Documentation/admin-guide/cgroup-v1/memcg_test.rst | 15 ++------
 Documentation/admin-guide/cgroup-v1/memory.rst     | 21 +++++------
 Documentation/trace/events-kmem.rst                |  2 +-
 Documentation/vm/unevictable-lru.rst               | 22 +++++-------
 include/linux/mm_types.h                           |  2 +-
 include/linux/mmzone.h                             |  3 +-
 mm/filemap.c                                       |  4 +--
 mm/rmap.c                                          |  4 +--
 mm/vmscan.c                                        | 41 ++++++++++++----------
 9 files changed, 50 insertions(+), 64 deletions(-)

diff --git a/Documentation/admin-guide/cgroup-v1/memcg_test.rst b/Documentation/admin-guide/cgroup-v1/memcg_test.rst
index 3f7115e07b5d..0b9f91589d3d 100644
--- a/Documentation/admin-guide/cgroup-v1/memcg_test.rst
+++ b/Documentation/admin-guide/cgroup-v1/memcg_test.rst
@@ -133,18 +133,9 @@ Under below explanation, we assume CONFIG_MEM_RES_CTRL_SWAP=y.
 
 8. LRU
 ======
-        Each memcg has its own private LRU. Now, its handling is under global
-	VM's control (means that it's handled under global pgdat->lru_lock).
-	Almost all routines around memcg's LRU is called by global LRU's
-	list management functions under pgdat->lru_lock.
-
-	A special function is mem_cgroup_isolate_pages(). This scans
-	memcg's private LRU and call __isolate_lru_page() to extract a page
-	from LRU.
-
-	(By __isolate_lru_page(), the page is removed from both of global and
-	private LRU.)
-
+	Each memcg has its own vector of LRUs (inactive anon, active anon,
+	inactive file, active file, unevictable) of pages from each node,
+	each LRU handled under a single lru_lock for that memcg and node.
 
 9. Typical Tests.
 =================
diff --git a/Documentation/admin-guide/cgroup-v1/memory.rst b/Documentation/admin-guide/cgroup-v1/memory.rst
index 12757e63b26c..24450696579f 100644
--- a/Documentation/admin-guide/cgroup-v1/memory.rst
+++ b/Documentation/admin-guide/cgroup-v1/memory.rst
@@ -285,20 +285,17 @@ When oom event notifier is registered, event will be delivered.
 2.6 Locking
 -----------
 
-   lock_page_cgroup()/unlock_page_cgroup() should not be called under
-   the i_pages lock.
+Lock order is as follows:
 
-   Other lock order is following:
+  Page lock (PG_locked bit of page->flags)
+    mm->page_table_lock or split pte_lock
+      lock_page_memcg (memcg->move_lock)
+        mapping->i_pages lock
+          lruvec->lru_lock.
 
-   PG_locked.
-     mm->page_table_lock
-         pgdat->lru_lock
-	   lock_page_cgroup.
-
-  In many cases, just lock_page_cgroup() is called.
-
-  per-zone-per-cgroup LRU (cgroup's private LRU) is just guarded by
-  pgdat->lru_lock, it has no lock of its own.
+Per-node-per-memcgroup LRU (cgroup's private LRU) is guarded by
+lruvec->lru_lock; PG_lru bit of page->flags is cleared before
+isolating a page from its LRU under lruvec->lru_lock.
 
 2.7 Kernel Memory Extension (CONFIG_MEMCG_KMEM)
 -----------------------------------------------
diff --git a/Documentation/trace/events-kmem.rst b/Documentation/trace/events-kmem.rst
index 555484110e36..68fa75247488 100644
--- a/Documentation/trace/events-kmem.rst
+++ b/Documentation/trace/events-kmem.rst
@@ -69,7 +69,7 @@ When pages are freed in batch, the also mm_page_free_batched is triggered.
 Broadly speaking, pages are taken off the LRU lock in bulk and
 freed in batch with a page list. Significant amounts of activity here could
 indicate that the system is under memory pressure and can also indicate
-contention on the zone->lru_lock.
+contention on the lruvec->lru_lock.
 
 4. Per-CPU Allocator Activity
 =============================
diff --git a/Documentation/vm/unevictable-lru.rst b/Documentation/vm/unevictable-lru.rst
index 17d0861b0f1d..0e1490524f53 100644
--- a/Documentation/vm/unevictable-lru.rst
+++ b/Documentation/vm/unevictable-lru.rst
@@ -33,7 +33,7 @@ reclaim in Linux.  The problems have been observed at customer sites on large
 memory x86_64 systems.
 
 To illustrate this with an example, a non-NUMA x86_64 platform with 128GB of
-main memory will have over 32 million 4k pages in a single zone.  When a large
+main memory will have over 32 million 4k pages in a single node.  When a large
 fraction of these pages are not evictable for any reason [see below], vmscan
 will spend a lot of time scanning the LRU lists looking for the small fraction
 of pages that are evictable.  This can result in a situation where all CPUs are
@@ -55,7 +55,7 @@ unevictable, either by definition or by circumstance, in the future.
 The Unevictable Page List
 -------------------------
 
-The Unevictable LRU infrastructure consists of an additional, per-zone, LRU list
+The Unevictable LRU infrastructure consists of an additional, per-node, LRU list
 called the "unevictable" list and an associated page flag, PG_unevictable, to
 indicate that the page is being managed on the unevictable list.
 
@@ -84,15 +84,9 @@ The unevictable list does not differentiate between file-backed and anonymous,
 swap-backed pages.  This differentiation is only important while the pages are,
 in fact, evictable.
 
-The unevictable list benefits from the "arrayification" of the per-zone LRU
+The unevictable list benefits from the "arrayification" of the per-node LRU
 lists and statistics originally proposed and posted by Christoph Lameter.
 
-The unevictable list does not use the LRU pagevec mechanism. Rather,
-unevictable pages are placed directly on the page's zone's unevictable list
-under the zone lru_lock.  This allows us to prevent the stranding of pages on
-the unevictable list when one task has the page isolated from the LRU and other
-tasks are changing the "evictability" state of the page.
-
 
 Memory Control Group Interaction
 --------------------------------
@@ -101,8 +95,8 @@ The unevictable LRU facility interacts with the memory control group [aka
 memory controller; see Documentation/admin-guide/cgroup-v1/memory.rst] by extending the
 lru_list enum.
 
-The memory controller data structure automatically gets a per-zone unevictable
-list as a result of the "arrayification" of the per-zone LRU lists (one per
+The memory controller data structure automatically gets a per-node unevictable
+list as a result of the "arrayification" of the per-node LRU lists (one per
 lru_list enum element).  The memory controller tracks the movement of pages to
 and from the unevictable list.
 
@@ -196,7 +190,7 @@ for the sake of expediency, to leave a unevictable page on one of the regular
 active/inactive LRU lists for vmscan to deal with.  vmscan checks for such
 pages in all of the shrink_{active|inactive|page}_list() functions and will
 "cull" such pages that it encounters: that is, it diverts those pages to the
-unevictable list for the zone being scanned.
+unevictable list for the node being scanned.
 
 There may be situations where a page is mapped into a VM_LOCKED VMA, but the
 page is not marked as PG_mlocked.  Such pages will make it all the way to
@@ -328,7 +322,7 @@ If the page was NOT already mlocked, mlock_vma_page() attempts to isolate the
 page from the LRU, as it is likely on the appropriate active or inactive list
 at that time.  If the isolate_lru_page() succeeds, mlock_vma_page() will put
 back the page - by calling putback_lru_page() - which will notice that the page
-is now mlocked and divert the page to the zone's unevictable list.  If
+is now mlocked and divert the page to the node's unevictable list.  If
 mlock_vma_page() is unable to isolate the page from the LRU, vmscan will handle
 it later if and when it attempts to reclaim the page.
 
@@ -603,7 +597,7 @@ Some examples of these unevictable pages on the LRU lists are:
      unevictable list in mlock_vma_page().
 
 shrink_inactive_list() also diverts any unevictable pages that it finds on the
-inactive lists to the appropriate zone's unevictable list.
+inactive lists to the appropriate node's unevictable list.
 
 shrink_inactive_list() should only see SHM_LOCK'd pages that became SHM_LOCK'd
 after shrink_active_list() had moved them to the inactive list, or pages mapped
diff --git a/include/linux/mm_types.h b/include/linux/mm_types.h
index 496c3ff97cce..c3f1e76720af 100644
--- a/include/linux/mm_types.h
+++ b/include/linux/mm_types.h
@@ -78,7 +78,7 @@ struct page {
 		struct {	/* Page cache and anonymous pages */
 			/**
 			 * @lru: Pageout list, eg. active_list protected by
-			 * pgdat->lru_lock.  Sometimes used as a generic list
+			 * lruvec->lru_lock.  Sometimes used as a generic list
 			 * by the page owner.
 			 */
 			struct list_head lru;
diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h
index 7727f4c373f7..0ed520954843 100644
--- a/include/linux/mmzone.h
+++ b/include/linux/mmzone.h
@@ -113,8 +113,7 @@ static inline bool free_area_empty(struct free_area *area, int migratetype)
 struct pglist_data;
 
 /*
- * zone->lock and the zone lru_lock are two of the hottest locks in the kernel.
- * So add a wild amount of padding here to ensure that they fall into separate
+ * Add a wild amount of padding here to ensure datas fall into separate
  * cachelines.  There are very few zone structures in the machine, so space
  * consumption is not a concern here.
  */
diff --git a/mm/filemap.c b/mm/filemap.c
index 5202e38ab79e..28ced379849f 100644
--- a/mm/filemap.c
+++ b/mm/filemap.c
@@ -102,8 +102,8 @@
  *    ->swap_lock		(try_to_unmap_one)
  *    ->private_lock		(try_to_unmap_one)
  *    ->i_pages lock		(try_to_unmap_one)
- *    ->pgdat->lru_lock		(follow_page->mark_page_accessed)
- *    ->pgdat->lru_lock		(check_pte_range->isolate_lru_page)
+ *    ->lruvec->lru_lock	(follow_page->mark_page_accessed)
+ *    ->lruvec->lru_lock	(check_pte_range->isolate_lru_page)
  *    ->private_lock		(page_remove_rmap->set_page_dirty)
  *    ->i_pages lock		(page_remove_rmap->set_page_dirty)
  *    bdi.wb->list_lock		(page_remove_rmap->set_page_dirty)
diff --git a/mm/rmap.c b/mm/rmap.c
index 9425260774a1..46cc5a959790 100644
--- a/mm/rmap.c
+++ b/mm/rmap.c
@@ -28,12 +28,12 @@
  *           hugetlb_fault_mutex (hugetlbfs specific page fault mutex)
  *           anon_vma->rwsem
  *             mm->page_table_lock or pte_lock
- *               pgdat->lru_lock (in mark_page_accessed, isolate_lru_page)
  *               swap_lock (in swap_duplicate, swap_info_get)
  *                 mmlist_lock (in mmput, drain_mmlist and others)
  *                 mapping->private_lock (in __set_page_dirty_buffers)
- *                   mem_cgroup_{begin,end}_page_stat (memcg->move_lock)
+ *                   lock_page_memcg move_lock (in __set_page_dirty_buffers)
  *                     i_pages lock (widely used)
+ *                       lruvec->lru_lock (in lock_page_lruvec_irq)
  *                 inode->i_lock (in set_page_dirty's __mark_inode_dirty)
  *                 bdi.wb->list_lock (in set_page_dirty's __mark_inode_dirty)
  *                   sb_lock (within inode_lock in fs/fs-writeback.c)
diff --git a/mm/vmscan.c b/mm/vmscan.c
index 68ec8a631242..550d21d9369d 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -1612,14 +1612,16 @@ static __always_inline void update_lru_sizes(struct lruvec *lruvec,
 }
 
 /**
- * pgdat->lru_lock is heavily contended.  Some of the functions that
+ * Isolating page from the lruvec to fill in @dst list by nr_to_scan times.
+ *
+ * lruvec->lru_lock is heavily contended.  Some of the functions that
  * shrink the lists perform better by taking out a batch of pages
  * and working on them outside the LRU lock.
  *
  * For pagecache intensive workloads, this function is the hottest
  * spot in the kernel (apart from copy_*_user functions).
  *
- * Appropriate locks must be held before calling this function.
+ * Lru_lock must be held before calling this function.
  *
  * @nr_to_scan:	The number of eligible pages to look through on the list.
  * @lruvec:	The LRU vector to pull pages from.
@@ -1813,25 +1815,11 @@ static int too_many_isolated(struct pglist_data *pgdat, int file,
 }
 
 /*
- * This moves pages from @list to corresponding LRU list.
- *
- * We move them the other way if the page is referenced by one or more
- * processes, from rmap.
- *
- * If the pages are mostly unmapped, the processing is fast and it is
- * appropriate to hold zone_lru_lock across the whole operation.  But if
- * the pages are mapped, the processing is slow (page_referenced()) so we
- * should drop zone_lru_lock around each page.  It's impossible to balance
- * this, so instead we remove the pages from the LRU while processing them.
- * It is safe to rely on PG_active against the non-LRU pages in here because
- * nobody will play with that bit on a non-LRU page.
- *
- * The downside is that we have to touch page->_refcount against each page.
- * But we had to alter page->flags anyway.
+ * move_pages_to_lru() moves pages from private @list to appropriate LRU list.
+ * On return, @list is reused as a list of pages to be freed by the caller.
  *
  * Returns the number of pages moved to the given lruvec.
  */
-
 static unsigned noinline_for_stack move_pages_to_lru(struct lruvec *lruvec,
 						     struct list_head *list)
 {
@@ -2006,6 +1994,23 @@ static int current_may_throttle(void)
 	return nr_reclaimed;
 }
 
+/*
+ * shrink_active_list() moves pages from the active LRU to the inactive LRU.
+ *
+ * We move them the other way if the page is referenced by one or more
+ * processes.
+ *
+ * If the pages are mostly unmapped, the processing is fast and it is
+ * appropriate to hold lru_lock across the whole operation.  But if
+ * the pages are mapped, the processing is slow (page_referenced()), so
+ * we should drop lru_lock around each page.  It's impossible to balance
+ * this, so instead we remove the pages from the LRU while processing them.
+ * It is safe to rely on PG_active against the non-LRU pages in here because
+ * nobody will play with that bit on a non-LRU page.
+ *
+ * The downside is that we have to touch page->_refcount against each page.
+ * But we had to alter page->flags anyway.
+ */
 static void shrink_active_list(unsigned long nr_to_scan,
 			       struct lruvec *lruvec,
 			       struct scan_control *sc,
-- 
1.8.3.1

Re: [PATCH v19 00/20] per memcg lru_lock

[Daniel Jordan]

On Thu, Sep 24, 2020 at 11:28:15AM +0800, Alex Shi wrote:
> The new version rebased on v5.9-rc6 with line by line review by Hugh Dickins.

These thpscale numbers are from a proto-v19, which now seems to be gone from
Alex Shi's github.  Once again, this is a regression test where memcg is
enabled but not used.  There's a reasonable amount of isolations from
compaction as expected, as well as reclaim to a lesser extent.

I confined the runs to one node of a two-socket broadwell server, the same
machine as my other results.  thpscale's total_size argument is about 80% of
the node's memory, its madvise option was enabled, and the system's thp
settings are enabled=always and defrag=madvise.

Both base and lru kernels show huge variance run to run, which is surprising
because I was expecting a microbenchmark like this to be more stable.  There
seems to be an overall decrease in mean fault latency with the lru changes, but
it's in the noise, so it's hard to say how much of an improvement it really is.

I only ran up to four threads so these would be ready before I left.  I'll be
away for a few days.


thpscale Fault Latencies
                                          thp                    thp                    thp                    thp
                                        base1                  base2                   lru1                   lru2
Min       fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Min       fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Min       fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Min       fault-huge-1      214.00 (   0.00%)      227.00 (  -6.07%)      235.00 (  -9.81%)      240.00 ( -12.15%)
Min       fault-huge-3      321.00 (   0.00%)      366.00 ( -14.02%)      323.00 (  -0.62%)      407.00 ( -26.79%)
Min       fault-huge-4      441.00 (   0.00%)      401.00 (   9.07%)      525.00 ( -19.05%)      434.00 (   1.59%)
Min       fault-both-1      214.00 (   0.00%)      227.00 (  -6.07%)      235.00 (  -9.81%)      240.00 ( -12.15%)
Min       fault-both-3      321.00 (   0.00%)      366.00 ( -14.02%)      323.00 (  -0.62%)      407.00 ( -26.79%)
Min       fault-both-4      441.00 (   0.00%)      401.00 (   9.07%)      525.00 ( -19.05%)      434.00 (   1.59%)
Amean     fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Amean     fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Amean     fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Amean     fault-huge-1     1549.55 (   0.00%)     1667.13 *  -7.59%*     1361.50 *  12.14%*     1458.10 *   5.90%*
Amean     fault-huge-3     2582.29 (   0.00%)     2556.45 (   1.00%)     2756.65 *  -6.75%*     2157.29 *  16.46%*
Amean     fault-huge-4     2352.21 (   0.00%)     2709.37 * -15.18%*     2323.89 (   1.20%)     1888.94 *  19.69%*
Amean     fault-both-1     1549.55 (   0.00%)     1667.13 *  -7.59%*     1361.50 *  12.14%*     1458.10 *   5.90%*
Amean     fault-both-3     2582.29 (   0.00%)     2556.45 (   1.00%)     2756.65 *  -6.75%*     2157.29 *  16.46%*
Amean     fault-both-4     2352.21 (   0.00%)     2709.37 * -15.18%*     2323.89 (   1.20%)     1888.94 *  19.69%*
Stddev    fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Stddev    fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Stddev    fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Stddev    fault-huge-1     2011.48 (   0.00%)     3765.64 ( -87.21%)     3061.45 ( -52.20%)     1758.56 (  12.57%)
Stddev    fault-huge-3    11153.49 (   0.00%)     8339.83 (  25.23%)     7017.28 (  37.08%)     3976.86 (  64.34%)
Stddev    fault-huge-4     8817.67 (   0.00%)    16241.48 ( -84.19%)    11595.28 ( -31.50%)     6631.47 (  24.79%)
Stddev    fault-both-1     2011.48 (   0.00%)     3765.64 ( -87.21%)     3061.45 ( -52.20%)     1758.56 (  12.57%)
Stddev    fault-both-3    11153.49 (   0.00%)     8339.83 (  25.23%)     7017.28 (  37.08%)     3976.86 (  64.34%)
Stddev    fault-both-4     8817.67 (   0.00%)    16241.48 ( -84.19%)    11595.28 ( -31.50%)     6631.47 (  24.79%)
CoeffVar  fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
CoeffVar  fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
CoeffVar  fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
CoeffVar  fault-huge-1      129.81 (   0.00%)      225.88 ( -74.00%)      224.86 ( -73.22%)      120.61 (   7.09%)
CoeffVar  fault-huge-3      431.92 (   0.00%)      326.23 (  24.47%)      254.56 (  41.06%)      184.35 (  57.32%)
CoeffVar  fault-huge-4      374.87 (   0.00%)      599.46 ( -59.91%)      498.96 ( -33.10%)      351.07 (   6.35%)
CoeffVar  fault-both-1      129.81 (   0.00%)      225.88 ( -74.00%)      224.86 ( -73.22%)      120.61 (   7.09%)
CoeffVar  fault-both-3      431.92 (   0.00%)      326.23 (  24.47%)      254.56 (  41.06%)      184.35 (  57.32%)
CoeffVar  fault-both-4      374.87 (   0.00%)      599.46 ( -59.91%)      498.96 ( -33.10%)      351.07 (   6.35%)
Max       fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Max       fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Max       fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
Max       fault-huge-1    90549.00 (   0.00%)   166062.00 ( -83.39%)   134242.00 ( -48.25%)    82424.00 (   8.97%)
Max       fault-huge-3  1229237.00 (   0.00%)   392796.00 (  68.05%)   508290.00 (  58.65%)   433992.00 (  64.69%)
Max       fault-huge-4   418414.00 (   0.00%)  1147308.00 (-174.20%)   792153.00 ( -89.32%)   433393.00 (  -3.58%)
Max       fault-both-1    90549.00 (   0.00%)   166062.00 ( -83.39%)   134242.00 ( -48.25%)    82424.00 (   8.97%)
Max       fault-both-3  1229237.00 (   0.00%)   392796.00 (  68.05%)   508290.00 (  58.65%)   433992.00 (  64.69%)
Max       fault-both-4   418414.00 (   0.00%)  1147308.00 (-174.20%)   792153.00 ( -89.32%)   433393.00 (  -3.58%)
BAmean-50 fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
BAmean-50 fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
BAmean-50 fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
BAmean-50 fault-huge-1     1329.84 (   0.00%)     1086.23 (  18.32%)      765.68 (  42.42%)     1238.41 (   6.88%)
BAmean-50 fault-huge-3     1410.46 (   0.00%)     1406.43 (   0.29%)     1749.95 ( -24.07%)     1362.23 (   3.42%)
BAmean-50 fault-huge-4     1453.01 (   0.00%)     1373.01 (   5.51%)     1268.61 (  12.69%)     1157.08 (  20.37%)
BAmean-50 fault-both-1     1329.84 (   0.00%)     1086.23 (  18.32%)      765.68 (  42.42%)     1238.41 (   6.88%)
BAmean-50 fault-both-3     1410.46 (   0.00%)     1406.43 (   0.29%)     1749.95 ( -24.07%)     1362.23 (   3.42%)
BAmean-50 fault-both-4     1453.01 (   0.00%)     1373.01 (   5.51%)     1268.61 (  12.69%)     1157.08 (  20.37%)
BAmean-95 fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
BAmean-95 fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
BAmean-95 fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
BAmean-95 fault-huge-1     1428.93 (   0.00%)     1336.45 (   6.47%)     1125.72 (  21.22%)     1324.67 (   7.30%)
BAmean-95 fault-huge-3     1881.39 (   0.00%)     1868.23 (   0.70%)     2257.90 ( -20.01%)     1794.46 (   4.62%)
BAmean-95 fault-huge-4     1853.49 (   0.00%)     2038.27 (  -9.97%)     1758.37 (   5.13%)     1522.69 (  17.85%)
BAmean-95 fault-both-1     1428.93 (   0.00%)     1336.45 (   6.47%)     1125.72 (  21.22%)     1324.67 (   7.30%)
BAmean-95 fault-both-3     1881.39 (   0.00%)     1868.23 (   0.70%)     2257.90 ( -20.01%)     1794.46 (   4.62%)
BAmean-95 fault-both-4     1853.49 (   0.00%)     2038.27 (  -9.97%)     1758.37 (   5.13%)     1522.69 (  17.85%)
BAmean-99 fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
BAmean-99 fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
BAmean-99 fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
BAmean-99 fault-huge-1     1447.04 (   0.00%)     1394.38 (   3.64%)     1188.40 (  17.87%)     1359.40 (   6.06%)
BAmean-99 fault-huge-3     2139.13 (   0.00%)     2127.28 (   0.55%)     2500.44 ( -16.89%)     2024.05 (   5.38%)
BAmean-99 fault-huge-4     2051.01 (   0.00%)     2141.53 (  -4.41%)     1959.27 (   4.47%)     1705.47 (  16.85%)
BAmean-99 fault-both-1     1447.04 (   0.00%)     1394.38 (   3.64%)     1188.40 (  17.87%)     1359.40 (   6.06%)
BAmean-99 fault-both-3     2139.13 (   0.00%)     2127.28 (   0.55%)     2500.44 ( -16.89%)     2024.05 (   5.38%)
BAmean-99 fault-both-4     2051.01 (   0.00%)     2141.53 (  -4.41%)     1959.27 (   4.47%)     1705.47 (  16.85%)

thpscale Percentage Faults Huge
                                     thp                    thp                    thp                    thp
                                   base1                  base2                   lru1                   lru2
Percentage huge-1      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)
Percentage huge-3      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)
Percentage huge-4      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)

                         thp         thp         thp         thp
                       base1       base2        lru1        lru2
Duration User          93.79       93.26       93.61       97.02
Duration System       592.52      601.32      585.31      575.20
Duration Elapsed     1239.40     1243.79     1232.97     1229.09

                                            thp            thp            thp            thp
                                          base1          base2           lru1           lru2
Ops Minor Faults                     2532126.00     2377121.00     2410222.00     2414384.00
Ops Major Faults                         836.00         722.00         778.00         610.00
Ops Swap Ins                             676.00         644.00         656.00         760.00
Ops Swap Outs                          15887.00       15705.00       11341.00        6812.00
Ops Allocation stalls                  67986.00       44391.00       48791.00       70025.00
Ops Fragmentation stalls                   0.00           0.00           0.00           0.00
Ops DMA allocs                             0.00           0.00           0.00           0.00
Ops DMA32 allocs                           0.00           0.00           0.00           0.00
Ops Normal allocs                  163203689.00   154651154.00   159354937.00   165237378.00
Ops Movable allocs                         0.00           0.00           0.00           0.00
Ops Direct pages scanned              832666.00     1385214.00      652686.00      499004.00
Ops Kswapd pages scanned              808301.00     3517190.00     2310658.00      615450.00
Ops Kswapd pages reclaimed             28737.00      314122.00       13761.00       21149.00
Ops Direct pages reclaimed              1542.00      118664.00         278.00        5002.00
Ops Kswapd efficiency %                    3.56           8.93           0.60           3.44
Ops Kswapd velocity                      652.17        2827.80        1874.06         500.74
Ops Direct efficiency %                    0.19           8.57           0.04           1.00
Ops Direct velocity                      671.83        1113.70         529.36         405.99
Ops Percentage direct scans               50.74          28.26          22.03          44.78
Ops Page writes by reclaim             15887.00       15705.00       11341.00        6812.00
Ops Page writes file                       0.00           0.00           0.00           0.00
Ops Page writes anon                   15887.00       15705.00       11341.00        6812.00
Ops Page reclaim immediate                 0.00           0.00           0.00           0.00
Ops Sector Reads                    79350969.00    79290528.00    79326339.00    79294800.00
Ops Sector Writes                  105724641.00   105722825.00   105705814.00   105687161.00
Ops Page rescued immediate                 0.00           0.00           0.00           0.00
Ops Slabs scanned                      83935.00      113839.00      100286.00       78442.00
Ops Direct inode steals                   56.00          44.00          86.00          31.00
Ops Kswapd inode steals                    0.00           1.00           2.00           2.00
Ops Kswapd skipped wait                    0.00           0.00           0.00           0.00
Ops THP fault alloc                   232051.00      232036.00      232035.00      232035.00
Ops THP fault fallback                     1.00           0.00           0.00           0.00
Ops THP collapse alloc                    13.00          12.00          15.00          11.00
Ops THP collapse fail                      0.00           0.00           0.00           0.00
Ops THP split                          22665.00       52360.00       35592.00       15363.00
Ops THP split failed                       0.00           0.00           0.00           0.00
Ops Compaction stalls                 144127.00      120784.00      125512.00      144578.00
Ops Compaction success                  8039.00       24423.00       15316.00        3672.00
Ops Compaction failures               136088.00       96361.00      110196.00      140906.00
Ops Compaction efficiency                  5.58          20.22          12.20           2.54
Ops Page migrate success             4170185.00    12177428.00     7860810.00     3037053.00
Ops Page migrate failure                9476.00        9987.00        1987.00         623.00
Ops Compaction pages isolated        9551164.00    25547480.00    16290756.00     6222921.00
Ops Compaction migrate scanned       6529450.00    15982527.00     9845328.00     5711509.00
Ops Compaction free scanned         17198448.00    21663579.00     9531167.00    10790527.00
Ops Compact scan efficiency               37.97          73.78         103.30          52.93
Ops Compaction cost                     4555.96       13237.59        8537.99        3310.69
Ops Kcompactd wake                        51.00          88.00          48.00          20.00
Ops Kcompactd migrate scanned         127333.00      325654.00      144656.00      670374.00
Ops Kcompactd free scanned            100028.00       35658.00       12486.00      127376.00
Ops NUMA alloc hit                  48379083.00    48250045.00    48278578.00    48259808.00
Ops NUMA alloc miss                    68141.00       51994.00       61465.00       70881.00
Ops NUMA interleave hit                    0.00           0.00           0.00           0.00
Ops NUMA alloc local                48379030.00    48250007.00    48278535.00    48259769.00
Ops NUMA base-page range updates       19832.00        4340.00       14959.00        5190.00
Ops NUMA PTE updates                    2424.00         756.00        1647.00        1094.00
Ops NUMA PMD updates                      34.00           7.00          26.00           8.00
Ops NUMA hint faults                    2148.00         386.00        1411.00         415.00
Ops NUMA hint local faults %            1814.00         362.00        1401.00         238.00
Ops NUMA hint local percent               84.45          93.78          99.29          57.35
Ops NUMA pages migrated                 5392.00         535.00        1030.00        1710.00
Ops AutoNUMA cost                         10.98           1.97           7.18           2.14

Re: [PATCH v19 00/20] per memcg lru_lock

[Alex Shi]

在 2020/9/25 上午2:06, Daniel Jordan 写道:
> On Thu, Sep 24, 2020 at 11:28:15AM +0800, Alex Shi wrote:
>> The new version rebased on v5.9-rc6 with line by line review by Hugh Dickins.
> 
> These thpscale numbers are from a proto-v19, which now seems to be gone from

Hi Daniel,

Thanks a lot for testing!
Is the head of lruv19 branch 9ee69337d51d on my github? We may just hit a narrow
window, which I just removed the old lruv19, and updated a new one. But even the
old version has same performance behavior too. :)

> Alex Shi's github.  Once again, this is a regression test where memcg is
> enabled but not used.  There's a reasonable amount of isolations from
> compaction as expected, as well as reclaim to a lesser extent.
> 
> I confined the runs to one node of a two-socket broadwell server, the same
> machine as my other results.  thpscale's total_size argument is about 80% of
> the node's memory, its madvise option was enabled, and the system's thp
> settings are enabled=always and defrag=madvise.
> 
> Both base and lru kernels show huge variance run to run, which is surprising
> because I was expecting a microbenchmark like this to be more stable.  There
> seems to be an overall decrease in mean fault latency with the lru changes, but
> it's in the noise, so it's hard to say how much of an improvement it really is.

Yes, the lru lock replace has no clear performance changes, unless the 
migration/compaction compete on different lru locks which require to run in
different memcgs, and then tphscale should get some benefit.

> 
> I only ran up to four threads so these would be ready before I left.  I'll be
> away for a few days.
> 
> 
> thpscale Fault Latencies
>                                           thp                    thp                    thp                    thp
>                                         base1                  base2                   lru1                   lru2
> Min       fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Min       fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Min       fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Min       fault-huge-1      214.00 (   0.00%)      227.00 (  -6.07%)      235.00 (  -9.81%)      240.00 ( -12.15%)
> Min       fault-huge-3      321.00 (   0.00%)      366.00 ( -14.02%)      323.00 (  -0.62%)      407.00 ( -26.79%)
> Min       fault-huge-4      441.00 (   0.00%)      401.00 (   9.07%)      525.00 ( -19.05%)      434.00 (   1.59%)
> Min       fault-both-1      214.00 (   0.00%)      227.00 (  -6.07%)      235.00 (  -9.81%)      240.00 ( -12.15%)
> Min       fault-both-3      321.00 (   0.00%)      366.00 ( -14.02%)      323.00 (  -0.62%)      407.00 ( -26.79%)
> Min       fault-both-4      441.00 (   0.00%)      401.00 (   9.07%)      525.00 ( -19.05%)      434.00 (   1.59%)
> Amean     fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Amean     fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Amean     fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Amean     fault-huge-1     1549.55 (   0.00%)     1667.13 *  -7.59%*     1361.50 *  12.14%*     1458.10 *   5.90%*
> Amean     fault-huge-3     2582.29 (   0.00%)     2556.45 (   1.00%)     2756.65 *  -6.75%*     2157.29 *  16.46%*
> Amean     fault-huge-4     2352.21 (   0.00%)     2709.37 * -15.18%*     2323.89 (   1.20%)     1888.94 *  19.69%*
> Amean     fault-both-1     1549.55 (   0.00%)     1667.13 *  -7.59%*     1361.50 *  12.14%*     1458.10 *   5.90%*
> Amean     fault-both-3     2582.29 (   0.00%)     2556.45 (   1.00%)     2756.65 *  -6.75%*     2157.29 *  16.46%*
> Amean     fault-both-4     2352.21 (   0.00%)     2709.37 * -15.18%*     2323.89 (   1.20%)     1888.94 *  19.69%*
> Stddev    fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Stddev    fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Stddev    fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Stddev    fault-huge-1     2011.48 (   0.00%)     3765.64 ( -87.21%)     3061.45 ( -52.20%)     1758.56 (  12.57%)
> Stddev    fault-huge-3    11153.49 (   0.00%)     8339.83 (  25.23%)     7017.28 (  37.08%)     3976.86 (  64.34%)
> Stddev    fault-huge-4     8817.67 (   0.00%)    16241.48 ( -84.19%)    11595.28 ( -31.50%)     6631.47 (  24.79%)
> Stddev    fault-both-1     2011.48 (   0.00%)     3765.64 ( -87.21%)     3061.45 ( -52.20%)     1758.56 (  12.57%)
> Stddev    fault-both-3    11153.49 (   0.00%)     8339.83 (  25.23%)     7017.28 (  37.08%)     3976.86 (  64.34%)
> Stddev    fault-both-4     8817.67 (   0.00%)    16241.48 ( -84.19%)    11595.28 ( -31.50%)     6631.47 (  24.79%)
> CoeffVar  fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> CoeffVar  fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> CoeffVar  fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> CoeffVar  fault-huge-1      129.81 (   0.00%)      225.88 ( -74.00%)      224.86 ( -73.22%)      120.61 (   7.09%)
> CoeffVar  fault-huge-3      431.92 (   0.00%)      326.23 (  24.47%)      254.56 (  41.06%)      184.35 (  57.32%)
> CoeffVar  fault-huge-4      374.87 (   0.00%)      599.46 ( -59.91%)      498.96 ( -33.10%)      351.07 (   6.35%)
> CoeffVar  fault-both-1      129.81 (   0.00%)      225.88 ( -74.00%)      224.86 ( -73.22%)      120.61 (   7.09%)
> CoeffVar  fault-both-3      431.92 (   0.00%)      326.23 (  24.47%)      254.56 (  41.06%)      184.35 (  57.32%)
> CoeffVar  fault-both-4      374.87 (   0.00%)      599.46 ( -59.91%)      498.96 ( -33.10%)      351.07 (   6.35%)
> Max       fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Max       fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Max       fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> Max       fault-huge-1    90549.00 (   0.00%)   166062.00 ( -83.39%)   134242.00 ( -48.25%)    82424.00 (   8.97%)
> Max       fault-huge-3  1229237.00 (   0.00%)   392796.00 (  68.05%)   508290.00 (  58.65%)   433992.00 (  64.69%)
> Max       fault-huge-4   418414.00 (   0.00%)  1147308.00 (-174.20%)   792153.00 ( -89.32%)   433393.00 (  -3.58%)
> Max       fault-both-1    90549.00 (   0.00%)   166062.00 ( -83.39%)   134242.00 ( -48.25%)    82424.00 (   8.97%)
> Max       fault-both-3  1229237.00 (   0.00%)   392796.00 (  68.05%)   508290.00 (  58.65%)   433992.00 (  64.69%)
> Max       fault-both-4   418414.00 (   0.00%)  1147308.00 (-174.20%)   792153.00 ( -89.32%)   433393.00 (  -3.58%)
> BAmean-50 fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> BAmean-50 fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> BAmean-50 fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> BAmean-50 fault-huge-1     1329.84 (   0.00%)     1086.23 (  18.32%)      765.68 (  42.42%)     1238.41 (   6.88%)
> BAmean-50 fault-huge-3     1410.46 (   0.00%)     1406.43 (   0.29%)     1749.95 ( -24.07%)     1362.23 (   3.42%)
> BAmean-50 fault-huge-4     1453.01 (   0.00%)     1373.01 (   5.51%)     1268.61 (  12.69%)     1157.08 (  20.37%)
> BAmean-50 fault-both-1     1329.84 (   0.00%)     1086.23 (  18.32%)      765.68 (  42.42%)     1238.41 (   6.88%)
> BAmean-50 fault-both-3     1410.46 (   0.00%)     1406.43 (   0.29%)     1749.95 ( -24.07%)     1362.23 (   3.42%)
> BAmean-50 fault-both-4     1453.01 (   0.00%)     1373.01 (   5.51%)     1268.61 (  12.69%)     1157.08 (  20.37%)
> BAmean-95 fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> BAmean-95 fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> BAmean-95 fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> BAmean-95 fault-huge-1     1428.93 (   0.00%)     1336.45 (   6.47%)     1125.72 (  21.22%)     1324.67 (   7.30%)
> BAmean-95 fault-huge-3     1881.39 (   0.00%)     1868.23 (   0.70%)     2257.90 ( -20.01%)     1794.46 (   4.62%)
> BAmean-95 fault-huge-4     1853.49 (   0.00%)     2038.27 (  -9.97%)     1758.37 (   5.13%)     1522.69 (  17.85%)
> BAmean-95 fault-both-1     1428.93 (   0.00%)     1336.45 (   6.47%)     1125.72 (  21.22%)     1324.67 (   7.30%)
> BAmean-95 fault-both-3     1881.39 (   0.00%)     1868.23 (   0.70%)     2257.90 ( -20.01%)     1794.46 (   4.62%)
> BAmean-95 fault-both-4     1853.49 (   0.00%)     2038.27 (  -9.97%)     1758.37 (   5.13%)     1522.69 (  17.85%)
> BAmean-99 fault-base-1        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> BAmean-99 fault-base-3        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> BAmean-99 fault-base-4        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)        0.00 (   0.00%)
> BAmean-99 fault-huge-1     1447.04 (   0.00%)     1394.38 (   3.64%)     1188.40 (  17.87%)     1359.40 (   6.06%)
> BAmean-99 fault-huge-3     2139.13 (   0.00%)     2127.28 (   0.55%)     2500.44 ( -16.89%)     2024.05 (   5.38%)
> BAmean-99 fault-huge-4     2051.01 (   0.00%)     2141.53 (  -4.41%)     1959.27 (   4.47%)     1705.47 (  16.85%)
> BAmean-99 fault-both-1     1447.04 (   0.00%)     1394.38 (   3.64%)     1188.40 (  17.87%)     1359.40 (   6.06%)
> BAmean-99 fault-both-3     2139.13 (   0.00%)     2127.28 (   0.55%)     2500.44 ( -16.89%)     2024.05 (   5.38%)
> BAmean-99 fault-both-4     2051.01 (   0.00%)     2141.53 (  -4.41%)     1959.27 (   4.47%)     1705.47 (  16.85%)
> 
> thpscale Percentage Faults Huge
>                                      thp                    thp                    thp                    thp
>                                    base1                  base2                   lru1                   lru2
> Percentage huge-1      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)
> Percentage huge-3      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)
> Percentage huge-4      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)      100.00 (   0.00%)
> 
>                          thp         thp         thp         thp
>                        base1       base2        lru1        lru2
> Duration User          93.79       93.26       93.61       97.02
> Duration System       592.52      601.32      585.31      575.20
> Duration Elapsed     1239.40     1243.79     1232.97     1229.09
> 
>                                             thp            thp            thp            thp
>                                           base1          base2           lru1           lru2
> Ops Minor Faults                     2532126.00     2377121.00     2410222.00     2414384.00
> Ops Major Faults                         836.00         722.00         778.00         610.00
> Ops Swap Ins                             676.00         644.00         656.00         760.00
> Ops Swap Outs                          15887.00       15705.00       11341.00        6812.00
> Ops Allocation stalls                  67986.00       44391.00       48791.00       70025.00
> Ops Fragmentation stalls                   0.00           0.00           0.00           0.00
> Ops DMA allocs                             0.00           0.00           0.00           0.00
> Ops DMA32 allocs                           0.00           0.00           0.00           0.00
> Ops Normal allocs                  163203689.00   154651154.00   159354937.00   165237378.00
> Ops Movable allocs                         0.00           0.00           0.00           0.00
> Ops Direct pages scanned              832666.00     1385214.00      652686.00      499004.00
> Ops Kswapd pages scanned              808301.00     3517190.00     2310658.00      615450.00
> Ops Kswapd pages reclaimed             28737.00      314122.00       13761.00       21149.00
> Ops Direct pages reclaimed              1542.00      118664.00         278.00        5002.00
> Ops Kswapd efficiency %                    3.56           8.93           0.60           3.44
> Ops Kswapd velocity                      652.17        2827.80        1874.06         500.74
> Ops Direct efficiency %                    0.19           8.57           0.04           1.00
> Ops Direct velocity                      671.83        1113.70         529.36         405.99
> Ops Percentage direct scans               50.74          28.26          22.03          44.78
> Ops Page writes by reclaim             15887.00       15705.00       11341.00        6812.00
> Ops Page writes file                       0.00           0.00           0.00           0.00
> Ops Page writes anon                   15887.00       15705.00       11341.00        6812.00
> Ops Page reclaim immediate                 0.00           0.00           0.00           0.00
> Ops Sector Reads                    79350969.00    79290528.00    79326339.00    79294800.00
> Ops Sector Writes                  105724641.00   105722825.00   105705814.00   105687161.00
> Ops Page rescued immediate                 0.00           0.00           0.00           0.00
> Ops Slabs scanned                      83935.00      113839.00      100286.00       78442.00
> Ops Direct inode steals                   56.00          44.00          86.00          31.00
> Ops Kswapd inode steals                    0.00           1.00           2.00           2.00
> Ops Kswapd skipped wait                    0.00           0.00           0.00           0.00
> Ops THP fault alloc                   232051.00      232036.00      232035.00      232035.00
> Ops THP fault fallback                     1.00           0.00           0.00           0.00
> Ops THP collapse alloc                    13.00          12.00          15.00          11.00
> Ops THP collapse fail                      0.00           0.00           0.00           0.00
> Ops THP split                          22665.00       52360.00       35592.00       15363.00
> Ops THP split failed                       0.00           0.00           0.00           0.00
> Ops Compaction stalls                 144127.00      120784.00      125512.00      144578.00
> Ops Compaction success                  8039.00       24423.00       15316.00        3672.00
> Ops Compaction failures               136088.00       96361.00      110196.00      140906.00
> Ops Compaction efficiency                  5.58          20.22          12.20           2.54
> Ops Page migrate success             4170185.00    12177428.00     7860810.00     3037053.00
> Ops Page migrate failure                9476.00        9987.00        1987.00         623.00
> Ops Compaction pages isolated        9551164.00    25547480.00    16290756.00     6222921.00
> Ops Compaction migrate scanned       6529450.00    15982527.00     9845328.00     5711509.00
> Ops Compaction free scanned         17198448.00    21663579.00     9531167.00    10790527.00
> Ops Compact scan efficiency               37.97          73.78         103.30          52.93
> Ops Compaction cost                     4555.96       13237.59        8537.99        3310.69
> Ops Kcompactd wake                        51.00          88.00          48.00          20.00
> Ops Kcompactd migrate scanned         127333.00      325654.00      144656.00      670374.00
> Ops Kcompactd free scanned            100028.00       35658.00       12486.00      127376.00
> Ops NUMA alloc hit                  48379083.00    48250045.00    48278578.00    48259808.00
> Ops NUMA alloc miss                    68141.00       51994.00       61465.00       70881.00
> Ops NUMA interleave hit                    0.00           0.00           0.00           0.00
> Ops NUMA alloc local                48379030.00    48250007.00    48278535.00    48259769.00
> Ops NUMA base-page range updates       19832.00        4340.00       14959.00        5190.00
> Ops NUMA PTE updates                    2424.00         756.00        1647.00        1094.00
> Ops NUMA PMD updates                      34.00           7.00          26.00           8.00
> Ops NUMA hint faults                    2148.00         386.00        1411.00         415.00
> Ops NUMA hint local faults %            1814.00         362.00        1401.00         238.00
> Ops NUMA hint local percent               84.45          93.78          99.29          57.35
> Ops NUMA pages migrated                 5392.00         535.00        1030.00        1710.00
> Ops AutoNUMA cost                         10.98           1.97           7.18           2.14
>