* [PATCH 1/1] powerpc/mm: Add memory barrier in __hugepte_alloc()
@ 2016-04-05 19:05 Sukadev Bhattiprolu
2016-04-06 9:56 ` Michal Hocko
2016-07-22 5:50 ` [1/1] " Michael Ellerman
0 siblings, 2 replies; 5+ messages in thread
From: Sukadev Bhattiprolu @ 2016-04-05 19:05 UTC (permalink / raw)
To: Michael Ellerman
Cc: linux-kernel, linux-mm, linuxppc-dev, James Dykman, Aneesh Kumar K.V
>From f7b73c6b4508fe9b141a43d92be2f9dd7d3c4a58 Mon Sep 17 00:00:00 2001
From: Sukadev Bhattiprolu <sukadev@linux.vnet.ibm.com>
Date: Thu, 24 Mar 2016 02:07:57 -0400
Subject: [PATCH 1/1] powerpc/mm: Add memory barrier in __hugepte_alloc()
__hugepte_alloc() uses kmem_cache_zalloc() to allocate a zeroed PTE
and proceeds to use the newly allocated PTE. Add a memory barrier to
make sure that the other CPUs see a properly initialized PTE.
Based on a fix suggested by James Dykman.
Reported-by: James Dykman <jdykman@us.ibm.com>
Signed-off-by: Aneesh Kumar K.V <aneesh.kumar@linux.vnet.ibm.com>
Signed-off-by: Sukadev Bhattiprolu <sukadev@linux.vnet.ibm.com>
Tested-by: James Dykman <jdykman@us.ibm.com>
---
Note:
The bug was encountered and fix tested on an older version
of the kernel. Forward porting to mainline.
---
arch/powerpc/mm/hugetlbpage.c | 7 +++++++
1 file changed, 7 insertions(+)
diff --git a/arch/powerpc/mm/hugetlbpage.c b/arch/powerpc/mm/hugetlbpage.c
index d991b9e..081f679 100644
--- a/arch/powerpc/mm/hugetlbpage.c
+++ b/arch/powerpc/mm/hugetlbpage.c
@@ -81,6 +81,13 @@ static int __hugepte_alloc(struct mm_struct *mm, hugepd_t *hpdp,
if (! new)
return -ENOMEM;
+ /*
+ * Make sure other cpus find the hugepd set only after a
+ * properly initialized page table is visible to them.
+ * For more details look for comment in __pte_alloc().
+ */
+ smp_wmb();
+
spin_lock(&mm->page_table_lock);
#ifdef CONFIG_PPC_FSL_BOOK3E
/*
--
1.8.3.1
^ permalink raw reply related [flat|nested] 5+ messages in thread
* Re: [PATCH 1/1] powerpc/mm: Add memory barrier in __hugepte_alloc()
2016-04-05 19:05 [PATCH 1/1] powerpc/mm: Add memory barrier in __hugepte_alloc() Sukadev Bhattiprolu
@ 2016-04-06 9:56 ` Michal Hocko
2016-04-06 10:09 ` Aneesh Kumar K.V
2016-07-22 5:50 ` [1/1] " Michael Ellerman
1 sibling, 1 reply; 5+ messages in thread
From: Michal Hocko @ 2016-04-06 9:56 UTC (permalink / raw)
To: Sukadev Bhattiprolu
Cc: Michael Ellerman, linux-kernel, linux-mm, linuxppc-dev,
James Dykman, Aneesh Kumar K.V
On Tue 05-04-16 12:05:47, Sukadev Bhattiprolu wrote:
[...]
> diff --git a/arch/powerpc/mm/hugetlbpage.c b/arch/powerpc/mm/hugetlbpage.c
> index d991b9e..081f679 100644
> --- a/arch/powerpc/mm/hugetlbpage.c
> +++ b/arch/powerpc/mm/hugetlbpage.c
> @@ -81,6 +81,13 @@ static int __hugepte_alloc(struct mm_struct *mm, hugepd_t *hpdp,
> if (! new)
> return -ENOMEM;
>
> + /*
> + * Make sure other cpus find the hugepd set only after a
> + * properly initialized page table is visible to them.
> + * For more details look for comment in __pte_alloc().
> + */
> + smp_wmb();
> +
what is the pairing memory barrier?
> spin_lock(&mm->page_table_lock);
> #ifdef CONFIG_PPC_FSL_BOOK3E
> /*
> --
> 1.8.3.1
--
Michal Hocko
SUSE Labs
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH 1/1] powerpc/mm: Add memory barrier in __hugepte_alloc()
2016-04-06 9:56 ` Michal Hocko
@ 2016-04-06 10:09 ` Aneesh Kumar K.V
2016-04-06 11:27 ` Michal Hocko
0 siblings, 1 reply; 5+ messages in thread
From: Aneesh Kumar K.V @ 2016-04-06 10:09 UTC (permalink / raw)
To: Michal Hocko, Sukadev Bhattiprolu
Cc: Michael Ellerman, linux-kernel, linux-mm, linuxppc-dev, James Dykman
Michal Hocko <mhocko@kernel.org> writes:
> [ text/plain ]
> On Tue 05-04-16 12:05:47, Sukadev Bhattiprolu wrote:
> [...]
>> diff --git a/arch/powerpc/mm/hugetlbpage.c b/arch/powerpc/mm/hugetlbpage.c
>> index d991b9e..081f679 100644
>> --- a/arch/powerpc/mm/hugetlbpage.c
>> +++ b/arch/powerpc/mm/hugetlbpage.c
>> @@ -81,6 +81,13 @@ static int __hugepte_alloc(struct mm_struct *mm, hugepd_t *hpdp,
>> if (! new)
>> return -ENOMEM;
>>
>> + /*
>> + * Make sure other cpus find the hugepd set only after a
>> + * properly initialized page table is visible to them.
>> + * For more details look for comment in __pte_alloc().
>> + */
>> + smp_wmb();
>> +
>
> what is the pairing memory barrier?
>
>> spin_lock(&mm->page_table_lock);
>> #ifdef CONFIG_PPC_FSL_BOOK3E
>> /*
This is documented in __pte_alloc(). I didn't want to repeat the same
here.
/*
* Ensure all pte setup (eg. pte page lock and page clearing) are
* visible before the pte is made visible to other CPUs by being
* put into page tables.
*
* The other side of the story is the pointer chasing in the page
* table walking code (when walking the page table without locking;
* ie. most of the time). Fortunately, these data accesses consist
* of a chain of data-dependent loads, meaning most CPUs (alpha
* being the notable exception) will already guarantee loads are
* seen in-order. See the alpha page table accessors for the
* smp_read_barrier_depends() barriers in page table walking code.
*/
smp_wmb(); /* Could be smp_wmb__xxx(before|after)_spin_lock */
-aneesh
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH 1/1] powerpc/mm: Add memory barrier in __hugepte_alloc()
2016-04-06 10:09 ` Aneesh Kumar K.V
@ 2016-04-06 11:27 ` Michal Hocko
0 siblings, 0 replies; 5+ messages in thread
From: Michal Hocko @ 2016-04-06 11:27 UTC (permalink / raw)
To: Aneesh Kumar K.V
Cc: Sukadev Bhattiprolu, Michael Ellerman, linux-kernel, linux-mm,
linuxppc-dev, James Dykman
On Wed 06-04-16 15:39:17, Aneesh Kumar K.V wrote:
> Michal Hocko <mhocko@kernel.org> writes:
>
> > [ text/plain ]
> > On Tue 05-04-16 12:05:47, Sukadev Bhattiprolu wrote:
> > [...]
> >> diff --git a/arch/powerpc/mm/hugetlbpage.c b/arch/powerpc/mm/hugetlbpage.c
> >> index d991b9e..081f679 100644
> >> --- a/arch/powerpc/mm/hugetlbpage.c
> >> +++ b/arch/powerpc/mm/hugetlbpage.c
> >> @@ -81,6 +81,13 @@ static int __hugepte_alloc(struct mm_struct *mm, hugepd_t *hpdp,
> >> if (! new)
> >> return -ENOMEM;
> >>
> >> + /*
> >> + * Make sure other cpus find the hugepd set only after a
> >> + * properly initialized page table is visible to them.
> >> + * For more details look for comment in __pte_alloc().
> >> + */
> >> + smp_wmb();
> >> +
> >
> > what is the pairing memory barrier?
> >
> >> spin_lock(&mm->page_table_lock);
> >> #ifdef CONFIG_PPC_FSL_BOOK3E
> >> /*
>
> This is documented in __pte_alloc(). I didn't want to repeat the same
> here.
>
> /*
> * Ensure all pte setup (eg. pte page lock and page clearing) are
> * visible before the pte is made visible to other CPUs by being
> * put into page tables.
> *
> * The other side of the story is the pointer chasing in the page
> * table walking code (when walking the page table without locking;
> * ie. most of the time). Fortunately, these data accesses consist
> * of a chain of data-dependent loads, meaning most CPUs (alpha
> * being the notable exception) will already guarantee loads are
> * seen in-order. See the alpha page table accessors for the
> * smp_read_barrier_depends() barriers in page table walking code.
> */
> smp_wmb(); /* Could be smp_wmb__xxx(before|after)_spin_lock */
OK, I have missed the reference to __pte_alloc. My bad!
--
Michal Hocko
SUSE Labs
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [1/1] powerpc/mm: Add memory barrier in __hugepte_alloc()
2016-04-05 19:05 [PATCH 1/1] powerpc/mm: Add memory barrier in __hugepte_alloc() Sukadev Bhattiprolu
2016-04-06 9:56 ` Michal Hocko
@ 2016-07-22 5:50 ` Michael Ellerman
1 sibling, 0 replies; 5+ messages in thread
From: Michael Ellerman @ 2016-07-22 5:50 UTC (permalink / raw)
To: Sukadev Bhattiprolu
Cc: Aneesh Kumar K.V, linux-mm, linuxppc-dev, linux-kernel, James Dykman
On Tue, 2016-05-04 at 19:05:47 UTC, Sukadev Bhattiprolu wrote:
> >From f7b73c6b4508fe9b141a43d92be2f9dd7d3c4a58 Mon Sep 17 00:00:00 2001
> From: Sukadev Bhattiprolu <sukadev@linux.vnet.ibm.com>
> Date: Thu, 24 Mar 2016 02:07:57 -0400
> Subject: [PATCH 1/1] powerpc/mm: Add memory barrier in __hugepte_alloc()
>
> __hugepte_alloc() uses kmem_cache_zalloc() to allocate a zeroed PTE
> and proceeds to use the newly allocated PTE. Add a memory barrier to
> make sure that the other CPUs see a properly initialized PTE.
>
> Based on a fix suggested by James Dykman.
>
> Reported-by: James Dykman <jdykman@us.ibm.com>
> Signed-off-by: Aneesh Kumar K.V <aneesh.kumar@linux.vnet.ibm.com>
> Signed-off-by: Sukadev Bhattiprolu <sukadev@linux.vnet.ibm.com>
> Tested-by: James Dykman <jdykman@us.ibm.com>
Applied to powerpc next, thanks.
https://git.kernel.org/powerpc/c/0eab46be21449f1612791201aa
cheers
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2016-07-22 5:50 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-04-05 19:05 [PATCH 1/1] powerpc/mm: Add memory barrier in __hugepte_alloc() Sukadev Bhattiprolu
2016-04-06 9:56 ` Michal Hocko
2016-04-06 10:09 ` Aneesh Kumar K.V
2016-04-06 11:27 ` Michal Hocko
2016-07-22 5:50 ` [1/1] " Michael Ellerman
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).