* BUG: Mellanox crash with iommu=soft and swiotlb=force
@ 2015-09-28 21:04 Christoffer Dall
2015-09-28 21:59 ` Or Gerlitz
0 siblings, 1 reply; 4+ messages in thread
From: Christoffer Dall @ 2015-09-28 21:04 UTC (permalink / raw)
To: amirv, idos, netdev; +Cc: ian.campbell, stefano.stabellini, konrad.wilk
Hi,
In doing some performance experiments I found that using a 10G Mellanox
MX354A Dual port FDR CX3 device on a server running Apache and running
ab against that server causes the system to crash with 'iommu=soft
swiotlb=force'. The same behavior is seen without these options on Dom0
running under Xen.
I have tried this on v4.0 and v4.3-rc3.
Examples of crashes:
http://pastebin.ubuntu.com/11953498/
http://pastebin.ubuntu.com/11953443/
Kernel config (v4.3):
http://paste.ubuntu.com/12605446/
To reproduce, host a file in apache server on a system with the Mellanox
NIC (I used the 41K index file of the GCC manual) and run ab (apache
bench) from a client machine, something like this:
$ ab -n 100000 -c 100 http://10.10.1.2/gcc/index.html
I'm afraid debugging this is out of my area of expertise. Is this
something you could have a look at?
Thanks,
-Christoffer
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: BUG: Mellanox crash with iommu=soft and swiotlb=force
2015-09-28 21:04 BUG: Mellanox crash with iommu=soft and swiotlb=force Christoffer Dall
@ 2015-09-28 21:59 ` Or Gerlitz
2015-09-29 7:04 ` Christoffer Dall
2015-10-11 13:59 ` Christoffer Dall
0 siblings, 2 replies; 4+ messages in thread
From: Or Gerlitz @ 2015-09-28 21:59 UTC (permalink / raw)
To: Christoffer Dall
Cc: Linux Netdev List, ian.campbell, stefano.stabellini, konrad.wilk,
Eugenia Emantayev, Yevgeny Petrilin
On Tue, Sep 29, 2015 at 12:04 AM, Christoffer Dall
<christoffer.dall@linaro.org> wrote:
> Hi,
>
> In doing some performance experiments I found that using a 10G Mellanox
> MX354A Dual port FDR CX3 device on a server running Apache and running
> ab against that server causes the system to crash with 'iommu=soft
> swiotlb=force'. The same behavior is seen without these options on Dom0
> running under Xen.
>
> I have tried this on v4.0 and v4.3-rc3.
Woops, needs looking indeed. Unfortunately many people in the team are
off for the Sukkot holiday with real backing to business coming to
play on Oct 6th -- not sure we can really respond on that before.
Are you running over ARM? which? if not, is that x86 64bit?
Or.
> Examples of crashes:
> http://pastebin.ubuntu.com/11953498/
> http://pastebin.ubuntu.com/11953443/
>
> Kernel config (v4.3):
> http://paste.ubuntu.com/12605446/
>
> To reproduce, host a file in apache server on a system with the Mellanox
> NIC (I used the 41K index file of the GCC manual) and run ab (apache
> bench) from a client machine, something like this:
>
> $ ab -n 100000 -c 100 http://10.10.1.2/gcc/index.html
>
> I'm afraid debugging this is out of my area of expertise. Is this
> something you could have a look at?
>
>
> Thanks,
> -Christoffer
> --
> To unsubscribe from this list: send the line "unsubscribe netdev" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: BUG: Mellanox crash with iommu=soft and swiotlb=force
2015-09-28 21:59 ` Or Gerlitz
@ 2015-09-29 7:04 ` Christoffer Dall
2015-10-11 13:59 ` Christoffer Dall
1 sibling, 0 replies; 4+ messages in thread
From: Christoffer Dall @ 2015-09-29 7:04 UTC (permalink / raw)
To: Or Gerlitz
Cc: Linux Netdev List, ian.campbell, stefano.stabellini, konrad.wilk,
Eugenia Emantayev, Yevgeny Petrilin
On Tue, Sep 29, 2015 at 12:59:35AM +0300, Or Gerlitz wrote:
> On Tue, Sep 29, 2015 at 12:04 AM, Christoffer Dall
> <christoffer.dall@linaro.org> wrote:
> > Hi,
> >
> > In doing some performance experiments I found that using a 10G Mellanox
> > MX354A Dual port FDR CX3 device on a server running Apache and running
> > ab against that server causes the system to crash with 'iommu=soft
> > swiotlb=force'. The same behavior is seen without these options on Dom0
> > running under Xen.
> >
> > I have tried this on v4.0 and v4.3-rc3.
>
> Woops, needs looking indeed. Unfortunately many people in the team are
> off for the Sukkot holiday with real backing to business coming to
> play on Oct 6th -- not sure we can really respond on that before.
>
> Are you running over ARM? which? if not, is that x86 64bit?
>
I'm running on x86_64.
Thanks,
-Christoffer
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: BUG: Mellanox crash with iommu=soft and swiotlb=force
2015-09-28 21:59 ` Or Gerlitz
2015-09-29 7:04 ` Christoffer Dall
@ 2015-10-11 13:59 ` Christoffer Dall
1 sibling, 0 replies; 4+ messages in thread
From: Christoffer Dall @ 2015-10-11 13:59 UTC (permalink / raw)
To: Or Gerlitz
Cc: Linux Netdev List, ian.campbell, stefano.stabellini, konrad.wilk,
Eugenia Emantayev, Yevgeny Petrilin
Hi,
On Tue, Sep 29, 2015 at 12:59:35AM +0300, Or Gerlitz wrote:
> On Tue, Sep 29, 2015 at 12:04 AM, Christoffer Dall
> <christoffer.dall@linaro.org> wrote:
> > Hi,
> >
> > In doing some performance experiments I found that using a 10G Mellanox
> > MX354A Dual port FDR CX3 device on a server running Apache and running
> > ab against that server causes the system to crash with 'iommu=soft
> > swiotlb=force'. The same behavior is seen without these options on Dom0
> > running under Xen.
> >
> > I have tried this on v4.0 and v4.3-rc3.
>
> Woops, needs looking indeed. Unfortunately many people in the team are
> off for the Sukkot holiday with real backing to business coming to
> play on Oct 6th -- not sure we can really respond on that before.
>
Friendly reminder on this one. Did anyone have a look?
Thanks,
-Christoffer
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2015-10-11 13:59 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-09-28 21:04 BUG: Mellanox crash with iommu=soft and swiotlb=force Christoffer Dall
2015-09-28 21:59 ` Or Gerlitz
2015-09-29 7:04 ` Christoffer Dall
2015-10-11 13:59 ` Christoffer Dall
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.