From: Eric Dumazet <edumazet@google.com>
To: Hazem Mohamed Abuelfotoh <abuehaze@amazon.com>
Cc: netdev <netdev@vger.kernel.org>,
stable@vger.kernel.org, Yuchung Cheng <ycheng@google.com>,
Neal Cardwell <ncardwell@google.com>,
Wei Wang <weiwan@google.com>,
"Strohman, Andy" <astroh@amazon.com>,
Benjamin Herrenschmidt <benh@amazon.com>
Subject: Re: [PATCH net] tcp: fix receive buffer autotuning to trigger for any valid advertised MSS
Date: Mon, 7 Dec 2020 17:08:04 +0100 [thread overview]
Message-ID: <CANn89iKnOu4t6xL0SZnaks4CZZuQ-a30sMF=o8Wk8OKL3o6Dyg@mail.gmail.com> (raw)
In-Reply-To: <CANn89iJb6snL7xCK=x=du_nH_4cCVyNz7zgPNm9AgZWW5m1ZJg@mail.gmail.com>
On Mon, Dec 7, 2020 at 4:37 PM Eric Dumazet <edumazet@google.com> wrote:
>
> On Mon, Dec 7, 2020 at 12:41 PM Hazem Mohamed Abuelfotoh
> <abuehaze@amazon.com> wrote:
> >
> > Previously receiver buffer auto-tuning starts after receiving
> > one advertised window amount of data.After the initial
> > receiver buffer was raised by
> > commit a337531b942b ("tcp: up initial rmem to 128KB
> > and SYN rwin to around 64KB"),the receiver buffer may
> > take too long for TCP autotuning to start raising
> > the receiver buffer size.
> > commit 041a14d26715 ("tcp: start receiver buffer autotuning sooner")
> > tried to decrease the threshold at which TCP auto-tuning starts
> > but it's doesn't work well in some environments
> > where the receiver has large MTU (9001) especially with high RTT
> > connections as in these environments rcvq_space.space will be the same
> > as rcv_wnd so TCP autotuning will never start because
> > sender can't send more than rcv_wnd size in one round trip.
> > To address this issue this patch is decreasing the initial
> > rcvq_space.space so TCP autotuning kicks in whenever the sender is
> > able to send more than 5360 bytes in one round trip regardless the
> > receiver's configured MTU.
> >
> > Fixes: a337531b942b ("tcp: up initial rmem to 128KB and SYN rwin to around 64KB")
> > Fixes: 041a14d26715 ("tcp: start receiver buffer autotuning sooner")
> >
> > Signed-off-by: Hazem Mohamed Abuelfotoh <abuehaze@amazon.com>
> > ---
> > net/ipv4/tcp_input.c | 3 ++-
> > 1 file changed, 2 insertions(+), 1 deletion(-)
> >
> > diff --git a/net/ipv4/tcp_input.c b/net/ipv4/tcp_input.c
> > index 389d1b340248..f0ffac9e937b 100644
> > --- a/net/ipv4/tcp_input.c
> > +++ b/net/ipv4/tcp_input.c
> > @@ -504,13 +504,14 @@ static void tcp_grow_window(struct sock *sk, const struct sk_buff *skb)
> > static void tcp_init_buffer_space(struct sock *sk)
> > {
> > int tcp_app_win = sock_net(sk)->ipv4.sysctl_tcp_app_win;
> > + struct inet_connection_sock *icsk = inet_csk(sk);
> > struct tcp_sock *tp = tcp_sk(sk);
> > int maxwin;
> >
> > if (!(sk->sk_userlocks & SOCK_SNDBUF_LOCK))
> > tcp_sndbuf_expand(sk);
> >
> > - tp->rcvq_space.space = min_t(u32, tp->rcv_wnd, TCP_INIT_CWND * tp->advmss);
> > + tp->rcvq_space.space = min_t(u32, tp->rcv_wnd, TCP_INIT_CWND * icsk->icsk_ack.rcv_mss);
>
> I find using icsk->icsk_ack.rcv_mss misleading.
>
> I would either use TCP_MSS_DEFAULT , or maybe simply 0, since we had
> no samples yet, there is little point to use a magic value.
0 will not work, since we use a do_div(grow, tp->rcvq_space.space)
>
> Note that if a driver uses 16KB of memory to hold a 1500 bytes packet,
> then a 10 MSS GRO packet is consuming 160 KB of memory,
> which is bigger than tcp_rmem[1]. TCP could decide to drop these fat packets.
>
> I wonder if your patch does not work around a more fundamental issue,
> I am still unable to reproduce the issue.
next prev parent reply other threads:[~2020-12-07 16:09 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <4ABEB85B-262F-4657-BB69-4F37ABC0AE3D@amazon.com>
2020-12-07 11:40 ` [PATCH net] tcp: fix receive buffer autotuning to trigger for any valid advertised MSS Hazem Mohamed Abuelfotoh
2020-12-07 15:37 ` Eric Dumazet
2020-12-07 16:08 ` Eric Dumazet [this message]
2020-12-07 17:49 ` Mohamed Abuelfotoh, Hazem
2020-12-04 21:28 [PATCH net-next] tcp: optimise receiver buffer autotuning initialisation for high latency connections Neal Cardwell
2020-12-07 11:46 ` [PATCH net] tcp: fix receive buffer autotuning to trigger for any valid advertised MSS Hazem Mohamed Abuelfotoh
2020-12-07 18:53 ` Jakub Kicinski
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='CANn89iKnOu4t6xL0SZnaks4CZZuQ-a30sMF=o8Wk8OKL3o6Dyg@mail.gmail.com' \
--to=edumazet@google.com \
--cc=abuehaze@amazon.com \
--cc=astroh@amazon.com \
--cc=benh@amazon.com \
--cc=ncardwell@google.com \
--cc=netdev@vger.kernel.org \
--cc=stable@vger.kernel.org \
--cc=weiwan@google.com \
--cc=ycheng@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).