From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 728A6C433EF for ; Wed, 5 Jan 2022 04:40:53 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S237382AbiAEEkw (ORCPT ); Tue, 4 Jan 2022 23:40:52 -0500 Received: from out30-132.freemail.mail.aliyun.com ([115.124.30.132]:48833 "EHLO out30-132.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S237365AbiAEEkw (ORCPT ); Tue, 4 Jan 2022 23:40:52 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R181e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e04423;MF=alibuda@linux.alibaba.com;NM=1;PH=DS;RN=6;SR=0;TI=SMTPD_---0V1.2IYO_1641357649; Received: from localhost(mailfrom:alibuda@linux.alibaba.com fp:SMTPD_---0V1.2IYO_1641357649) by smtp.aliyun-inc.com(127.0.0.1); Wed, 05 Jan 2022 12:40:50 +0800 Date: Wed, 5 Jan 2022 12:40:49 +0800 From: "D. Wythe" To: Karsten Graul Cc: kuba@kernel.org, davem@davemloft.net, netdev@vger.kernel.org, linux-s390@vger.kernel.org, linux-rdma@vger.kernel.org Subject: Re: [PATCH net-next v2] net/smc: Reduce overflow of smc clcsock listen queue Message-ID: <20220105044049.GA107642@e02h04389.eu6sqa> Reply-To: "D. Wythe" References: <1641301961-59331-1-git-send-email-alibuda@linux.alibaba.com> <8a60dabb-1799-316c-80b5-14c920fe98ab@linux.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <8a60dabb-1799-316c-80b5-14c920fe98ab@linux.ibm.com> User-Agent: Mutt/1.5.21 (2010-09-15) Precedence: bulk List-ID: X-Mailing-List: linux-rdma@vger.kernel.org Hi, Since we are trying to use the backlog parameter to limit smc dangling connections, it's seems there's no difference from increasing the backlog parameter for the TCP listen socket, user space Application can simply avoid the 10K connections problem through that. If so, this patch looks redundant to me. Look forward to your advise. Thanks. On Tue, Jan 04, 2022 at 02:45:35PM +0100, Karsten Graul wrote: > On 04/01/2022 14:12, D. Wythe wrote: > > From: "D. Wythe" > > > > In nginx/wrk multithread and 10K connections benchmark, the > > backend TCP connection established very slowly, and lots of TCP > > connections stay in SYN_SENT state. > > I see what you are trying to solve here. > So what happens with your patch now is that we are accepting way more connections > in advance and queue them up for the SMC connection handshake worker. > The connection handshake worker itself will not run faster with this change, so overall > it should be the same time that is needed to establish all connections. > What you solve is that when 10k connections are started at the same time, some of them > will be dropped due to tcp 3-way handshake timeouts. Your patch avoids that but one can now flood > the stack with an ~infinite amount of dangling sockets waiting for the SMC handshake, maybe even > causing oom conditions. > > What should be respected with such a change would be the backlog parameter for the listen socket, > i.e. how many backlog connections are requested by the user space application? > There is no such handling of backlog right now, and due to the 'braking' workers we avoided > to flood the kernel with too many dangling connections. With your change there should be a way to limit > this ind of connections in some way.