From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.0 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7B57EC433DF for ; Fri, 31 Jul 2020 11:36:32 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 565FC20838 for ; Fri, 31 Jul 2020 11:36:32 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732512AbgGaLgc (ORCPT ); Fri, 31 Jul 2020 07:36:32 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52248 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1732104AbgGaLgc (ORCPT ); Fri, 31 Jul 2020 07:36:32 -0400 Received: from orbyte.nwl.cc (orbyte.nwl.cc [IPv6:2001:41d0:e:133a::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id DBA33C061574 for ; Fri, 31 Jul 2020 04:36:31 -0700 (PDT) Received: from n0-1 by orbyte.nwl.cc with local (Exim 4.94) (envelope-from ) id 1k1TKw-0001IV-G7; Fri, 31 Jul 2020 13:36:30 +0200 Date: Fri, 31 Jul 2020 13:36:30 +0200 From: Phil Sutter To: Pablo Neira Ayuso Cc: netfilter-devel@vger.kernel.org Subject: Re: [iptables PATCH] nft: Eliminate table list from cache Message-ID: <20200731113630.GE13697@orbyte.nwl.cc> Mail-Followup-To: Phil Sutter , Pablo Neira Ayuso , netfilter-devel@vger.kernel.org References: <20200730135710.23076-1-phil@nwl.cc> <20200730192554.GA5322@salvia> <20200731112134.GA13697@orbyte.nwl.cc> <20200731112537.GA10915@salvia> <20200731112600.GA10942@salvia> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200731112600.GA10942@salvia> Sender: netfilter-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: netfilter-devel@vger.kernel.org On Fri, Jul 31, 2020 at 01:26:00PM +0200, Pablo Neira Ayuso wrote: > On Fri, Jul 31, 2020 at 01:25:37PM +0200, Pablo Neira Ayuso wrote: > > On Fri, Jul 31, 2020 at 01:21:34PM +0200, Phil Sutter wrote: > > > Hi Pablo, > > > > > > On Thu, Jul 30, 2020 at 09:25:54PM +0200, Pablo Neira Ayuso wrote: > > > > On Thu, Jul 30, 2020 at 03:57:10PM +0200, Phil Sutter wrote: > > > > > The full list of tables in kernel is not relevant, only those used by > > > > > iptables-nft and for those, knowing if they exist or not is sufficient. > > > > > For holding that information, the already existing 'table' array in > > > > > nft_cache suits well. > > > > > > > > > > Consequently, nft_table_find() merely checks if the new 'exists' boolean > > > > > is true or not and nft_for_each_table() iterates over the builtin_table > > > > > array in nft_handle, additionally checking the boolean in cache for > > > > > whether to skip the entry or not. > > > > > > > > > > Signed-off-by: Phil Sutter > > > > > --- > > > > > iptables/nft-cache.c | 73 +++++++++++--------------------------------- > > > > > iptables/nft-cache.h | 9 ------ > > > > > iptables/nft.c | 55 +++++++++------------------------ > > > > > iptables/nft.h | 2 +- > > > > > 4 files changed, 34 insertions(+), 105 deletions(-) > > > > > > > > This diffstat looks interesting :-) > > > > > > As promised, I wanted to leverage your change for further optimization, > > > but ended up optimizing your code out along with the old one. :D > > > > > > > One question: > > > > > > > > c->table[i].exists = true; > > > > > > > > then we assume this table is still in the kernel and we don't recheck? > > > > > > Upon each COMMIT line, nft_action() calls nft_release_cache(). This will > > > also reset the 'exists' value to false. > > > > Thanks for explaining. > > > > I think the chain cache can also be converted to use linux list, > > right? > > Having said this, I think it's fine if you push out this. OK! Looks like I found the problem, it is this 'initialized' boolean which is not reset when flushing the cache. Looks like more leeway for streamlining. :) Cheers, Phil