From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6009AC5ACAE for ; Wed, 11 Sep 2019 09:44:05 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 415E82067B for ; Wed, 11 Sep 2019 09:44:05 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727477AbfIKJoE (ORCPT ); Wed, 11 Sep 2019 05:44:04 -0400 Received: from s3.sipsolutions.net ([144.76.43.62]:34570 "EHLO sipsolutions.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726724AbfIKJoE (ORCPT ); Wed, 11 Sep 2019 05:44:04 -0400 Received: by sipsolutions.net with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1i7zAP-00032e-TR; Wed, 11 Sep 2019 11:44:02 +0200 Message-ID: <4397b67b63d1b1a332afa9010e7f48abd54b49b2.camel@sipsolutions.net> Subject: Re: [RFCv3 2/3] nl80211: Support >4096 byte NEW_WIPHY event nlmsg From: Johannes Berg To: Denis Kenzior , linux-wireless@vger.kernel.org Date: Wed, 11 Sep 2019 11:44:00 +0200 In-Reply-To: <20190906154303.9303-2-denkenz@gmail.com> (sfid-20190906_174916_548199_A21A5DD3) References: <20190906154303.9303-1-denkenz@gmail.com> <20190906154303.9303-2-denkenz@gmail.com> (sfid-20190906_174916_548199_A21A5DD3) Content-Type: text/plain; charset="UTF-8" User-Agent: Evolution 3.30.5 (3.30.5-1.fc29) MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Sender: linux-wireless-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-wireless@vger.kernel.org Hi, The first patch looks good, couple of nits/comments on this one below. On Fri, 2019-09-06 at 10:43 -0500, Denis Kenzior wrote: > For historical reasons, NEW_WIPHY messages generated by dumps or > GET_WIPHY commands were limited to 4096 bytes. This was due to the > fact that the kernel only allocated 4k buffers prior to commit > 9063e21fb026 ("netlink: autosize skb lengthes"). Once the sizes of > NEW_WIPHY messages exceeded these sizes, split dumps were introduced. Actually, userspace prior to around the same time *also* only used 4k buffers (old libnl), and so even with that kernel we still could possibly have to deal with userspace that had 4k messages only ... but we could have solved that part trivially instead of adding code to split it, just the kernel part was still in the way then. Anyway, I can reword this per my understanding (but will have to reread all my messages I guess). > findings. E.g. the kernel was at fault for the 4096 byte buffer size > limits and not userspace. Nit: I think most of the time when you write "e.g." ("exempli gratia", "for example") you really mean "i.e." ("id est", "which is"). > - The code in case '3' is quite complex, but it does try to support a > message running out of room in the middle of a channel dump and > restarting from where it left off in the next split message. Perhaps > this can be simplified, but it seems this capability is useful. > Please take extra care when reviewing this. Is it useful? You say it basically all fits today, and that means the channels will either fit into a single message or not ... Then again, if we add a lot of channels or a lot more data to each channel. Hmm. OK, I guess better if we do have it. > + void *last_good_pos = 0; Use NULL. > + last_good_pos = nlmsg_get_pos(msg); > state->split_start++; Maybe we're better off having a local macro for these two lines? That way, we don't risk updating one without the other, which would be confusing. > @@ -2004,81 +2004,78 @@ static int nl80211_send_wiphy(struct cfg80211_registered_device *rdev, > if (!nl_bands) > goto nla_put_failure; > > - for (band = state->band_start; > - band < NUM_NL80211_BANDS; band++) { > + /* Position in the buffer if we added a set of channel info */ > + last_channel_pos = 0; NULL > [snip] > +chan_put_failure: > + if (!last_channel_pos) > + goto nla_put_failure; > + > + nlmsg_trim(msg, last_channel_pos); > + nla_nest_end(msg, nl_freqs); > nla_nest_end(msg, nl_band); > > - if (state->split) { > - /* start again here */ > - if (state->chan_start) > - band--; > + if (state->chan_start < sband->n_channels) > break; > - } > + > + state->chan_start = 0; > + state->band_start++; > } > - nla_nest_end(msg, nl_bands); > > - if (band < NUM_NL80211_BANDS) > - state->band_start = band + 1; > - else > - state->band_start = 0; > +band_put_failure: > + if (!last_channel_pos) > + goto nla_put_failure; > + > + nla_nest_end(msg, nl_bands); > > - /* if bands & channels are done, continue outside */ > - if (state->band_start == 0 && state->chan_start == 0) > - state->split_start++; > - if (state->split) > + if (state->band_start < NUM_NL80211_BANDS) > break; Thinking out loud, maybe we could simplify this by just having a small "stack" of nested attributes to end? I mean, essentially, you have here similar code to the nla_put_failure label, in that it finishes and sends out the message, except here you have to end a bunch of nested attributes. What if we did something like #define dump_nest_start(msg, attr) ({ \ struct nlattr r = nla_nest_start_noflag(msg, attr); \ BUG_ON(nest_stack_depth >= ARRAY_SIZE(nest_stack); \ nest_stack[nest_stack_depth++] = r; \ r; \ }) #define dump_nest_end(msg, r) do { \ BUG_ON(nest_stack_depth > 0); \ nest_stack_depth--; \ BUG_ON(nest_stack[nest_stack_depth] == r); \ nla_nest_end(msg, r); \ } while (0) or something like that (we probably don't want to use nla_nest_start_noflag() for future attributes, etc. but anyway). Then we could unwind any nesting at the end in the common code at the nla_put_failure label very easily, I think? > + * applications that are not legacy, e.g. ones that requested i.e. :) johannes