From: Jason Wang <jasowang@redhat.com>
To: Xuan Zhuo <xuanzhuo@linux.alibaba.com>
Cc: netdev@vger.kernel.org, "Michael S. Tsirkin" <mst@redhat.com>,
"David S. Miller" <davem@davemloft.net>,
Eric Dumazet <edumazet@google.com>,
Jakub Kicinski <kuba@kernel.org>, Paolo Abeni <pabeni@redhat.com>,
Alexei Starovoitov <ast@kernel.org>,
Daniel Borkmann <daniel@iogearbox.net>,
Jesper Dangaard Brouer <hawk@kernel.org>,
John Fastabend <john.fastabend@gmail.com>,
virtualization@lists.linux-foundation.org, bpf@vger.kernel.org
Subject: Re: [PATCH net-next 3/8] virtio_net: introduce virtnet_xdp_handler() to seprate the logic of run xdp
Date: Tue, 4 Apr 2023 13:04:02 +0800 [thread overview]
Message-ID: <CACGkMEvfTE1F7Wa3P2do1o+149kSdGkjyVYt6e4r2r5UQZ6ocA@mail.gmail.com> (raw)
In-Reply-To: <1680495148.1559556-3-xuanzhuo@linux.alibaba.com>
On Mon, Apr 3, 2023 at 12:17 PM Xuan Zhuo <xuanzhuo@linux.alibaba.com> wrote:
>
> On Mon, 3 Apr 2023 10:43:03 +0800, Jason Wang <jasowang@redhat.com> wrote:
> > On Tue, Mar 28, 2023 at 8:04 PM Xuan Zhuo <xuanzhuo@linux.alibaba.com> wrote:
> > >
> > > At present, we have two similar logic to perform the XDP prog.
> > >
> > > Therefore, this PATCH separates the code of executing XDP, which is
> > > conducive to later maintenance.
> > >
> > > Signed-off-by: Xuan Zhuo <xuanzhuo@linux.alibaba.com>
> > > ---
> > > drivers/net/virtio_net.c | 142 +++++++++++++++++++++------------------
> > > 1 file changed, 75 insertions(+), 67 deletions(-)
> > >
> > > diff --git a/drivers/net/virtio_net.c b/drivers/net/virtio_net.c
> > > index bb426958cdd4..72b9d6ee4024 100644
> > > --- a/drivers/net/virtio_net.c
> > > +++ b/drivers/net/virtio_net.c
> > > @@ -301,6 +301,15 @@ struct padded_vnet_hdr {
> > > char padding[12];
> > > };
> > >
> > > +enum {
> > > + /* xdp pass */
> > > + VIRTNET_XDP_RES_PASS,
> > > + /* drop packet. the caller needs to release the page. */
> > > + VIRTNET_XDP_RES_DROP,
> > > + /* packet is consumed by xdp. the caller needs to do nothing. */
> > > + VIRTNET_XDP_RES_CONSUMED,
> > > +};
> >
> > I'd prefer this to be done on top unless it is a must. But I don't see
> > any advantage of introducing this, it's partial mapping of XDP action
> > and it needs to be extended when XDP action is extended. (And we've
> > already had: VIRTIO_XDP_REDIR and VIRTIO_XDP_TX ...)
>
> No, these are the three states of buffer after XDP processing.
>
> * PASS: goto make skb
XDP_PASS goes for this.
> * DROP: we should release buffer
XDP_DROP and error conditions go with this.
> * CUNSUMED: xdp prog used the buffer, we do nothing
XDP_TX/XDP_REDIRECTION goes for this.
So t virtnet_xdp_handler() just maps XDP ACTION plus the error
conditions to the above three states.
We can simply map error to XDP_DROP like:
case XDP_TX:
stats->xdp_tx++;
xdpf = xdp_convert_buff_to_frame(xdp);
if (unlikely(!xdpf))
return XDP_DROP;
A good side effect is to avoid the xdp_xmit pointer to be passed to
the function.
>
> The latter two are not particularly related to XDP ACTION. And it does not need
> to extend when XDP action is extended. At least I have not thought of this
> situation.
What's the advantages of such indirection compared to using XDP action directly?
Thanks
>
>
> >
> > > +
> > > static void virtnet_rq_free_unused_buf(struct virtqueue *vq, void *buf);
> > > static void virtnet_sq_free_unused_buf(struct virtqueue *vq, void *buf);
> > >
> > > @@ -789,6 +798,59 @@ static int virtnet_xdp_xmit(struct net_device *dev,
> > > return ret;
> > > }
> > >
> > > +static int virtnet_xdp_handler(struct bpf_prog *xdp_prog, struct xdp_buff *xdp,
> > > + struct net_device *dev,
> > > + unsigned int *xdp_xmit,
> > > + struct virtnet_rq_stats *stats)
> > > +{
> > > + struct xdp_frame *xdpf;
> > > + int err;
> > > + u32 act;
> > > +
> > > + act = bpf_prog_run_xdp(xdp_prog, xdp);
> > > + stats->xdp_packets++;
> > > +
> > > + switch (act) {
> > > + case XDP_PASS:
> > > + return VIRTNET_XDP_RES_PASS;
> > > +
> > > + case XDP_TX:
> > > + stats->xdp_tx++;
> > > + xdpf = xdp_convert_buff_to_frame(xdp);
> > > + if (unlikely(!xdpf))
> > > + return VIRTNET_XDP_RES_DROP;
> > > +
> > > + err = virtnet_xdp_xmit(dev, 1, &xdpf, 0);
> > > + if (unlikely(!err)) {
> > > + xdp_return_frame_rx_napi(xdpf);
> > > + } else if (unlikely(err < 0)) {
> > > + trace_xdp_exception(dev, xdp_prog, act);
> > > + return VIRTNET_XDP_RES_DROP;
> > > + }
> > > +
> > > + *xdp_xmit |= VIRTIO_XDP_TX;
> > > + return VIRTNET_XDP_RES_CONSUMED;
> > > +
> > > + case XDP_REDIRECT:
> > > + stats->xdp_redirects++;
> > > + err = xdp_do_redirect(dev, xdp, xdp_prog);
> > > + if (err)
> > > + return VIRTNET_XDP_RES_DROP;
> > > +
> > > + *xdp_xmit |= VIRTIO_XDP_REDIR;
> > > + return VIRTNET_XDP_RES_CONSUMED;
> > > +
> > > + default:
> > > + bpf_warn_invalid_xdp_action(dev, xdp_prog, act);
> > > + fallthrough;
> > > + case XDP_ABORTED:
> > > + trace_xdp_exception(dev, xdp_prog, act);
> > > + fallthrough;
> > > + case XDP_DROP:
> > > + return VIRTNET_XDP_RES_DROP;
> > > + }
> > > +}
> > > +
> > > static unsigned int virtnet_get_headroom(struct virtnet_info *vi)
> > > {
> > > return vi->xdp_enabled ? VIRTIO_XDP_HEADROOM : 0;
> > > @@ -876,7 +938,6 @@ static struct sk_buff *receive_small(struct net_device *dev,
> > > struct page *page = virt_to_head_page(buf);
> > > unsigned int delta = 0;
> > > struct page *xdp_page;
> > > - int err;
> > > unsigned int metasize = 0;
> > >
> > > len -= vi->hdr_len;
> > > @@ -898,7 +959,6 @@ static struct sk_buff *receive_small(struct net_device *dev,
> > > xdp_prog = rcu_dereference(rq->xdp_prog);
> > > if (xdp_prog) {
> > > struct virtio_net_hdr_mrg_rxbuf *hdr = buf + header_offset;
> > > - struct xdp_frame *xdpf;
> > > struct xdp_buff xdp;
> > > void *orig_data;
> > > u32 act;
> > > @@ -931,46 +991,22 @@ static struct sk_buff *receive_small(struct net_device *dev,
> > > xdp_prepare_buff(&xdp, buf + VIRTNET_RX_PAD + vi->hdr_len,
> > > xdp_headroom, len, true);
> > > orig_data = xdp.data;
> > > - act = bpf_prog_run_xdp(xdp_prog, &xdp);
> > > - stats->xdp_packets++;
> > > +
> > > + act = virtnet_xdp_handler(xdp_prog, &xdp, dev, xdp_xmit, stats);
> > >
> > > switch (act) {
> > > - case XDP_PASS:
> > > + case VIRTNET_XDP_RES_PASS:
> > > /* Recalculate length in case bpf program changed it */
> > > delta = orig_data - xdp.data;
> > > len = xdp.data_end - xdp.data;
> > > metasize = xdp.data - xdp.data_meta;
> > > break;
> > > - case XDP_TX:
> > > - stats->xdp_tx++;
> > > - xdpf = xdp_convert_buff_to_frame(&xdp);
> > > - if (unlikely(!xdpf))
> > > - goto err_xdp;
> > > - err = virtnet_xdp_xmit(dev, 1, &xdpf, 0);
> > > - if (unlikely(!err)) {
> > > - xdp_return_frame_rx_napi(xdpf);
> > > - } else if (unlikely(err < 0)) {
> > > - trace_xdp_exception(vi->dev, xdp_prog, act);
> > > - goto err_xdp;
> > > - }
> > > - *xdp_xmit |= VIRTIO_XDP_TX;
> > > - rcu_read_unlock();
> > > - goto xdp_xmit;
> > > - case XDP_REDIRECT:
> > > - stats->xdp_redirects++;
> > > - err = xdp_do_redirect(dev, &xdp, xdp_prog);
> > > - if (err)
> > > - goto err_xdp;
> > > - *xdp_xmit |= VIRTIO_XDP_REDIR;
> > > +
> > > + case VIRTNET_XDP_RES_CONSUMED:
> > > rcu_read_unlock();
> > > goto xdp_xmit;
> > > - default:
> > > - bpf_warn_invalid_xdp_action(vi->dev, xdp_prog, act);
> > > - fallthrough;
> > > - case XDP_ABORTED:
> > > - trace_xdp_exception(vi->dev, xdp_prog, act);
> > > - goto err_xdp;
> > > - case XDP_DROP:
> > > +
> > > + case VIRTNET_XDP_RES_DROP:
> > > goto err_xdp;
> > > }
> > > }
> > > @@ -1277,7 +1313,6 @@ static struct sk_buff *receive_mergeable(struct net_device *dev,
> > > if (xdp_prog) {
> > > unsigned int xdp_frags_truesz = 0;
> > > struct skb_shared_info *shinfo;
> > > - struct xdp_frame *xdpf;
> > > struct page *xdp_page;
> > > struct xdp_buff xdp;
> > > void *data;
> > > @@ -1294,49 +1329,22 @@ static struct sk_buff *receive_mergeable(struct net_device *dev,
> > > if (unlikely(err))
> > > goto err_xdp_frags;
> > >
> > > - act = bpf_prog_run_xdp(xdp_prog, &xdp);
> > > - stats->xdp_packets++;
> > > + act = virtnet_xdp_handler(xdp_prog, &xdp, dev, xdp_xmit, stats);
> > >
> > > switch (act) {
> > > - case XDP_PASS:
> > > + case VIRTNET_XDP_RES_PASS:
> > > head_skb = build_skb_from_xdp_buff(dev, vi, &xdp, xdp_frags_truesz);
> > > if (unlikely(!head_skb))
> > > goto err_xdp_frags;
> > >
> > > rcu_read_unlock();
> > > return head_skb;
> > > - case XDP_TX:
> > > - stats->xdp_tx++;
> > > - xdpf = xdp_convert_buff_to_frame(&xdp);
> > > - if (unlikely(!xdpf)) {
> > > - netdev_dbg(dev, "convert buff to frame failed for xdp\n");
> >
> > Nit: This debug is lost after the conversion.
>
> Will fix.
>
> Thanks.
>
> >
> > Thanks
> >
> > > - goto err_xdp_frags;
> > > - }
> > > - err = virtnet_xdp_xmit(dev, 1, &xdpf, 0);
> > > - if (unlikely(!err)) {
> > > - xdp_return_frame_rx_napi(xdpf);
> > > - } else if (unlikely(err < 0)) {
> > > - trace_xdp_exception(vi->dev, xdp_prog, act);
> > > - goto err_xdp_frags;
> > > - }
> > > - *xdp_xmit |= VIRTIO_XDP_TX;
> > > - rcu_read_unlock();
> > > - goto xdp_xmit;
> > > - case XDP_REDIRECT:
> > > - stats->xdp_redirects++;
> > > - err = xdp_do_redirect(dev, &xdp, xdp_prog);
> > > - if (err)
> > > - goto err_xdp_frags;
> > > - *xdp_xmit |= VIRTIO_XDP_REDIR;
> > > +
> > > + case VIRTNET_XDP_RES_CONSUMED:
> > > rcu_read_unlock();
> > > goto xdp_xmit;
> > > - default:
> > > - bpf_warn_invalid_xdp_action(vi->dev, xdp_prog, act);
> > > - fallthrough;
> > > - case XDP_ABORTED:
> > > - trace_xdp_exception(vi->dev, xdp_prog, act);
> > > - fallthrough;
> > > - case XDP_DROP:
> > > +
> > > + case VIRTNET_XDP_RES_DROP:
> > > goto err_xdp_frags;
> > > }
> > > err_xdp_frags:
> > > --
> > > 2.32.0.3.g01195cf9f
> > >
> >
>
next prev parent reply other threads:[~2023-04-04 5:06 UTC|newest]
Thread overview: 33+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-03-28 12:04 [PATCH net-next 0/8] virtio_net: refactor xdp codes Xuan Zhuo
2023-03-28 12:04 ` [PATCH net-next 1/8] virtio_net: mergeable xdp: put old page immediately Xuan Zhuo
2023-03-31 9:01 ` Jason Wang
2023-04-03 4:11 ` Xuan Zhuo
2023-03-28 12:04 ` [PATCH net-next 2/8] virtio_net: mergeable xdp: introduce mergeable_xdp_prepare Xuan Zhuo
2023-03-31 9:14 ` Jason Wang
2023-04-03 4:11 ` Xuan Zhuo
2023-03-28 12:04 ` [PATCH net-next 3/8] virtio_net: introduce virtnet_xdp_handler() to seprate the logic of run xdp Xuan Zhuo
2023-04-03 2:43 ` Jason Wang
2023-04-03 4:12 ` Xuan Zhuo
2023-04-04 5:04 ` Jason Wang [this message]
2023-04-04 6:11 ` Xuan Zhuo
2023-04-04 6:35 ` Jason Wang
2023-04-04 6:44 ` Xuan Zhuo
2023-04-04 7:01 ` Jason Wang
2023-04-04 7:06 ` Xuan Zhuo
2023-04-04 8:03 ` Jason Wang
2023-04-04 8:09 ` Xuan Zhuo
2023-03-28 12:04 ` [PATCH net-next 4/8] virtio_net: separate the logic of freeing xdp shinfo Xuan Zhuo
2023-04-03 2:44 ` Jason Wang
2023-03-28 12:04 ` [PATCH net-next 5/8] virtio_net: separate the logic of freeing the rest mergeable buf Xuan Zhuo
2023-04-03 2:46 ` Jason Wang
2023-03-28 12:04 ` [PATCH net-next 6/8] virtio_net: auto release xdp shinfo Xuan Zhuo
2023-04-03 3:18 ` Jason Wang
2023-04-03 4:17 ` Xuan Zhuo
2023-03-28 12:04 ` [PATCH net-next 7/8] virtio_net: introduce receive_mergeable_xdp() Xuan Zhuo
2023-03-30 10:18 ` Paolo Abeni
2023-03-31 7:18 ` Xuan Zhuo
2023-03-28 12:04 ` [PATCH net-next 8/8] virtio_net: introduce receive_small_xdp() Xuan Zhuo
2023-03-30 10:48 ` Paolo Abeni
2023-03-31 7:20 ` Xuan Zhuo
2023-03-31 7:24 ` Michael S. Tsirkin
-- strict thread matches above, loose matches on Subject: below --
2023-03-22 3:03 [PATCH net-next 0/8] virtio_net: refactor xdp codes Xuan Zhuo
2023-03-22 3:03 ` [PATCH net-next 3/8] virtio_net: introduce virtnet_xdp_handler() to seprate the logic of run xdp Xuan Zhuo
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CACGkMEvfTE1F7Wa3P2do1o+149kSdGkjyVYt6e4r2r5UQZ6ocA@mail.gmail.com \
--to=jasowang@redhat.com \
--cc=ast@kernel.org \
--cc=bpf@vger.kernel.org \
--cc=daniel@iogearbox.net \
--cc=davem@davemloft.net \
--cc=edumazet@google.com \
--cc=hawk@kernel.org \
--cc=john.fastabend@gmail.com \
--cc=kuba@kernel.org \
--cc=mst@redhat.com \
--cc=netdev@vger.kernel.org \
--cc=pabeni@redhat.com \
--cc=virtualization@lists.linux-foundation.org \
--cc=xuanzhuo@linux.alibaba.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).