* [net-next PATCH 0/2] Add ethtool support for completion event size
@ 2022-02-17 14:49 Subbaraya Sundeep
2022-02-17 14:49 ` [net-next PATCH 1/2] ethtool: add support to set/get " Subbaraya Sundeep
` (2 more replies)
0 siblings, 3 replies; 9+ messages in thread
From: Subbaraya Sundeep @ 2022-02-17 14:49 UTC (permalink / raw)
To: davem, kuba, netdev, sundeep.lkml
Cc: hkelam, gakula, sgoutham, Subbaraya Sundeep
After a packet is sent or received by NIC then NIC posts
a completion event which consists of transmission status
(like send success or error) and received status(like
pointers to packet fragments). These completion events may
also use a ring similar to rx and tx rings. This patchset
introduces ce-size ethtool parameter to modify the size
of the completion event if NIC hardware has that capability.
A bigger completion event can have more receive buffer pointers
inturn NIC can transfer a bigger frame from wire as long as
hardware(MAC) receive frame size limit is not exceeded.
Patch 1 adds support setting/getting ce-size via
ethtool -G and ethtool -g.
Patch 2 includes octeontx2 driver changes to use
completion event size set from ethtool -G.
Thanks,
Sundeep
Subbaraya Sundeep (2):
ethtool: add support to set/get completion event size
octeontx2-pf: Vary completion queue event size
Documentation/networking/ethtool-netlink.rst | 2 ++
.../net/ethernet/marvell/octeontx2/nic/otx2_common.c | 4 ++--
.../net/ethernet/marvell/octeontx2/nic/otx2_common.h | 1 +
.../net/ethernet/marvell/octeontx2/nic/otx2_ethtool.c | 17 ++++++++++++++---
drivers/net/ethernet/marvell/octeontx2/nic/otx2_pf.c | 2 ++
drivers/net/ethernet/marvell/octeontx2/nic/otx2_vf.c | 2 ++
include/linux/ethtool.h | 3 +++
include/uapi/linux/ethtool_netlink.h | 1 +
net/ethtool/netlink.h | 2 +-
net/ethtool/rings.c | 19 +++++++++++++++++--
10 files changed, 45 insertions(+), 8 deletions(-)
--
2.7.4
^ permalink raw reply [flat|nested] 9+ messages in thread
* [net-next PATCH 1/2] ethtool: add support to set/get completion event size
2022-02-17 14:49 [net-next PATCH 0/2] Add ethtool support for completion event size Subbaraya Sundeep
@ 2022-02-17 14:49 ` Subbaraya Sundeep
2022-02-17 17:02 ` Jakub Kicinski
2022-02-17 14:49 ` [net-next PATCH 2/2] octeontx2-pf: Vary completion queue " Subbaraya Sundeep
2022-02-17 17:01 ` [net-next PATCH 0/2] Add ethtool support for completion " Jakub Kicinski
2 siblings, 1 reply; 9+ messages in thread
From: Subbaraya Sundeep @ 2022-02-17 14:49 UTC (permalink / raw)
To: davem, kuba, netdev, sundeep.lkml
Cc: hkelam, gakula, sgoutham, Subbaraya Sundeep
Add support to set completion event size via ethtool -G
parameter and get it via ethtool -g parameter.
~ # ./ethtool -G eth0 ce-size 512
~ # ./ethtool -g eth0
Ring parameters for eth0:
Pre-set maximums:
RX: 1048576
RX Mini: n/a
RX Jumbo: n/a
TX: 1048576
Current hardware settings:
RX: 256
RX Mini: n/a
RX Jumbo: n/a
TX: 4096
RX Buf Len: 2048
CE Size: 128
Signed-off-by: Subbaraya Sundeep <sbhatta@marvell.com>
Signed-off-by: Sunil Goutham <sgoutham@marvell.com>
---
Documentation/networking/ethtool-netlink.rst | 2 ++
include/linux/ethtool.h | 3 +++
include/uapi/linux/ethtool_netlink.h | 1 +
net/ethtool/netlink.h | 2 +-
net/ethtool/rings.c | 19 +++++++++++++++++--
5 files changed, 24 insertions(+), 3 deletions(-)
diff --git a/Documentation/networking/ethtool-netlink.rst b/Documentation/networking/ethtool-netlink.rst
index cae28af..e159805 100644
--- a/Documentation/networking/ethtool-netlink.rst
+++ b/Documentation/networking/ethtool-netlink.rst
@@ -861,6 +861,7 @@ Kernel response contents:
``ETHTOOL_A_RINGS_TX`` u32 size of TX ring
``ETHTOOL_A_RINGS_RX_BUF_LEN`` u32 size of buffers on the ring
``ETHTOOL_A_RINGS_TCP_DATA_SPLIT`` u8 TCP header / data split
+ ``ETHTOOL_A_RINGS_CE_SIZE`` u32 TX/RX completion event size
==================================== ====== ===========================
``ETHTOOL_A_RINGS_TCP_DATA_SPLIT`` indicates whether the device is usable with
@@ -885,6 +886,7 @@ Request contents:
``ETHTOOL_A_RINGS_RX_JUMBO`` u32 size of RX jumbo ring
``ETHTOOL_A_RINGS_TX`` u32 size of TX ring
``ETHTOOL_A_RINGS_RX_BUF_LEN`` u32 size of buffers on the ring
+ ``ETHTOOL_A_RINGS_CE_SIZE`` u32 TX/RX completion event size
==================================== ====== ===========================
Kernel checks that requested ring sizes do not exceed limits reported by
diff --git a/include/linux/ethtool.h b/include/linux/ethtool.h
index e0853f4..e3979aa 100644
--- a/include/linux/ethtool.h
+++ b/include/linux/ethtool.h
@@ -71,10 +71,12 @@ enum {
* struct kernel_ethtool_ringparam - RX/TX ring configuration
* @rx_buf_len: Current length of buffers on the rx ring.
* @tcp_data_split: Scatter packet headers and data to separate buffers
+ * @ce_size: Size of TX/RX completion event
*/
struct kernel_ethtool_ringparam {
u32 rx_buf_len;
u8 tcp_data_split;
+ u32 ce_size;
};
/**
@@ -83,6 +85,7 @@ struct kernel_ethtool_ringparam {
*/
enum ethtool_supported_ring_param {
ETHTOOL_RING_USE_RX_BUF_LEN = BIT(0),
+ ETHTOOL_RING_USE_CE_SIZE = BIT(1),
};
#define __ETH_RSS_HASH_BIT(bit) ((u32)1 << (bit))
diff --git a/include/uapi/linux/ethtool_netlink.h b/include/uapi/linux/ethtool_netlink.h
index 417d428..15fed00 100644
--- a/include/uapi/linux/ethtool_netlink.h
+++ b/include/uapi/linux/ethtool_netlink.h
@@ -337,6 +337,7 @@ enum {
ETHTOOL_A_RINGS_TX, /* u32 */
ETHTOOL_A_RINGS_RX_BUF_LEN, /* u32 */
ETHTOOL_A_RINGS_TCP_DATA_SPLIT, /* u8 */
+ ETHTOOL_A_RINGS_CE_SIZE, /* u32 */
/* add new constants above here */
__ETHTOOL_A_RINGS_CNT,
diff --git a/net/ethtool/netlink.h b/net/ethtool/netlink.h
index 75856db..b7fac61 100644
--- a/net/ethtool/netlink.h
+++ b/net/ethtool/netlink.h
@@ -363,7 +363,7 @@ extern const struct nla_policy ethnl_features_set_policy[ETHTOOL_A_FEATURES_WANT
extern const struct nla_policy ethnl_privflags_get_policy[ETHTOOL_A_PRIVFLAGS_HEADER + 1];
extern const struct nla_policy ethnl_privflags_set_policy[ETHTOOL_A_PRIVFLAGS_FLAGS + 1];
extern const struct nla_policy ethnl_rings_get_policy[ETHTOOL_A_RINGS_HEADER + 1];
-extern const struct nla_policy ethnl_rings_set_policy[ETHTOOL_A_RINGS_RX_BUF_LEN + 1];
+extern const struct nla_policy ethnl_rings_set_policy[ETHTOOL_A_RINGS_CE_SIZE + 1];
extern const struct nla_policy ethnl_channels_get_policy[ETHTOOL_A_CHANNELS_HEADER + 1];
extern const struct nla_policy ethnl_channels_set_policy[ETHTOOL_A_CHANNELS_COMBINED_COUNT + 1];
extern const struct nla_policy ethnl_coalesce_get_policy[ETHTOOL_A_COALESCE_HEADER + 1];
diff --git a/net/ethtool/rings.c b/net/ethtool/rings.c
index 18a5035..2778368 100644
--- a/net/ethtool/rings.c
+++ b/net/ethtool/rings.c
@@ -54,7 +54,8 @@ static int rings_reply_size(const struct ethnl_req_info *req_base,
nla_total_size(sizeof(u32)) + /* _RINGS_RX_JUMBO */
nla_total_size(sizeof(u32)) + /* _RINGS_TX */
nla_total_size(sizeof(u32)) + /* _RINGS_RX_BUF_LEN */
- nla_total_size(sizeof(u8)); /* _RINGS_TCP_DATA_SPLIT */
+ nla_total_size(sizeof(u8)) + /* _RINGS_TCP_DATA_SPLIT */
+ nla_total_size(sizeof(u32)); /* _RINGS_CE_SIZE */
}
static int rings_fill_reply(struct sk_buff *skb,
@@ -91,7 +92,9 @@ static int rings_fill_reply(struct sk_buff *skb,
(nla_put_u32(skb, ETHTOOL_A_RINGS_RX_BUF_LEN, kr->rx_buf_len))) ||
(kr->tcp_data_split &&
(nla_put_u8(skb, ETHTOOL_A_RINGS_TCP_DATA_SPLIT,
- kr->tcp_data_split))))
+ kr->tcp_data_split))) ||
+ (kr->ce_size &&
+ (nla_put_u32(skb, ETHTOOL_A_RINGS_CE_SIZE, kr->ce_size))))
return -EMSGSIZE;
return 0;
@@ -119,6 +122,7 @@ const struct nla_policy ethnl_rings_set_policy[] = {
[ETHTOOL_A_RINGS_RX_JUMBO] = { .type = NLA_U32 },
[ETHTOOL_A_RINGS_TX] = { .type = NLA_U32 },
[ETHTOOL_A_RINGS_RX_BUF_LEN] = NLA_POLICY_MIN(NLA_U32, 1),
+ [ETHTOOL_A_RINGS_CE_SIZE] = NLA_POLICY_MIN(NLA_U32, 1),
};
int ethnl_set_rings(struct sk_buff *skb, struct genl_info *info)
@@ -159,6 +163,8 @@ int ethnl_set_rings(struct sk_buff *skb, struct genl_info *info)
ethnl_update_u32(&ringparam.tx_pending, tb[ETHTOOL_A_RINGS_TX], &mod);
ethnl_update_u32(&kernel_ringparam.rx_buf_len,
tb[ETHTOOL_A_RINGS_RX_BUF_LEN], &mod);
+ ethnl_update_u32(&kernel_ringparam.ce_size,
+ tb[ETHTOOL_A_RINGS_CE_SIZE], &mod);
ret = 0;
if (!mod)
goto out_ops;
@@ -190,6 +196,15 @@ int ethnl_set_rings(struct sk_buff *skb, struct genl_info *info)
goto out_ops;
}
+ if (kernel_ringparam.ce_size &&
+ !(ops->supported_ring_params & ETHTOOL_RING_USE_CE_SIZE)) {
+ ret = -EOPNOTSUPP;
+ NL_SET_ERR_MSG_ATTR(info->extack,
+ tb[ETHTOOL_A_RINGS_CE_SIZE],
+ "setting ce size not supported");
+ goto out_ops;
+ }
+
ret = dev->ethtool_ops->set_ringparam(dev, &ringparam,
&kernel_ringparam, info->extack);
if (ret < 0)
--
2.7.4
^ permalink raw reply related [flat|nested] 9+ messages in thread
* [net-next PATCH 2/2] octeontx2-pf: Vary completion queue event size
2022-02-17 14:49 [net-next PATCH 0/2] Add ethtool support for completion event size Subbaraya Sundeep
2022-02-17 14:49 ` [net-next PATCH 1/2] ethtool: add support to set/get " Subbaraya Sundeep
@ 2022-02-17 14:49 ` Subbaraya Sundeep
2022-02-17 17:01 ` [net-next PATCH 0/2] Add ethtool support for completion " Jakub Kicinski
2 siblings, 0 replies; 9+ messages in thread
From: Subbaraya Sundeep @ 2022-02-17 14:49 UTC (permalink / raw)
To: davem, kuba, netdev, sundeep.lkml
Cc: hkelam, gakula, sgoutham, Subbaraya Sundeep
Completion Queue Entry(CQE) is a descriptor written
by hardware to notify software about the send and
receive completion status. The CQE can be of size
128 or 512 bytes. A 512 bytes CQE can hold more receive
fragments pointers compared to 128 bytes CQE. This
patch enables to modify CQE size using:
<ethtool -G ce-size N>.
Signed-off-by: Subbaraya Sundeep <sbhatta@marvell.com>
Signed-off-by: Sunil Goutham <sgoutham@marvell.com>
---
.../net/ethernet/marvell/octeontx2/nic/otx2_common.c | 4 ++--
.../net/ethernet/marvell/octeontx2/nic/otx2_common.h | 1 +
.../net/ethernet/marvell/octeontx2/nic/otx2_ethtool.c | 17 ++++++++++++++---
drivers/net/ethernet/marvell/octeontx2/nic/otx2_pf.c | 2 ++
drivers/net/ethernet/marvell/octeontx2/nic/otx2_vf.c | 2 ++
5 files changed, 21 insertions(+), 5 deletions(-)
diff --git a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_common.c b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_common.c
index 2c97608..b9d7601 100644
--- a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_common.c
+++ b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_common.c
@@ -1048,7 +1048,7 @@ int otx2_config_nix(struct otx2_nic *pfvf)
struct nix_lf_alloc_rsp *rsp;
int err;
- pfvf->qset.xqe_size = NIX_XQESZ_W16 ? 128 : 512;
+ pfvf->qset.xqe_size = pfvf->hw.xqe_size;
/* Get memory to put this msg */
nixlf = otx2_mbox_alloc_msg_nix_lf_alloc(&pfvf->mbox);
@@ -1061,7 +1061,7 @@ int otx2_config_nix(struct otx2_nic *pfvf)
nixlf->cq_cnt = pfvf->qset.cq_cnt;
nixlf->rss_sz = MAX_RSS_INDIR_TBL_SIZE;
nixlf->rss_grps = MAX_RSS_GROUPS;
- nixlf->xqe_sz = NIX_XQESZ_W16;
+ nixlf->xqe_sz = pfvf->hw.xqe_size == 128 ? NIX_XQESZ_W16 : NIX_XQESZ_W64;
/* We don't know absolute NPA LF idx attached.
* AF will replace 'RVU_DEFAULT_PF_FUNC' with
* NPA LF attached to this RVU PF/VF.
diff --git a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_common.h b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_common.h
index 7724f17..f34da5d 100644
--- a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_common.h
+++ b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_common.h
@@ -180,6 +180,7 @@ struct otx2_hw {
#define OTX2_DEFAULT_RBUF_LEN 2048
u16 rbuf_len;
+ u32 xqe_size;
/* NPA */
u32 stack_pg_ptrs; /* No of ptrs per stack page */
diff --git a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_ethtool.c b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_ethtool.c
index abe5267..d851b67 100644
--- a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_ethtool.c
+++ b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_ethtool.c
@@ -372,6 +372,7 @@ static void otx2_get_ringparam(struct net_device *netdev,
ring->tx_max_pending = Q_COUNT(Q_SIZE_MAX);
ring->tx_pending = qs->sqe_cnt ? qs->sqe_cnt : Q_COUNT(Q_SIZE_4K);
kernel_ring->rx_buf_len = pfvf->hw.rbuf_len;
+ kernel_ring->ce_size = pfvf->hw.xqe_size;
}
static int otx2_set_ringparam(struct net_device *netdev,
@@ -382,6 +383,7 @@ static int otx2_set_ringparam(struct net_device *netdev,
struct otx2_nic *pfvf = netdev_priv(netdev);
u32 rx_buf_len = kernel_ring->rx_buf_len;
u32 old_rx_buf_len = pfvf->hw.rbuf_len;
+ u32 xqe_size = kernel_ring->ce_size;
bool if_up = netif_running(netdev);
struct otx2_qset *qs = &pfvf->qset;
u32 rx_count, tx_count;
@@ -398,6 +400,12 @@ static int otx2_set_ringparam(struct net_device *netdev,
return -EINVAL;
}
+ if (xqe_size != 128 && xqe_size != 512) {
+ netdev_err(netdev,
+ "Completion event size must be 128 or 512");
+ return -EINVAL;
+ }
+
/* Permitted lengths are 16 64 256 1K 4K 16K 64K 256K 1M */
rx_count = ring->rx_pending;
/* On some silicon variants a skid or reserved CQEs are
@@ -416,7 +424,7 @@ static int otx2_set_ringparam(struct net_device *netdev,
tx_count = Q_COUNT(Q_SIZE(tx_count, 3));
if (tx_count == qs->sqe_cnt && rx_count == qs->rqe_cnt &&
- rx_buf_len == old_rx_buf_len)
+ rx_buf_len == old_rx_buf_len && xqe_size == pfvf->hw.xqe_size)
return 0;
if (if_up)
@@ -427,6 +435,7 @@ static int otx2_set_ringparam(struct net_device *netdev,
qs->rqe_cnt = rx_count;
pfvf->hw.rbuf_len = rx_buf_len;
+ pfvf->hw.xqe_size = xqe_size;
if (if_up)
return netdev->netdev_ops->ndo_open(netdev);
@@ -1222,7 +1231,8 @@ static int otx2_set_link_ksettings(struct net_device *netdev,
static const struct ethtool_ops otx2_ethtool_ops = {
.supported_coalesce_params = ETHTOOL_COALESCE_USECS |
ETHTOOL_COALESCE_MAX_FRAMES,
- .supported_ring_params = ETHTOOL_RING_USE_RX_BUF_LEN,
+ .supported_ring_params = ETHTOOL_RING_USE_RX_BUF_LEN |
+ ETHTOOL_RING_USE_CE_SIZE,
.get_link = otx2_get_link,
.get_drvinfo = otx2_get_drvinfo,
.get_strings = otx2_get_strings,
@@ -1342,7 +1352,8 @@ static int otx2vf_get_link_ksettings(struct net_device *netdev,
static const struct ethtool_ops otx2vf_ethtool_ops = {
.supported_coalesce_params = ETHTOOL_COALESCE_USECS |
ETHTOOL_COALESCE_MAX_FRAMES,
- .supported_ring_params = ETHTOOL_RING_USE_RX_BUF_LEN,
+ .supported_ring_params = ETHTOOL_RING_USE_RX_BUF_LEN |
+ ETHTOOL_RING_USE_CE_SIZE,
.get_link = otx2_get_link,
.get_drvinfo = otx2vf_get_drvinfo,
.get_strings = otx2vf_get_strings,
diff --git a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_pf.c b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_pf.c
index a536916..441aafc 100644
--- a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_pf.c
+++ b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_pf.c
@@ -2585,6 +2585,8 @@ static int otx2_probe(struct pci_dev *pdev, const struct pci_device_id *id)
hw->tot_tx_queues = qcount;
hw->max_queues = qcount;
hw->rbuf_len = OTX2_DEFAULT_RBUF_LEN;
+ /* Use CQE of 128 byte descriptor size by default */
+ hw->xqe_size = 128;
num_vec = pci_msix_vec_count(pdev);
hw->irq_name = devm_kmalloc_array(&hw->pdev->dev, num_vec, NAME_SIZE,
diff --git a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_vf.c b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_vf.c
index a232e20..9e87836 100644
--- a/drivers/net/ethernet/marvell/octeontx2/nic/otx2_vf.c
+++ b/drivers/net/ethernet/marvell/octeontx2/nic/otx2_vf.c
@@ -572,6 +572,8 @@ static int otx2vf_probe(struct pci_dev *pdev, const struct pci_device_id *id)
hw->max_queues = qcount;
hw->tot_tx_queues = qcount;
hw->rbuf_len = OTX2_DEFAULT_RBUF_LEN;
+ /* Use CQE of 128 byte descriptor size by default */
+ hw->xqe_size = 128;
hw->irq_name = devm_kmalloc_array(&hw->pdev->dev, num_vec, NAME_SIZE,
GFP_KERNEL);
--
2.7.4
^ permalink raw reply related [flat|nested] 9+ messages in thread
* Re: [net-next PATCH 0/2] Add ethtool support for completion event size
2022-02-17 14:49 [net-next PATCH 0/2] Add ethtool support for completion event size Subbaraya Sundeep
2022-02-17 14:49 ` [net-next PATCH 1/2] ethtool: add support to set/get " Subbaraya Sundeep
2022-02-17 14:49 ` [net-next PATCH 2/2] octeontx2-pf: Vary completion queue " Subbaraya Sundeep
@ 2022-02-17 17:01 ` Jakub Kicinski
2022-02-18 5:37 ` sundeep subbaraya
2 siblings, 1 reply; 9+ messages in thread
From: Jakub Kicinski @ 2022-02-17 17:01 UTC (permalink / raw)
To: Subbaraya Sundeep; +Cc: davem, netdev, sundeep.lkml, hkelam, gakula, sgoutham
On Thu, 17 Feb 2022 20:19:04 +0530 Subbaraya Sundeep wrote:
> After a packet is sent or received by NIC then NIC posts
> a completion event which consists of transmission status
> (like send success or error) and received status(like
> pointers to packet fragments). These completion events may
> also use a ring similar to rx and tx rings. This patchset
> introduces ce-size ethtool parameter to modify the size
> of the completion event if NIC hardware has that capability.
> A bigger completion event can have more receive buffer pointers
> inturn NIC can transfer a bigger frame from wire as long as
> hardware(MAC) receive frame size limit is not exceeded.
>
> Patch 1 adds support setting/getting ce-size via
> ethtool -G and ethtool -g.
>
> Patch 2 includes octeontx2 driver changes to use
> completion event size set from ethtool -G.
Please add an explanation to ethtool-netlink.rst so people can
understand what the semantics are.
I think we may want to rename CE -> CQE, we used cqe for IRQ config.
Does changing the CQE size also change the size of the completion ring?
Or does it only control aggregation / writeback size?
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [net-next PATCH 1/2] ethtool: add support to set/get completion event size
2022-02-17 14:49 ` [net-next PATCH 1/2] ethtool: add support to set/get " Subbaraya Sundeep
@ 2022-02-17 17:02 ` Jakub Kicinski
2022-02-18 8:10 ` sundeep subbaraya
0 siblings, 1 reply; 9+ messages in thread
From: Jakub Kicinski @ 2022-02-17 17:02 UTC (permalink / raw)
To: Subbaraya Sundeep; +Cc: davem, netdev, sundeep.lkml, hkelam, gakula, sgoutham
On Thu, 17 Feb 2022 20:19:05 +0530 Subbaraya Sundeep wrote:
> Add support to set completion event size via ethtool -G
> parameter and get it via ethtool -g parameter.
> @@ -83,6 +85,7 @@ struct kernel_ethtool_ringparam {
> */
> enum ethtool_supported_ring_param {
> ETHTOOL_RING_USE_RX_BUF_LEN = BIT(0),
> + ETHTOOL_RING_USE_CE_SIZE = BIT(1),
> };
include/linux/ethtool.h:90: warning: Enum value 'ETHTOOL_RING_USE_CE_SIZE' not described in enum 'ethtool_supported_ring_param'
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [net-next PATCH 0/2] Add ethtool support for completion event size
2022-02-17 17:01 ` [net-next PATCH 0/2] Add ethtool support for completion " Jakub Kicinski
@ 2022-02-18 5:37 ` sundeep subbaraya
2022-02-19 4:29 ` Jakub Kicinski
0 siblings, 1 reply; 9+ messages in thread
From: sundeep subbaraya @ 2022-02-18 5:37 UTC (permalink / raw)
To: Jakub Kicinski
Cc: Subbaraya Sundeep, David Miller, netdev, hariprasad,
Geetha sowjanya, Sunil Kovvuri Goutham
Hi Jakub,
On Thu, Feb 17, 2022 at 10:31 PM Jakub Kicinski <kuba@kernel.org> wrote:
>
> On Thu, 17 Feb 2022 20:19:04 +0530 Subbaraya Sundeep wrote:
> > After a packet is sent or received by NIC then NIC posts
> > a completion event which consists of transmission status
> > (like send success or error) and received status(like
> > pointers to packet fragments). These completion events may
> > also use a ring similar to rx and tx rings. This patchset
> > introduces ce-size ethtool parameter to modify the size
> > of the completion event if NIC hardware has that capability.
> > A bigger completion event can have more receive buffer pointers
> > inturn NIC can transfer a bigger frame from wire as long as
> > hardware(MAC) receive frame size limit is not exceeded.
> >
> > Patch 1 adds support setting/getting ce-size via
> > ethtool -G and ethtool -g.
> >
> > Patch 2 includes octeontx2 driver changes to use
> > completion event size set from ethtool -G.
>
> Please add an explanation to ethtool-netlink.rst so people can
> understand what the semantics are.
>
Sure
> I think we may want to rename CE -> CQE, we used cqe for IRQ config.
>
I used CE because not to be confused with CQE mode in coalesce. I will
change to CQE
> Does changing the CQE size also change the size of the completion ring?
> Or does it only control aggregation / writeback size?
In our case we change the completion ring size too.
Thanks,
Sundeep
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [net-next PATCH 1/2] ethtool: add support to set/get completion event size
2022-02-17 17:02 ` Jakub Kicinski
@ 2022-02-18 8:10 ` sundeep subbaraya
2022-02-18 11:04 ` sundeep subbaraya
0 siblings, 1 reply; 9+ messages in thread
From: sundeep subbaraya @ 2022-02-18 8:10 UTC (permalink / raw)
To: Jakub Kicinski
Cc: Subbaraya Sundeep, David Miller, netdev, hariprasad,
Geetha sowjanya, Sunil Kovvuri Goutham
Hi Jakub,
On Thu, Feb 17, 2022 at 10:32 PM Jakub Kicinski <kuba@kernel.org> wrote:
>
> On Thu, 17 Feb 2022 20:19:05 +0530 Subbaraya Sundeep wrote:
> > Add support to set completion event size via ethtool -G
> > parameter and get it via ethtool -g parameter.
>
> > @@ -83,6 +85,7 @@ struct kernel_ethtool_ringparam {
> > */
> > enum ethtool_supported_ring_param {
> > ETHTOOL_RING_USE_RX_BUF_LEN = BIT(0),
> > + ETHTOOL_RING_USE_CE_SIZE = BIT(1),
> > };
>
> include/linux/ethtool.h:90: warning: Enum value 'ETHTOOL_RING_USE_CE_SIZE' not described in enum 'ethtool_supported_ring_param'
compiled for ARM64, x86 and with COMPILE_TEST, W=1 but I did not see
any problem.
Please let me know what I am missing here.
Thanks,
Sundeep
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [net-next PATCH 1/2] ethtool: add support to set/get completion event size
2022-02-18 8:10 ` sundeep subbaraya
@ 2022-02-18 11:04 ` sundeep subbaraya
0 siblings, 0 replies; 9+ messages in thread
From: sundeep subbaraya @ 2022-02-18 11:04 UTC (permalink / raw)
To: Jakub Kicinski
Cc: Subbaraya Sundeep, David Miller, netdev, hariprasad,
Geetha sowjanya, Sunil Kovvuri Goutham
Hi,
On Fri, Feb 18, 2022 at 1:40 PM sundeep subbaraya
<sundeep.lkml@gmail.com> wrote:
>
> Hi Jakub,
>
> On Thu, Feb 17, 2022 at 10:32 PM Jakub Kicinski <kuba@kernel.org> wrote:
> >
> > On Thu, 17 Feb 2022 20:19:05 +0530 Subbaraya Sundeep wrote:
> > > Add support to set completion event size via ethtool -G
> > > parameter and get it via ethtool -g parameter.
> >
> > > @@ -83,6 +85,7 @@ struct kernel_ethtool_ringparam {
> > > */
> > > enum ethtool_supported_ring_param {
> > > ETHTOOL_RING_USE_RX_BUF_LEN = BIT(0),
> > > + ETHTOOL_RING_USE_CE_SIZE = BIT(1),
> > > };
> >
> > include/linux/ethtool.h:90: warning: Enum value 'ETHTOOL_RING_USE_CE_SIZE' not described in enum 'ethtool_supported_ring_param'
>
> compiled for ARM64, x86 and with COMPILE_TEST, W=1 but I did not see
> any problem.
> Please let me know what I am missing here.
>
Got it. It is a kdoc warning. Sorry for the noise.
Sundeep
> Thanks,
> Sundeep
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [net-next PATCH 0/2] Add ethtool support for completion event size
2022-02-18 5:37 ` sundeep subbaraya
@ 2022-02-19 4:29 ` Jakub Kicinski
0 siblings, 0 replies; 9+ messages in thread
From: Jakub Kicinski @ 2022-02-19 4:29 UTC (permalink / raw)
To: sundeep subbaraya
Cc: Subbaraya Sundeep, David Miller, netdev, hariprasad,
Geetha sowjanya, Sunil Kovvuri Goutham
On Fri, 18 Feb 2022 11:07:11 +0530 sundeep subbaraya wrote:
> > Does changing the CQE size also change the size of the completion ring?
> > Or does it only control aggregation / writeback size?
>
> In our case we change the completion ring size too.
Okay, sounds good. Let's make sure the behavior is documented.
^ permalink raw reply [flat|nested] 9+ messages in thread
end of thread, other threads:[~2022-02-19 4:30 UTC | newest]
Thread overview: 9+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-02-17 14:49 [net-next PATCH 0/2] Add ethtool support for completion event size Subbaraya Sundeep
2022-02-17 14:49 ` [net-next PATCH 1/2] ethtool: add support to set/get " Subbaraya Sundeep
2022-02-17 17:02 ` Jakub Kicinski
2022-02-18 8:10 ` sundeep subbaraya
2022-02-18 11:04 ` sundeep subbaraya
2022-02-17 14:49 ` [net-next PATCH 2/2] octeontx2-pf: Vary completion queue " Subbaraya Sundeep
2022-02-17 17:01 ` [net-next PATCH 0/2] Add ethtool support for completion " Jakub Kicinski
2022-02-18 5:37 ` sundeep subbaraya
2022-02-19 4:29 ` Jakub Kicinski
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).