* [PATCH net 1/1] igc: read before write to SRRCTL register
@ 2023-04-13 15:12 ` Song Yoong Siang
0 siblings, 0 replies; 17+ messages in thread
From: Song Yoong Siang @ 2023-04-13 15:12 UTC (permalink / raw)
To: Jesse Brandeburg, Tony Nguyen, David S . Miller, Eric Dumazet,
Jakub Kicinski, Paolo Abeni, Alexei Starovoitov, Daniel Borkmann,
Jesper Dangaard Brouer, John Fastabend, Maciej Fijalkowski,
Vedang Patel, Jithu Joseph, Andre Guedes, Jesper Dangaard Brouer,
Stanislav Fomichev
Cc: intel-wired-lan, netdev, linux-kernel, bpf, xdp-hints, stable,
Song Yoong Siang
igc_configure_rx_ring() function will be called as part of XDP program
setup. If Rx hardware timestamp is enabled prio to XDP program setup,
this timestamp enablement will be overwritten when buffer size is
written into SRRCTL register.
Thus, this commit read the register value before write to SRRCTL
register. This commit is tested by using xdp_hw_metadata bpf selftest
tool. The tool enables Rx hardware timestamp and then attach XDP program
to igc driver. It will display hardware timestamp of UDP packet with
port number 9092. Below are detail of test steps and results.
Command on DUT:
sudo ./xdp_hw_metadata <interface name>
Command on Link Partner:
echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
Result before this patch:
skb hwtstamp is not found!
Result after this patch:
found skb hwtstamp = 1677762212.590696226
Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
Cc: <stable@vger.kernel.org> # 5.14+
Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
---
drivers/net/ethernet/intel/igc/igc_base.h | 7 +++++--
drivers/net/ethernet/intel/igc/igc_main.c | 5 ++++-
2 files changed, 9 insertions(+), 3 deletions(-)
diff --git a/drivers/net/ethernet/intel/igc/igc_base.h b/drivers/net/ethernet/intel/igc/igc_base.h
index 7a992befca24..b95007d51d13 100644
--- a/drivers/net/ethernet/intel/igc/igc_base.h
+++ b/drivers/net/ethernet/intel/igc/igc_base.h
@@ -87,8 +87,11 @@ union igc_adv_rx_desc {
#define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive Software Flush */
/* SRRCTL bit definitions */
-#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
-#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
+#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
+#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
+#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
+#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
+#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
#define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
#endif /* _IGC_BASE_H */
diff --git a/drivers/net/ethernet/intel/igc/igc_main.c b/drivers/net/ethernet/intel/igc/igc_main.c
index 25fc6c65209b..de7b21c2ccd6 100644
--- a/drivers/net/ethernet/intel/igc/igc_main.c
+++ b/drivers/net/ethernet/intel/igc/igc_main.c
@@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter *adapter,
else
buf_size = IGC_RXBUFFER_2048;
- srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
+ srrctl = rd32(IGC_SRRCTL(reg_idx));
+ srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK | IGC_SRRCTL_BSIZEHDRSIZE_MASK |
+ IGC_SRRCTL_DESCTYPE_MASK);
+ srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
--
2.34.1
^ permalink raw reply related [flat|nested] 17+ messages in thread* [Intel-wired-lan] [PATCH net 1/1] igc: read before write to SRRCTL register
@ 2023-04-13 15:12 ` Song Yoong Siang
0 siblings, 0 replies; 17+ messages in thread
From: Song Yoong Siang @ 2023-04-13 15:12 UTC (permalink / raw)
To: Jesse Brandeburg, Tony Nguyen, David S . Miller, Eric Dumazet,
Jakub Kicinski, Paolo Abeni, Alexei Starovoitov, Daniel Borkmann,
Jesper Dangaard Brouer, John Fastabend, Maciej Fijalkowski,
Vedang Patel, Jithu Joseph, Andre Guedes, Jesper Dangaard Brouer,
Stanislav Fomichev
Cc: xdp-hints, netdev, linux-kernel, stable, intel-wired-lan,
Song Yoong Siang, bpf
igc_configure_rx_ring() function will be called as part of XDP program
setup. If Rx hardware timestamp is enabled prio to XDP program setup,
this timestamp enablement will be overwritten when buffer size is
written into SRRCTL register.
Thus, this commit read the register value before write to SRRCTL
register. This commit is tested by using xdp_hw_metadata bpf selftest
tool. The tool enables Rx hardware timestamp and then attach XDP program
to igc driver. It will display hardware timestamp of UDP packet with
port number 9092. Below are detail of test steps and results.
Command on DUT:
sudo ./xdp_hw_metadata <interface name>
Command on Link Partner:
echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
Result before this patch:
skb hwtstamp is not found!
Result after this patch:
found skb hwtstamp = 1677762212.590696226
Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
Cc: <stable@vger.kernel.org> # 5.14+
Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
---
drivers/net/ethernet/intel/igc/igc_base.h | 7 +++++--
drivers/net/ethernet/intel/igc/igc_main.c | 5 ++++-
2 files changed, 9 insertions(+), 3 deletions(-)
diff --git a/drivers/net/ethernet/intel/igc/igc_base.h b/drivers/net/ethernet/intel/igc/igc_base.h
index 7a992befca24..b95007d51d13 100644
--- a/drivers/net/ethernet/intel/igc/igc_base.h
+++ b/drivers/net/ethernet/intel/igc/igc_base.h
@@ -87,8 +87,11 @@ union igc_adv_rx_desc {
#define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive Software Flush */
/* SRRCTL bit definitions */
-#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
-#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
+#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
+#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
+#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
+#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
+#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
#define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
#endif /* _IGC_BASE_H */
diff --git a/drivers/net/ethernet/intel/igc/igc_main.c b/drivers/net/ethernet/intel/igc/igc_main.c
index 25fc6c65209b..de7b21c2ccd6 100644
--- a/drivers/net/ethernet/intel/igc/igc_main.c
+++ b/drivers/net/ethernet/intel/igc/igc_main.c
@@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter *adapter,
else
buf_size = IGC_RXBUFFER_2048;
- srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
+ srrctl = rd32(IGC_SRRCTL(reg_idx));
+ srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK | IGC_SRRCTL_BSIZEHDRSIZE_MASK |
+ IGC_SRRCTL_DESCTYPE_MASK);
+ srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
--
2.34.1
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan
^ permalink raw reply related [flat|nested] 17+ messages in thread* Re: [PATCH net 1/1] igc: read before write to SRRCTL register
2023-04-13 15:12 ` [Intel-wired-lan] " Song Yoong Siang
@ 2023-04-13 16:54 ` Jacob Keller
-1 siblings, 0 replies; 17+ messages in thread
From: Jacob Keller @ 2023-04-13 16:54 UTC (permalink / raw)
To: Song Yoong Siang, Jesse Brandeburg, Tony Nguyen,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Maciej Fijalkowski, Vedang Patel, Jithu Joseph,
Andre Guedes, Jesper Dangaard Brouer, Stanislav Fomichev
Cc: intel-wired-lan, netdev, linux-kernel, bpf, xdp-hints, stable
On 4/13/2023 8:12 AM, Song Yoong Siang wrote:
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
> Thus, this commit read the register value before write to SRRCTL
> register. This commit is tested by using xdp_hw_metadata bpf selftest
> tool. The tool enables Rx hardware timestamp and then attach XDP program
> to igc driver. It will display hardware timestamp of UDP packet with
> port number 9092. Below are detail of test steps and results.
>
> Command on DUT:
> sudo ./xdp_hw_metadata <interface name>
>
> Command on Link Partner:
> echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
>
> Result before this patch:
> skb hwtstamp is not found!
>
> Result after this patch:
> found skb hwtstamp = 1677762212.590696226
>
> Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
> Cc: <stable@vger.kernel.org> # 5.14+
> Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
Reviewed-by: Jacob Keller <jacob.e.keller@intel.com>
^ permalink raw reply [flat|nested] 17+ messages in thread* Re: [Intel-wired-lan] [PATCH net 1/1] igc: read before write to SRRCTL register
@ 2023-04-13 16:54 ` Jacob Keller
0 siblings, 0 replies; 17+ messages in thread
From: Jacob Keller @ 2023-04-13 16:54 UTC (permalink / raw)
To: Song Yoong Siang, Jesse Brandeburg, Tony Nguyen,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Maciej Fijalkowski, Vedang Patel, Jithu Joseph,
Andre Guedes, Jesper Dangaard Brouer, Stanislav Fomichev
Cc: xdp-hints, netdev, linux-kernel, stable, intel-wired-lan, bpf
On 4/13/2023 8:12 AM, Song Yoong Siang wrote:
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
> Thus, this commit read the register value before write to SRRCTL
> register. This commit is tested by using xdp_hw_metadata bpf selftest
> tool. The tool enables Rx hardware timestamp and then attach XDP program
> to igc driver. It will display hardware timestamp of UDP packet with
> port number 9092. Below are detail of test steps and results.
>
> Command on DUT:
> sudo ./xdp_hw_metadata <interface name>
>
> Command on Link Partner:
> echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
>
> Result before this patch:
> skb hwtstamp is not found!
>
> Result after this patch:
> found skb hwtstamp = 1677762212.590696226
>
> Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
> Cc: <stable@vger.kernel.org> # 5.14+
> Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
Reviewed-by: Jacob Keller <jacob.e.keller@intel.com>
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan
^ permalink raw reply [flat|nested] 17+ messages in thread
* Re: [Intel-wired-lan] [PATCH net 1/1] igc: read before write to SRRCTL register
2023-04-13 15:12 ` [Intel-wired-lan] " Song Yoong Siang
@ 2023-04-13 18:42 ` Jesper Dangaard Brouer
-1 siblings, 0 replies; 17+ messages in thread
From: Jesper Dangaard Brouer @ 2023-04-13 18:42 UTC (permalink / raw)
To: Song Yoong Siang, Jesse Brandeburg, Tony Nguyen,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Maciej Fijalkowski, Vedang Patel, Jithu Joseph,
Andre Guedes, Stanislav Fomichev
Cc: xdp-hints, netdev, linux-kernel, stable, intel-wired-lan, brouer, bpf
On 13/04/2023 17.12, Song Yoong Siang wrote:
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
Ah, I believe I have hit this bug with my igc patches.
Thanks for fixing.
> Thus, this commit read the register value before write to SRRCTL
> register. This commit is tested by using xdp_hw_metadata bpf selftest
> tool. The tool enables Rx hardware timestamp and then attach XDP program
> to igc driver. It will display hardware timestamp of UDP packet with
> port number 9092. Below are detail of test steps and results.
>
> Command on DUT:
> sudo ./xdp_hw_metadata <interface name>
>
Why port 9092 ?
The ./xdp_hw_metadata prog will redirect port 9091
> Command on Link Partner:
> echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
>
Again port 9092 ?
> Result before this patch:
> skb hwtstamp is not found!
>
> Result after this patch:
> found skb hwtstamp = 1677762212.590696226
I usually use this cmd to see if number is sane:
$ date -d @1677762212
2023-03-02T14:03:32 CET
>
> Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
> Cc: <stable@vger.kernel.org> # 5.14+
> Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
> ---
> drivers/net/ethernet/intel/igc/igc_base.h | 7 +++++--
> drivers/net/ethernet/intel/igc/igc_main.c | 5 ++++-
> 2 files changed, 9 insertions(+), 3 deletions(-)
>
> diff --git a/drivers/net/ethernet/intel/igc/igc_base.h b/drivers/net/ethernet/intel/igc/igc_base.h
> index 7a992befca24..b95007d51d13 100644
> --- a/drivers/net/ethernet/intel/igc/igc_base.h
> +++ b/drivers/net/ethernet/intel/igc/igc_base.h
> @@ -87,8 +87,11 @@ union igc_adv_rx_desc {
> #define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive Software Flush */
>
> /* SRRCTL bit definitions */
> -#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
> -#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
> +#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
> +#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
> +#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
> +#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
> +#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
> #define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
>
> #endif /* _IGC_BASE_H */
> diff --git a/drivers/net/ethernet/intel/igc/igc_main.c b/drivers/net/ethernet/intel/igc/igc_main.c
> index 25fc6c65209b..de7b21c2ccd6 100644
> --- a/drivers/net/ethernet/intel/igc/igc_main.c
> +++ b/drivers/net/ethernet/intel/igc/igc_main.c
> @@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter *adapter,
> else
> buf_size = IGC_RXBUFFER_2048;
>
> - srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
> + srrctl = rd32(IGC_SRRCTL(reg_idx));
> + srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK | IGC_SRRCTL_BSIZEHDRSIZE_MASK |
> + IGC_SRRCTL_DESCTYPE_MASK);
> + srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
> srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
> srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
>
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan
^ permalink raw reply [flat|nested] 17+ messages in thread* Re: [PATCH net 1/1] igc: read before write to SRRCTL register
@ 2023-04-13 18:42 ` Jesper Dangaard Brouer
0 siblings, 0 replies; 17+ messages in thread
From: Jesper Dangaard Brouer @ 2023-04-13 18:42 UTC (permalink / raw)
To: Song Yoong Siang, Jesse Brandeburg, Tony Nguyen,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Maciej Fijalkowski, Vedang Patel, Jithu Joseph,
Andre Guedes, Stanislav Fomichev
Cc: brouer, intel-wired-lan, netdev, linux-kernel, bpf, xdp-hints, stable
On 13/04/2023 17.12, Song Yoong Siang wrote:
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
Ah, I believe I have hit this bug with my igc patches.
Thanks for fixing.
> Thus, this commit read the register value before write to SRRCTL
> register. This commit is tested by using xdp_hw_metadata bpf selftest
> tool. The tool enables Rx hardware timestamp and then attach XDP program
> to igc driver. It will display hardware timestamp of UDP packet with
> port number 9092. Below are detail of test steps and results.
>
> Command on DUT:
> sudo ./xdp_hw_metadata <interface name>
>
Why port 9092 ?
The ./xdp_hw_metadata prog will redirect port 9091
> Command on Link Partner:
> echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
>
Again port 9092 ?
> Result before this patch:
> skb hwtstamp is not found!
>
> Result after this patch:
> found skb hwtstamp = 1677762212.590696226
I usually use this cmd to see if number is sane:
$ date -d @1677762212
2023-03-02T14:03:32 CET
>
> Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
> Cc: <stable@vger.kernel.org> # 5.14+
> Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
> ---
> drivers/net/ethernet/intel/igc/igc_base.h | 7 +++++--
> drivers/net/ethernet/intel/igc/igc_main.c | 5 ++++-
> 2 files changed, 9 insertions(+), 3 deletions(-)
>
> diff --git a/drivers/net/ethernet/intel/igc/igc_base.h b/drivers/net/ethernet/intel/igc/igc_base.h
> index 7a992befca24..b95007d51d13 100644
> --- a/drivers/net/ethernet/intel/igc/igc_base.h
> +++ b/drivers/net/ethernet/intel/igc/igc_base.h
> @@ -87,8 +87,11 @@ union igc_adv_rx_desc {
> #define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive Software Flush */
>
> /* SRRCTL bit definitions */
> -#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
> -#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
> +#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
> +#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
> +#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
> +#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
> +#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
> #define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
>
> #endif /* _IGC_BASE_H */
> diff --git a/drivers/net/ethernet/intel/igc/igc_main.c b/drivers/net/ethernet/intel/igc/igc_main.c
> index 25fc6c65209b..de7b21c2ccd6 100644
> --- a/drivers/net/ethernet/intel/igc/igc_main.c
> +++ b/drivers/net/ethernet/intel/igc/igc_main.c
> @@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter *adapter,
> else
> buf_size = IGC_RXBUFFER_2048;
>
> - srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
> + srrctl = rd32(IGC_SRRCTL(reg_idx));
> + srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK | IGC_SRRCTL_BSIZEHDRSIZE_MASK |
> + IGC_SRRCTL_DESCTYPE_MASK);
> + srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
> srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
> srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
>
^ permalink raw reply [flat|nested] 17+ messages in thread* RE: [PATCH net 1/1] igc: read before write to SRRCTL register
2023-04-13 18:42 ` Jesper Dangaard Brouer
@ 2023-04-14 1:33 ` Song, Yoong Siang
-1 siblings, 0 replies; 17+ messages in thread
From: Song, Yoong Siang @ 2023-04-14 1:33 UTC (permalink / raw)
To: Jesper Dangaard Brouer, Brandeburg, Jesse, Nguyen, Anthony L,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Fijalkowski, Maciej, Vedang Patel, Joseph, Jithu,
Andre Guedes, Stanislav Fomichev
Cc: Brouer, Jesper, intel-wired-lan, netdev, linux-kernel, bpf,
xdp-hints, stable
On Friday, April 14, 2023 2:42 AM, Jesper Dangaard Brouer <jbrouer@redhat.com> wrote:
>On 13/04/2023 17.12, Song Yoong Siang wrote:
>> igc_configure_rx_ring() function will be called as part of XDP program
>> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
>> this timestamp enablement will be overwritten when buffer size is
>> written into SRRCTL register.
>>
>
>Ah, I believe I have hit this bug with my igc patches.
>Thanks for fixing.
No problem. I found it when testing your patches too.
>
>> Thus, this commit read the register value before write to SRRCTL
>> register. This commit is tested by using xdp_hw_metadata bpf selftest
>> tool. The tool enables Rx hardware timestamp and then attach XDP
>> program to igc driver. It will display hardware timestamp of UDP
>> packet with port number 9092. Below are detail of test steps and results.
>>
>> Command on DUT:
>> sudo ./xdp_hw_metadata <interface name>
>>
>
>Why port 9092 ?
>The ./xdp_hw_metadata prog will redirect port 9091
Yes, you are right. But this patch is tested without your patches. So, igc Rx
XDP metadata support is not there. We only can test XDP_PASS which
the timestamp is put into skb. xdp_hw_metadata tool will open a SOCK_DGRAM
server on port 9092 to dump out timestamp in skb.
I use xdp_hw_metadata tool to test because it can reproduce the issue well.
This issue happens only when we enable hw timestamp before attach XDP prog.
No issue if enable hw timestamp after attach XDP prog.
>
>
>> Command on Link Partner:
>> echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
>>
>
>Again port 9092 ?
>
>> Result before this patch:
>> skb hwtstamp is not found!
>>
>> Result after this patch:
>> found skb hwtstamp = 1677762212.590696226
>
>I usually use this cmd to see if number is sane:
>
>$ date -d @1677762212
>2023-03-02T14:03:32 CET
>
Since this patch is focusing on hw timestamp enablement. So I
think checking on whether Rx HW timestamp is there when
rx_filter = HWTSTAMP_FILTER_ALL is good enough.
Thanks & Regards
Siang
>
>>
>> Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
>> Cc: <stable@vger.kernel.org> # 5.14+
>> Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
>> ---
>> drivers/net/ethernet/intel/igc/igc_base.h | 7 +++++--
>> drivers/net/ethernet/intel/igc/igc_main.c | 5 ++++-
>> 2 files changed, 9 insertions(+), 3 deletions(-)
>>
>> diff --git a/drivers/net/ethernet/intel/igc/igc_base.h
>> b/drivers/net/ethernet/intel/igc/igc_base.h
>> index 7a992befca24..b95007d51d13 100644
>> --- a/drivers/net/ethernet/intel/igc/igc_base.h
>> +++ b/drivers/net/ethernet/intel/igc/igc_base.h
>> @@ -87,8 +87,11 @@ union igc_adv_rx_desc {
>> #define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive
>Software Flush */
>>
>> /* SRRCTL bit definitions */
>> -#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
>> -#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
>> +#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
>> +#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
>> +#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
>> +#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
>> +#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
>> #define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
>>
>> #endif /* _IGC_BASE_H */
>> diff --git a/drivers/net/ethernet/intel/igc/igc_main.c
>> b/drivers/net/ethernet/intel/igc/igc_main.c
>> index 25fc6c65209b..de7b21c2ccd6 100644
>> --- a/drivers/net/ethernet/intel/igc/igc_main.c
>> +++ b/drivers/net/ethernet/intel/igc/igc_main.c
>> @@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter
>*adapter,
>> else
>> buf_size = IGC_RXBUFFER_2048;
>>
>> - srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
>> + srrctl = rd32(IGC_SRRCTL(reg_idx));
>> + srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK |
>IGC_SRRCTL_BSIZEHDRSIZE_MASK |
>> + IGC_SRRCTL_DESCTYPE_MASK);
>> + srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
>> srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
>> srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
>>
^ permalink raw reply [flat|nested] 17+ messages in thread* Re: [Intel-wired-lan] [PATCH net 1/1] igc: read before write to SRRCTL register
@ 2023-04-14 1:33 ` Song, Yoong Siang
0 siblings, 0 replies; 17+ messages in thread
From: Song, Yoong Siang @ 2023-04-14 1:33 UTC (permalink / raw)
To: Jesper Dangaard Brouer, Brandeburg, Jesse, Nguyen, Anthony L,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Fijalkowski, Maciej, Vedang Patel, Joseph, Jithu,
Andre Guedes, Stanislav Fomichev
Cc: xdp-hints, netdev, linux-kernel, stable, intel-wired-lan, Brouer,
Jesper, bpf
On Friday, April 14, 2023 2:42 AM, Jesper Dangaard Brouer <jbrouer@redhat.com> wrote:
>On 13/04/2023 17.12, Song Yoong Siang wrote:
>> igc_configure_rx_ring() function will be called as part of XDP program
>> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
>> this timestamp enablement will be overwritten when buffer size is
>> written into SRRCTL register.
>>
>
>Ah, I believe I have hit this bug with my igc patches.
>Thanks for fixing.
No problem. I found it when testing your patches too.
>
>> Thus, this commit read the register value before write to SRRCTL
>> register. This commit is tested by using xdp_hw_metadata bpf selftest
>> tool. The tool enables Rx hardware timestamp and then attach XDP
>> program to igc driver. It will display hardware timestamp of UDP
>> packet with port number 9092. Below are detail of test steps and results.
>>
>> Command on DUT:
>> sudo ./xdp_hw_metadata <interface name>
>>
>
>Why port 9092 ?
>The ./xdp_hw_metadata prog will redirect port 9091
Yes, you are right. But this patch is tested without your patches. So, igc Rx
XDP metadata support is not there. We only can test XDP_PASS which
the timestamp is put into skb. xdp_hw_metadata tool will open a SOCK_DGRAM
server on port 9092 to dump out timestamp in skb.
I use xdp_hw_metadata tool to test because it can reproduce the issue well.
This issue happens only when we enable hw timestamp before attach XDP prog.
No issue if enable hw timestamp after attach XDP prog.
>
>
>> Command on Link Partner:
>> echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
>>
>
>Again port 9092 ?
>
>> Result before this patch:
>> skb hwtstamp is not found!
>>
>> Result after this patch:
>> found skb hwtstamp = 1677762212.590696226
>
>I usually use this cmd to see if number is sane:
>
>$ date -d @1677762212
>2023-03-02T14:03:32 CET
>
Since this patch is focusing on hw timestamp enablement. So I
think checking on whether Rx HW timestamp is there when
rx_filter = HWTSTAMP_FILTER_ALL is good enough.
Thanks & Regards
Siang
>
>>
>> Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
>> Cc: <stable@vger.kernel.org> # 5.14+
>> Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
>> ---
>> drivers/net/ethernet/intel/igc/igc_base.h | 7 +++++--
>> drivers/net/ethernet/intel/igc/igc_main.c | 5 ++++-
>> 2 files changed, 9 insertions(+), 3 deletions(-)
>>
>> diff --git a/drivers/net/ethernet/intel/igc/igc_base.h
>> b/drivers/net/ethernet/intel/igc/igc_base.h
>> index 7a992befca24..b95007d51d13 100644
>> --- a/drivers/net/ethernet/intel/igc/igc_base.h
>> +++ b/drivers/net/ethernet/intel/igc/igc_base.h
>> @@ -87,8 +87,11 @@ union igc_adv_rx_desc {
>> #define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive
>Software Flush */
>>
>> /* SRRCTL bit definitions */
>> -#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
>> -#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
>> +#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
>> +#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
>> +#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
>> +#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
>> +#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
>> #define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
>>
>> #endif /* _IGC_BASE_H */
>> diff --git a/drivers/net/ethernet/intel/igc/igc_main.c
>> b/drivers/net/ethernet/intel/igc/igc_main.c
>> index 25fc6c65209b..de7b21c2ccd6 100644
>> --- a/drivers/net/ethernet/intel/igc/igc_main.c
>> +++ b/drivers/net/ethernet/intel/igc/igc_main.c
>> @@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter
>*adapter,
>> else
>> buf_size = IGC_RXBUFFER_2048;
>>
>> - srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
>> + srrctl = rd32(IGC_SRRCTL(reg_idx));
>> + srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK |
>IGC_SRRCTL_BSIZEHDRSIZE_MASK |
>> + IGC_SRRCTL_DESCTYPE_MASK);
>> + srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
>> srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
>> srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
>>
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan
^ permalink raw reply [flat|nested] 17+ messages in thread
* Re: [PATCH net 1/1] igc: read before write to SRRCTL register
2023-04-13 15:12 ` [Intel-wired-lan] " Song Yoong Siang
@ 2023-04-13 19:05 ` Jesper Dangaard Brouer
-1 siblings, 0 replies; 17+ messages in thread
From: Jesper Dangaard Brouer @ 2023-04-13 19:05 UTC (permalink / raw)
To: Song Yoong Siang, Jesse Brandeburg, Tony Nguyen,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Maciej Fijalkowski, Vedang Patel, Jithu Joseph,
Andre Guedes, Stanislav Fomichev
Cc: brouer, intel-wired-lan, netdev, linux-kernel, bpf, xdp-hints, stable
On 13/04/2023 17.12, Song Yoong Siang wrote:
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
> Thus, this commit read the register value before write to SRRCTL
> register. This commit is tested by using xdp_hw_metadata bpf selftest
> tool. The tool enables Rx hardware timestamp and then attach XDP program
> to igc driver. It will display hardware timestamp of UDP packet with
> port number 9092. Below are detail of test steps and results.
[...]
> diff --git a/drivers/net/ethernet/intel/igc/igc_base.h b/drivers/net/ethernet/intel/igc/igc_base.h
> index 7a992befca24..b95007d51d13 100644
> --- a/drivers/net/ethernet/intel/igc/igc_base.h
> +++ b/drivers/net/ethernet/intel/igc/igc_base.h
> @@ -87,8 +87,11 @@ union igc_adv_rx_desc {
> #define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive Software Flush */
>
> /* SRRCTL bit definitions */
> -#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
> -#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
> +#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
> +#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
> +#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
> +#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
> +#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
> #define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
>
> #endif /* _IGC_BASE_H */
> diff --git a/drivers/net/ethernet/intel/igc/igc_main.c b/drivers/net/ethernet/intel/igc/igc_main.c
> index 25fc6c65209b..de7b21c2ccd6 100644
> --- a/drivers/net/ethernet/intel/igc/igc_main.c
> +++ b/drivers/net/ethernet/intel/igc/igc_main.c
> @@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter *adapter,
> else
> buf_size = IGC_RXBUFFER_2048;
>
> - srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
> + srrctl = rd32(IGC_SRRCTL(reg_idx));
> + srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK | IGC_SRRCTL_BSIZEHDRSIZE_MASK |
> + IGC_SRRCTL_DESCTYPE_MASK);
^^
Please fix indention, moving IGC_SRRCTL_DESCTYPE_MASK such that it
aligns with IGC_SRRCTL_BSIZEPKT_MASK. This make is easier for the eye
to spot that it is part of the negation (~).
> + srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
> srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
> srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
>
^ permalink raw reply [flat|nested] 17+ messages in thread* Re: [Intel-wired-lan] [PATCH net 1/1] igc: read before write to SRRCTL register
@ 2023-04-13 19:05 ` Jesper Dangaard Brouer
0 siblings, 0 replies; 17+ messages in thread
From: Jesper Dangaard Brouer @ 2023-04-13 19:05 UTC (permalink / raw)
To: Song Yoong Siang, Jesse Brandeburg, Tony Nguyen,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Maciej Fijalkowski, Vedang Patel, Jithu Joseph,
Andre Guedes, Stanislav Fomichev
Cc: xdp-hints, netdev, linux-kernel, stable, intel-wired-lan, brouer, bpf
On 13/04/2023 17.12, Song Yoong Siang wrote:
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
> Thus, this commit read the register value before write to SRRCTL
> register. This commit is tested by using xdp_hw_metadata bpf selftest
> tool. The tool enables Rx hardware timestamp and then attach XDP program
> to igc driver. It will display hardware timestamp of UDP packet with
> port number 9092. Below are detail of test steps and results.
[...]
> diff --git a/drivers/net/ethernet/intel/igc/igc_base.h b/drivers/net/ethernet/intel/igc/igc_base.h
> index 7a992befca24..b95007d51d13 100644
> --- a/drivers/net/ethernet/intel/igc/igc_base.h
> +++ b/drivers/net/ethernet/intel/igc/igc_base.h
> @@ -87,8 +87,11 @@ union igc_adv_rx_desc {
> #define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive Software Flush */
>
> /* SRRCTL bit definitions */
> -#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
> -#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
> +#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
> +#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
> +#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
> +#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
> +#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
> #define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
>
> #endif /* _IGC_BASE_H */
> diff --git a/drivers/net/ethernet/intel/igc/igc_main.c b/drivers/net/ethernet/intel/igc/igc_main.c
> index 25fc6c65209b..de7b21c2ccd6 100644
> --- a/drivers/net/ethernet/intel/igc/igc_main.c
> +++ b/drivers/net/ethernet/intel/igc/igc_main.c
> @@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter *adapter,
> else
> buf_size = IGC_RXBUFFER_2048;
>
> - srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
> + srrctl = rd32(IGC_SRRCTL(reg_idx));
> + srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK | IGC_SRRCTL_BSIZEHDRSIZE_MASK |
> + IGC_SRRCTL_DESCTYPE_MASK);
^^
Please fix indention, moving IGC_SRRCTL_DESCTYPE_MASK such that it
aligns with IGC_SRRCTL_BSIZEPKT_MASK. This make is easier for the eye
to spot that it is part of the negation (~).
> + srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
> srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
> srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
>
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan
^ permalink raw reply [flat|nested] 17+ messages in thread* RE: [PATCH net 1/1] igc: read before write to SRRCTL register
2023-04-13 19:05 ` [Intel-wired-lan] " Jesper Dangaard Brouer
@ 2023-04-14 1:36 ` Song, Yoong Siang
-1 siblings, 0 replies; 17+ messages in thread
From: Song, Yoong Siang @ 2023-04-14 1:36 UTC (permalink / raw)
To: Jesper Dangaard Brouer, Brandeburg, Jesse, Nguyen, Anthony L,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Fijalkowski, Maciej, Vedang Patel, Joseph, Jithu,
Andre Guedes, Stanislav Fomichev
Cc: Brouer, Jesper, intel-wired-lan, netdev, linux-kernel, bpf,
xdp-hints, stable
On Friday, April 14, 2023 3:06 AM , Jesper Dangaard Brouer <jbrouer@redhat.com> wrote:
>On 13/04/2023 17.12, Song Yoong Siang wrote:
>> igc_configure_rx_ring() function will be called as part of XDP program
>> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
>> this timestamp enablement will be overwritten when buffer size is
>> written into SRRCTL register.
>>
>> Thus, this commit read the register value before write to SRRCTL
>> register. This commit is tested by using xdp_hw_metadata bpf selftest
>> tool. The tool enables Rx hardware timestamp and then attach XDP
>> program to igc driver. It will display hardware timestamp of UDP
>> packet with port number 9092. Below are detail of test steps and results.
>[...]
>> diff --git a/drivers/net/ethernet/intel/igc/igc_base.h
>> b/drivers/net/ethernet/intel/igc/igc_base.h
>> index 7a992befca24..b95007d51d13 100644
>> --- a/drivers/net/ethernet/intel/igc/igc_base.h
>> +++ b/drivers/net/ethernet/intel/igc/igc_base.h
>> @@ -87,8 +87,11 @@ union igc_adv_rx_desc {
>> #define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive Software Flush */
>>
>> /* SRRCTL bit definitions */
>> -#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
>> -#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
>> +#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
>> +#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
>> +#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
>> +#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
>> +#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
>> #define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
>>
>> #endif /* _IGC_BASE_H */
>> diff --git a/drivers/net/ethernet/intel/igc/igc_main.c
>> b/drivers/net/ethernet/intel/igc/igc_main.c
>> index 25fc6c65209b..de7b21c2ccd6 100644
>> --- a/drivers/net/ethernet/intel/igc/igc_main.c
>> +++ b/drivers/net/ethernet/intel/igc/igc_main.c
>> @@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter *adapter,
>> else
>> buf_size = IGC_RXBUFFER_2048;
>>
>> - srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
>> + srrctl = rd32(IGC_SRRCTL(reg_idx));
>> + srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK | IGC_SRRCTL_BSIZEHDRSIZE_MASK |
>> + IGC_SRRCTL_DESCTYPE_MASK);
> ^^
>Please fix indention, moving IGC_SRRCTL_DESCTYPE_MASK such that it aligns
>with IGC_SRRCTL_BSIZEPKT_MASK. This make is easier for the eye to spot that it
>is part of the negation (~).
Sure. Thanks for your comment. I will fix it in v2.
>
>> + srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
>> srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
>> srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
>>
^ permalink raw reply [flat|nested] 17+ messages in thread* Re: [Intel-wired-lan] [PATCH net 1/1] igc: read before write to SRRCTL register
@ 2023-04-14 1:36 ` Song, Yoong Siang
0 siblings, 0 replies; 17+ messages in thread
From: Song, Yoong Siang @ 2023-04-14 1:36 UTC (permalink / raw)
To: Jesper Dangaard Brouer, Brandeburg, Jesse, Nguyen, Anthony L,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Fijalkowski, Maciej, Vedang Patel, Joseph, Jithu,
Andre Guedes, Stanislav Fomichev
Cc: xdp-hints, netdev, linux-kernel, stable, intel-wired-lan, Brouer,
Jesper, bpf
On Friday, April 14, 2023 3:06 AM , Jesper Dangaard Brouer <jbrouer@redhat.com> wrote:
>On 13/04/2023 17.12, Song Yoong Siang wrote:
>> igc_configure_rx_ring() function will be called as part of XDP program
>> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
>> this timestamp enablement will be overwritten when buffer size is
>> written into SRRCTL register.
>>
>> Thus, this commit read the register value before write to SRRCTL
>> register. This commit is tested by using xdp_hw_metadata bpf selftest
>> tool. The tool enables Rx hardware timestamp and then attach XDP
>> program to igc driver. It will display hardware timestamp of UDP
>> packet with port number 9092. Below are detail of test steps and results.
>[...]
>> diff --git a/drivers/net/ethernet/intel/igc/igc_base.h
>> b/drivers/net/ethernet/intel/igc/igc_base.h
>> index 7a992befca24..b95007d51d13 100644
>> --- a/drivers/net/ethernet/intel/igc/igc_base.h
>> +++ b/drivers/net/ethernet/intel/igc/igc_base.h
>> @@ -87,8 +87,11 @@ union igc_adv_rx_desc {
>> #define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive Software Flush */
>>
>> /* SRRCTL bit definitions */
>> -#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
>> -#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
>> +#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
>> +#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
>> +#define IGC_SRRCTL_BSIZEHDRSIZE_MASK GENMASK(13, 8)
>> +#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
>> +#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
>> #define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
>>
>> #endif /* _IGC_BASE_H */
>> diff --git a/drivers/net/ethernet/intel/igc/igc_main.c
>> b/drivers/net/ethernet/intel/igc/igc_main.c
>> index 25fc6c65209b..de7b21c2ccd6 100644
>> --- a/drivers/net/ethernet/intel/igc/igc_main.c
>> +++ b/drivers/net/ethernet/intel/igc/igc_main.c
>> @@ -641,7 +641,10 @@ static void igc_configure_rx_ring(struct igc_adapter *adapter,
>> else
>> buf_size = IGC_RXBUFFER_2048;
>>
>> - srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
>> + srrctl = rd32(IGC_SRRCTL(reg_idx));
>> + srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK | IGC_SRRCTL_BSIZEHDRSIZE_MASK |
>> + IGC_SRRCTL_DESCTYPE_MASK);
> ^^
>Please fix indention, moving IGC_SRRCTL_DESCTYPE_MASK such that it aligns
>with IGC_SRRCTL_BSIZEPKT_MASK. This make is easier for the eye to spot that it
>is part of the negation (~).
Sure. Thanks for your comment. I will fix it in v2.
>
>> + srrctl |= IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
>> srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
>> srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
>>
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan
^ permalink raw reply [flat|nested] 17+ messages in thread
* Re: [Intel-wired-lan] [PATCH net 1/1] igc: read before write to SRRCTL register
2023-04-13 15:12 ` [Intel-wired-lan] " Song Yoong Siang
@ 2023-04-30 5:03 ` naamax.meir
-1 siblings, 0 replies; 17+ messages in thread
From: naamax.meir @ 2023-04-30 5:03 UTC (permalink / raw)
To: Song Yoong Siang, Jesse Brandeburg, Tony Nguyen,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Maciej Fijalkowski, Vedang Patel, Jithu Joseph,
Andre Guedes, Jesper Dangaard Brouer, Stanislav Fomichev
Cc: xdp-hints, netdev, linux-kernel, stable, intel-wired-lan, bpf
On 4/13/2023 18:12, Song Yoong Siang wrote:
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
> Thus, this commit read the register value before write to SRRCTL
> register. This commit is tested by using xdp_hw_metadata bpf selftest
> tool. The tool enables Rx hardware timestamp and then attach XDP program
> to igc driver. It will display hardware timestamp of UDP packet with
> port number 9092. Below are detail of test steps and results.
>
> Command on DUT:
> sudo ./xdp_hw_metadata <interface name>
>
> Command on Link Partner:
> echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
>
> Result before this patch:
> skb hwtstamp is not found!
>
> Result after this patch:
> found skb hwtstamp = 1677762212.590696226
>
> Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
> Cc: <stable@vger.kernel.org> # 5.14+
> Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
> ---
> drivers/net/ethernet/intel/igc/igc_base.h | 7 +++++--
> drivers/net/ethernet/intel/igc/igc_main.c | 5 ++++-
> 2 files changed, 9 insertions(+), 3 deletions(-)
Tested-by: Naama Meir <naamax.meir@linux.intel.com>
^ permalink raw reply [flat|nested] 17+ messages in thread* Re: [Intel-wired-lan] [PATCH net 1/1] igc: read before write to SRRCTL register
@ 2023-04-30 5:03 ` naamax.meir
0 siblings, 0 replies; 17+ messages in thread
From: naamax.meir @ 2023-04-30 5:03 UTC (permalink / raw)
To: Song Yoong Siang, Jesse Brandeburg, Tony Nguyen,
David S . Miller, Eric Dumazet, Jakub Kicinski, Paolo Abeni,
Alexei Starovoitov, Daniel Borkmann, Jesper Dangaard Brouer,
John Fastabend, Maciej Fijalkowski, Vedang Patel, Jithu Joseph,
Andre Guedes, Jesper Dangaard Brouer, Stanislav Fomichev
Cc: xdp-hints, netdev, linux-kernel, stable, intel-wired-lan, bpf
On 4/13/2023 18:12, Song Yoong Siang wrote:
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
> Thus, this commit read the register value before write to SRRCTL
> register. This commit is tested by using xdp_hw_metadata bpf selftest
> tool. The tool enables Rx hardware timestamp and then attach XDP program
> to igc driver. It will display hardware timestamp of UDP packet with
> port number 9092. Below are detail of test steps and results.
>
> Command on DUT:
> sudo ./xdp_hw_metadata <interface name>
>
> Command on Link Partner:
> echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
>
> Result before this patch:
> skb hwtstamp is not found!
>
> Result after this patch:
> found skb hwtstamp = 1677762212.590696226
>
> Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
> Cc: <stable@vger.kernel.org> # 5.14+
> Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
> ---
> drivers/net/ethernet/intel/igc/igc_base.h | 7 +++++--
> drivers/net/ethernet/intel/igc/igc_main.c | 5 ++++-
> 2 files changed, 9 insertions(+), 3 deletions(-)
Tested-by: Naama Meir <naamax.meir@linux.intel.com>
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan
^ permalink raw reply [flat|nested] 17+ messages in thread
* [PATCH net 1/1] igc: read before write to SRRCTL register
@ 2023-05-02 15:48 Tony Nguyen
2023-05-03 8:07 ` Leon Romanovsky
2023-05-03 8:20 ` patchwork-bot+netdevbpf
0 siblings, 2 replies; 17+ messages in thread
From: Tony Nguyen @ 2023-05-02 15:48 UTC (permalink / raw)
To: davem, kuba, pabeni, edumazet, netdev
Cc: Song Yoong Siang, anthony.l.nguyen, sasha.neftin,
maciej.fijalkowski, magnus.karlsson, ast, daniel, hawk,
john.fastabend, bpf, stable, Jacob Keller,
Jesper Dangaard Brouer, Naama Meir
From: Song Yoong Siang <yoong.siang.song@intel.com>
igc_configure_rx_ring() function will be called as part of XDP program
setup. If Rx hardware timestamp is enabled prio to XDP program setup,
this timestamp enablement will be overwritten when buffer size is
written into SRRCTL register.
Thus, this commit read the register value before write to SRRCTL
register. This commit is tested by using xdp_hw_metadata bpf selftest
tool. The tool enables Rx hardware timestamp and then attach XDP program
to igc driver. It will display hardware timestamp of UDP packet with
port number 9092. Below are detail of test steps and results.
Command on DUT:
sudo ./xdp_hw_metadata <interface name>
Command on Link Partner:
echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
Result before this patch:
skb hwtstamp is not found!
Result after this patch:
found skb hwtstamp = 1677800973.642836757
Optionally, read PHC to confirm the values obtained are almost the same:
Command:
sudo ./testptp -d /dev/ptp0 -g
Result:
clock time: 1677800973.913598978 or Fri Mar 3 07:49:33 2023
Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
Cc: <stable@vger.kernel.org> # 5.14+
Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
Reviewed-by: Jacob Keller <jacob.e.keller@intel.com>
Reviewed-by: Jesper Dangaard Brouer <brouer@redhat.com>
Tested-by: Jesper Dangaard Brouer <brouer@redhat.com>
Tested-by: Naama Meir <naamax.meir@linux.intel.com>
Signed-off-by: Tony Nguyen <anthony.l.nguyen@intel.com>
---
drivers/net/ethernet/intel/igc/igc_base.h | 11 ++++++++---
drivers/net/ethernet/intel/igc/igc_main.c | 7 +++++--
2 files changed, 13 insertions(+), 5 deletions(-)
diff --git a/drivers/net/ethernet/intel/igc/igc_base.h b/drivers/net/ethernet/intel/igc/igc_base.h
index 7a992befca24..9f3827eda157 100644
--- a/drivers/net/ethernet/intel/igc/igc_base.h
+++ b/drivers/net/ethernet/intel/igc/igc_base.h
@@ -87,8 +87,13 @@ union igc_adv_rx_desc {
#define IGC_RXDCTL_SWFLUSH 0x04000000 /* Receive Software Flush */
/* SRRCTL bit definitions */
-#define IGC_SRRCTL_BSIZEPKT_SHIFT 10 /* Shift _right_ */
-#define IGC_SRRCTL_BSIZEHDRSIZE_SHIFT 2 /* Shift _left_ */
-#define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF 0x02000000
+#define IGC_SRRCTL_BSIZEPKT_MASK GENMASK(6, 0)
+#define IGC_SRRCTL_BSIZEPKT(x) FIELD_PREP(IGC_SRRCTL_BSIZEPKT_MASK, \
+ (x) / 1024) /* in 1 KB resolution */
+#define IGC_SRRCTL_BSIZEHDR_MASK GENMASK(13, 8)
+#define IGC_SRRCTL_BSIZEHDR(x) FIELD_PREP(IGC_SRRCTL_BSIZEHDR_MASK, \
+ (x) / 64) /* in 64 bytes resolution */
+#define IGC_SRRCTL_DESCTYPE_MASK GENMASK(27, 25)
+#define IGC_SRRCTL_DESCTYPE_ADV_ONEBUF FIELD_PREP(IGC_SRRCTL_DESCTYPE_MASK, 1)
#endif /* _IGC_BASE_H */
diff --git a/drivers/net/ethernet/intel/igc/igc_main.c b/drivers/net/ethernet/intel/igc/igc_main.c
index ba49728be919..1c4676882082 100644
--- a/drivers/net/ethernet/intel/igc/igc_main.c
+++ b/drivers/net/ethernet/intel/igc/igc_main.c
@@ -640,8 +640,11 @@ static void igc_configure_rx_ring(struct igc_adapter *adapter,
else
buf_size = IGC_RXBUFFER_2048;
- srrctl = IGC_RX_HDR_LEN << IGC_SRRCTL_BSIZEHDRSIZE_SHIFT;
- srrctl |= buf_size >> IGC_SRRCTL_BSIZEPKT_SHIFT;
+ srrctl = rd32(IGC_SRRCTL(reg_idx));
+ srrctl &= ~(IGC_SRRCTL_BSIZEPKT_MASK | IGC_SRRCTL_BSIZEHDR_MASK |
+ IGC_SRRCTL_DESCTYPE_MASK);
+ srrctl |= IGC_SRRCTL_BSIZEHDR(IGC_RX_HDR_LEN);
+ srrctl |= IGC_SRRCTL_BSIZEPKT(buf_size);
srrctl |= IGC_SRRCTL_DESCTYPE_ADV_ONEBUF;
wr32(IGC_SRRCTL(reg_idx), srrctl);
--
2.38.1
^ permalink raw reply related [flat|nested] 17+ messages in thread* Re: [PATCH net 1/1] igc: read before write to SRRCTL register
2023-05-02 15:48 Tony Nguyen
@ 2023-05-03 8:07 ` Leon Romanovsky
2023-05-03 8:20 ` patchwork-bot+netdevbpf
1 sibling, 0 replies; 17+ messages in thread
From: Leon Romanovsky @ 2023-05-03 8:07 UTC (permalink / raw)
To: Tony Nguyen
Cc: davem, kuba, pabeni, edumazet, netdev, Song Yoong Siang,
sasha.neftin, maciej.fijalkowski, magnus.karlsson, ast, daniel,
hawk, john.fastabend, bpf, stable, Jacob Keller,
Jesper Dangaard Brouer, Naama Meir
On Tue, May 02, 2023 at 08:48:06AM -0700, Tony Nguyen wrote:
> From: Song Yoong Siang <yoong.siang.song@intel.com>
>
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
> Thus, this commit read the register value before write to SRRCTL
> register. This commit is tested by using xdp_hw_metadata bpf selftest
> tool. The tool enables Rx hardware timestamp and then attach XDP program
> to igc driver. It will display hardware timestamp of UDP packet with
> port number 9092. Below are detail of test steps and results.
>
> Command on DUT:
> sudo ./xdp_hw_metadata <interface name>
>
> Command on Link Partner:
> echo -n skb | nc -u -q1 <destination IPv4 addr> 9092
>
> Result before this patch:
> skb hwtstamp is not found!
>
> Result after this patch:
> found skb hwtstamp = 1677800973.642836757
>
> Optionally, read PHC to confirm the values obtained are almost the same:
> Command:
> sudo ./testptp -d /dev/ptp0 -g
> Result:
> clock time: 1677800973.913598978 or Fri Mar 3 07:49:33 2023
>
> Fixes: fc9df2a0b520 ("igc: Enable RX via AF_XDP zero-copy")
> Cc: <stable@vger.kernel.org> # 5.14+
> Signed-off-by: Song Yoong Siang <yoong.siang.song@intel.com>
> Reviewed-by: Jacob Keller <jacob.e.keller@intel.com>
> Reviewed-by: Jesper Dangaard Brouer <brouer@redhat.com>
> Tested-by: Jesper Dangaard Brouer <brouer@redhat.com>
> Tested-by: Naama Meir <naamax.meir@linux.intel.com>
> Signed-off-by: Tony Nguyen <anthony.l.nguyen@intel.com>
> ---
> drivers/net/ethernet/intel/igc/igc_base.h | 11 ++++++++---
> drivers/net/ethernet/intel/igc/igc_main.c | 7 +++++--
> 2 files changed, 13 insertions(+), 5 deletions(-)
>
Thanks,
Reviewed-by: Leon Romanovsky <leonro@nvidia.com>
^ permalink raw reply [flat|nested] 17+ messages in thread* Re: [PATCH net 1/1] igc: read before write to SRRCTL register
2023-05-02 15:48 Tony Nguyen
2023-05-03 8:07 ` Leon Romanovsky
@ 2023-05-03 8:20 ` patchwork-bot+netdevbpf
1 sibling, 0 replies; 17+ messages in thread
From: patchwork-bot+netdevbpf @ 2023-05-03 8:20 UTC (permalink / raw)
To: Tony Nguyen
Cc: davem, kuba, pabeni, edumazet, netdev, yoong.siang.song,
sasha.neftin, maciej.fijalkowski, magnus.karlsson, ast, daniel,
hawk, john.fastabend, bpf, stable, jacob.e.keller, brouer,
naamax.meir
Hello:
This patch was applied to netdev/net.git (main)
by David S. Miller <davem@davemloft.net>:
On Tue, 2 May 2023 08:48:06 -0700 you wrote:
> From: Song Yoong Siang <yoong.siang.song@intel.com>
>
> igc_configure_rx_ring() function will be called as part of XDP program
> setup. If Rx hardware timestamp is enabled prio to XDP program setup,
> this timestamp enablement will be overwritten when buffer size is
> written into SRRCTL register.
>
> [...]
Here is the summary with links:
- [net,1/1] igc: read before write to SRRCTL register
https://git.kernel.org/netdev/net/c/3ce29c17dc84
You are awesome, thank you!
--
Deet-doot-dot, I am a bot.
https://korg.docs.kernel.org/patchwork/pwbot.html
^ permalink raw reply [flat|nested] 17+ messages in thread
end of thread, other threads:[~2023-05-03 8:20 UTC | newest]
Thread overview: 17+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2023-04-13 15:12 [PATCH net 1/1] igc: read before write to SRRCTL register Song Yoong Siang
2023-04-13 15:12 ` [Intel-wired-lan] " Song Yoong Siang
2023-04-13 16:54 ` Jacob Keller
2023-04-13 16:54 ` [Intel-wired-lan] " Jacob Keller
2023-04-13 18:42 ` Jesper Dangaard Brouer
2023-04-13 18:42 ` Jesper Dangaard Brouer
2023-04-14 1:33 ` Song, Yoong Siang
2023-04-14 1:33 ` [Intel-wired-lan] " Song, Yoong Siang
2023-04-13 19:05 ` Jesper Dangaard Brouer
2023-04-13 19:05 ` [Intel-wired-lan] " Jesper Dangaard Brouer
2023-04-14 1:36 ` Song, Yoong Siang
2023-04-14 1:36 ` [Intel-wired-lan] " Song, Yoong Siang
2023-04-30 5:03 ` naamax.meir
2023-04-30 5:03 ` naamax.meir
2023-05-02 15:48 Tony Nguyen
2023-05-03 8:07 ` Leon Romanovsky
2023-05-03 8:20 ` patchwork-bot+netdevbpf
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.