From: Tariq Toukan <ttoukan.linux@gmail.com>
To: Jakub Kicinski <kuba@kernel.org>
Cc: davem@davemloft.net, netdev@vger.kernel.org, edumazet@google.com,
pabeni@redhat.com, borisp@nvidia.com, john.fastabend@gmail.com,
maximmi@nvidia.com, tariqt@nvidia.com, vfedorenko@novek.ru,
Gal Pressman <gal@nvidia.com>, Saeed Mahameed <saeedm@nvidia.com>
Subject: Re: [PATCH net-next v3 7/7] tls: rx: do not use the standard strparser
Date: Wed, 15 Mar 2023 22:26:55 +0200 [thread overview]
Message-ID: <54cdcc22-821a-b0fc-2eb6-b88c47049188@gmail.com> (raw)
In-Reply-To: <20230313112210.71905e2d@kernel.org>
[-- Attachment #1: Type: text/plain, Size: 4812 bytes --]
On 13/03/2023 20:22, Jakub Kicinski wrote:
> On Sun, 12 Mar 2023 19:59:57 +0200 Tariq Toukan wrote:
>> On 09/03/2023 19:54, Jakub Kicinski wrote:
>>> On Thu, 9 Mar 2023 17:15:26 +0200 Tariq Toukan wrote:
>>>> A few fixes were introduced for this patch, but it seems to still cause
>>>> issues.
>>>>
>>>> I'm running simple client/server test with wrk and nginx and TLS RX
>>>> device offload on.
>>>> It fails with TlsDecryptError on the client side for the large file
>>>> (256000b), while succeeding for the small one (10000b). See repro
>>>> details below.
>>>>
>>>> I narrowed the issue down to this offending patch, by applying a few
>>>> reverts (had to solve trivial conflicts):
>>>
>>> What's the sequence of records in terms of being offloaded vs fall back?
>>> Could you whip up a simple ring buffer to see if previous records were
>>> offloaded and what the skb geometries where?
>>
>> Interesting. All records go through the sw fallback.
>>
>> Command:
>> $ wrk_openssl_3_0_0 -b2.2.2.2 -t1 -c1 -d2 --timeout 5s
>> https://2.2.2.3:20443/256000b.img
>
> Is wrk_openssl_3_0_0 a nginx command? Any CX6 DX card can do this?
>
It's the standard wrk client, nothing special here.
We simply rename it to indicate that it was compiled against a specific
openssl version.
>> Debug code:
>> @@ -1712,8 +1723,13 @@ static int tls_rx_one_record(struct sock *sk,
>> struct msghdr *msg,
>> int err;
>>
>> err = tls_decrypt_device(sk, msg, tls_ctx, darg);
>> - if (!err)
>> + if (!err) {
>> err = tls_decrypt_sw(sk, tls_ctx, msg, darg);
>> + printk("sk: %p, tls_decrypt_sw, err = %d\n", sk, err);
>> + } else {
>> + printk("sk: %p, tls_decrypt_device, err = %d\n", sk, err);
>> + }
>> + skb_dump(KERN_ERR, darg->skb, false);
>> if (err < 0)
>> return err;
>>
>> dmesg output including skb geometries is attached.
>
> Hm, could you add to the debug the addresses of the fragments
> (and decrypted status) of the data queued to TCP by the driver?
> And then the frag addresses in skb_dump() ?
>
I used the debug code below. Find dmesg output attached.
I disabled GRO to reduce complexity.
# cat /proc/net/tls_stat
TlsCurrTxSw 0
TlsCurrRxSw 0
TlsCurrTxDevice 1
TlsCurrRxDevice 1
TlsTxSw 0
TlsRxSw 0
TlsTxDevice 2
TlsRxDevice 2
TlsDecryptError 2
TlsRxDeviceResync 2
TlsDecryptRetry 0
TlsRxNoPadViolation 0
Insights:
In this repro, we always go through tls_decrypt_sw, never to
tls_decrypt_device.
The corrupted SKB is the one with mixed offloaded and non-offloaded
decryption. You can clearly see this by its len (2330624 bytes!),
followed by a kernel panic.
Calling skb_dump on the corrupted skb also hits the kernel panic.
Code:
diff --git a/drivers/net/ethernet/mellanox/mlx5/core/en_rx.c
b/drivers/net/ethernet/mellanox/mlx5/core/en_rx.c
index 3f7b63d6616b..864288b5d412 100644
--- a/drivers/net/ethernet/mellanox/mlx5/core/en_rx.c
+++ b/drivers/net/ethernet/mellanox/mlx5/core/en_rx.c
@@ -2262,6 +2262,7 @@ static void mlx5e_handle_rx_cqe_mpwrq(struct
mlx5e_rq *rq, struct mlx5_cqe64 *cq
goto mpwrq_cqe_out;
}
+ printk("driver calling napi_gro_receive for skb %p, is decrypt =
%d\n", skb, skb->decrypted);
napi_gro_receive(rq->cq.napi, skb);
mpwrq_cqe_out:
diff --git a/net/tls/tls_sw.c b/net/tls/tls_sw.c
index 782d3701b86f..3858299196d3 100644
--- a/net/tls/tls_sw.c
+++ b/net/tls/tls_sw.c
@@ -1710,10 +1710,19 @@ static int tls_rx_one_record(struct sock *sk,
struct msghdr *msg,
struct tls_prot_info *prot = &tls_ctx->prot_info;
struct strp_msg *rxm;
int err;
+ int i;
err = tls_decrypt_device(sk, msg, tls_ctx, darg);
- if (!err)
+ if (!err) {
err = tls_decrypt_sw(sk, tls_ctx, msg, darg);
+ printk("sk: %p, tls_decrypt_sw, err = %d\n", sk, err);
+ } else {
+ printk("sk: %p, tls_decrypt_device, err = %d\n", sk, err);
+ }
+ printk("skb: %p, len = %d, nfrags = %d\n", darg->skb,
darg->skb->len, skb_shinfo(darg->skb)->nr_frags);
+ for (i = 0; i < skb_shinfo(darg->skb)->nr_frags; i++)
+ printk("frag#%d: %p, len %d\n", i,
&skb_shinfo(darg->skb)->frags[i],
+
skb_frag_size(&skb_shinfo(darg->skb)->frags[i]));
if (err < 0)
return err;
> tls_decrypt_sw() will also get used in partially decrypted records,
> right?
Right.
[-- Attachment #2: dmesg_tls_rx_decrypt_err_2.txt --]
[-- Type: text/plain, Size: 41837 bytes --]
[ 476.401920] driver calling napi_gro_receive for skb 00000000172dacb5, is decrypt = 0
[ 476.404309] driver calling napi_gro_receive for skb 00000000a2a5da4b, is decrypt = 0
[ 476.406468] driver calling napi_gro_receive for skb 00000000a488e380, is decrypt = 0
[ 476.409170] driver calling napi_gro_receive for skb 0000000010f82300, is decrypt = 0
[ 476.416379] driver calling napi_gro_receive for skb 0000000010f82300, is decrypt = 0
[ 476.417646] driver calling napi_gro_receive for skb 00000000a488e380, is decrypt = 0
[ 476.418720] driver calling napi_gro_receive for skb 000000003772defa, is decrypt = 0
[ 476.421004] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.421974] skb: 000000000c841177, len = 45, nfrags = 1
[ 476.422865] frag#0: 00000000a5edf33c, len 45
[ 476.426485] driver calling napi_gro_receive for skb 00000000a488e380, is decrypt = 0
[ 476.427679] driver calling napi_gro_receive for skb 00000000a7267d4f, is decrypt = 0
[ 476.428905] driver calling napi_gro_receive for skb 0000000077f97780, is decrypt = 0
[ 476.430083] driver calling napi_gro_receive for skb 00000000059b4377, is decrypt = 0
[ 476.431305] driver calling napi_gro_receive for skb 000000002be0b2b9, is decrypt = 0
[ 476.432499] driver calling napi_gro_receive for skb 00000000675232c6, is decrypt = 0
[ 476.433694] driver calling napi_gro_receive for skb 000000008574bfc0, is decrypt = 0
[ 476.434923] driver calling napi_gro_receive for skb 000000003e9ad851, is decrypt = 0
[ 476.436198] driver calling napi_gro_receive for skb 00000000c0674ee0, is decrypt = 0
[ 476.437259] driver calling napi_gro_receive for skb 000000006e139894, is decrypt = 0
[ 476.442763] driver calling napi_gro_receive for skb 000000001951ef02, is decrypt = 0
[ 476.479911] driver calling napi_gro_receive for skb 00000000c8099318, is decrypt = 0
[ 476.480644] driver calling napi_gro_receive for skb 00000000734f25bb, is decrypt = 0
[ 476.481360] driver calling napi_gro_receive for skb 0000000028bbd832, is decrypt = 0
[ 476.482124] driver calling napi_gro_receive for skb 00000000836b993d, is decrypt = 0
[ 476.482846] driver calling napi_gro_receive for skb 000000002ccf5af5, is decrypt = 0
[ 476.483566] driver calling napi_gro_receive for skb 000000009e72ffb7, is decrypt = 0
[ 476.484349] driver calling napi_gro_receive for skb 0000000073698823, is decrypt = 0
[ 476.485140] driver calling napi_gro_receive for skb 0000000056cd838c, is decrypt = 0
[ 476.485936] driver calling napi_gro_receive for skb 0000000095ebfd81, is decrypt = 0
[ 476.486006] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.486379] driver calling napi_gro_receive for skb 000000005ab97059, is decrypt = 0
[ 476.487538] skb: 00000000cd6f327f, len = 16413, nfrags = 0
[ 476.487984] driver calling napi_gro_receive for skb 000000006ce49e36, is decrypt = 0
[ 476.487987] driver calling napi_gro_receive for skb 00000000d010301f, is decrypt = 0
[ 476.487989] driver calling napi_gro_receive for skb 000000009bde62fb, is decrypt = 0
[ 476.487992] driver calling napi_gro_receive for skb 0000000098e3b44b, is decrypt = 0
[ 476.487994] driver calling napi_gro_receive for skb 0000000090a6546e, is decrypt = 0
[ 476.487997] driver calling napi_gro_receive for skb 00000000baf7e4a4, is decrypt = 0
[ 476.488011] driver calling napi_gro_receive for skb 000000001f86ffbf, is decrypt = 0
[ 476.489305] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.489638] driver calling napi_gro_receive for skb 0000000047eebe9e, is decrypt = 0
[ 476.491256] skb: 00000000cd6f327f, len = 32826, nfrags = 0
[ 476.491701] driver calling napi_gro_receive for skb 000000007222c0fb, is decrypt = 0
[ 476.499849] driver calling napi_gro_receive for skb 00000000ae17e442, is decrypt = 0
[ 476.507486] driver calling napi_gro_receive for skb 00000000ef6f5f3b, is decrypt = 0
[ 476.508209] driver calling napi_gro_receive for skb 00000000fd53ae4a, is decrypt = 0
[ 476.508946] driver calling napi_gro_receive for skb 000000004b03b630, is decrypt = 0
[ 476.509673] driver calling napi_gro_receive for skb 000000002ccf5af5, is decrypt = 0
[ 476.510407] driver calling napi_gro_receive for skb 000000009e72ffb7, is decrypt = 0
[ 476.510430] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.510849] driver calling napi_gro_receive for skb 0000000073698823, is decrypt = 0
[ 476.511156] skb: 00000000cd6f327f, len = 23175, nfrags = 0
[ 476.511600] driver calling napi_gro_receive for skb 0000000090a6546e, is decrypt = 0
[ 476.513533] driver calling napi_gro_receive for skb 00000000baf7e4a4, is decrypt = 0
[ 476.514246] driver calling napi_gro_receive for skb 0000000095ebfd81, is decrypt = 0
[ 476.515077] driver calling napi_gro_receive for skb 000000007778a9f6, is decrypt = 0
[ 476.515913] driver calling napi_gro_receive for skb 0000000068bd6dc4, is decrypt = 0
[ 476.516697] driver calling napi_gro_receive for skb 00000000abee4c02, is decrypt = 0
[ 476.517600] driver calling napi_gro_receive for skb 00000000be2a3447, is decrypt = 0
[ 476.518313] driver calling napi_gro_receive for skb 00000000f13be044, is decrypt = 0
[ 476.519026] driver calling napi_gro_receive for skb 0000000096ed4dd8, is decrypt = 0
[ 476.519759] driver calling napi_gro_receive for skb 000000001285fc6b, is decrypt = 0
[ 476.520597] driver calling napi_gro_receive for skb 000000002ecd82af, is decrypt = 0
[ 476.521337] driver calling napi_gro_receive for skb 000000009d88e7f7, is decrypt = 0
[ 476.522111] driver calling napi_gro_receive for skb 00000000a5391a61, is decrypt = 0
[ 476.522933] driver calling napi_gro_receive for skb 000000002f93a7cf, is decrypt = 0
[ 476.523703] driver calling napi_gro_receive for skb 00000000a19450ed, is decrypt = 0
[ 476.523724] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.524147] driver calling napi_gro_receive for skb 0000000091e1c36b, is decrypt = 0
[ 476.524457] skb: 00000000cd6f327f, len = 39588, nfrags = 0
[ 476.524939] driver calling napi_gro_receive for skb 00000000fa963b74, is decrypt = 0
[ 476.526884] driver calling napi_gro_receive for skb 00000000044342a6, is decrypt = 0
[ 476.527613] driver calling napi_gro_receive for skb 000000000c50032e, is decrypt = 0
[ 476.528336] driver calling napi_gro_receive for skb 00000000e94ed795, is decrypt = 0
[ 476.529123] driver calling napi_gro_receive for skb 00000000059b4377, is decrypt = 0
[ 476.529846] driver calling napi_gro_receive for skb 000000002be0b2b9, is decrypt = 0
[ 476.530587] driver calling napi_gro_receive for skb 00000000675232c6, is decrypt = 0
[ 476.530610] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.531031] driver calling napi_gro_receive for skb 000000008574bfc0, is decrypt = 0
[ 476.531335] skb: 00000000cd6f327f, len = 29937, nfrags = 0
[ 476.531895] driver calling napi_gro_receive for skb 000000003e9ad851, is decrypt = 0
[ 476.531898] driver calling napi_gro_receive for skb 00000000c0674ee0, is decrypt = 0
[ 476.534563] driver calling napi_gro_receive for skb 000000006e139894, is decrypt = 0
[ 476.535305] driver calling napi_gro_receive for skb 000000001951ef02, is decrypt = 0
[ 476.536027] driver calling napi_gro_receive for skb 0000000090a6546e, is decrypt = 0
[ 476.536753] driver calling napi_gro_receive for skb 00000000abee4c02, is decrypt = 0
[ 476.537482] driver calling napi_gro_receive for skb 000000007778a9f6, is decrypt = 0
[ 476.538195] driver calling napi_gro_receive for skb 00000000be2a3447, is decrypt = 0
[ 476.538990] driver calling napi_gro_receive for skb 0000000096ed4dd8, is decrypt = 0
[ 476.539715] driver calling napi_gro_receive for skb 000000001285fc6b, is decrypt = 0
[ 476.540469] driver calling napi_gro_receive for skb 00000000f13be044, is decrypt = 0
[ 476.541215] driver calling napi_gro_receive for skb 000000002ecd82af, is decrypt = 0
[ 476.541930] driver calling napi_gro_receive for skb 000000009d88e7f7, is decrypt = 0
[ 476.542663] driver calling napi_gro_receive for skb 00000000a5391a61, is decrypt = 0
[ 476.543437] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.543440] driver calling napi_gro_receive for skb 00000000c8099318, is decrypt = 0
[ 476.543749] skb: 00000000cd6f327f, len = 20286, nfrags = 0
[ 476.544193] driver calling napi_gro_receive for skb 000000007c40f21b, is decrypt = 0
[ 476.544196] driver calling napi_gro_receive for skb 00000000a488e380, is decrypt = 0
[ 476.546559] driver calling napi_gro_receive for skb 0000000056cd838c, is decrypt = 0
[ 476.547276] driver calling napi_gro_receive for skb 0000000073698823, is decrypt = 0
[ 476.548079] driver calling napi_gro_receive for skb 000000002ccf5af5, is decrypt = 0
[ 476.548800] driver calling napi_gro_receive for skb 0000000095ebfd81, is decrypt = 0
[ 476.549517] driver calling napi_gro_receive for skb 000000000c50032e, is decrypt = 0
[ 476.550314] driver calling napi_gro_receive for skb 00000000fa963b74, is decrypt = 0
[ 476.550335] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.550757] driver calling napi_gro_receive for skb 00000000e94ed795, is decrypt = 0
[ 476.551063] skb: 00000000cd6f327f, len = 36699, nfrags = 0
[ 476.551515] driver calling napi_gro_receive for skb 00000000059b4377, is decrypt = 0
[ 476.553441] driver calling napi_gro_receive for skb 000000002be0b2b9, is decrypt = 0
[ 476.554159] driver calling napi_gro_receive for skb 00000000abee4c02, is decrypt = 0
[ 476.554867] driver calling napi_gro_receive for skb 000000007778a9f6, is decrypt = 0
[ 476.555699] driver calling napi_gro_receive for skb 00000000be2a3447, is decrypt = 0
[ 476.556445] driver calling napi_gro_receive for skb 0000000096ed4dd8, is decrypt = 0
[ 476.557216] driver calling napi_gro_receive for skb 00000000f13be044, is decrypt = 0
[ 476.557243] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.557658] driver calling napi_gro_receive for skb 000000002ecd82af, is decrypt = 0
[ 476.557962] skb: 00000000cd6f327f, len = 29944, nfrags = 0
[ 476.558403] driver calling napi_gro_receive for skb 000000009d88e7f7, is decrypt = 0
[ 476.560348] driver calling napi_gro_receive for skb 00000000a5391a61, is decrypt = 0
[ 476.561078] driver calling napi_gro_receive for skb 00000000c8099318, is decrypt = 0
[ 476.561787] driver calling napi_gro_receive for skb 000000007c40f21b, is decrypt = 0
[ 476.562568] driver calling napi_gro_receive for skb 00000000a488e380, is decrypt = 0
[ 476.563303] driver calling napi_gro_receive for skb 0000000056cd838c, is decrypt = 0
[ 476.564038] driver calling napi_gro_receive for skb 0000000073698823, is decrypt = 0
[ 476.564749] driver calling napi_gro_receive for skb 000000002ccf5af5, is decrypt = 0
[ 476.565464] driver calling napi_gro_receive for skb 0000000095ebfd81, is decrypt = 0
[ 476.566190] driver calling napi_gro_receive for skb 000000000c50032e, is decrypt = 0
[ 476.566908] driver calling napi_gro_receive for skb 000000007c40f21b, is decrypt = 0
[ 476.567630] driver calling napi_gro_receive for skb 00000000a488e380, is decrypt = 0
[ 476.568349] driver calling napi_gro_receive for skb 00000000a5391a61, is decrypt = 0
[ 476.569117] driver calling napi_gro_receive for skb 00000000c8099318, is decrypt = 0
[ 476.570012] driver calling napi_gro_receive for skb 00000000d2461240, is decrypt = 0
[ 476.570026] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.570457] driver calling napi_gro_receive for skb 00000000684810c4, is decrypt = 0
[ 476.570764] skb: 00000000cd6f327f, len = 20293, nfrags = 0
[ 476.571213] driver calling napi_gro_receive for skb 00000000c2b6cd74, is decrypt = 0
[ 476.573203] driver calling napi_gro_receive for skb 0000000055af9806, is decrypt = 0
[ 476.573988] driver calling napi_gro_receive for skb 00000000157ff1db, is decrypt = 0
[ 476.574767] driver calling napi_gro_receive for skb 00000000ca656a3b, is decrypt = 0
[ 476.575521] driver calling napi_gro_receive for skb 0000000023f6592e, is decrypt = 0
[ 476.583185] driver calling napi_gro_receive for skb 00000000b0f00ff7, is decrypt = 0
[ 476.583926] driver calling napi_gro_receive for skb 00000000c3bdc5bc, is decrypt = 0
[ 476.583942] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.584365] driver calling napi_gro_receive for skb 000000000ddf859f, is decrypt = 0
[ 476.584678] skb: 00000000cd6f327f, len = 16434, nfrags = 0
[ 476.585117] driver calling napi_gro_receive for skb 00000000afb015d0, is decrypt = 0
[ 476.587084] driver calling napi_gro_receive for skb 00000000451fb132, is decrypt = 0
[ 476.587824] driver calling napi_gro_receive for skb 0000000095ebfd81, is decrypt = 0
[ 476.588536] driver calling napi_gro_receive for skb 00000000abee4c02, is decrypt = 0
[ 476.589254] driver calling napi_gro_receive for skb 00000000be2a3447, is decrypt = 0
[ 476.590020] driver calling napi_gro_receive for skb 0000000096ed4dd8, is decrypt = 0
[ 476.590787] driver calling napi_gro_receive for skb 00000000f13be044, is decrypt = 0
[ 476.591496] driver calling napi_gro_receive for skb 00000000d2461240, is decrypt = 0
[ 476.592214] driver calling napi_gro_receive for skb 00000000684810c4, is decrypt = 0
[ 476.592940] driver calling napi_gro_receive for skb 00000000c2b6cd74, is decrypt = 0
[ 476.593666] driver calling napi_gro_receive for skb 00000000ca656a3b, is decrypt = 0
[ 476.594585] driver calling napi_gro_receive for skb 0000000023f6592e, is decrypt = 0
[ 476.595298] driver calling napi_gro_receive for skb 00000000b0f00ff7, is decrypt = 0
[ 476.596081] driver calling napi_gro_receive for skb 0000000055af9806, is decrypt = 0
[ 476.596823] driver calling napi_gro_receive for skb 00000000157ff1db, is decrypt = 0
[ 476.596832] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.597271] driver calling napi_gro_receive for skb 000000002ecd82af, is decrypt = 0
[ 476.597579] skb: 00000000cd6f327f, len = 32847, nfrags = 0
[ 476.598022] driver calling napi_gro_receive for skb 000000007c40f21b, is decrypt = 0
[ 476.599966] driver calling napi_gro_receive for skb 00000000a488e380, is decrypt = 0
[ 476.600745] driver calling napi_gro_receive for skb 00000000ca656a3b, is decrypt = 0
[ 476.601522] driver calling napi_gro_receive for skb 0000000023f6592e, is decrypt = 0
[ 476.602278] driver calling napi_gro_receive for skb 00000000b0f00ff7, is decrypt = 0
[ 476.603007] driver calling napi_gro_receive for skb 0000000055af9806, is decrypt = 0
[ 476.603766] driver calling napi_gro_receive for skb 0000000012da5d4f, is decrypt = 0
[ 476.603769] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.604209] driver calling napi_gro_receive for skb 00000000dbd83ebf, is decrypt = 0
[ 476.604520] skb: 00000000cd6f327f, len = 23196, nfrags = 0
[ 476.604959] driver calling napi_gro_receive for skb 00000000187e61fa, is decrypt = 0
[ 476.606877] driver calling napi_gro_receive for skb 000000003b677506, is decrypt = 0
[ 476.607584] driver calling napi_gro_receive for skb 00000000044342a6, is decrypt = 0
[ 476.608287] driver calling napi_gro_receive for skb 000000001285fc6b, is decrypt = 0
[ 476.608999] driver calling napi_gro_receive for skb 000000007778a9f6, is decrypt = 0
[ 476.609697] driver calling napi_gro_receive for skb 000000000c50032e, is decrypt = 0
[ 476.610413] driver calling napi_gro_receive for skb 00000000684810c4, is decrypt = 0
[ 476.611125] driver calling napi_gro_receive for skb 00000000be2a3447, is decrypt = 0
[ 476.611832] driver calling napi_gro_receive for skb 0000000096ed4dd8, is decrypt = 0
[ 476.612545] driver calling napi_gro_receive for skb 00000000f13be044, is decrypt = 0
[ 476.613244] driver calling napi_gro_receive for skb 00000000fa963b74, is decrypt = 0
[ 476.613951] driver calling napi_gro_receive for skb 000000002be0b2b9, is decrypt = 0
[ 476.614651] driver calling napi_gro_receive for skb 00000000e94ed795, is decrypt = 0
[ 476.615355] driver calling napi_gro_receive for skb 00000000059b4377, is decrypt = 0
[ 476.616071] driver calling napi_gro_receive for skb 0000000056cd838c, is decrypt = 0
[ 476.616078] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.616507] driver calling napi_gro_receive for skb 0000000073698823, is decrypt = 0
[ 476.616820] skb: 00000000cd6f327f, len = 16441, nfrags = 0
[ 476.617256] driver calling napi_gro_receive for skb 000000002ccf5af5, is decrypt = 0
[ 476.619173] driver calling napi_gro_receive for skb 0000000095ebfd81, is decrypt = 0
[ 476.619879] driver calling napi_gro_receive for skb 000000001285fc6b, is decrypt = 0
[ 476.620591] driver calling napi_gro_receive for skb 0000000096ed4dd8, is decrypt = 1
[ 476.621293] driver calling napi_gro_receive for skb 00000000f13be044, is decrypt = 1
[ 476.622001] driver calling napi_gro_receive for skb 000000000c50032e, is decrypt = 1
[ 476.622712] driver calling napi_gro_receive for skb 00000000044342a6, is decrypt = 1
[ 476.622720] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.623147] driver calling napi_gro_receive for skb 00000000fa963b74, is decrypt = 1
[ 476.623459] skb: 00000000cd6f327f, len = 32854, nfrags = 0
[ 476.623903] driver calling napi_gro_receive for skb 000000002be0b2b9, is decrypt = 1
[ 476.625827] driver calling napi_gro_receive for skb 00000000e94ed795, is decrypt = 1
[ 476.626532] driver calling napi_gro_receive for skb 00000000059b4377, is decrypt = 1
[ 476.627232] driver calling napi_gro_receive for skb 00000000ca656a3b, is decrypt = 1
[ 476.627936] driver calling napi_gro_receive for skb 00000000c3bdc5bc, is decrypt = 1
[ 476.628648] driver calling napi_gro_receive for skb 000000000ddf859f, is decrypt = 1
[ 476.629351] driver calling napi_gro_receive for skb 00000000afb015d0, is decrypt = 1
[ 476.630058] driver calling napi_gro_receive for skb 00000000451fb132, is decrypt = 1
[ 476.630760] driver calling napi_gro_receive for skb 00000000d2461240, is decrypt = 1
[ 476.631461] driver calling napi_gro_receive for skb 00000000684810c4, is decrypt = 1
[ 476.632174] driver calling napi_gro_receive for skb 0000000056cd838c, is decrypt = 1
[ 476.632887] driver calling napi_gro_receive for skb 0000000073698823, is decrypt = 1
[ 476.633588] driver calling napi_gro_receive for skb 000000002ccf5af5, is decrypt = 1
[ 476.634294] driver calling napi_gro_receive for skb 0000000095ebfd81, is decrypt = 1
[ 476.635015] sk: 000000001f13dce9, tls_decrypt_sw, err = -74
[ 476.635537] skb: 00000000332e86ab, len = 2330624, nfrags = 0
[ 476.660494] driver calling napi_gro_receive for skb 00000000699d87d6, is decrypt = 0
[ 476.663310] driver calling napi_gro_receive for skb 00000000ba8ba02d, is decrypt = 0
[ 476.666011] driver calling napi_gro_receive for skb 000000008049abe9, is decrypt = 0
[ 476.670328] driver calling napi_gro_receive for skb 000000008049abe9, is decrypt = 0
[ 476.671112] driver calling napi_gro_receive for skb 00000000ba8ba02d, is decrypt = 0
[ 476.671904] driver calling napi_gro_receive for skb 0000000032bd7692, is decrypt = 0
[ 476.673678] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.675110] skb: 00000000584135ab, len = 45, nfrags = 1
[ 476.676512] frag#0: 00000000593a5a7c, len 45
[ 476.678040] driver calling napi_gro_receive for skb 00000000ba8ba02d, is decrypt = 0
[ 476.679214] driver calling napi_gro_receive for skb 00000000c5bc3d6c, is decrypt = 0
[ 476.680446] driver calling napi_gro_receive for skb 00000000e02cd0e2, is decrypt = 0
[ 476.681660] driver calling napi_gro_receive for skb 0000000075887a2f, is decrypt = 0
[ 476.682851] driver calling napi_gro_receive for skb 000000007bf4c6c4, is decrypt = 0
[ 476.684047] driver calling napi_gro_receive for skb 00000000384b4a6e, is decrypt = 0
[ 476.685242] driver calling napi_gro_receive for skb 000000001825ba75, is decrypt = 0
[ 476.686429] driver calling napi_gro_receive for skb 0000000033864df9, is decrypt = 0
[ 476.687638] driver calling napi_gro_receive for skb 000000002b404bb4, is decrypt = 0
[ 476.688842] driver calling napi_gro_receive for skb 000000000a8d9aba, is decrypt = 0
[ 476.694760] driver calling napi_gro_receive for skb 0000000033233bcc, is decrypt = 0
[ 476.727942] driver calling napi_gro_receive for skb 0000000094822866, is decrypt = 0
[ 476.730468] driver calling napi_gro_receive for skb 00000000f3aef5ea, is decrypt = 0
[ 476.732978] driver calling napi_gro_receive for skb 000000004172ec3c, is decrypt = 0
[ 476.735088] driver calling napi_gro_receive for skb 0000000075534fcd, is decrypt = 0
[ 476.737080] driver calling napi_gro_receive for skb 0000000028e91c60, is decrypt = 0
[ 476.737802] driver calling napi_gro_receive for skb 00000000507304a0, is decrypt = 0
[ 476.738526] driver calling napi_gro_receive for skb 00000000925c5b10, is decrypt = 0
[ 476.739244] driver calling napi_gro_receive for skb 00000000003d1c40, is decrypt = 0
[ 476.740007] driver calling napi_gro_receive for skb 00000000569b18b8, is decrypt = 0
[ 476.740056] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.740447] driver calling napi_gro_receive for skb 00000000d44dbed8, is decrypt = 0
[ 476.741589] skb: 0000000063c0ec85, len = 16413, nfrags = 0
[ 476.742035] driver calling napi_gro_receive for skb 0000000072650410, is decrypt = 0
[ 476.744706] driver calling napi_gro_receive for skb 000000000ce80127, is decrypt = 0
[ 476.745421] driver calling napi_gro_receive for skb 00000000b322a911, is decrypt = 0
[ 476.746144] driver calling napi_gro_receive for skb 0000000037002252, is decrypt = 0
[ 476.746852] driver calling napi_gro_receive for skb 0000000055e2448e, is decrypt = 0
[ 476.747573] driver calling napi_gro_receive for skb 00000000a092f228, is decrypt = 0
[ 476.748316] driver calling napi_gro_receive for skb 000000006d079c0d, is decrypt = 0
[ 476.748400] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.748773] driver calling napi_gro_receive for skb 0000000089d6435f, is decrypt = 0
[ 476.749809] skb: 0000000063c0ec85, len = 32826, nfrags = 0
[ 476.750250] driver calling napi_gro_receive for skb 0000000064339cef, is decrypt = 0
[ 476.752928] driver calling napi_gro_receive for skb 00000000192574b8, is decrypt = 0
[ 476.753665] driver calling napi_gro_receive for skb 00000000062ae971, is decrypt = 0
[ 476.754385] driver calling napi_gro_receive for skb 00000000cb945c61, is decrypt = 0
[ 476.755100] driver calling napi_gro_receive for skb 000000005561e897, is decrypt = 0
[ 476.755830] driver calling napi_gro_receive for skb 000000008fc16595, is decrypt = 0
[ 476.756569] driver calling napi_gro_receive for skb 000000004b488174, is decrypt = 0
[ 476.756592] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.757022] driver calling napi_gro_receive for skb 00000000829f1f28, is decrypt = 0
[ 476.757326] skb: 0000000063c0ec85, len = 23175, nfrags = 0
[ 476.757771] driver calling napi_gro_receive for skb 00000000253355ff, is decrypt = 0
[ 476.759681] driver calling napi_gro_receive for skb 00000000cded4fcf, is decrypt = 0
[ 476.760417] driver calling napi_gro_receive for skb 000000002daab721, is decrypt = 0
[ 476.761147] driver calling napi_gro_receive for skb 00000000ab9145f6, is decrypt = 0
[ 476.761874] driver calling napi_gro_receive for skb 000000009c673c53, is decrypt = 0
[ 476.762596] driver calling napi_gro_receive for skb 00000000b322a911, is decrypt = 0
[ 476.763336] driver calling napi_gro_receive for skb 000000000ce80127, is decrypt = 0
[ 476.764062] driver calling napi_gro_receive for skb 000000002462a0ef, is decrypt = 0
[ 476.764802] driver calling napi_gro_receive for skb 0000000047b14a1a, is decrypt = 0
[ 476.765527] driver calling napi_gro_receive for skb 000000008a44954d, is decrypt = 0
[ 476.766250] driver calling napi_gro_receive for skb 00000000a7267d4f, is decrypt = 0
[ 476.766970] driver calling napi_gro_receive for skb 0000000077f97780, is decrypt = 0
[ 476.767689] driver calling napi_gro_receive for skb 000000005ab97059, is decrypt = 0
[ 476.768423] driver calling napi_gro_receive for skb 000000006ce49e36, is decrypt = 0
[ 476.769174] driver calling napi_gro_receive for skb 00000000d010301f, is decrypt = 0
[ 476.769183] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.769618] driver calling napi_gro_receive for skb 000000009bde62fb, is decrypt = 0
[ 476.769927] skb: 0000000063c0ec85, len = 39588, nfrags = 0
[ 476.770369] driver calling napi_gro_receive for skb 000000008fd055e0, is decrypt = 0
[ 476.772307] driver calling napi_gro_receive for skb 000000006bdce441, is decrypt = 0
[ 476.773057] driver calling napi_gro_receive for skb 0000000044afc35e, is decrypt = 0
[ 476.773787] driver calling napi_gro_receive for skb 00000000986d5c90, is decrypt = 0
[ 476.774508] driver calling napi_gro_receive for skb 000000004a4abfc0, is decrypt = 0
[ 476.775237] driver calling napi_gro_receive for skb 00000000b322a911, is decrypt = 0
[ 476.775986] driver calling napi_gro_receive for skb 000000000ce80127, is decrypt = 0
[ 476.776018] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.776429] driver calling napi_gro_receive for skb 000000002462a0ef, is decrypt = 0
[ 476.776751] skb: 0000000063c0ec85, len = 29937, nfrags = 0
[ 476.777199] driver calling napi_gro_receive for skb 0000000047b14a1a, is decrypt = 0
[ 476.779122] driver calling napi_gro_receive for skb 00000000a7267d4f, is decrypt = 0
[ 476.779875] driver calling napi_gro_receive for skb 0000000077f97780, is decrypt = 0
[ 476.780623] driver calling napi_gro_receive for skb 000000005ab97059, is decrypt = 0
[ 476.781353] driver calling napi_gro_receive for skb 000000006ce49e36, is decrypt = 0
[ 476.782068] driver calling napi_gro_receive for skb 000000008a44954d, is decrypt = 0
[ 476.782813] driver calling napi_gro_receive for skb 00000000ab9b12d1, is decrypt = 0
[ 476.783531] driver calling napi_gro_receive for skb 0000000053ca597a, is decrypt = 0
[ 476.784260] driver calling napi_gro_receive for skb 000000000cb4b9fd, is decrypt = 0
[ 476.785005] driver calling napi_gro_receive for skb 00000000bd214bfd, is decrypt = 0
[ 476.785725] driver calling napi_gro_receive for skb 00000000a00ec12e, is decrypt = 0
[ 476.786455] driver calling napi_gro_receive for skb 000000006d079c0d, is decrypt = 0
[ 476.787171] driver calling napi_gro_receive for skb 0000000089d6435f, is decrypt = 0
[ 476.787904] driver calling napi_gro_receive for skb 000000003ccb2025, is decrypt = 0
[ 476.788657] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.788672] driver calling napi_gro_receive for skb 0000000094822866, is decrypt = 0
[ 476.788981] skb: 0000000063c0ec85, len = 20286, nfrags = 0
[ 476.789421] driver calling napi_gro_receive for skb 0000000054cf4de7, is decrypt = 0
[ 476.791084] driver calling napi_gro_receive for skb 00000000ba8ba02d, is decrypt = 0
[ 476.791785] driver calling napi_gro_receive for skb 00000000003d1c40, is decrypt = 0
[ 476.792561] driver calling napi_gro_receive for skb 00000000829f1f28, is decrypt = 0
[ 476.793275] driver calling napi_gro_receive for skb 00000000bc8bcdf1, is decrypt = 0
[ 476.793975] driver calling napi_gro_receive for skb 00000000fb4007fe, is decrypt = 0
[ 476.794679] driver calling napi_gro_receive for skb 00000000c3d9ed74, is decrypt = 0
[ 476.795404] driver calling napi_gro_receive for skb 000000007f98c29b, is decrypt = 0
[ 476.795435] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.795858] driver calling napi_gro_receive for skb 00000000851ea100, is decrypt = 0
[ 476.796172] skb: 0000000063c0ec85, len = 36699, nfrags = 0
[ 476.796618] driver calling napi_gro_receive for skb 00000000cdf2ba92, is decrypt = 0
[ 476.798535] driver calling napi_gro_receive for skb 0000000026e454cb, is decrypt = 0
[ 476.799237] driver calling napi_gro_receive for skb 00000000796d8a38, is decrypt = 0
[ 476.799994] driver calling napi_gro_receive for skb 0000000022c91ace, is decrypt = 0
[ 476.800729] driver calling napi_gro_receive for skb 00000000943517ed, is decrypt = 0
[ 476.801432] driver calling napi_gro_receive for skb 000000003116ab69, is decrypt = 0
[ 476.802161] driver calling napi_gro_receive for skb 000000009db3b29b, is decrypt = 0
[ 476.802182] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.802598] driver calling napi_gro_receive for skb 000000000565bae4, is decrypt = 0
[ 476.802916] skb: 0000000063c0ec85, len = 31392, nfrags = 0
[ 476.803349] driver calling napi_gro_receive for skb 0000000082bd8d50, is decrypt = 0
[ 476.812305] driver calling napi_gro_receive for skb 00000000ebc5a357, is decrypt = 0
[ 476.813028] driver calling napi_gro_receive for skb 00000000a00ec12e, is decrypt = 0
[ 476.813726] driver calling napi_gro_receive for skb 000000006d079c0d, is decrypt = 0
[ 476.814420] driver calling napi_gro_receive for skb 0000000089d6435f, is decrypt = 0
[ 476.815119] driver calling napi_gro_receive for skb 00000000bc8bcdf1, is decrypt = 0
[ 476.815846] driver calling napi_gro_receive for skb 0000000022c91ace, is decrypt = 0
[ 476.816607] driver calling napi_gro_receive for skb 000000001486c3df, is decrypt = 0
[ 476.817331] driver calling napi_gro_receive for skb 00000000d5b67e7d, is decrypt = 0
[ 476.818033] driver calling napi_gro_receive for skb 00000000d2527282, is decrypt = 0
[ 476.818728] driver calling napi_gro_receive for skb 000000000dfa85d4, is decrypt = 0
[ 476.819429] driver calling napi_gro_receive for skb 0000000091e6478d, is decrypt = 0
[ 476.820179] driver calling napi_gro_receive for skb 00000000292ff769, is decrypt = 0
[ 476.820895] driver calling napi_gro_receive for skb 00000000556510b3, is decrypt = 0
[ 476.821611] driver calling napi_gro_receive for skb 00000000fb4007fe, is decrypt = 0
[ 476.821624] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.822044] driver calling napi_gro_receive for skb 0000000026e454cb, is decrypt = 0
[ 476.822359] skb: 0000000063c0ec85, len = 21741, nfrags = 0
[ 476.822794] driver calling napi_gro_receive for skb 00000000943517ed, is decrypt = 0
[ 476.824793] driver calling napi_gro_receive for skb 000000003116ab69, is decrypt = 0
[ 476.825492] driver calling napi_gro_receive for skb 000000000ce80127, is decrypt = 0
[ 476.826194] driver calling napi_gro_receive for skb 000000009db3b29b, is decrypt = 0
[ 476.826888] driver calling napi_gro_receive for skb 000000000565bae4, is decrypt = 0
[ 476.827592] driver calling napi_gro_receive for skb 0000000082bd8d50, is decrypt = 0
[ 476.828359] driver calling napi_gro_receive for skb 00000000ebc5a357, is decrypt = 0
[ 476.828368] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.828818] driver calling napi_gro_receive for skb 00000000bc8bcdf1, is decrypt = 0
[ 476.829127] skb: 0000000063c0ec85, len = 16434, nfrags = 0
[ 476.829563] driver calling napi_gro_receive for skb 0000000022c91ace, is decrypt = 0
[ 476.831473] driver calling napi_gro_receive for skb 000000001486c3df, is decrypt = 0
[ 476.832231] driver calling napi_gro_receive for skb 00000000d5b67e7d, is decrypt = 0
[ 476.832936] driver calling napi_gro_receive for skb 000000000dfa85d4, is decrypt = 0
[ 476.833649] driver calling napi_gro_receive for skb 0000000091e6478d, is decrypt = 0
[ 476.834356] driver calling napi_gro_receive for skb 00000000292ff769, is decrypt = 0
[ 476.835065] driver calling napi_gro_receive for skb 00000000556510b3, is decrypt = 0
[ 476.835769] driver calling napi_gro_receive for skb 00000000a00ec12e, is decrypt = 0
[ 476.836519] driver calling napi_gro_receive for skb 000000006d079c0d, is decrypt = 0
[ 476.837232] driver calling napi_gro_receive for skb 0000000089d6435f, is decrypt = 0
[ 476.837935] driver calling napi_gro_receive for skb 00000000a7267d4f, is decrypt = 0
[ 476.838634] driver calling napi_gro_receive for skb 0000000094822866, is decrypt = 0
[ 476.839335] driver calling napi_gro_receive for skb 0000000054cf4de7, is decrypt = 0
[ 476.840061] driver calling napi_gro_receive for skb 00000000ba8ba02d, is decrypt = 0
[ 476.840829] driver calling napi_gro_receive for skb 000000000ce80127, is decrypt = 0
[ 476.840835] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.841267] driver calling napi_gro_receive for skb 0000000082bd8d50, is decrypt = 0
[ 476.841578] skb: 0000000063c0ec85, len = 32847, nfrags = 0
[ 476.842013] driver calling napi_gro_receive for skb 00000000943517ed, is decrypt = 0
[ 476.843981] driver calling napi_gro_receive for skb 000000009db3b29b, is decrypt = 0
[ 476.844699] driver calling napi_gro_receive for skb 000000000565bae4, is decrypt = 0
[ 476.845403] driver calling napi_gro_receive for skb 00000000ebc5a357, is decrypt = 0
[ 476.846100] driver calling napi_gro_receive for skb 00000000bc8bcdf1, is decrypt = 0
[ 476.846802] driver calling napi_gro_receive for skb 0000000022c91ace, is decrypt = 0
[ 476.847521] driver calling napi_gro_receive for skb 0000000095afe878, is decrypt = 0
[ 476.847528] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.847988] driver calling napi_gro_receive for skb 0000000042259aef, is decrypt = 0
[ 476.848296] skb: 0000000063c0ec85, len = 23196, nfrags = 0
[ 476.848748] driver calling napi_gro_receive for skb 000000005d49c6d6, is decrypt = 0
[ 476.850669] driver calling napi_gro_receive for skb 000000005be7b58d, is decrypt = 0
[ 476.851380] driver calling napi_gro_receive for skb 000000006bdce441, is decrypt = 0
[ 476.852114] driver calling napi_gro_receive for skb 000000000cb4b9fd, is decrypt = 0
[ 476.852829] driver calling napi_gro_receive for skb 00000000796d8a38, is decrypt = 0
[ 476.853536] driver calling napi_gro_receive for skb 00000000d2527282, is decrypt = 0
[ 476.854238] driver calling napi_gro_receive for skb 000000001486c3df, is decrypt = 0
[ 476.854942] driver calling napi_gro_receive for skb 00000000d5b67e7d, is decrypt = 0
[ 476.855642] driver calling napi_gro_receive for skb 0000000091e6478d, is decrypt = 0
[ 476.856411] driver calling napi_gro_receive for skb 00000000292ff769, is decrypt = 0
[ 476.857134] driver calling napi_gro_receive for skb 000000009bde62fb, is decrypt = 0
[ 476.857843] driver calling napi_gro_receive for skb 0000000044afc35e, is decrypt = 0
[ 476.858549] driver calling napi_gro_receive for skb 00000000986d5c90, is decrypt = 0
[ 476.859261] driver calling napi_gro_receive for skb 000000004a4abfc0, is decrypt = 0
[ 476.859992] driver calling napi_gro_receive for skb 000000008fd055e0, is decrypt = 0
[ 476.859999] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.860475] driver calling napi_gro_receive for skb 000000002462a0ef, is decrypt = 0
[ 476.860802] skb: 0000000063c0ec85, len = 16441, nfrags = 0
[ 476.861251] driver calling napi_gro_receive for skb 0000000077f97780, is decrypt = 0
[ 476.863177] driver calling napi_gro_receive for skb 000000005ab97059, is decrypt = 0
[ 476.863915] driver calling napi_gro_receive for skb 000000006ce49e36, is decrypt = 0
[ 476.864645] driver calling napi_gro_receive for skb 000000008a44954d, is decrypt = 1
[ 476.865340] driver calling napi_gro_receive for skb 0000000047b14a1a, is decrypt = 1
[ 476.866046] driver calling napi_gro_receive for skb 00000000a7267d4f, is decrypt = 1
[ 476.866768] driver calling napi_gro_receive for skb 0000000054cf4de7, is decrypt = 1
[ 476.866783] sk: 000000001f13dce9, tls_decrypt_sw, err = 0
[ 476.867205] driver calling napi_gro_receive for skb 00000000ba8ba02d, is decrypt = 1
[ 476.867522] skb: 0000000063c0ec85, len = 32854, nfrags = 0
[ 476.867976] driver calling napi_gro_receive for skb 000000005d49c6d6, is decrypt = 1
[ 476.869914] driver calling napi_gro_receive for skb 000000006bdce441, is decrypt = 1
[ 476.870635] driver calling napi_gro_receive for skb 000000000cb4b9fd, is decrypt = 1
[ 476.871333] driver calling napi_gro_receive for skb 000000000ce80127, is decrypt = 1
[ 476.872100] driver calling napi_gro_receive for skb 0000000094822866, is decrypt = 1
[ 476.872826] driver calling napi_gro_receive for skb 0000000095afe878, is decrypt = 1
[ 476.873545] driver calling napi_gro_receive for skb 0000000042259aef, is decrypt = 1
[ 476.874251] driver calling napi_gro_receive for skb 000000005be7b58d, is decrypt = 1
[ 476.874948] driver calling napi_gro_receive for skb 0000000044afc35e, is decrypt = 1
[ 476.875653] driver calling napi_gro_receive for skb 00000000986d5c90, is decrypt = 1
[ 476.876414] driver calling napi_gro_receive for skb 0000000077f97780, is decrypt = 1
[ 476.877131] driver calling napi_gro_receive for skb 000000005ab97059, is decrypt = 1
[ 476.884790] driver calling napi_gro_receive for skb 00000000d010301f, is decrypt = 1
[ 476.885523] driver calling napi_gro_receive for skb 000000009bde62fb, is decrypt = 1
[ 476.886247] sk: 000000001f13dce9, tls_decrypt_sw, err = -74
[ 476.886775] BUG: kernel NULL pointer dereference, address: 0000000000000108
[ 476.887381] #PF: supervisor read access in kernel mode
[ 476.887859] #PF: error_code(0x0000) - not-present page
[ 476.888355] PGD 10d7d7067 P4D 10d7d7067 PUD 10d7d9067 PMD 0
[ 476.893564] Oops: 0000 [#1] SMP
[ 476.893899] CPU: 2 PID: 11095 Comm: wrk_openssl_3_0 Not tainted 6.2.0+ #17
[ 476.894493] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.13.0-0-gf21b5a4aeb02-prebuilt.qemu.org 04/01/2014
[ 476.895446] RIP: 0010:tls_rx_one_record+0x93/0x370 [tls]
[ 476.895943] Code: 0f 84 54 02 00 00 44 29 66 40 45 31 e4 44 89 e2 4c 89 ee 48 c7 c7 50 7b 24 a0 e8 58 8b f6 e0 48 8b 73 08 48 c7 c7 a0 7b 24 a0 <48> 8b 96 c8 00 00 00 8b 86 c0 00 00 00 0f b6 4c 02 02 8b 56 70 e8
[ 476.897607] RSP: 0018:ffff88811dadfba0 EFLAGS: 00010246
[ 476.898168] RAX: 000000000000002f RBX: ffff88811dadfc58 RCX: 0000000000000000
[ 476.898890] RDX: 0000000000000000 RSI: 0000000000000040 RDI: ffffffffa0247ba0
[ 476.899613] RBP: ffff88814f588200 R08: ffffffff8345c2c8 R09: 0000000000000003
[ 476.900351] R10: ffffffff8265c2e0 R11: ffffffff8315c2e0 R12: 00000000ffffffb6
[ 476.901080] R13: ffff888131cb71c0 R14: ffff88810340cc00 R15: ffff88811dadfec0
[ 476.901801] FS: 00007f635578d640(0000) GS:ffff88846f900000(0000) knlGS:0000000000000000
[ 476.902651] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 476.903256] CR2: 0000000000000108 CR3: 00000001216f5006 CR4: 0000000000370ea0
[ 476.903991] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 476.904721] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 476.905455] Call Trace:
[ 476.905795] <TASK>
[ 476.906102] tls_sw_recvmsg+0x366/0x8f0 [tls]
[ 476.906606] inet_recvmsg+0x47/0xc0
[ 476.907035] sock_recvmsg+0x44/0x70
[ 476.907455] ____sys_recvmsg+0x6f/0x140
[ 476.907908] ? iovec_from_user.part.0+0x44/0x170
[ 476.908426] ? __import_iovec+0x42/0x150
[ 476.908908] ? import_iovec+0x7/0x10
[ 476.909272] ? copy_msghdr_from_user+0x6d/0xa0
[ 476.909700] ___sys_recvmsg+0x7e/0xc0
[ 476.910075] ? ep_done_scan+0x16/0xc0
[ 476.910446] ? do_epoll_wait+0xd2/0x6b0
[ 476.910829] __sys_recvmsg+0x4e/0x90
[ 476.911195] do_syscall_64+0x3d/0x90
[ 476.911559] entry_SYSCALL_64_after_hwframe+0x46/0xb0
[ 476.912035] RIP: 0033:0x7f635cb1323d
[ 476.912399] Code: 28 89 54 24 1c 48 89 74 24 10 89 7c 24 08 e8 da 6e f7 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 8b 7c 24 08 b8 2f 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 33 44 89 c7 48 89 44 24 08 e8 1e 6f f7 ff 48
[ 476.913937] RSP: 002b:00007f635578ca20 EFLAGS: 00000293 ORIG_RAX: 000000000000002f
[ 476.914620] RAX: ffffffffffffffda RBX: 0000000000004145 RCX: 00007f635cb1323d
[ 476.915235] RDX: 0000000000000000 RSI: 00007f635578ca80 RDI: 0000000000000004
[ 476.915864] RBP: 00007f6350020a50 R08: 0000000000000000 R09: 00007f635578cbe8
[ 476.916478] R10: 0000000000000000 R11: 0000000000000293 R12: 00007f6350018843
[ 476.917108] R13: 00007f635578d5a0 R14: 00007f635578cb08 R15: 0000000000000000
[ 476.917725] </TASK>
[ 476.917986] Modules linked in: mlx5_ib mlx5_core tls xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xt_addrtype iptable_nat nf_nat br_netfilter overlay rpcrdma rdma_ucm ib_iser libiscsi scsi_transport_iscsi ib_umad rdma_cm ib_ipoib iw_cm ib_cm ib_uverbs ib_core zram zsmalloc fuse [last unloaded: tls]
[ 476.920201] CR2: 0000000000000108
[ 476.920546] ---[ end trace 0000000000000000 ]---
[ 476.920989] RIP: 0010:tls_rx_one_record+0x93/0x370 [tls]
[ 476.921474] Code: 0f 84 54 02 00 00 44 29 66 40 45 31 e4 44 89 e2 4c 89 ee 48 c7 c7 50 7b 24 a0 e8 58 8b f6 e0 48 8b 73 08 48 c7 c7 a0 7b 24 a0 <48> 8b 96 c8 00 00 00 8b 86 c0 00 00 00 0f b6 4c 02 02 8b 56 70 e8
[ 476.922992] RSP: 0018:ffff88811dadfba0 EFLAGS: 00010246
[ 476.923476] RAX: 000000000000002f RBX: ffff88811dadfc58 RCX: 0000000000000000
[ 476.924094] RDX: 0000000000000000 RSI: 0000000000000040 RDI: ffffffffa0247ba0
[ 476.924711] RBP: ffff88814f588200 R08: ffffffff8345c2c8 R09: 0000000000000003
[ 476.925324] R10: ffffffff8265c2e0 R11: ffffffff8315c2e0 R12: 00000000ffffffb6
[ 476.925935] R13: ffff888131cb71c0 R14: ffff88810340cc00 R15: ffff88811dadfec0
[ 476.926547] FS: 00007f635578d640(0000) GS:ffff88846f900000(0000) knlGS:0000000000000000
[ 476.927267] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 476.927786] CR2: 0000000000000108 CR3: 00000001216f5006 CR4: 0000000000370ea0
[ 476.928410] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 476.929038] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 476.929650] note: wrk_openssl_3_0[11095] exited with irqs disabled
[ 477.030807] driver calling napi_gro_receive for skb 00000000a00ec12e, is decrypt = 0
[ 477.310813] driver calling napi_gro_receive for skb 0000000089d6435f, is decrypt = 0
[ 477.854843] driver calling napi_gro_receive for skb 000000006d079c0d, is decrypt = 0
[ 478.942824] driver calling napi_gro_receive for skb 000000004a4abfc0, is decrypt = 0
[ 481.150820] driver calling napi_gro_receive for skb 000000003116ab69, is decrypt = 0
[ 485.502809] driver calling napi_gro_receive for skb 00000000fb4007fe, is decrypt = 0
next prev parent reply other threads:[~2023-03-15 20:27 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-07-22 23:50 [PATCH net-next v3 0/7] tls: rx: decrypt from the TCP queue Jakub Kicinski
2022-07-22 23:50 ` [PATCH net-next v3 1/7] tls: rx: wrap recv_pkt accesses in helpers Jakub Kicinski
2022-07-22 23:50 ` [PATCH net-next v3 2/7] tls: rx: factor SW handling out of tls_rx_one_record() Jakub Kicinski
2022-07-22 23:50 ` [PATCH net-next v3 3/7] tls: rx: don't free the output in case of zero-copy Jakub Kicinski
2022-07-22 23:50 ` [PATCH net-next v3 4/7] tls: rx: device: keep the zero copy status with offload Jakub Kicinski
2022-07-22 23:50 ` [PATCH net-next v3 5/7] tcp: allow tls to decrypt directly from the tcp rcv queue Jakub Kicinski
2022-07-22 23:50 ` [PATCH net-next v3 6/7] tls: rx: device: add input CoW helper Jakub Kicinski
2022-07-22 23:50 ` [PATCH net-next v3 7/7] tls: rx: do not use the standard strparser Jakub Kicinski
2022-07-26 9:27 ` Paolo Abeni
2022-07-26 17:01 ` Jakub Kicinski
2022-07-26 17:26 ` Paolo Abeni
2022-08-02 14:54 ` Tariq Toukan
2022-08-02 15:40 ` Jakub Kicinski
2022-08-04 1:24 ` Jakub Kicinski
2022-08-04 6:13 ` Tariq Toukan
2022-08-04 8:05 ` Tariq Toukan
2022-08-04 15:35 ` Jakub Kicinski
2022-08-07 6:01 ` Tariq Toukan
2022-08-04 15:59 ` Jakub Kicinski
2022-08-07 6:01 ` Tariq Toukan
2022-08-08 5:24 ` Tariq Toukan
2022-08-08 18:24 ` Jakub Kicinski
2022-08-09 8:47 ` Tariq Toukan
2023-03-09 15:15 ` Tariq Toukan
2023-03-09 17:54 ` Jakub Kicinski
2023-03-12 17:59 ` Tariq Toukan
2023-03-13 18:22 ` Jakub Kicinski
2023-03-15 20:26 ` Tariq Toukan [this message]
2023-03-16 1:41 ` Jakub Kicinski
2022-07-26 22:00 ` [PATCH net-next v3 0/7] tls: rx: decrypt from the TCP queue patchwork-bot+netdevbpf
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=54cdcc22-821a-b0fc-2eb6-b88c47049188@gmail.com \
--to=ttoukan.linux@gmail.com \
--cc=borisp@nvidia.com \
--cc=davem@davemloft.net \
--cc=edumazet@google.com \
--cc=gal@nvidia.com \
--cc=john.fastabend@gmail.com \
--cc=kuba@kernel.org \
--cc=maximmi@nvidia.com \
--cc=netdev@vger.kernel.org \
--cc=pabeni@redhat.com \
--cc=saeedm@nvidia.com \
--cc=tariqt@nvidia.com \
--cc=vfedorenko@novek.ru \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.