From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id DF4F4C433FE for ; Tue, 19 Oct 2021 14:49:13 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id C38356113B for ; Tue, 19 Oct 2021 14:49:13 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232601AbhJSOvZ (ORCPT ); Tue, 19 Oct 2021 10:51:25 -0400 Received: from mail-dm6nam08on2071.outbound.protection.outlook.com ([40.107.102.71]:12642 "EHLO NAM04-DM6-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S232116AbhJSOvX (ORCPT ); Tue, 19 Oct 2021 10:51:23 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=LXtTxP1on4jWtDaLl01gttX1LSGswhzZgf9pqnYj61Rec3BYOd6Pq0FDqeC0m5jCPhIpxytzf6v3yv/2oSQYQbykyri0YripxwQlPH2EwCJOl4rTbdCXHi8mGSJzbISuyJ6ldrsghLJJPtJ7tTylKXd8OR1ptJwQ+vsKUwfB2dY/sfIiiDBXxChJM8PBXRmJvYGr9+BXZrGDuwHNG3mC/mw12kTJVagwdH2G18WdHaa+JuDk85ZUSgUmKd6itM3UzGkuH2G0LjDVIHz/Z8To+yRiUuWr3r5FjiFtwhjq6VURHYGi6QpkkEYbegUGy1xWq8dy1xpBxDu0Xd6t5N+ZsA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=nnYsQpFbbU9w72FPBcPIOhXIc+/fmO4PsWHDublhcrQ=; b=X2km8BSqekc6WgS+ahOXKg+NQQrk69fNBz7xMgAFckogSlrB9ccQE382Fpjm15570rN4IHVVMZSnqR/zpcrVSIuK5SHNirzF6hba/1UuzkrFbR7/Mf89wHo0QbmNeQCZ2TaOlISc2zkIkN8VLqqwBQl083RpiQoTdIVhsT0bZRShWiJ7/sEdJM1v85FB38bJF9HW68TEeAlSJLqrA7kNnDohUtwLP3js4552x5elZKiCZepNnJ6rxVkmoogXnN4ted+VNKAQswe1p4EJPOeE1MTzXpUftBDHFareu+QtI1e0VxeBPQC12vPLkjEkyTM+IkiWOyAOU4vzWLNVTjV/2Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.112.36) smtp.rcpttodomain=google.com smtp.mailfrom=nvidia.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=nnYsQpFbbU9w72FPBcPIOhXIc+/fmO4PsWHDublhcrQ=; b=AWGL2rsxXyxdgvgjIAJXvbIBn6Mz4JBANN9gMr84HBjlzoJ1iGaFzVESgJdnZV+bGBrkGuUrh1fU+VxxMIKTxCbqUJ5LpwCSpp3XpnHdrgRtUEgvrX2/sil2OJhGCVblsDEiYynn5HfsDhWHsor2L7sgI22Vr0RjKpVKCQNkUQQ3vFasmUCX7e0iOO5a3+0H5X89U7C9z73M9/NzZNoyC+gBM+A48f9RMD9P0KGZxWs2u27Z4dxx7ghrBfxIfCbJngmTElnhCtSW25AuysstTK8TMrq6tWAQjPG0KSGyOaw3ccBEi+ibYZLZ3uza32b8rQX9OtM9y361g+SR1be45g== Received: from MWHPR20CA0037.namprd20.prod.outlook.com (2603:10b6:300:ed::23) by DM6PR12MB3449.namprd12.prod.outlook.com (2603:10b6:5:3b::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4608.18; Tue, 19 Oct 2021 14:49:09 +0000 Received: from CO1NAM11FT019.eop-nam11.prod.protection.outlook.com (2603:10b6:300:ed:cafe::2e) by MWHPR20CA0037.outlook.office365.com (2603:10b6:300:ed::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4608.15 via Frontend Transport; Tue, 19 Oct 2021 14:49:08 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.112.36) smtp.mailfrom=nvidia.com; google.com; dkim=none (message not signed) header.d=none;google.com; dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.112.36 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.112.36; helo=mail.nvidia.com; Received: from mail.nvidia.com (216.228.112.36) by CO1NAM11FT019.mail.protection.outlook.com (10.13.175.57) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.4608.15 via Frontend Transport; Tue, 19 Oct 2021 14:49:08 +0000 Received: from HQMAIL107.nvidia.com (172.20.187.13) by HQMAIL101.nvidia.com (172.20.187.10) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Tue, 19 Oct 2021 14:49:03 +0000 Received: from vdi.nvidia.com (172.20.187.6) by mail.nvidia.com (172.20.187.13) with Microsoft SMTP Server id 15.0.1497.18 via Frontend Transport; Tue, 19 Oct 2021 14:48:52 +0000 From: Maxim Mikityanskiy To: Alexei Starovoitov , Daniel Borkmann , Andrii Nakryiko , Martin KaFai Lau , Song Liu , Yonghong Song , John Fastabend , KP Singh CC: Eric Dumazet , "David S. Miller" , Jakub Kicinski , Hideaki YOSHIFUJI , David Ahern , "Jesper Dangaard Brouer" , Nathan Chancellor , "Nick Desaulniers" , Brendan Jackman , Florent Revest , Joe Stringer , "Lorenz Bauer" , Tariq Toukan , , , , Maxim Mikityanskiy Subject: [PATCH bpf-next 09/10] bpf: Add a helper to issue timestamp cookies in XDP Date: Tue, 19 Oct 2021 17:46:54 +0300 Message-ID: <20211019144655.3483197-10-maximmi@nvidia.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20211019144655.3483197-1-maximmi@nvidia.com> References: <20211019144655.3483197-1-maximmi@nvidia.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: ab28417b-d125-472e-eb62-08d9930f9b1e X-MS-TrafficTypeDiagnostic: DM6PR12MB3449: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8882; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: his0TTJTrh2Hvzr8+YQCtjPYLkTAwuM/MNmgUYXivdiNlyl24n9NQ8nrqiD3aWAl5pEj1tKSjVpALqZtQ9BjU2Vr1LCutoi65VWlyVSDSbVGlscKWqoA04PrCqjUaVU9bBUkHfY4mhVOSpoeGF0vWIxfZ49ie1/DDJkVa3mJRTVDOaviMaJb/aAKOmjaHaAq2zi1kPrPieKVAvq6GNzespZnaKCe/HCqU6nmf/cD3dLvsTOoQCY57Qs8CEZwb5AXsz881UCt0RXI3pr+yd/61EIUqYh2hN5/sfa5RHkDTQlVdDfBlJgyKmlQHzyg7azBcNC9VEBZS2StSYoaJDSF0nmMz32AfjeJ0YwN1dQoXs9WvueYtf2RrpZ9PweNDSzczQn/kVvej7iz7Q7G4QZvECV6VQ7fZbJjNGSJjr2MVSeghE54U2/tXlVP6oHOJNUUFtOUIubh6o+6pg2N2C2nsbEG0qsQWsTDIuOC7JrIDPnn+06D86247Sw7J9B3gR5/cpySgUl2p2RrPDpwPwvUiV4TLfPzWCEgRykqGwe7e9fv9zBWGFR8kC5jfGqtzflylDrVkq5z+y24J/Bmop5TrwCEpjJODbM54F1xlrAlFFM3A5kIqmFS0qKkEtreb9wZlZAUA09CR7sDSdTdnQ1ZUlrMyzzzpXONBAzic7cQNgaOO++TQqi0WlrKpen8Nf6T0ozcWBTX/f0v3CkdhPpv4A== X-Forefront-Antispam-Report: CIP:216.228.112.36;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:schybrid05.nvidia.com;CAT:NONE;SFS:(4636009)(36840700001)(46966006)(7636003)(356005)(7416002)(36756003)(7696005)(54906003)(82310400003)(5660300002)(4326008)(186003)(36906005)(107886003)(110136005)(36860700001)(70206006)(70586007)(336012)(8936002)(426003)(2906002)(83380400001)(508600001)(86362001)(1076003)(2616005)(8676002)(316002)(26005)(47076005);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Oct 2021 14:49:08.0616 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: ab28417b-d125-472e-eb62-08d9930f9b1e X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.112.36];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CO1NAM11FT019.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB3449 Precedence: bulk List-ID: X-Mailing-List: bpf@vger.kernel.org The new helper bpf_tcp_raw_gen_tscookie allows an XDP program to generate timestamp cookies (to be used together with SYN cookies) which encode different options set by the client in the SYN packet: SACK support, ECN support, window scale. These options are encoded in lower bits of the timestamp, which will be returned by the client in a subsequent ACK packet. The format is the same used by synproxy. Signed-off-by: Maxim Mikityanskiy Reviewed-by: Tariq Toukan --- include/net/tcp.h | 1 + include/uapi/linux/bpf.h | 27 +++++++++++++++ net/core/filter.c | 38 +++++++++++++++++++++ net/ipv4/syncookies.c | 60 ++++++++++++++++++++++++++++++++++ tools/include/uapi/linux/bpf.h | 27 +++++++++++++++ 5 files changed, 153 insertions(+) diff --git a/include/net/tcp.h b/include/net/tcp.h index 1cc96a225848..651820bef6a2 100644 --- a/include/net/tcp.h +++ b/include/net/tcp.h @@ -564,6 +564,7 @@ u32 __cookie_v4_init_sequence(const struct iphdr *iph, const struct tcphdr *th, u16 *mssp); __u32 cookie_v4_init_sequence(const struct sk_buff *skb, __u16 *mss); u64 cookie_init_timestamp(struct request_sock *req, u64 now); +bool cookie_init_timestamp_raw(struct tcphdr *th, __be32 *tsval, __be32 *tsecr); bool cookie_timestamp_decode(const struct net *net, struct tcp_options_received *opt); bool cookie_ecn_ok(const struct tcp_options_received *opt, diff --git a/include/uapi/linux/bpf.h b/include/uapi/linux/bpf.h index e32f72077250..791790b41874 100644 --- a/include/uapi/linux/bpf.h +++ b/include/uapi/linux/bpf.h @@ -5053,6 +5053,32 @@ union bpf_attr { * * **-EPROTONOSUPPORT** if the IP version is not 4 or 6 (or 6, but * CONFIG_IPV6 is disabled). + * + * int bpf_tcp_raw_gen_tscookie(struct tcphdr *th, u32 th_len, __be32 *tsopt, u32 tsopt_len) + * Description + * Try to generate a timestamp cookie which encodes some of the + * flags sent by the client in the SYN packet: SACK support, ECN + * support, window scale. To be used with SYN cookies. + * + * *th* points to the start of the TCP header of the client's SYN + * packet, while *th_len* contains the length of the TCP header (at + * least **sizeof**\ (**struct tcphdr**)). + * + * *tsopt* points to the output location where to put the resulting + * timestamp values: tsval and tsecr, in the format of the TCP + * timestamp option. + * + * Return + * On success, 0. + * + * On failure, the returned value is one of the following: + * + * **-EINVAL** if the input arguments are invalid. + * + * **-ENOENT** if the TCP header doesn't have the timestamp option. + * + * **-EOPNOTSUPP** if the kernel configuration does not enable SYN + * cookies (CONFIG_SYN_COOKIES is off). */ #define __BPF_FUNC_MAPPER(FN) \ FN(unspec), \ @@ -5238,6 +5264,7 @@ union bpf_attr { FN(ct_release), \ FN(tcp_raw_gen_syncookie), \ FN(tcp_raw_check_syncookie), \ + FN(tcp_raw_gen_tscookie), \ /* */ /* integer value in 'imm' field of BPF_CALL instruction selects which helper diff --git a/net/core/filter.c b/net/core/filter.c index 5f03d4a282a0..73fe20ef7442 100644 --- a/net/core/filter.c +++ b/net/core/filter.c @@ -7403,6 +7403,42 @@ static const struct bpf_func_proto bpf_tcp_raw_check_syncookie_proto = { .arg4_type = ARG_CONST_SIZE, }; +BPF_CALL_4(bpf_tcp_raw_gen_tscookie, struct tcphdr *, th, u32, th_len, + __be32 *, tsopt, u32, tsopt_len) +{ + int err; + +#ifdef CONFIG_SYN_COOKIES + if (tsopt_len != sizeof(u64)) { + err = -EINVAL; + goto err_out; + } + + if (!cookie_init_timestamp_raw(th, &tsopt[0], &tsopt[1])) { + err = -ENOENT; + goto err_out; + } + + return 0; +err_out: +#else + err = -EOPNOTSUPP; +#endif + memset(tsopt, 0, tsopt_len); + return err; +} + +static const struct bpf_func_proto bpf_tcp_raw_gen_tscookie_proto = { + .func = bpf_tcp_raw_gen_tscookie, + .gpl_only = false, + .pkt_access = true, + .ret_type = RET_INTEGER, + .arg1_type = ARG_PTR_TO_MEM, + .arg2_type = ARG_CONST_SIZE, + .arg3_type = ARG_PTR_TO_UNINIT_MEM, + .arg4_type = ARG_CONST_SIZE, +}; + #endif /* CONFIG_INET */ bool bpf_helper_changes_pkt_data(void *func) @@ -7825,6 +7861,8 @@ xdp_func_proto(enum bpf_func_id func_id, const struct bpf_prog *prog) return &bpf_tcp_raw_gen_syncookie_proto; case BPF_FUNC_tcp_raw_check_syncookie: return &bpf_tcp_raw_check_syncookie_proto; + case BPF_FUNC_tcp_raw_gen_tscookie: + return &bpf_tcp_raw_gen_tscookie_proto; #endif default: return bpf_sk_base_func_proto(func_id); diff --git a/net/ipv4/syncookies.c b/net/ipv4/syncookies.c index 8696dc343ad2..4dd2c7a096eb 100644 --- a/net/ipv4/syncookies.c +++ b/net/ipv4/syncookies.c @@ -85,6 +85,66 @@ u64 cookie_init_timestamp(struct request_sock *req, u64 now) return (u64)ts * (NSEC_PER_SEC / TCP_TS_HZ); } +bool cookie_init_timestamp_raw(struct tcphdr *th, __be32 *tsval, __be32 *tsecr) +{ + int length = (th->doff * 4) - sizeof(*th); + u8 wscale = TS_OPT_WSCALE_MASK; + bool option_timestamp = false; + bool option_sack = false; + u32 cookie; + u8 *ptr; + + ptr = (u8 *)(th + 1); + + while (length > 0) { + u8 opcode = *ptr++; + u8 opsize; + + if (opcode == TCPOPT_EOL) + break; + if (opcode == TCPOPT_NOP) { + length--; + continue; + } + + if (length < 2) + break; + opsize = *ptr++; + if (opsize < 2) + break; + if (opsize > length) + break; + + switch (opcode) { + case TCPOPT_WINDOW: + wscale = min_t(u8, *ptr, TCP_MAX_WSCALE); + break; + case TCPOPT_TIMESTAMP: + option_timestamp = true; + /* Client's tsval becomes our tsecr. */ + *tsecr = cpu_to_be32(get_unaligned_be32(ptr)); + break; + case TCPOPT_SACK_PERM: + option_sack = true; + break; + } + + ptr += opsize - 2; + length -= opsize; + } + + if (!option_timestamp) + return false; + + cookie = tcp_time_stamp_raw() & ~TSMASK; + cookie |= wscale & TS_OPT_WSCALE_MASK; + if (option_sack) + cookie |= TS_OPT_SACK; + if (th->ece && th->cwr) + cookie |= TS_OPT_ECN; + *tsval = cpu_to_be32(cookie); + return true; +} static __u32 secure_tcp_syn_cookie(__be32 saddr, __be32 daddr, __be16 sport, __be16 dport, __u32 sseq, __u32 data) diff --git a/tools/include/uapi/linux/bpf.h b/tools/include/uapi/linux/bpf.h index e32f72077250..791790b41874 100644 --- a/tools/include/uapi/linux/bpf.h +++ b/tools/include/uapi/linux/bpf.h @@ -5053,6 +5053,32 @@ union bpf_attr { * * **-EPROTONOSUPPORT** if the IP version is not 4 or 6 (or 6, but * CONFIG_IPV6 is disabled). + * + * int bpf_tcp_raw_gen_tscookie(struct tcphdr *th, u32 th_len, __be32 *tsopt, u32 tsopt_len) + * Description + * Try to generate a timestamp cookie which encodes some of the + * flags sent by the client in the SYN packet: SACK support, ECN + * support, window scale. To be used with SYN cookies. + * + * *th* points to the start of the TCP header of the client's SYN + * packet, while *th_len* contains the length of the TCP header (at + * least **sizeof**\ (**struct tcphdr**)). + * + * *tsopt* points to the output location where to put the resulting + * timestamp values: tsval and tsecr, in the format of the TCP + * timestamp option. + * + * Return + * On success, 0. + * + * On failure, the returned value is one of the following: + * + * **-EINVAL** if the input arguments are invalid. + * + * **-ENOENT** if the TCP header doesn't have the timestamp option. + * + * **-EOPNOTSUPP** if the kernel configuration does not enable SYN + * cookies (CONFIG_SYN_COOKIES is off). */ #define __BPF_FUNC_MAPPER(FN) \ FN(unspec), \ @@ -5238,6 +5264,7 @@ union bpf_attr { FN(ct_release), \ FN(tcp_raw_gen_syncookie), \ FN(tcp_raw_check_syncookie), \ + FN(tcp_raw_gen_tscookie), \ /* */ /* integer value in 'imm' field of BPF_CALL instruction selects which helper -- 2.30.2