From: "Laura García Liébana" <nevola@gmail.com>
To: Carsten Aulbert <carsten.aulbert@aei.mpg.de>
Cc: Mail List - Netfilter <netfilter@vger.kernel.org>
Subject: Re: Possible to load balance (nftlb) mostly NFS traffic with important connections?
Date: Fri, 21 May 2021 12:47:51 +0200 [thread overview]
Message-ID: <CAF90-WiLP5pT9ecWdZB27pN_JmDfqz_i2KZySq6TKGAEBptdrg@mail.gmail.com> (raw)
In-Reply-To: <9cbbeb2e-f09c-5eca-f86c-6f3b25cd9ea3@aei.mpg.de>
Hi Casten,
On Sat, May 15, 2021 at 1:11 PM Carsten Aulbert
<carsten.aulbert@aei.mpg.de> wrote:
>
> Dear experts,
>
> we are operating a compute cluster with a number of storage systems
> serving data via NFS via LACP-bonded 10 Gbit/s links (usually 2 or 4).
>
> From time to time, users may overload a server and use up all available
> bandwidth for hours and sometimes days at a time and I am currently
> exploring if we could use tools like nftlb[1] to achieve the following:
>
> (a) For (NFS|any) traffic have at least two tiers (farms?), one are
> standard compute nodes and one are interactive log-in nodes/web servers.
> The former should have a much lower bandwidth priority as the latter.
> These targets can easily be distinguished by IP ranges/netmasks.
>
> (b) Sometimes we need to perform bandwidth intensive/sensitive
> operations, e.g. just today I would like to move a user's file system
> from one too busy box to another but sending the ZFS snapshot over via
> mbuffer takes really long and I would like to prioritize this connection
> as well, i.e. I know the source and destination IP as well as target TCP
> port.
>
nftlb doesn't support bandwidth management per farm or pool, only
connection limits can be configured.
Uplinks load balancing is in my TODO list and probably it would be
useful for your case.
Kind Regards.
> I am still learning to migrate from iptables to nft while I stumbled
> over nftlb which looks to support what I want, but I am not sure yet -
> and I have not found many documents describing potential set-ups and
> thus I wanted to ask the experts here first.
>
> Base of all our systems is currently Debian 10 (buster) and thus kernel
> 4.19.
>
> Cheers and thanks a lot in advance for any insights/pointers/...!
>
> Carsten
>
> [1] https://github.com/zevenet/nftlb
> --
> Dr. Carsten Aulbert, Max Planck Institute for Gravitational Physics,
> Callinstraße 38, 30167 Hannover, Germany, Phone +49 511 762 17185
>
>
prev parent reply other threads:[~2021-05-21 10:47 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-05-15 7:21 Possible to load balance (nftlb) mostly NFS traffic with important connections? Carsten Aulbert
2021-05-21 10:47 ` Laura García Liébana [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAF90-WiLP5pT9ecWdZB27pN_JmDfqz_i2KZySq6TKGAEBptdrg@mail.gmail.com \
--to=nevola@gmail.com \
--cc=carsten.aulbert@aei.mpg.de \
--cc=netfilter@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.