From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from smtp2.osuosl.org (smtp2.osuosl.org [140.211.166.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id C3CFCC00A5A for ; Thu, 19 Jan 2023 12:24:22 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp2.osuosl.org (Postfix) with ESMTP id 6208840199; Thu, 19 Jan 2023 12:24:22 +0000 (UTC) DKIM-Filter: OpenDKIM Filter v2.11.0 smtp2.osuosl.org 6208840199 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=osuosl.org; s=default; t=1674131062; bh=WCH1GIGJIU1IT/VQS5oP30ZY4kIAamw0KFylZ6qocso=; h=Date:To:References:From:In-Reply-To:Subject:List-Id: List-Unsubscribe:List-Archive:List-Post:List-Help:List-Subscribe: Cc:From; b=9HAr+QnDk+20x9GS/cPsCYbAjOSg73nr/bRA1XKWnj2gmQ+ro9V4uOyNQmqPeKpBk gITIufpzbxaWDoBLH38mbIIUzn70qqII+0mfWYIRsF2pHGlzXVKBhzWvswMMpLnNsV Ar4GZtvBK/tARsOpUhJoHjcQFiTUIHYjygbxl5I4cOHPjeEQfubQ5PoH9vpRVu/xzH 49lFhfEAH0/mMlKd8Tz+TXcehQlffl3az3C7v3s+UX38vMEE2gUzd+7TgkbKomG9t6 sB8Iw+62900fisdFUZ45ZLGxYfynXL29F3biyJB8TzX3FsKqNnFg4wTLTUkmBXscZ4 UofjCLSmn6U3w== X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp2.osuosl.org ([127.0.0.1]) by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 97OEq8eQpoUX; Thu, 19 Jan 2023 12:24:21 +0000 (UTC) Received: from ash.osuosl.org (ash.osuosl.org [140.211.166.34]) by smtp2.osuosl.org (Postfix) with ESMTP id 1B98D404EF; Thu, 19 Jan 2023 12:24:21 +0000 (UTC) DKIM-Filter: OpenDKIM Filter v2.11.0 smtp2.osuosl.org 1B98D404EF Received: from smtp2.osuosl.org (smtp2.osuosl.org [140.211.166.133]) by ash.osuosl.org (Postfix) with ESMTP id E645D1BF2C8 for ; Thu, 19 Jan 2023 12:24:18 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp2.osuosl.org (Postfix) with ESMTP id C1961404EF for ; Thu, 19 Jan 2023 12:24:18 +0000 (UTC) DKIM-Filter: OpenDKIM Filter v2.11.0 smtp2.osuosl.org C1961404EF X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp2.osuosl.org ([127.0.0.1]) by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ys-cqXQD628d for ; Thu, 19 Jan 2023 12:24:17 +0000 (UTC) X-Greylist: whitelisted by SQLgrey-1.8.0 DKIM-Filter: OpenDKIM Filter v2.11.0 smtp2.osuosl.org 5DCEB40199 Received: from mail-wm1-x32a.google.com (mail-wm1-x32a.google.com [IPv6:2a00:1450:4864:20::32a]) by smtp2.osuosl.org (Postfix) with ESMTPS id 5DCEB40199 for ; Thu, 19 Jan 2023 12:24:17 +0000 (UTC) Received: by mail-wm1-x32a.google.com with SMTP id f12-20020a7bc8cc000000b003daf6b2f9b9so3439580wml.3 for ; Thu, 19 Jan 2023 04:24:17 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=FX9Mfb24gJlsHgP4a0XeQNRlaL2qfOwNv92m+typ/N8=; b=uwQbVK0CdoFY6he5cwD6l7E6xITm2eLFNNzpOfj8OJGZvItzDhVvzVmyZm6PfgosS2 aMqtHN2eCV/lv53cAakPiOtPElcBCHwIAkzgfjaajF+SMva4wEetoB/qetmlRnDDkO8d tTDhzavgkiRjZtH2iWj4KF9fbk8oqBYR4hmZJOHZhDulWHKNwaTJu832Ld7dROaZEpGC o3akQFWZFdZ0jgcR1WTMJLJwTEPQDNbzBCfW/4nRawUclbrGMHC7sSboBnTOGPgZ0N+U HKFxkSdmgP72UwVryrs/C+Vb5bfIg3+hSUxSfrPwrmiMjCVzdeVduyqeWXOur97vqS1R voTg== X-Gm-Message-State: AFqh2kotyV1CRB2mLIDFiYaa6z1WwVSE61jDUdKsMxALe/W7NnlxcLsN 2Z4tRklWKbQ+t4cVoUdCsPNbF742HPo= X-Google-Smtp-Source: AMrXdXtL0Czzu3r5rTHxGVeZDdrr/t86wi3Oz99Him2TnvwyX48P5OCan+l3t7eBv9N/HUKLXcg1Fw== X-Received: by 2002:a05:600c:3d96:b0:3db:26b7:2fc8 with SMTP id bi22-20020a05600c3d9600b003db26b72fc8mr1125857wmb.39.1674131055307; Thu, 19 Jan 2023 04:24:15 -0800 (PST) Received: from [10.0.10.31] (rejtana.telefonserwis.pl. [91.231.125.228]) by smtp.gmail.com with ESMTPSA id bp28-20020a5d5a9c000000b00273cd321a1bsm33725760wrb.107.2023.01.19.04.24.14 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 19 Jan 2023 04:24:14 -0800 (PST) Message-ID: <744de70c-782d-5d36-87fc-e6b92ac84190@gmail.com> Date: Thu, 19 Jan 2023 13:24:13 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.6.1 Content-Language: pl To: Paul Menzel References: <652bf236-d97e-832c-e0f3-24927a46d7ad@molgen.mpg.de> From: Bartek Kois In-Reply-To: <652bf236-d97e-832c-e0f3-24927a46d7ad@molgen.mpg.de> X-Mailman-Original-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=FX9Mfb24gJlsHgP4a0XeQNRlaL2qfOwNv92m+typ/N8=; b=EjyrwTQV2Uxkw5+IYFQVyabv07socjV7JD9qoNWI7WGpQoWtdZZzV2hw2RIYIInkCS Tqt3nlwS5cFpxuZwph73GXB99gFcJ+HBmuuP9zT6tYdkx7uirGVWbMT6MHraMEed7AyC c+0bb4Vdippv1uG28Q6+S3EaXqGsVWaT7lT8CFXmLlw0x8IHIKWYU4iOeKF/fhGPiG5f AT746iEhWiiefL1jtWCeEXWvxYcHC8DKqAknx8vNC8YNVeTkgKJysRQGWm33qtYGdubI KEGnqNvzhUmneX9Pfo287GpFoWdXwKBusXKr74r+WTX/n00ipLu/Dd0W0R/ijKOiJeLs bqrQ== X-Mailman-Original-Authentication-Results: smtp2.osuosl.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.a=rsa-sha256 header.s=20210112 header.b=EjyrwTQV Subject: Re: [Intel-wired-lan] Supermicro AOC-STGN-I1S (Intel 82599EN based 10G adapter) - poor network perfomance after moving to Debian 11.5 X-BeenThere: intel-wired-lan@osuosl.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Intel Wired Ethernet Linux Kernel Driver Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: intel-wired-lan@osuosl.org, regressions@lists.linux.dev Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Errors-To: intel-wired-lan-bounces@osuosl.org Sender: "Intel-wired-lan" ClcgZG5pdSAxOS4wMS4yMDIzIG/CoDExOjE3LCBQYXVsIE1lbnplbCBwaXN6ZToKPgo+ICNyZWd6 Ym90IF5pbnRyb2R1Y2VkOiA0LjkuODguLjUuMTAuMTQ5Cj4KPiBEZWFyIEJhcnRlaywKPgo+Cj4g QW0gMTQuMDEuMjMgdW0gMTE6MjMgc2NocmllYiBCYXJ0ZWsgS29pczoKPgo+PiBBZnRlciBtb3Zp bmcgZnJvbSBEZWJpYW4gOS43IHRvIDExLjUgYXMgc29vbiBhcyBJIHBlcmZvcm0gImlwIGxpbmsg Cj4+IHNldCBlbnAxczAgdXAiIGZvciBteSAxMEcgYWRhcHRlciAoQU9DLVNUR04tSTFTIC0gSW50 ZWwgODI1OTlFTiBiYXNlZCAKPj4gMTBHIGFkYXB0ZXIpIEkgYW0gZXhwZXJpZW5jaW5nIGhpZ2gg Y3B1IGxvYWQgKGV2ZW4gaWYgbm8gdHJhZmZpYyBpcyAKPj4gcGFzc2luZyB0aHJvdWdoIHRoZSBh ZGFwdGVyKSBhbmQgbmV0d29yayBwZXJmb3JtYW5jZSBpcyBsb3cgKHdoZW4gCj4+IG5ldHdvcmsg aXMgY29ubmVjdGVkKS4KPgo+IEhvdyBkbyB5b3UgdGVzdCB0aGUgbmV0d29yayBwZXJmb3JtYW5j ZT8gUGxlYXNlIGdpdmUgZXhhY3QgbnVtYmVycyBmb3IgCj4gY29tcGFyaXNvbi4KPgpJIGFtIHVz aW5nIHRoaXMgc2VydmVyIGFzIGEgcm91dGVyIGZvciBteSBzdWJzY3JpYmVycyB3aXRoIGlwdGFi bGVzIChmb3IgCk5BVCBhbmQgZmlyZXdhbGwpIGFuZCBoZnNjIChmb3IgUW9TKS4gRmlyc3QgSSBl bmNvdW50ZXJlZCB0aGlzIHByb2JsZW0gCndoaWxlIG1pZ3JhdGluZyBmb3JtIERlYmlhbiA5Ljcg dG8gMTEuNS4gUm91dGVycyBiYXNlZMKgIG9uIFN1cGVybWljcm8gClgxMVNTTC1GIChJbnRlbMKu IEMyMzIgY2hpcHNldCkgd29ya3Mgd2l0aCBubyBwcm9ibGVtcyBhZnRlciB0aGF0IAptaWdyYXRp b24sIGJ1dCByb3V0ZXJzIGJhc2VkIG9uIFN1cGVybWljcm8gWDlTQ0wgKEludGVsIEMyMDIgUENI KSBhbmQgClN1cGVybWljcm8gWDEwU0xMKy1GIChJbnRlbCBDMjIyIEV4cHJlc3MgUENIKSBzdGFy dHMgYmVoYXZpbmcgc3RyYW5nZWx5IAp3aXRoIGhpZ2ggY3B1IGxvYWQgKDAuNS0wLjggd2hpbGUg YmVmb3JlIGl0IHdhcyBhcm91bmQgMC4wLTAuMSkgYW5kIApzdWJzY3JpYmVycyBub3QgYmVpbmcg YWJsZSB0byB1dGlsaXplIHRoZWlyIHBsYW5zLiBJIHRyaWVkIHRvIHN0cmlwIGRvd24gCnRoZSBw cm9ibGVtIGFuZCBlbmRzIHVwIHdpdGggY2xlYW4gc3lzdGVtIHdpdGggbm8gaXB0YWJsZXMgb3Ig aGZzYyBydWxlcyAKYmVoYXZpbmcgdGhlIHNhbWUgKGhpZ2hlciBsb2FkKSByaWdodCBhZnRlciBz ZXR0aW5nIHRoZSAxMEcgbGluayB1cGV2ZW4gCmlmIG5vIHRyYWZmaWMgaXMgcGFzc2luZyBieS4K Cj4+IFRoZSBjcHUgbG9hZCBpcyBvc2NpbGxhdGluZyBiZXR3ZWVuIDAuMSBhbmQgMC4zIG9uIHZh bmlsbGEgc3lzdGVtCj4+IHdpdGggbm8gbmV0d29yayBhdHRhY2hlZC4gVGhlIHByb2JsZW0gY2Fu IGJlIG9ic2VydmVkIG9uIHRoZSAKPj4gZm9sbG93aW5nIHBsYXRmb3JtczogU3VwZXJtaWNybyBY OVNDTCAoSW50ZWwgQzIwMiBQQ0gpIGFuZAo+PiBTdXBlcm1pY3JvIFgxMFNMTCstRiAoSW50ZWwg QzIyMiBFeHByZXNzIFBDSCksIGJ1dCBmb3IgdGhlIFN1cGVybWljcm8KPj4gWDExU1NMLUYgKElu dGVswq4gQzIzMiBjaGlwc2V0KSBldmVyeXRoaW5nIGlzIHdvcmtpbmcgd2VsbC4KPj4KPj4gVGVz dGVkIGVudmlyb25tZW50czoKPj4gRGViaWFuIDkuNyAtIExpbnV4IDQuOS4wLTYtYW1kNjQgIzEg U01QIERlYmlhbiA0LjkuODgtMStkZWI5dTEgCj4+ICgyMDE4LTA1LTA3KSB4ODZfNjQgR05VL0xp bnV4IFthbGwgcGxhdGZvcm1zIHdvcmtpbmcgd2VsbCB3aXRoIG5vIAo+PiBwcm9ibGVtczogU3Vw ZXJtaWNybyBYOVNDTCAoSW50ZWwgQzIwMiBQQ0gpLCBTdXBlcm1pY3JvIFgxMFNMTCstRiAKPj4g KEludGVsIEMyMjIgRXhwcmVzcyBQQ0gpLCBTdXBlcm1pY3JvIFgxMVNTTC1GIChJbnRlbMKuIEMy MzIgY2hpcHNldCldCj4KPj4gRGViaWFuIDExLjUgLSBMaW51eCA1LjEwLjAtMTktYW1kNjQgIzEg U01QIERlYmlhbiA1LjEwLjE0OS0yIAo+PiAoMjAyMi0xMC0yMSkgeDg2XzY0IEdOVS9MaW51eMKg IFtvbGRlciBwbGF0Zm9ybXM6IFN1cGVybWljcm8gWDlTQ0wgCj4+IChJbnRlbCBDMjAyIFBDSCks IFN1cGVybWljcm8gWDEwU0xMKy1GIChJbnRlbCBDMjIyIEV4cHJlc3MgUENIKSAKPj4gYmVoYXZl IHByb2JsZW1hdGljIGFzIGRlc2NyaWJlZCBhYm92ZSB8IG5ld2VyIHBsYXRmb3JtOiBTdXBlcm1p Y3JvIAo+PiBYMTFTU0wtRiAoSW50ZWzCriBDMjMyIGNoaXBzZXQpIHdvcmtpbmcgd2VsbCB3aXRo IG5vIHByb2JsZW1zXQo+Cj4gTWF5YmUgY3JlYXRlIGEgYnVnIGF0IHRoZSBMaW51eCBrZXJuZWwg YnVnIHRyYWNrZXIgWzFdLCB3aGVyZSB5b3UgY2FuIAo+IGF0dGFjaCBhbGwgdGhlIGxvZ3MgKGBk bWVzZ2AsIGBsc3BjaSAtbm5rIC1zIOKApmAsIOKApikuCj4KSWB2ZSBhbHJlYWR5IHJlcG9ydGVk IHRoYXQgdG8gdGhlIERlYmlhbiB0ZWFtIAp0dHBzOi8vYnVncy5kZWJpYW4ub3JnL2NnaS1iaW4v YnVncmVwb3J0LmNnaT9idWc9MTAyNDc2MywgYnV0IHNvIGZhciAKbm9ib2R5IHRvb2sgY2FyZSBv ZiB0aGlzIGlzc3VlIHNvIGZhci4KCj4+IFNvIGZhciB0byBzb2x2ZSB0aGUgcHJvYmxlbSBJIHdh cyB0cnlpbmcgdG8gdXBncmFkZSBzeXN0ZW0gdG8gdGhlIAo+PiBuZXdlc3Qgc3RhYmxlIHZlcnNp b24sIHVwZ3JhZGUga2VybmVsIHRvIHZlcnNpb24gNi54LCB1cGdyYWRlIGl4Z2JlIAo+PiBkcml2 ZXIgdG8gdGhlIG5ld2VzdCB2ZXJzaW9uIGJ1dCB3aXRoIG5vIGx1Y2suCj4KPiBUaGFuayB5b3Ug Zm9yIGNoZWNraW5nIHRoYXQuIFRvbyBiYWQgaXTigJlzIHN0aWxsIHByZXNlbnQuIFRvIHJ1bGUg b3V0IAo+IHNvbWUgdXNlciBzcGFjZSBwcm9ibGVtLCBjb3VsZCB5b3UgdGVzdCBEZWJpYW4gOS43 IHdpdGggYSBzdGFibGUgTGludXggCj4gcmVsZWFzZSwgY3VycmVudGx5IDYuMS43Pwo+Cj4gV2hh dCBkb2VzIGBzdWRvIHBlcmYgdG9wIC0tc29ydCBjb21tLGRzb2Agc2hvdywgd2hlcmUgdGhlIHRp bWUgaXMgc3BlbnQ/CgpEdXJpbmcgbXkgZmlyc3QgdGVzdCBpbiByZWFsIGVudmlyb21lbnQgd2l0 aCBzdWJzY3JpYmVycyBJIGdldGhlciB0aGUgCmZvbGxvd2luZyBkYXRhIHRocm91Z2ggdGhlIHBl cmY6CgogwqAgMjcuODMlwqAgW2tlcm5lbF3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqAgW2tdIHN0cm5jcHkKIMKgIDE0LjgwJcKgIFtrZXJuZWxdwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgIFtrXSBuZnRfZG9fY2hhaW4KIMKgwqAgNy42MSXCoCBba2VybmVs XcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBba10gbWVtY21wCiDCoMKgIDUu NjMlwqAgW2tlcm5lbF3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgW2tdIG5m dF9tZXRhX2dldF9ldmFsCiDCoMKgIDMuMTQlwqAgW2tlcm5lbF3CoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgW2tdIG5mdF9jbXBfZXZhbAogwqDCoCAyLjc5JcKgIFtrZXJuZWxd wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIFtrXSBhc21fZXhjX25taQogwqDC oCAxLjA3JcKgIFtrZXJuZWxdwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIFtr XSBtb2R1bGVfZ2V0X2thbGxzeW0KIMKgwqAgMC45MiXCoCBba2VybmVsXcKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBba10ga2FsbHN5bXNfZXhwYW5kX3N5bWJvbC5jb25zdHBy b3AuMAogwqDCoCAwLjg1JcKgIFtrZXJuZWxdwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgIFtrXSBpeGdiZV9wb2xsCiDCoMKgIDAuNzUlwqAgW2tlcm5lbF3CoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgW2tdIGZvcm1hdF9kZWNvZGUKIMKgwqAgMC42MSXCoCBb a2VybmVsXcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBba10gbnVtYmVyCiDC oMKgIDAuNTYlwqAgW2tlcm5lbF3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAg W2tdIG1lbnVfc2VsZWN0CiDCoMKgIDAuNTQlwqAgW2tlcm5lbF3CoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqAgW2tdIGNsZmx1c2hfY2FjaGVfcmFuZ2UKIMKgwqAgMC41MiXCoCBb a2VybmVsXcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBba10gY3B1aWRsZV9l bnRlcl9zdGF0ZQogwqDCoCAwLjUxJcKgIFtrZXJuZWxdwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgIFtrXSB2c25wcmludGYKIMKgwqAgMC41MCXCoCBba2VybmVsXcKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBba10gdTMyX2NsYXNzaWZ5CiDCoMKgIDAuNDkl wqAgW2tlcm5lbF3CoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgW2tdIGZpYl90 YWJsZV9sb29rdXAKIMKgwqAgMC40MCXCoCBba2VybmVsXcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoCBba10gZG1hX3B0ZV9jbGVhcl9sZXZlbAogwqDCoCAwLjM5JcKgIFtrZXJu ZWxdwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIFtrXSBkb21haW5fbWFwcGlu ZwogwqDCoCAwLjM2JcKgIFtrZXJuZWxdwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgIFtrXSBpeGdiZV94bWl0X2ZyYW0KCgogwqDCoMKgIFBJRCBVU0VSwqDCoMKgwqDCoCBQUsKg IE5JwqDCoMKgIFZJUlTCoMKgwqAgUkVTwqDCoMKgIFNIUiBTwqAgJUNQVcKgICVNRU0gVElNRSsg Q09NTUFORAogwqDCoMKgwqAgMTggcm9vdMKgwqDCoMKgwqAgMjDCoMKgIDDCoMKgwqDCoMKgwqAg MMKgwqDCoMKgwqAgMMKgwqDCoMKgwqAgMCBTwqAgMjguMsKgwqAgMC4wIDc6MDYuMjcgCmtzb2Z0 aXJxZC8xCiDCoMKgwqDCoCAxMiByb290wqDCoMKgwqDCoCAyMMKgwqAgMMKgwqDCoMKgwqDCoCAw wqDCoMKgwqDCoCAwwqDCoMKgwqDCoCAwIFLCoCAxMi4wwqDCoCAwLjAgNDoxMC44OCAKa3NvZnRp cnFkLzAKIMKgwqDCoMKgIDIzIHJvb3TCoMKgwqDCoMKgIDIwwqDCoCAwwqDCoMKgwqDCoMKgIDDC oMKgwqDCoMKgIDDCoMKgwqDCoMKgIDAgU8KgwqAgNi4wwqDCoCAwLjAgNDozNi4wOCAKa3NvZnRp cnFkLzIKIMKgwqDCoMKgIDI4IHJvb3TCoMKgwqDCoMKgIDIwwqDCoCAwwqDCoMKgwqDCoMKgIDDC oMKgwqDCoMKgIDDCoMKgwqDCoMKgIDAgU8KgwqAgNS4zwqDCoCAwLjAgNjo0Ni40NyAKa3NvZnRp cnFkLzMKIMKgODQ2NDQ5IHJvb3TCoMKgwqDCoMKgIDIwwqDCoCAwwqDCoMKgwqDCoMKgIDDCoMKg wqDCoMKgIDDCoMKgwqDCoMKgIDAgScKgwqAgMS4wwqDCoCAwLjAgMDowMS42MSAKa3dvcmtlci8w OjAtZXZlbnRzX3Bvd2VyX2VmZmljaWVudAogwqDCoMKgwqAgMTMgcm9vdMKgwqDCoMKgwqAgMjDC oMKgIDDCoMKgwqDCoMKgwqAgMMKgwqDCoMKgwqAgMMKgwqDCoMKgwqAgMCBJwqDCoCAwLjPCoMKg IDAuMCAwOjEzLjUwIApyY3Vfc2NoZWQKIMKgwqAgODI2NCByb290wqDCoMKgwqDCoCAyMMKgwqAg MMKgIDEwMTUzNsKgwqAgNjk0NMKgwqAgNDgyNCBTwqDCoCAwLjPCoMKgIDAuMiAwOjA3Ljc3IGRo Y3BkCiDCoMKgwqDCoMKgIDEgcm9vdMKgwqDCoMKgwqAgMjDCoMKgIDDCoCAxNjQwNDjCoCAxMDE4 NMKgwqAgNzY3MiBTwqDCoCAwLjDCoMKgIDAuMyAwOjA0LjUyIApzeXN0ZW1kCiDCoMKgwqDCoMKg IDIgcm9vdMKgwqDCoMKgwqAgMjDCoMKgIDDCoMKgwqDCoMKgwqAgMMKgwqDCoMKgwqAgMMKgwqDC oMKgwqAgMCBTwqDCoCAwLjDCoMKgIDAuMCAwOjAwLjAwIAprdGhyZWFkZAogwqDCoMKgwqDCoCAz IHJvb3TCoMKgwqDCoMKgwqAgMCAtMjDCoMKgwqDCoMKgwqAgMMKgwqDCoMKgwqAgMMKgwqDCoMKg wqAgMCBJwqDCoCAwLjDCoMKgIDAuMCAwOjAwLjAwIHJjdV9ncAogwqDCoMKgwqDCoCA0IHJvb3TC oMKgwqDCoMKgwqAgMCAtMjDCoMKgwqDCoMKgwqAgMMKgwqDCoMKgwqAgMMKgwqDCoMKgwqAgMCBJ wqDCoCAwLjDCoMKgIDAuMCAwOjAwLjAwIApyY3VfcGFyX2dwCiDCoMKgwqDCoMKgIDYgcm9vdMKg wqDCoMKgwqDCoCAwIC0yMMKgwqDCoMKgwqDCoCAwwqDCoMKgwqDCoCAwwqDCoMKgwqDCoCAwIEnC oMKgIDAuMMKgwqAgMC4wIDA6MDAuMDAgCmt3b3JrZXIvMDowSC1ldmVudHNfaGlnaHByaQogwqDC oMKgwqDCoCA5IHJvb3TCoMKgwqDCoMKgwqAgMCAtMjDCoMKgwqDCoMKgwqAgMMKgwqDCoMKgwqAg MMKgwqDCoMKgwqAgMCBJwqDCoCAwLjDCoMKgIDAuMCAwOjAwLjAwIAptbV9wZXJjcHVfd3EKIMKg wqDCoMKgIDEwIHJvb3TCoMKgwqDCoMKgIDIwwqDCoCAwwqDCoMKgwqDCoMKgIDDCoMKgwqDCoMKg IDDCoMKgwqDCoMKgIDAgU8KgwqAgMC4wwqDCoCAwLjAgMDowMC4wMCAKcmN1X3Rhc2tzX3J1ZGVf CiDCoMKgwqDCoCAxMSByb290wqDCoMKgwqDCoCAyMMKgwqAgMMKgwqDCoMKgwqDCoCAwwqDCoMKg wqDCoCAwwqDCoMKgwqDCoCAwIFPCoMKgIDAuMMKgwqAgMC4wIDA6MDAuMDAgCnJjdV90YXNrc190 cmFjZQogwqDCoMKgwqAgMTQgcm9vdMKgwqDCoMKgwqAgcnTCoMKgIDDCoMKgwqDCoMKgwqAgMMKg wqDCoMKgwqAgMMKgwqDCoMKgwqAgMCBTwqDCoCAwLjDCoMKgIDAuMCAwOjAwLjI2IAptaWdyYXRp b24vMAoKPgo+PiBTdXBlcm1pY3JvIHN1cHBvcnQgc3VnZ2VzdGVkIGFzIGZvbGxvd3M6Cj4+IGl0 IG1pZ2h0IGJlIGtlcm5lbCByZWxhdGVkIGRlYmlhbiAxMS41IGhhcyBrZXJuZWwgNS4xMCB3aGlj aCBpcyBhIAo+PiByZWNlbnQga2VybmVsIGl0IG1pZ2h0IG5vdCBwcm9wZXJseSBzdXBwb3J0IHRo ZSBjaGlwc2V0cyBmb3IgWDkgCj4+IHRoZXJlZm9yZSBpIHN1Z2dlc3QgdG8gdXNlIFJIRUwgb3Ig Q2VudE9TIGFzIHRoZXkgdXNlIG11Y2ggb2xkZXIgCj4+IGtlcm5lbCB2ZXJzaW9ucy4gSSBleHBl Y3QgdGhhdCB3aXRoIHVidW50dSAyMC4wNCB5b3Ugc2VlIHRoZSBzYW1lIAo+PiBwcm9ibGVtIGl0 IHVzZXMga2VybmVsIDUuNAo+IFRlc3RpbmcgYW5vdGhlciBHTlUvTGludXggZGlzdHJpYnV0aW9u IGZvciBhbm90aGVyIGRhdGEgcG9pbnQsIG1pZ2h0IAo+IGJlIGEgZ29vZCBpZGVhLgo+Cj4gQXMg bm9ib2R5IGhhcyByZXNwb25kZWQgeWV0LCBiaXNlY3RpbmcgdGhlIGlzc3VlIGlzIHByb2JhYmx5 IHRoZSAKPiBmYXN0ZXN0IHdheSB0byBnZXQgdG8gdGhlIGJvdHRvbSBvZiB0aGlzLiBMdWNraWx5 IHRoZSBwcm9ibGVtIHNlZW1zIAo+IHJlcHJvZHVjaWJsZSBhbmQgeW91IHNlZW0gdG8gYmUgYWJs ZSB0byBidWlsZCBhIExpbnV4IGtlcm5lbCB5b3Vyc2VsZiwgCj4gc28gdGhhdCBzaG91bGQgd29y ay4gKEZvciB0ZXN0aW5nIHB1cnBvc2VzIHlvdSBjb3VsZCBhbHNvIHRlc3Qgd2l0aCAKPiBVYnVu dHUsIGFzIHRoZXkgcHJvdmlkZSBMaW51eCBrZXJuZWwgYnVpbGRzIGZvciAoYWxtb3N0KSBhbGwg cmVsZWFzZXMgCj4gaW4gdGhlaXIgTGludXgga2VybmVsIG1haW5saW5lIFBQQSBbMl0uKQo+Ck9m IGNvdXJzZcKgIEkgY2FuIHRyeSBVYnVudHUgYW5kIHJlcG9ydCBob3cgaXQgaXMgd29ya2luZy4K CkJlc3QgcmVnYXJkcwoKQmFydGVrIEtvaXMKCj4KPiBLaW5kIHJlZ2FyZHMsCj4KPiBQYXVsCj4K Pgo+IFsxXTogaHR0cHM6Ly9idWd6aWxsYS5rZXJuZWwub3JnLwo+IFsyXTogaHR0cHM6Ly9rZXJu ZWwudWJ1bnR1LmNvbS9+a2VybmVsLXBwYS9tYWlubGluZS8KX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX18KSW50ZWwtd2lyZWQtbGFuIG1haWxpbmcgbGlzdApJ bnRlbC13aXJlZC1sYW5Ab3N1b3NsLm9yZwpodHRwczovL2xpc3RzLm9zdW9zbC5vcmcvbWFpbG1h bi9saXN0aW5mby9pbnRlbC13aXJlZC1sYW4K From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-wm1-f43.google.com (mail-wm1-f43.google.com [209.85.128.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 391AD6FC2 for ; Thu, 19 Jan 2023 12:24:17 +0000 (UTC) Received: by mail-wm1-f43.google.com with SMTP id f19-20020a1c6a13000000b003db0ef4dedcso3439235wmc.4 for ; Thu, 19 Jan 2023 04:24:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=FX9Mfb24gJlsHgP4a0XeQNRlaL2qfOwNv92m+typ/N8=; b=EjyrwTQV2Uxkw5+IYFQVyabv07socjV7JD9qoNWI7WGpQoWtdZZzV2hw2RIYIInkCS Tqt3nlwS5cFpxuZwph73GXB99gFcJ+HBmuuP9zT6tYdkx7uirGVWbMT6MHraMEed7AyC c+0bb4Vdippv1uG28Q6+S3EaXqGsVWaT7lT8CFXmLlw0x8IHIKWYU4iOeKF/fhGPiG5f AT746iEhWiiefL1jtWCeEXWvxYcHC8DKqAknx8vNC8YNVeTkgKJysRQGWm33qtYGdubI KEGnqNvzhUmneX9Pfo287GpFoWdXwKBusXKr74r+WTX/n00ipLu/Dd0W0R/ijKOiJeLs bqrQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=FX9Mfb24gJlsHgP4a0XeQNRlaL2qfOwNv92m+typ/N8=; b=w7sPWqIKzF8jfLccwNlw9uIzcda2NCHRDYSAo8/uMAGy3GETB+C7T2vV+QfkLKNFQr yXr6L6cjzktgZNJwrBt9ZO8X04HXaaoUhEg0jEyTUPVDRD82Pu/cG/BOj2h/LwwQR+yz 8ueHHSVdlj43iwVDOSUDmc6zbCLcrI/C0S4od3WcPD9X+5g3p77ljOnwvFz6mYdn+ofs dcu/CvdeC4J0C2MpSry7yIf52Z0fNueqv/Hy9CPWOkboj1z+h/sTVZsIz1g0zmyNt+2t cuZa28eN6ZDx3sTKIxJZIwO4LBBLD5uFntQds3wGTp3lz1FahbvB1YtVXkUrgg23fZB5 Yybg== X-Gm-Message-State: AFqh2krdZaFhReZ522Ljr3+bUggNWZ2vSW3+Os9kioFLMPZ6X3uhhlBD hGRldlGXz7D9xmE+7p2OuRk= X-Google-Smtp-Source: AMrXdXtL0Czzu3r5rTHxGVeZDdrr/t86wi3Oz99Him2TnvwyX48P5OCan+l3t7eBv9N/HUKLXcg1Fw== X-Received: by 2002:a05:600c:3d96:b0:3db:26b7:2fc8 with SMTP id bi22-20020a05600c3d9600b003db26b72fc8mr1125857wmb.39.1674131055307; Thu, 19 Jan 2023 04:24:15 -0800 (PST) Received: from [10.0.10.31] (rejtana.telefonserwis.pl. [91.231.125.228]) by smtp.gmail.com with ESMTPSA id bp28-20020a5d5a9c000000b00273cd321a1bsm33725760wrb.107.2023.01.19.04.24.14 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 19 Jan 2023 04:24:14 -0800 (PST) Message-ID: <744de70c-782d-5d36-87fc-e6b92ac84190@gmail.com> Date: Thu, 19 Jan 2023 13:24:13 +0100 Precedence: bulk X-Mailing-List: regressions@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.6.1 Subject: Re: [Intel-wired-lan] Supermicro AOC-STGN-I1S (Intel 82599EN based 10G adapter) - poor network perfomance after moving to Debian 11.5 Content-Language: pl To: Paul Menzel Cc: intel-wired-lan@osuosl.org, regressions@lists.linux.dev References: <652bf236-d97e-832c-e0f3-24927a46d7ad@molgen.mpg.de> From: Bartek Kois In-Reply-To: <652bf236-d97e-832c-e0f3-24927a46d7ad@molgen.mpg.de> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit W dniu 19.01.2023 o 11:17, Paul Menzel pisze: > > #regzbot ^introduced: 4.9.88..5.10.149 > > Dear Bartek, > > > Am 14.01.23 um 11:23 schrieb Bartek Kois: > >> After moving from Debian 9.7 to 11.5 as soon as I perform "ip link >> set enp1s0 up" for my 10G adapter (AOC-STGN-I1S - Intel 82599EN based >> 10G adapter) I am experiencing high cpu load (even if no traffic is >> passing through the adapter) and network performance is low (when >> network is connected). > > How do you test the network performance? Please give exact numbers for > comparison. > I am using this server as a router for my subscribers with iptables (for NAT and firewall) and hfsc (for QoS). First I encountered this problem while migrating form Debian 9.7 to 11.5. Routers based  on Supermicro X11SSL-F (Intel® C232 chipset) works with no problems after that migration, but routers based on Supermicro X9SCL (Intel C202 PCH) and Supermicro X10SLL+-F (Intel C222 Express PCH) starts behaving strangely with high cpu load (0.5-0.8 while before it was around 0.0-0.1) and subscribers not being able to utilize their plans. I tried to strip down the problem and ends up with clean system with no iptables or hfsc rules behaving the same (higher load) right after setting the 10G link upeven if no traffic is passing by. >> The cpu load is oscillating between 0.1 and 0.3 on vanilla system >> with no network attached. The problem can be observed on the >> following platforms: Supermicro X9SCL (Intel C202 PCH) and >> Supermicro X10SLL+-F (Intel C222 Express PCH), but for the Supermicro >> X11SSL-F (Intel® C232 chipset) everything is working well. >> >> Tested environments: >> Debian 9.7 - Linux 4.9.0-6-amd64 #1 SMP Debian 4.9.88-1+deb9u1 >> (2018-05-07) x86_64 GNU/Linux [all platforms working well with no >> problems: Supermicro X9SCL (Intel C202 PCH), Supermicro X10SLL+-F >> (Intel C222 Express PCH), Supermicro X11SSL-F (Intel® C232 chipset)] > >> Debian 11.5 - Linux 5.10.0-19-amd64 #1 SMP Debian 5.10.149-2 >> (2022-10-21) x86_64 GNU/Linux  [older platforms: Supermicro X9SCL >> (Intel C202 PCH), Supermicro X10SLL+-F (Intel C222 Express PCH) >> behave problematic as described above | newer platform: Supermicro >> X11SSL-F (Intel® C232 chipset) working well with no problems] > > Maybe create a bug at the Linux kernel bug tracker [1], where you can > attach all the logs (`dmesg`, `lspci -nnk -s …`, …). > I`ve already reported that to the Debian team ttps://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1024763, but so far nobody took care of this issue so far. >> So far to solve the problem I was trying to upgrade system to the >> newest stable version, upgrade kernel to version 6.x, upgrade ixgbe >> driver to the newest version but with no luck. > > Thank you for checking that. Too bad it’s still present. To rule out > some user space problem, could you test Debian 9.7 with a stable Linux > release, currently 6.1.7? > > What does `sudo perf top --sort comm,dso` show, where the time is spent? During my first test in real enviroment with subscribers I gether the following data through the perf:   27.83%  [kernel]                   [k] strncpy   14.80%  [kernel]                   [k] nft_do_chain    7.61%  [kernel]                   [k] memcmp    5.63%  [kernel]                   [k] nft_meta_get_eval    3.14%  [kernel]                   [k] nft_cmp_eval    2.79%  [kernel]                   [k] asm_exc_nmi    1.07%  [kernel]                   [k] module_get_kallsym    0.92%  [kernel]                   [k] kallsyms_expand_symbol.constprop.0    0.85%  [kernel]                   [k] ixgbe_poll    0.75%  [kernel]                   [k] format_decode    0.61%  [kernel]                   [k] number    0.56%  [kernel]                   [k] menu_select    0.54%  [kernel]                   [k] clflush_cache_range    0.52%  [kernel]                   [k] cpuidle_enter_state    0.51%  [kernel]                   [k] vsnprintf    0.50%  [kernel]                   [k] u32_classify    0.49%  [kernel]                   [k] fib_table_lookup    0.40%  [kernel]                   [k] dma_pte_clear_level    0.39%  [kernel]                   [k] domain_mapping    0.36%  [kernel]                   [k] ixgbe_xmit_fram     PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM TIME+ COMMAND      18 root      20   0       0      0      0 S  28.2   0.0 7:06.27 ksoftirqd/1      12 root      20   0       0      0      0 R  12.0   0.0 4:10.88 ksoftirqd/0      23 root      20   0       0      0      0 S   6.0   0.0 4:36.08 ksoftirqd/2      28 root      20   0       0      0      0 S   5.3   0.0 6:46.47 ksoftirqd/3  846449 root      20   0       0      0      0 I   1.0   0.0 0:01.61 kworker/0:0-events_power_efficient      13 root      20   0       0      0      0 I   0.3   0.0 0:13.50 rcu_sched    8264 root      20   0  101536   6944   4824 S   0.3   0.2 0:07.77 dhcpd       1 root      20   0  164048  10184   7672 S   0.0   0.3 0:04.52 systemd       2 root      20   0       0      0      0 S   0.0   0.0 0:00.00 kthreadd       3 root       0 -20       0      0      0 I   0.0   0.0 0:00.00 rcu_gp       4 root       0 -20       0      0      0 I   0.0   0.0 0:00.00 rcu_par_gp       6 root       0 -20       0      0      0 I   0.0   0.0 0:00.00 kworker/0:0H-events_highpri       9 root       0 -20       0      0      0 I   0.0   0.0 0:00.00 mm_percpu_wq      10 root      20   0       0      0      0 S   0.0   0.0 0:00.00 rcu_tasks_rude_      11 root      20   0       0      0      0 S   0.0   0.0 0:00.00 rcu_tasks_trace      14 root      rt   0       0      0      0 S   0.0   0.0 0:00.26 migration/0 > >> Supermicro support suggested as follows: >> it might be kernel related debian 11.5 has kernel 5.10 which is a >> recent kernel it might not properly support the chipsets for X9 >> therefore i suggest to use RHEL or CentOS as they use much older >> kernel versions. I expect that with ubuntu 20.04 you see the same >> problem it uses kernel 5.4 > Testing another GNU/Linux distribution for another data point, might > be a good idea. > > As nobody has responded yet, bisecting the issue is probably the > fastest way to get to the bottom of this. Luckily the problem seems > reproducible and you seem to be able to build a Linux kernel yourself, > so that should work. (For testing purposes you could also test with > Ubuntu, as they provide Linux kernel builds for (almost) all releases > in their Linux kernel mainline PPA [2].) > Of course  I can try Ubuntu and report how it is working. Best regards Bartek Kois > > Kind regards, > > Paul > > > [1]: https://bugzilla.kernel.org/ > [2]: https://kernel.ubuntu.com/~kernel-ppa/mainline/