From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.6 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id A1B66C2BA83 for ; Sat, 15 Feb 2020 09:43:21 +0000 (UTC) Received: from dpdk.org (dpdk.org [92.243.14.124]) by mail.kernel.org (Postfix) with ESMTP id 47DB020659 for ; Sat, 15 Feb 2020 09:43:21 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=marvell.com header.i=@marvell.com header.b="sLISRYJH"; dkim=fail reason="signature verification failed" (1024-bit key) header.d=marvell.onmicrosoft.com header.i=@marvell.onmicrosoft.com header.b="LMfjFo6w" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 47DB020659 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=marvell.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=dev-bounces@dpdk.org Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 60CFFF72; Sat, 15 Feb 2020 10:43:20 +0100 (CET) Received: from mx0b-0016f401.pphosted.com (mx0a-0016f401.pphosted.com [67.231.148.174]) by dpdk.org (Postfix) with ESMTP id D6F75DE3 for ; Sat, 15 Feb 2020 10:43:18 +0100 (CET) Received: from pps.filterd (m0045849.ppops.net [127.0.0.1]) by mx0a-0016f401.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 01F9hDS3019816; Sat, 15 Feb 2020 01:43:13 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-transfer-encoding : mime-version; s=pfpt0818; bh=Who3p1XfJCsYtCgD8F/nH7/kiW2GgXk8laa0xjI6+IY=; b=sLISRYJHvXQ5q5W9Lv5P80l+XgeP1yrISJ4E58m4CKjfAhH/BJTUWJz/UqSAfadS2GH8 wU3sZ3uneUtJLZIGjMeqnL2eCbHjFJbN0FVvNNTG80HAGvRYSYLmRORr0eIzqdgBNQGK f/EPxz5nd8IzIvZmlKLBO3wbDi1jLMWrIaRF81E7NjuquAGjh5oz9VtYHF31ossnuocF pm6onI9b62Qg8vunyNtYyb1QD+sZsuH7ahPzXmtehobrVIwS5KlVZMh80B2RVzePe+ub vNXw02cCU5MldrMC9xj/MAPLD43JZha7HPLYNwIcnE1TafquvzRvsnMpOkopanYo4Im9 wg== Received: from sc-exch02.marvell.com ([199.233.58.182]) by mx0a-0016f401.pphosted.com with ESMTP id 2y5yy3u4u5-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Sat, 15 Feb 2020 01:43:13 -0800 Received: from DC5-EXCH01.marvell.com (10.69.176.38) by SC-EXCH02.marvell.com (10.93.176.82) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Sat, 15 Feb 2020 01:43:12 -0800 Received: from SC-EXCH03.marvell.com (10.93.176.83) by DC5-EXCH01.marvell.com (10.69.176.38) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Sat, 15 Feb 2020 01:43:11 -0800 Received: from NAM04-SN1-obe.outbound.protection.outlook.com (104.47.44.55) by SC-EXCH03.marvell.com (10.93.176.83) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Sat, 15 Feb 2020 01:43:11 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=a22PC7Q561DPKQIHXjKqXJfFWUR5VFFa2kix8aCcKmcGycsugXdjHfyYIj4VMvFYDS8g5m6MxoUTixWv5KPlJzFSdasPIufIs/l5Xx+TU/COCJ2+cEf8p5hmdFN2vcKHa4Bgc3N4OCcwcGrLLFVS2rl0K6nutX+4jSYA4s157tAzeI7wey86zOzspiKgXPLXUqvxHdcOoBotIJzHeu/DrgD+BHqNse3kXQXmcrsQW7886qveRThThX4eueYFR5T3nM/6/pDTa7l1CGtbUlHoC2UBQoovH2G3xi81QgN7UVBYQr0GnD1KzZBZO1VwFCvbJxlco6klhMuWLzQ+0FWUgQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Who3p1XfJCsYtCgD8F/nH7/kiW2GgXk8laa0xjI6+IY=; b=oPqDKkalYkeASla2TGmgUB1m2+OaV10ZhEUCETXeBTjTwZN8jin+6oOG+3KPrQZziv+MlFjv+TheWc4Hlvg8AOaVOgA7PGKd1ghJpBA2Nf1AaFs8wNtWD7JzNS9KsQbN9woP8bFcwZw/RGPve0UmO4tAajUtqjFTSEvylarJaIer2ixXUnK2BE76LH9ThMEUPtATmMeel/YJYknA1mI+Jw8oaqJUVByYbXA+wX0oZs3DyI0YWQpRyab3FdqP7BBMLpuogss56Z80M66xd7dpFhz/Q3TfQIcPDQwqQ+z1n9o0niUAo7bjeTQUv3HaxHRXX2rlXTOt7K7bumx4QZe8cQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=marvell.com; dmarc=pass action=none header.from=marvell.com; dkim=pass header.d=marvell.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.onmicrosoft.com; s=selector1-marvell-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Who3p1XfJCsYtCgD8F/nH7/kiW2GgXk8laa0xjI6+IY=; b=LMfjFo6w0hUrGBpz2ZXJCYETUZtShbNXeypn2r34sol1iaPykMZxV6BJSyEICDKtaJG3C6YvlMgdDqOGOgQCvJx/k2gGxH60EuCUpwq4lCvUqBs8F0/GXVQLElOUqLxZjyXXkqMaKPcGZijjUMoC6sR6mrlLU9Jun1IyTpcmZio= Received: from CY4PR1801MB1863.namprd18.prod.outlook.com (10.171.255.160) by CY4PR1801MB1880.namprd18.prod.outlook.com (10.171.255.19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2729.23; Sat, 15 Feb 2020 09:43:09 +0000 Received: from CY4PR1801MB1863.namprd18.prod.outlook.com ([fe80::a9b3:33be:a71e:894b]) by CY4PR1801MB1863.namprd18.prod.outlook.com ([fe80::a9b3:33be:a71e:894b%7]) with mapi id 15.20.2729.028; Sat, 15 Feb 2020 09:43:09 +0000 From: Pavan Nikhilesh Bhagavatula To: Gavin Hu , Jerin Jacob Kollanukkaran CC: "dev@dpdk.org" , nd Thread-Topic: [dpdk-dev] [PATCH] event/octeontx2: remove WFE from dualslot dequeue Thread-Index: AQHV4wJbQYmXKNV1LEqiGAH9RgfHS6gbw2sAgAA+qcA= Date: Sat, 15 Feb 2020 09:43:08 +0000 Message-ID: References: <20200214064525.1895-1-pbhagavatula@marvell.com> In-Reply-To: Accept-Language: en-IN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [49.205.216.43] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 38529c4f-37d8-4352-593c-08d7b1fb7737 x-ms-traffictypediagnostic: CY4PR1801MB1880: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:1332; x-forefront-prvs: 03142412E2 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(136003)(396003)(346002)(39860400002)(376002)(366004)(199004)(189003)(5660300002)(81166006)(81156014)(2906002)(8676002)(52536014)(7696005)(86362001)(186003)(26005)(53546011)(6506007)(55016002)(9686003)(316002)(66946007)(66446008)(8936002)(71200400001)(54906003)(110136005)(6636002)(66476007)(76116006)(478600001)(33656002)(64756008)(4326008)(66556008); DIR:OUT; SFP:1101; SCL:1; SRVR:CY4PR1801MB1880; H:CY4PR1801MB1863.namprd18.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: marvell.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: wADbFUbT7bk3iR860VgDYcHFR0Ow32fsGxRGCdDUYXN6fzYqLCqG+7R4twKWMiowBivRW+svkCaZQyaEFEp5PKhqEwzsvN7jJMmSsZjzkSqtjKSdNdWY32zmr8SLttYmpzHRl2wdk7Wx0f53x/TrxYXSPjtNKG0RoTTC+gDdwXQZmQseMXLItg/rZGwxWjLcNx2OmTq3bXfVjaXeBRx93zujC3NUDWevS18+sKzfk6Wq1PQ6CuNCQBGmtwS/JSgpOcCZ+bl0cC40lVklXpkkZOV4ZcJ+mxBMlZfAlz4VFxa7PocBeDoghuppV0/UPcpAPkb4rJMy+B2adXb3czxEOAX38non/5MC3FZkWvHoaPd5HWKxuMjEAfU1nOl5Mu4mEdMLB0pQdJYPjOtgnnkCiZGsiw7Axp6Av8EesJqQAtTpNOaVsH+IDEc2PjBkg5XV x-ms-exchange-antispam-messagedata: SAD+E0ZU7ERnOq4bfoM66CshBMI1ILOqWEIf2vBK0TxHrlz3yuKBn/g7hW/FFqZD5KS/Nn68UEtQINmEh1kSc5fUrduC5LLF5Nin1sq9yKHrXxNylKCZcfV3kyg87U5o+2xs941h2KvNzlqIVLU1pg== Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-Network-Message-Id: 38529c4f-37d8-4352-593c-08d7b1fb7737 X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Feb 2020 09:43:08.8699 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 70e1fb47-1155-421d-87fc-2e58f638b6e0 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: efrjS81668OnHWB2al2HqUWLdVIdaZ4tNPJS+H5ewSDe+duB+bVrqOrLJYrUfNcUbqosM91ohz66ukzEV/bvB+d6wCoeJUkKdaQzEkstpc0= X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR1801MB1880 X-OriginatorOrg: marvell.com X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.138, 18.0.572 definitions=2020-02-15_02:2020-02-14, 2020-02-15 signatures=0 Subject: Re: [dpdk-dev] [PATCH] event/octeontx2: remove WFE from dualslot dequeue X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Hi Gavin, >Hi Pavan, > >> -----Original Message----- >> From: pbhagavatula@marvell.com >> Sent: Friday, February 14, 2020 2:45 PM >> To: jerinj@marvell.com; Pavan Nikhilesh > >> Cc: Gavin Hu ; dev@dpdk.org >> Subject: [dpdk-dev] [PATCH] event/octeontx2: remove WFE from >dualslot >> dequeue >> >> From: Pavan Nikhilesh >> >> Each workslot is always bound to a specific lcore there is no multi-core >> contention to cause cache trashing as a result it is safe to remove the >> WFE. Also, in dual workslot dequeue work will mostlikely be available >on >> the pair workslot making WFE impractical. > >Does SSO still signal EVENTI to exit from WFE? Then the core ignore it? All transactions on SSO bus take the core out of WFE. >Can this be disabled as WFE is removed? This can't be disabled. > >> >> Signed-off-by: Pavan Nikhilesh >> --- >> >> Also, this in-turn reduces the branch misses >> >> Before: >> 0 >> >arm_spe_0/ts_enable=3D1,pct_enable=3D1,pa_enable=3D1,branch_filter=3D1,jit >ter=3D1, >> min_latency=3D0/ >> 0 dummy:u >> 0 llc-miss >> 0 tlb-miss >> 853 branch-miss >> 0 remote-access >> 0 l1d-miss >> >> After: >> 0 >> >arm_spe_0/ts_enable=3D1,pct_enable=3D1,pa_enable=3D1,branch_filter=3D1,jit >ter=3D1, >> min_latency=3D0/ >> 0 dummy:u >> 0 llc-miss >> 0 tlb-miss >> 250 branch-miss >> 0 remote-access >> 0 l1d-miss >> >> WFE Data: >> >> 0x4C40 - WFI_WFE_WAIT_CYCLES - Number of cycles waiting at a WFI >or >> WFE instruction. >> >> - WFE Cycles before the patch for Dual workslot >> #perf stat -C 20 -e r4C40 sleep 1 >> Performance counter stats for 'CPU(s) 20': >> >> 264 r4C40 >> 1.002494168 seconds time elapsed >> >> - WFE Cycles for single workslot >> #perf stat -C 20 -e r4C40 sleep 1 >> Performance counter stats for 'CPU(s) 20': >> >> 908,778,351 r4C40 >> 1.002598253 seconds time elapsed >> >> drivers/event/octeontx2/otx2_worker_dual.h | 6 +----- >> 1 file changed, 1 insertion(+), 5 deletions(-) >> >> diff --git a/drivers/event/octeontx2/otx2_worker_dual.h >> b/drivers/event/octeontx2/otx2_worker_dual.h >> index 5134e3d52..c88420eb4 100644 >> --- a/drivers/event/octeontx2/otx2_worker_dual.h >> +++ b/drivers/event/octeontx2/otx2_worker_dual.h >> @@ -29,11 +29,7 @@ otx2_ssogws_dual_get_work(struct >> otx2_ssogws_state *ws, >> rte_prefetch_non_temporal(lookup_mem); >> #ifdef RTE_ARCH_ARM64 >> asm volatile( >> - " ldr %[tag], [%[tag_loc]] \n" >> - " ldr %[wqp], [%[wqp_loc]] \n" >> - " tbz %[tag], 63, done%=3D \n" >> - " sevl \n" >> - "rty%=3D: wfe \n" >> + "rty%=3D: \n" >> " ldr %[tag], [%[tag_loc]] \n" >> " ldr %[wqp], [%[wqp_loc]] \n" >> " tbnz %[tag], 63, rty%=3D \n" >> -- >> 2.17.1