From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=MAILING_LIST_MULTI, SPF_HELO_NONE,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 09524C76188 for ; Tue, 16 Jul 2019 09:31:24 +0000 (UTC) Received: from dpdk.org (dpdk.org [92.243.14.124]) by mail.kernel.org (Postfix) with ESMTP id 1A03321721 for ; Tue, 16 Jul 2019 09:31:23 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 1A03321721 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=cse.iitb.ac.in Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=dev-bounces@dpdk.org Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 3A4561BDE4; Tue, 16 Jul 2019 11:31:19 +0200 (CEST) Received: from smtp2.iitb.ac.in (smtp2.iitb.ac.in [103.21.125.13]) by dpdk.org (Postfix) with ESMTP id BFA8D1BD43 for ; Tue, 16 Jul 2019 11:31:16 +0200 (CEST) Received: from ldns4.iitb.ac.in (ldns4.iitb.ac.in [10.200.12.4]) by smtp2.iitb.ac.in (Postfix) with SMTP id 15B4C104CF56 for ; Tue, 16 Jul 2019 15:01:16 +0530 (IST) Received: (qmail 25405 invoked by uid 510); 16 Jul 2019 15:01:16 +0530 X-Qmail-Scanner-Diagnostics: from 10.200.25.25 by ldns4 (envelope-from , uid 501) with qmail-scanner-2.11 spamassassin: 3.4.1. mhr: 1.0. {clamdscan: 0.100.0/25511} Clear:RC:1(10.200.25.25):SA:0(0.0/7.0):. Processed in 3.113598 secs; 16 Jul 2019 15:01:16 +0530 X-Envelope-From: nileshunhale@cse.iitb.ac.in X-Qmail-Scanner-Mime-Attachments: | X-Qmail-Scanner-Zip-Files: | Received: from unknown (HELO ldns4.iitb.ac.in) (10.200.25.25) by ldns2.iitb.ac.in with SMTP; 16 Jul 2019 15:01:12 +0530 Received: from smtp-auth.iitb.ac.in (smtpauth4.iitb.ac.in [10.200.8.4]) by ldns4.iitb.ac.in (Postfix) with ESMTP id 8E9E1341AB0; Tue, 16 Jul 2019 15:01:12 +0530 (IST) Received: from [10.129.131.157] (unknown [10.129.131.157]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: 183050050) by smtp-auth.iitb.ac.in (Postfix) with ESMTPSA id 8C36120E89C; Tue, 16 Jul 2019 15:01:12 +0530 (IST) To: dev@dpdk.org, users@dpdk.org From: Nilesh Message-ID: Date: Tue, 16 Jul 2019 15:01:12 +0530 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US Subject: [dpdk-dev] TX-dropped is high while sending custom packet via testpmd app X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Hello,     we are trying to send packets from the testpmd to another machine with DPDK running.     We are building custom packets before sending it on the wire.     After running the application the TX-dropped is quite high (can be inferred from following logs : ) $ sudo ./testpmd -c f -w 01:00.1  --   --nb-cores=2 --eth-peer=0,A4:BF:01:37:23:AB --rxq=1 --txq=1 Port statistics ====================================  ######################## NIC statistics for port 0 ########################  RX-packets: 1445150    RX-missed: 0          RX-bytes:  86709064  RX-errors: 0  RX-nombuf:  0  TX-packets: 1602045    TX-errors: 0          TX-bytes:  134571780  Throughput (since last show)  Rx-pps:            0  Tx-pps:            0  ############################################################################  ---------------------- Forward statistics for port 0 ----------------------  RX-packets: 1445160        RX-dropped: 0             RX-total: 1445160  TX-packets: 1602045        TX-dropped: 694971472     TX-total: 696573517  ----------------------------------------------------------------------------  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++  RX-packets: 1445160        RX-dropped: 0             RX-total: 1445160  TX-packets: 1602045        TX-dropped: 694971472     TX-total: 696573517  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ What could be the reason for such packet drop? What tuning of buffer/queue size affects this ? How to set optimal setting for high performance? System specification : 2 machines with Distributor ID:    Ubuntu Description:    Ubuntu 16.04.5 LTS Release:    16.04 Codename:    xenial Kernel: 4.15.0-29-generic DPDK: 19.05.0 Hardware: CPU: Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz NIC 1: Intel Corporation Ethernet Controller XL710 for 40GbE QSFP+ (i40e) NIC 2: Intel Corporation I350 Gigabit Network Connection (igb) Regards, Nilesh