From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.8 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1D41BC2B9F4 for ; Mon, 28 Jun 2021 15:54:56 +0000 (UTC) Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by mail.kernel.org (Postfix) with ESMTP id A72D26023B for ; Mon, 28 Jun 2021 15:54:55 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org A72D26023B Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=intel.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=dev-bounces@dpdk.org Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 0CCAF41165; Mon, 28 Jun 2021 17:54:34 +0200 (CEST) Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by mails.dpdk.org (Postfix) with ESMTP id E6E5D41145 for ; Mon, 28 Jun 2021 17:54:30 +0200 (CEST) X-IronPort-AV: E=McAfee;i="6200,9189,10029"; a="204975517" X-IronPort-AV: E=Sophos;i="5.83,306,1616482800"; d="scan'208";a="204975517" Received: from orsmga005.jf.intel.com ([10.7.209.41]) by fmsmga102.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 28 Jun 2021 08:54:30 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.83,306,1616482800"; d="scan'208";a="625296697" Received: from silpixa00399498.ir.intel.com (HELO silpixa00399498.ger.corp.intel.com) ([10.237.223.53]) by orsmga005.jf.intel.com with ESMTP; 28 Jun 2021 08:54:28 -0700 From: Anatoly Burakov To: dev@dpdk.org, David Hunt , Ray Kinsella , Neil Horman Cc: konstantin.ananyev@intel.com, ciara.loftus@intel.com Date: Mon, 28 Jun 2021 15:54:12 +0000 Message-Id: <086144939a5a619f52afbf002d260412bcfad9cf.1624895595.git.anatoly.burakov@intel.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: [dpdk-dev] [PATCH v4 5/7] power: support callbacks for multiple Rx queues X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Currently, there is a hard limitation on the PMD power management support that only allows it to support a single queue per lcore. This is not ideal as most DPDK use cases will poll multiple queues per core. The PMD power management mechanism relies on ethdev Rx callbacks, so it is very difficult to implement such support because callbacks are effectively stateless and have no visibility into what the other ethdev devices are doing. This places limitations on what we can do within the framework of Rx callbacks, but the basics of this implementation are as follows: - Replace per-queue structures with per-lcore ones, so that any device polled from the same lcore can share data - Any queue that is going to be polled from a specific lcore has to be added to the list of cores to poll, so that the callback is aware of other queues being polled by the same lcore - Both the empty poll counter and the actual power saving mechanism is shared between all queues polled on a particular lcore, and is only activated when a special designated "power saving" queue is polled. To put it another way, we have no idea which queue the user will poll in what order, so we rely on them telling us that queue X is the last one in the polling loop, so any power management should happen there. - A new API is added to mark a specific Rx queue as "power saving". Failing to call this API will result in no power management, however when having only one queue per core it is obvious which queue is the "power saving" one, so things will still work without this new API for use cases that were previously working without it. - The limitation on UMWAIT-based polling is not removed because UMWAIT is incapable of monitoring more than one address. Also, while we're at it, update and improve the docs. Signed-off-by: Anatoly Burakov --- Notes: v3: - Move the list of supported NICs to NIC feature table v2: - Use a TAILQ for queues instead of a static array - Address feedback from Konstantin - Add additional checks for stopped queues doc/guides/nics/features.rst | 10 + doc/guides/prog_guide/power_man.rst | 75 +++-- doc/guides/rel_notes/release_21_08.rst | 3 + lib/power/rte_power_pmd_mgmt.c | 381 ++++++++++++++++++++----- lib/power/rte_power_pmd_mgmt.h | 34 +++ lib/power/version.map | 3 + 6 files changed, 412 insertions(+), 94 deletions(-) diff --git a/doc/guides/nics/features.rst b/doc/guides/nics/features.rst index 403c2b03a3..a96e12d155 100644 --- a/doc/guides/nics/features.rst +++ b/doc/guides/nics/features.rst @@ -912,6 +912,16 @@ Supports to get Rx/Tx packet burst mode information. * **[implements] eth_dev_ops**: ``rx_burst_mode_get``, ``tx_burst_mode_get``. * **[related] API**: ``rte_eth_rx_burst_mode_get()``, ``rte_eth_tx_burst_mode_get()``. +.. _nic_features_get_monitor_addr: + +PMD power management using monitor addresses +-------------------------------------------- + +Supports getting a monitoring condition to use together with Ethernet PMD power +management (see :doc:`../prog_guide/power_man` for more details). + +* **[implements] eth_dev_ops**: ``get_monitor_addr`` + .. _nic_features_other: Other dev ops not represented by a Feature diff --git a/doc/guides/prog_guide/power_man.rst b/doc/guides/prog_guide/power_man.rst index c70ae128ac..fac2c19516 100644 --- a/doc/guides/prog_guide/power_man.rst +++ b/doc/guides/prog_guide/power_man.rst @@ -198,34 +198,41 @@ Ethernet PMD Power Management API Abstract ~~~~~~~~ -Existing power management mechanisms require developers -to change application design or change code to make use of it. -The PMD power management API provides a convenient alternative -by utilizing Ethernet PMD RX callbacks, -and triggering power saving whenever empty poll count reaches a certain number. - -Monitor - This power saving scheme will put the CPU into optimized power state - and use the ``rte_power_monitor()`` function - to monitor the Ethernet PMD RX descriptor address, - and wake the CPU up whenever there's new traffic. - -Pause - This power saving scheme will avoid busy polling - by either entering power-optimized sleep state - with ``rte_power_pause()`` function, - or, if it's not available, use ``rte_pause()``. - -Frequency scaling - This power saving scheme will use ``librte_power`` library - functionality to scale the core frequency up/down - depending on traffic volume. - -.. note:: - - Currently, this power management API is limited to mandatory mapping - of 1 queue to 1 core (multiple queues are supported, - but they must be polled from different cores). +Existing power management mechanisms require developers to change application +design or change code to make use of it. The PMD power management API provides a +convenient alternative by utilizing Ethernet PMD RX callbacks, and triggering +power saving whenever empty poll count reaches a certain number. + +* Monitor + This power saving scheme will put the CPU into optimized power state and + monitor the Ethernet PMD RX descriptor address, waking the CPU up whenever + there's new traffic. Support for this scheme may not be available on all + platforms, and further limitations may apply (see below). + +* Pause + This power saving scheme will avoid busy polling by either entering + power-optimized sleep state with ``rte_power_pause()`` function, or, if it's + not supported by the underlying platform, use ``rte_pause()``. + +* Frequency scaling + This power saving scheme will use ``librte_power`` library functionality to + scale the core frequency up/down depending on traffic volume. + +The "monitor" mode is only supported in the following configurations and scenarios: + +* If ``rte_cpu_get_intrinsics_support()`` function indicates that + ``rte_power_monitor()`` is supported by the platform, then monitoring will be + limited to a mapping of 1 core 1 queue (thus, each Rx queue will have to be + monitored from a different lcore). + +* If ``rte_cpu_get_intrinsics_support()`` function indicates that the + ``rte_power_monitor()`` function is not supported, then monitor mode will not + be supported. + +* Not all Ethernet devices support monitoring, even if the underlying + platform may support the necessary CPU instructions. Please refer to + :doc:`../nics/overview` for more information. + API Overview for Ethernet PMD Power Management ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ @@ -234,6 +241,16 @@ API Overview for Ethernet PMD Power Management * **Queue Disable**: Disable power scheme for certain queue/port/core. +* **Set Power Save Queue**: In case of polling multiple queues from one lcore, + designate a specific queue to be the one that triggers power management routines. + +.. note:: + + When using PMD power management with multiple Ethernet Rx queues on one lcore, + it is required to designate one of the configured Rx queues as a "power save" + queue by calling the appropriate API. Failing to do so will result in no + power saving ever taking effect. + References ---------- @@ -242,3 +259,5 @@ References * The :doc:`../sample_app_ug/vm_power_management` chapter in the :doc:`../sample_app_ug/index` section. + +* The :doc:`../nics/overview` chapter in the :doc:`../nics/index` section diff --git a/doc/guides/rel_notes/release_21_08.rst b/doc/guides/rel_notes/release_21_08.rst index f015c509fc..3926d45ef8 100644 --- a/doc/guides/rel_notes/release_21_08.rst +++ b/doc/guides/rel_notes/release_21_08.rst @@ -57,6 +57,9 @@ New Features * eal: added ``rte_power_monitor_multi`` to support waiting for multiple events. +* rte_power: The experimental PMD power management API now supports managing + multiple Ethernet Rx queues per lcore. + Removed Items ------------- diff --git a/lib/power/rte_power_pmd_mgmt.c b/lib/power/rte_power_pmd_mgmt.c index 9b95cf1794..7762cd39b8 100644 --- a/lib/power/rte_power_pmd_mgmt.c +++ b/lib/power/rte_power_pmd_mgmt.c @@ -33,7 +33,28 @@ enum pmd_mgmt_state { PMD_MGMT_ENABLED }; -struct pmd_queue_cfg { +union queue { + uint32_t val; + struct { + uint16_t portid; + uint16_t qid; + }; +}; + +struct queue_list_entry { + TAILQ_ENTRY(queue_list_entry) next; + union queue queue; +}; + +struct pmd_core_cfg { + TAILQ_HEAD(queue_list_head, queue_list_entry) head; + /**< Which port-queue pairs are associated with this lcore? */ + union queue power_save_queue; + /**< When polling multiple queues, all but this one will be ignored */ + bool power_save_queue_set; + /**< When polling multiple queues, power save queue must be set */ + size_t n_queues; + /**< How many queues are in the list? */ volatile enum pmd_mgmt_state pwr_mgmt_state; /**< State of power management for this queue */ enum rte_power_pmd_mgmt_type cb_mode; @@ -43,8 +64,96 @@ struct pmd_queue_cfg { uint64_t empty_poll_stats; /**< Number of empty polls */ } __rte_cache_aligned; +static struct pmd_core_cfg lcore_cfg[RTE_MAX_LCORE]; -static struct pmd_queue_cfg port_cfg[RTE_MAX_ETHPORTS][RTE_MAX_QUEUES_PER_PORT]; +static inline bool +queue_equal(const union queue *l, const union queue *r) +{ + return l->val == r->val; +} + +static inline void +queue_copy(union queue *dst, const union queue *src) +{ + dst->val = src->val; +} + +static inline bool +queue_is_power_save(const struct pmd_core_cfg *cfg, const union queue *q) +{ + const union queue *pwrsave = &cfg->power_save_queue; + + /* if there's only single queue, no need to check anything */ + if (cfg->n_queues == 1) + return true; + return cfg->power_save_queue_set && queue_equal(q, pwrsave); +} + +static struct queue_list_entry * +queue_list_find(const struct pmd_core_cfg *cfg, const union queue *q) +{ + struct queue_list_entry *cur; + + TAILQ_FOREACH(cur, &cfg->head, next) { + if (queue_equal(&cur->queue, q)) + return cur; + } + return NULL; +} + +static int +queue_set_power_save(struct pmd_core_cfg *cfg, const union queue *q) +{ + const struct queue_list_entry *found = queue_list_find(cfg, q); + if (found == NULL) + return -ENOENT; + queue_copy(&cfg->power_save_queue, q); + cfg->power_save_queue_set = true; + return 0; +} + +static int +queue_list_add(struct pmd_core_cfg *cfg, const union queue *q) +{ + struct queue_list_entry *qle; + + /* is it already in the list? */ + if (queue_list_find(cfg, q) != NULL) + return -EEXIST; + + qle = malloc(sizeof(*qle)); + if (qle == NULL) + return -ENOMEM; + + queue_copy(&qle->queue, q); + TAILQ_INSERT_TAIL(&cfg->head, qle, next); + cfg->n_queues++; + + return 0; +} + +static int +queue_list_remove(struct pmd_core_cfg *cfg, const union queue *q) +{ + struct queue_list_entry *found; + + found = queue_list_find(cfg, q); + if (found == NULL) + return -ENOENT; + + TAILQ_REMOVE(&cfg->head, found, next); + cfg->n_queues--; + free(found); + + /* if this was a power save queue, unset it */ + if (cfg->power_save_queue_set && queue_is_power_save(cfg, q)) { + union queue *pwrsave = &cfg->power_save_queue; + cfg->power_save_queue_set = false; + pwrsave->val = 0; + } + + return 0; +} static void calc_tsc(void) @@ -79,10 +188,10 @@ clb_umwait(uint16_t port_id, uint16_t qidx, struct rte_mbuf **pkts __rte_unused, uint16_t nb_rx, uint16_t max_pkts __rte_unused, void *addr __rte_unused) { + const unsigned int lcore = rte_lcore_id(); + struct pmd_core_cfg *q_conf; - struct pmd_queue_cfg *q_conf; - - q_conf = &port_cfg[port_id][qidx]; + q_conf = &lcore_cfg[lcore]; if (unlikely(nb_rx == 0)) { q_conf->empty_poll_stats++; @@ -107,11 +216,26 @@ clb_pause(uint16_t port_id, uint16_t qidx, struct rte_mbuf **pkts __rte_unused, uint16_t nb_rx, uint16_t max_pkts __rte_unused, void *addr __rte_unused) { - struct pmd_queue_cfg *q_conf; + const unsigned int lcore = rte_lcore_id(); + const union queue q = {.portid = port_id, .qid = qidx}; + const bool empty = nb_rx == 0; + struct pmd_core_cfg *q_conf; - q_conf = &port_cfg[port_id][qidx]; + q_conf = &lcore_cfg[lcore]; - if (unlikely(nb_rx == 0)) { + /* early exit */ + if (likely(!empty)) { + q_conf->empty_poll_stats = 0; + } else { + /* do we care about this particular queue? */ + if (!queue_is_power_save(q_conf, &q)) + return nb_rx; + + /* + * we can increment unconditionally here because if there were + * non-empty polls in other queues assigned to this core, we + * dropped the counter to zero anyway. + */ q_conf->empty_poll_stats++; /* sleep for 1 microsecond */ if (unlikely(q_conf->empty_poll_stats > EMPTYPOLL_MAX)) { @@ -127,8 +251,7 @@ clb_pause(uint16_t port_id, uint16_t qidx, struct rte_mbuf **pkts __rte_unused, rte_pause(); } } - } else - q_conf->empty_poll_stats = 0; + } return nb_rx; } @@ -138,19 +261,33 @@ clb_scale_freq(uint16_t port_id, uint16_t qidx, struct rte_mbuf **pkts __rte_unused, uint16_t nb_rx, uint16_t max_pkts __rte_unused, void *_ __rte_unused) { - struct pmd_queue_cfg *q_conf; + const unsigned int lcore = rte_lcore_id(); + const union queue q = {.portid = port_id, .qid = qidx}; + const bool empty = nb_rx == 0; + struct pmd_core_cfg *q_conf; - q_conf = &port_cfg[port_id][qidx]; + q_conf = &lcore_cfg[lcore]; - if (unlikely(nb_rx == 0)) { + /* early exit */ + if (likely(!empty)) { + q_conf->empty_poll_stats = 0; + + /* scale up freq immediately */ + rte_power_freq_max(rte_lcore_id()); + } else { + /* do we care about this particular queue? */ + if (!queue_is_power_save(q_conf, &q)) + return nb_rx; + + /* + * we can increment unconditionally here because if there were + * non-empty polls in other queues assigned to this core, we + * dropped the counter to zero anyway. + */ q_conf->empty_poll_stats++; if (unlikely(q_conf->empty_poll_stats > EMPTYPOLL_MAX)) /* scale down freq */ rte_power_freq_min(rte_lcore_id()); - } else { - q_conf->empty_poll_stats = 0; - /* scale up freq */ - rte_power_freq_max(rte_lcore_id()); } return nb_rx; @@ -167,11 +304,79 @@ queue_stopped(const uint16_t port_id, const uint16_t queue_id) return qinfo.queue_state == RTE_ETH_QUEUE_STATE_STOPPED; } +static int +cfg_queues_stopped(struct pmd_core_cfg *queue_cfg) +{ + const struct queue_list_entry *entry; + + TAILQ_FOREACH(entry, &queue_cfg->head, next) { + const union queue *q = &entry->queue; + int ret = queue_stopped(q->portid, q->qid); + if (ret != 1) + return ret; + } + return 1; +} + +static int +check_scale(unsigned int lcore) +{ + enum power_management_env env; + + /* only PSTATE and ACPI modes are supported */ + if (!rte_power_check_env_supported(PM_ENV_ACPI_CPUFREQ) && + !rte_power_check_env_supported(PM_ENV_PSTATE_CPUFREQ)) { + RTE_LOG(DEBUG, POWER, "Neither ACPI nor PSTATE modes are supported\n"); + return -ENOTSUP; + } + /* ensure we could initialize the power library */ + if (rte_power_init(lcore)) + return -EINVAL; + + /* ensure we initialized the correct env */ + env = rte_power_get_env(); + if (env != PM_ENV_ACPI_CPUFREQ && env != PM_ENV_PSTATE_CPUFREQ) { + RTE_LOG(DEBUG, POWER, "Neither ACPI nor PSTATE modes were initialized\n"); + return -ENOTSUP; + } + + /* we're done */ + return 0; +} + +static int +check_monitor(struct pmd_core_cfg *cfg, const union queue *qdata) +{ + struct rte_power_monitor_cond dummy; + + /* check if rte_power_monitor is supported */ + if (!global_data.intrinsics_support.power_monitor) { + RTE_LOG(DEBUG, POWER, "Monitoring intrinsics are not supported\n"); + return -ENOTSUP; + } + + if (cfg->n_queues > 0) { + RTE_LOG(DEBUG, POWER, "Monitoring multiple queues is not supported\n"); + return -ENOTSUP; + } + + /* check if the device supports the necessary PMD API */ + if (rte_eth_get_monitor_addr(qdata->portid, qdata->qid, + &dummy) == -ENOTSUP) { + RTE_LOG(DEBUG, POWER, "The device does not support rte_eth_get_monitor_addr\n"); + return -ENOTSUP; + } + + /* we're done */ + return 0; +} + int rte_power_ethdev_pmgmt_queue_enable(unsigned int lcore_id, uint16_t port_id, uint16_t queue_id, enum rte_power_pmd_mgmt_type mode) { - struct pmd_queue_cfg *queue_cfg; + const union queue qdata = {.portid = port_id, .qid = queue_id}; + struct pmd_core_cfg *queue_cfg; struct rte_eth_dev_info info; rte_rx_callback_fn clb; int ret; @@ -202,9 +407,19 @@ rte_power_ethdev_pmgmt_queue_enable(unsigned int lcore_id, uint16_t port_id, goto end; } - queue_cfg = &port_cfg[port_id][queue_id]; + queue_cfg = &lcore_cfg[lcore_id]; - if (queue_cfg->pwr_mgmt_state != PMD_MGMT_DISABLED) { + /* check if other queues are stopped as well */ + ret = cfg_queues_stopped(queue_cfg); + if (ret != 1) { + /* error means invalid queue, 0 means queue wasn't stopped */ + ret = ret < 0 ? -EINVAL : -EBUSY; + goto end; + } + + /* if callback was already enabled, check current callback type */ + if (queue_cfg->pwr_mgmt_state != PMD_MGMT_DISABLED && + queue_cfg->cb_mode != mode) { ret = -EINVAL; goto end; } @@ -214,53 +429,20 @@ rte_power_ethdev_pmgmt_queue_enable(unsigned int lcore_id, uint16_t port_id, switch (mode) { case RTE_POWER_MGMT_TYPE_MONITOR: - { - struct rte_power_monitor_cond dummy; - - /* check if rte_power_monitor is supported */ - if (!global_data.intrinsics_support.power_monitor) { - RTE_LOG(DEBUG, POWER, "Monitoring intrinsics are not supported\n"); - ret = -ENOTSUP; + /* check if we can add a new queue */ + ret = check_monitor(queue_cfg, &qdata); + if (ret < 0) goto end; - } - /* check if the device supports the necessary PMD API */ - if (rte_eth_get_monitor_addr(port_id, queue_id, - &dummy) == -ENOTSUP) { - RTE_LOG(DEBUG, POWER, "The device does not support rte_eth_get_monitor_addr\n"); - ret = -ENOTSUP; - goto end; - } clb = clb_umwait; break; - } case RTE_POWER_MGMT_TYPE_SCALE: - { - enum power_management_env env; - /* only PSTATE and ACPI modes are supported */ - if (!rte_power_check_env_supported(PM_ENV_ACPI_CPUFREQ) && - !rte_power_check_env_supported( - PM_ENV_PSTATE_CPUFREQ)) { - RTE_LOG(DEBUG, POWER, "Neither ACPI nor PSTATE modes are supported\n"); - ret = -ENOTSUP; + /* check if we can add a new queue */ + ret = check_scale(lcore_id); + if (ret < 0) goto end; - } - /* ensure we could initialize the power library */ - if (rte_power_init(lcore_id)) { - ret = -EINVAL; - goto end; - } - /* ensure we initialized the correct env */ - env = rte_power_get_env(); - if (env != PM_ENV_ACPI_CPUFREQ && - env != PM_ENV_PSTATE_CPUFREQ) { - RTE_LOG(DEBUG, POWER, "Neither ACPI nor PSTATE modes were initialized\n"); - ret = -ENOTSUP; - goto end; - } clb = clb_scale_freq; break; - } case RTE_POWER_MGMT_TYPE_PAUSE: /* figure out various time-to-tsc conversions */ if (global_data.tsc_per_us == 0) @@ -273,11 +455,20 @@ rte_power_ethdev_pmgmt_queue_enable(unsigned int lcore_id, uint16_t port_id, ret = -EINVAL; goto end; } + /* add this queue to the list */ + ret = queue_list_add(queue_cfg, &qdata); + if (ret < 0) { + RTE_LOG(DEBUG, POWER, "Failed to add queue to list: %s\n", + strerror(-ret)); + goto end; + } /* initialize data before enabling the callback */ - queue_cfg->empty_poll_stats = 0; - queue_cfg->cb_mode = mode; - queue_cfg->pwr_mgmt_state = PMD_MGMT_ENABLED; + if (queue_cfg->n_queues == 1) { + queue_cfg->empty_poll_stats = 0; + queue_cfg->cb_mode = mode; + queue_cfg->pwr_mgmt_state = PMD_MGMT_ENABLED; + } queue_cfg->cur_cb = rte_eth_add_rx_callback(port_id, queue_id, clb, NULL); @@ -290,7 +481,8 @@ int rte_power_ethdev_pmgmt_queue_disable(unsigned int lcore_id, uint16_t port_id, uint16_t queue_id) { - struct pmd_queue_cfg *queue_cfg; + const union queue qdata = {.portid = port_id, .qid = queue_id}; + struct pmd_core_cfg *queue_cfg; int ret; RTE_ETH_VALID_PORTID_OR_ERR_RET(port_id, -EINVAL); @@ -306,13 +498,31 @@ rte_power_ethdev_pmgmt_queue_disable(unsigned int lcore_id, } /* no need to check queue id as wrong queue id would not be enabled */ - queue_cfg = &port_cfg[port_id][queue_id]; + queue_cfg = &lcore_cfg[lcore_id]; + + /* check if other queues are stopped as well */ + ret = cfg_queues_stopped(queue_cfg); + if (ret != 1) { + /* error means invalid queue, 0 means queue wasn't stopped */ + return ret < 0 ? -EINVAL : -EBUSY; + } if (queue_cfg->pwr_mgmt_state != PMD_MGMT_ENABLED) return -EINVAL; - /* stop any callbacks from progressing */ - queue_cfg->pwr_mgmt_state = PMD_MGMT_DISABLED; + /* + * There is no good/easy way to do this without race conditions, so we + * are just going to throw our hands in the air and hope that the user + * has read the documentation and has ensured that ports are stopped at + * the time we enter the API functions. + */ + ret = queue_list_remove(queue_cfg, &qdata); + if (ret < 0) + return -ret; + + /* if we've removed all queues from the lists, set state to disabled */ + if (queue_cfg->n_queues == 0) + queue_cfg->pwr_mgmt_state = PMD_MGMT_DISABLED; switch (queue_cfg->cb_mode) { case RTE_POWER_MGMT_TYPE_MONITOR: /* fall-through */ @@ -336,3 +546,42 @@ rte_power_ethdev_pmgmt_queue_disable(unsigned int lcore_id, return 0; } + +int +rte_power_ethdev_pmgmt_queue_set_power_save(unsigned int lcore_id, + uint16_t port_id, uint16_t queue_id) +{ + const union queue qdata = {.portid = port_id, .qid = queue_id}; + struct pmd_core_cfg *queue_cfg; + int ret; + + RTE_ETH_VALID_PORTID_OR_ERR_RET(port_id, -EINVAL); + + if (lcore_id >= RTE_MAX_LCORE || queue_id >= RTE_MAX_QUEUES_PER_PORT) + return -EINVAL; + + /* no need to check queue id as wrong queue id would not be enabled */ + queue_cfg = &lcore_cfg[lcore_id]; + + if (queue_cfg->pwr_mgmt_state != PMD_MGMT_ENABLED) + return -EINVAL; + + ret = queue_set_power_save(queue_cfg, &qdata); + if (ret < 0) { + RTE_LOG(DEBUG, POWER, "Failed to set power save queue: %s\n", + strerror(-ret)); + return -ret; + } + + return 0; +} + +RTE_INIT(rte_power_ethdev_pmgmt_init) { + size_t i; + + /* initialize all tailqs */ + for (i = 0; i < RTE_DIM(lcore_cfg); i++) { + struct pmd_core_cfg *cfg = &lcore_cfg[i]; + TAILQ_INIT(&cfg->head); + } +} diff --git a/lib/power/rte_power_pmd_mgmt.h b/lib/power/rte_power_pmd_mgmt.h index 444e7b8a66..d6ef8f778a 100644 --- a/lib/power/rte_power_pmd_mgmt.h +++ b/lib/power/rte_power_pmd_mgmt.h @@ -90,6 +90,40 @@ int rte_power_ethdev_pmgmt_queue_disable(unsigned int lcore_id, uint16_t port_id, uint16_t queue_id); +/** + * @warning + * @b EXPERIMENTAL: this API may change, or be removed, without prior notice. + * + * Set a specific Ethernet device Rx queue to be the "power save" queue for a + * particular lcore. When multiple queues are assigned to a single lcore using + * the `rte_power_ethdev_pmgmt_queue_enable` API, only one of them will trigger + * the power management. In a typical scenario, the last queue to be polled on + * a particular lcore should be designated as power save queue. + * + * @note This function is not thread-safe. + * + * @note When using multiple queues per lcore, calling this function is + * mandatory. If not called, no power management routines would be triggered + * when the traffic starts. + * + * @warning This function must be called when all affected Ethernet ports are + * stopped and no Rx/Tx is in progress! + * + * @param lcore_id + * The lcore the Rx queue is polled from. + * @param port_id + * The port identifier of the Ethernet device. + * @param queue_id + * The queue identifier of the Ethernet device. + * @return + * 0 on success + * <0 on error + */ +__rte_experimental +int +rte_power_ethdev_pmgmt_queue_set_power_save(unsigned int lcore_id, + uint16_t port_id, uint16_t queue_id); + #ifdef __cplusplus } #endif diff --git a/lib/power/version.map b/lib/power/version.map index b004e3e4a9..105d1d94c2 100644 --- a/lib/power/version.map +++ b/lib/power/version.map @@ -38,4 +38,7 @@ EXPERIMENTAL { # added in 21.02 rte_power_ethdev_pmgmt_queue_disable; rte_power_ethdev_pmgmt_queue_enable; + + # added in 21.08 + rte_power_ethdev_pmgmt_queue_set_power_save; }; -- 2.25.1