All of lore.kernel.org
 help / color / mirror / Atom feed
From: Neil Horman <nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
To: dev-VfR2kkLFssw@public.gmane.org
Subject: Re: [PATCH v5 00/14] dpdk: Separate compile time linkage between eal lib and pmd's
Date: Fri, 16 May 2014 11:28:47 -0400	[thread overview]
Message-ID: <20140516152847.GB5432@hmsreliant.think-freely.org> (raw)
In-Reply-To: <1398092379-7679-1-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>

On Mon, Apr 21, 2014 at 10:59:25AM -0400, Neil Horman wrote:
> Disconnect compile time linkage between eal library / applications and pmd's
> 
> I noticed that, while tinkering with dpdk, building for shared libraries still
> resulted in all the test applications linking to all the built pmd's, despite
> not actually needing them all.  We are able to tell an application at run time
> (via the -d/--blacklist/--whitelist/--vdev options) which pmd's we want to use,
> and so have no need to link them at all. The only reason they get pulled in is
> because rte_eal_non_pci_init_etherdev and rte_pmd_init_all contain static lists
> to the individual pmd init functions. The result is that, even when building as
> DSO's, we have to load all the pmd libraries, which is space inefficient and
> defeating of some of the purpose of shared objects.
> 
> To correct this, I developed this patch series, which introduces a new macro,
> PMD_REGISTER_DRIVER, which wraps up Oliviers work using constructors on the
> virtual device pmds, then expands on it to include the physical device pmds,
> allowing us to break linkages between dpdk applications and pmd's almost
> entirely (save for the ring and xenvirt drivers, which have additional api's
> outside of the standard dpdk code that we need to further fix).  This also
> allows us to completely remove the rte_pmd_init_all routine, hiding its function
> internally to the rte_eal_init path.
> 
> I've tested this feature using the igb and pcap pmd's, both statically and
> dynamically linked with the test and testpmd sample applications, and it seems
> to work well.
> 
> Note, I encountered  a few bugs along the way, which I fixed and noted in the
> series.
> 
> Regards
> Neil
> 
> Change Notes:
> 
> 1) Reposted the entire series.  Recent changes permeated accross several
> patches, and since a few patches already had multiple versions, I've reposted
> the entire series and bumped the version number to 5, whcih skips a few
> versions, but ensures this series is seen as the most recent.
> 
> 2) Merged the PMD_REGISTER_DRIVER macro into rte_dev.h, which is a better
> location for it.  Required removing include of rte_pmd.h across most of the
> patches in the series.
> 
> 3) Cleaned up various leftover "virtual" comments in the driver registration api
> that no longer belong there after making it generic
> 
> 4) Fixed the LINK_USING_CC check in rte.lib.mk so it works like other uses
> 
> 5) Fixed CPU_LDFLAGS conversion to use -Wl in case we link with gcc.
> 
> 
> 

Ping, so whats the status on the rest of this series?  You said you would
integrate it with 1.7.0, but you've applied several dozen patches ahead of it
(many of which were posted after it), and as a result, it no longer applies.  I
assume you're planning on fixing all of this up?

Neil

  parent reply	other threads:[~2014-05-16 15:28 UTC|newest]

Thread overview: 77+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-04-15 18:05 [PATCH 0/15] dpdk: Separate compile time linkage between eal lib and pmd's Neil Horman
     [not found] ` <1397585169-14537-1-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2014-04-15 18:05   ` [PATCH 01/15] makefiles: Fixed -share command line option error Neil Horman
     [not found]     ` <1397585169-14537-2-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2014-04-16  9:22       ` Thomas Monjalon
2014-04-16 11:00         ` Neil Horman
     [not found]           ` <20140416110018.GB26829-B26myB8xz7F8NnZeBjwnZQMhkBWG/bsMQH7oEaQurus@public.gmane.org>
2014-04-16 11:37             ` Thomas Monjalon
2014-04-16 13:51       ` [PATCH 01/15 v2] " Neil Horman
     [not found]         ` <1397656304-468-1-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2014-04-18 11:23           ` Thomas Monjalon
2014-04-18 13:18             ` Neil Horman
     [not found]               ` <20140418131849.GC4053-bi+AKbBUZKY6gyzm1THtWbp2dZbC/Bob@public.gmane.org>
2014-04-18 13:29                 ` Thomas Monjalon
2014-04-18 17:36                   ` Neil Horman
2014-04-21 14:41                   ` Neil Horman
2014-04-29 23:42           ` Thomas Monjalon
2014-05-02 11:09             ` Neil Horman
     [not found]               ` <20140502110927.GA15335-B26myB8xz7F8NnZeBjwnZQMhkBWG/bsMQH7oEaQurus@public.gmane.org>
2014-05-02 12:22                 ` Thomas Monjalon
2014-05-02 13:01                   ` Neil Horman
     [not found]                     ` <20140502130148.GD15335-B26myB8xz7F8NnZeBjwnZQMhkBWG/bsMQH7oEaQurus@public.gmane.org>
2014-05-02 13:18                       ` Thomas Monjalon
2014-04-15 18:05   ` [PATCH 02/15] make: include whole archive on static link Neil Horman
     [not found]     ` <1397585169-14537-3-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2014-04-16  9:26       ` Thomas Monjalon
2014-04-16 11:02         ` Neil Horman
     [not found]           ` <20140416110204.GC26829-B26myB8xz7F8NnZeBjwnZQMhkBWG/bsMQH7oEaQurus@public.gmane.org>
2014-04-16 11:40             ` Thomas Monjalon
2014-04-16 13:02               ` Neil Horman
     [not found]                 ` <20140416130204.GB11887-bi+AKbBUZKY6gyzm1THtWbp2dZbC/Bob@public.gmane.org>
2014-04-16 13:33                   ` Neil Horman
2014-04-15 18:05   ` [PATCH 03/15] pmd: Add PMD_REGISTER_DRIVER macro Neil Horman
     [not found]     ` <1397585169-14537-4-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2014-04-16 11:52       ` Thomas Monjalon
2014-04-16 12:59         ` John W. Linville
2014-04-16 13:08         ` Neil Horman
     [not found]           ` <20140416130848.GC11887-bi+AKbBUZKY6gyzm1THtWbp2dZbC/Bob@public.gmane.org>
2014-04-16 16:11             ` Olivier MATZ
     [not found]               ` <534EABB4.9020301-pdR9zngts4EAvxtiuMwx3w@public.gmane.org>
2014-04-16 17:15                 ` John W. Linville
2014-04-16 17:29                 ` Neil Horman
     [not found]                   ` <20140416172924.GE11887-bi+AKbBUZKY6gyzm1THtWbp2dZbC/Bob@public.gmane.org>
2014-04-17  8:08                     ` Olivier MATZ
     [not found]                       ` <534F8BFD.6070701-pdR9zngts4EAvxtiuMwx3w@public.gmane.org>
2014-04-17 10:59                         ` Neil Horman
2014-04-18 11:42       ` Thomas Monjalon
2014-04-18 12:04         ` Neil Horman
     [not found]           ` <20140418120409.GB2812-bi+AKbBUZKY6gyzm1THtWbp2dZbC/Bob@public.gmane.org>
2014-04-18 12:08             ` Thomas Monjalon
2014-04-18 13:20               ` Neil Horman
     [not found]                 ` <20140418132054.GD4053-bi+AKbBUZKY6gyzm1THtWbp2dZbC/Bob@public.gmane.org>
2014-04-18 13:32                   ` Thomas Monjalon
2014-04-18 17:42                     ` Neil Horman
2014-04-15 18:05   ` [PATCH 04/15] pcap: Convert to use of PMD_REGISTER_DRIVER and fix linking Neil Horman
2014-04-15 18:05   ` [PATCH 05/15] ring: " Neil Horman
     [not found]     ` <1397585169-14537-6-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2014-04-16 13:53       ` [PATCH 05/15 v2] " Neil Horman
2014-04-17  9:50       ` [PATCH 05/15] " Ananyev, Konstantin
     [not found]         ` <2601191342CEEE43887BDE71AB9772580EF973E4-kPTMFJFq+rEu0RiL9chJVbfspsVTdybXVpNB7YpNyf8@public.gmane.org>
2014-04-17 11:06           ` Neil Horman
2014-04-17 15:16           ` [PATCH 05/15 v3] " Neil Horman
     [not found]             ` <1397747816-23245-1-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2014-06-13 13:28               ` De Lara Guarch, Pablo
2014-04-15 18:06   ` [PATCH 06/15] xenvirt: " Neil Horman
2014-04-15 18:06   ` [PATCH 07/15] eal: Make vdev init path generic for both virtual and physcial devices Neil Horman
     [not found]     ` <1397585169-14537-8-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2014-04-18 12:02       ` Thomas Monjalon
2014-04-15 18:06   ` [PATCH 08/15] igb: Convert to use of PMD_REGISTER_DRIVER and fix linking Neil Horman
2014-04-15 18:06   ` [PATCH 09/15] igbvf: " Neil Horman
2014-04-15 18:06   ` [PATCH 10/15] e1000: " Neil Horman
2014-04-15 18:06   ` [PATCH 11/15] ixgbe: " Neil Horman
2014-04-15 18:06   ` [PATCH 12/15] ixgbevf: " Neil Horman
2014-04-15 18:06   ` [PATCH 13/15] virtio: " Neil Horman
2014-04-15 18:06   ` [PATCH 14/15] vmxnet3: " Neil Horman
2014-04-15 18:06   ` [PATCH 15/15] pmd: Remove rte_pmd_init_all Neil Horman
2014-04-21 14:59   ` [PATCH v5 00/14] dpdk: Separate compile time linkage between eal lib and pmd's Neil Horman
     [not found]     ` <1398092379-7679-1-git-send-email-nhorman-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2014-04-21 14:59       ` [PATCH 0/X v5 01/14] makefiles: Fixed -share command line option error Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 02/14] pmd: Add PMD_REGISTER_DRIVER macro Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 03/14] pcap: Convert to use of PMD_REGISTER_DRIVER and fix linking Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 04/14] ring: " Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 05/14] xenvirt: " Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 06/14] eal: Make vdev init path generic for both virtual and physcial devices Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 07/14] igb: Convert to use of PMD_REGISTER_DRIVER and fix linking Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 08/14] igbvf: " Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 09/14] e1000: " Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 10/14] ixgbe: " Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 11/14] ixgbevf: " Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 12/14] virtio: " Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 13/14] vmxnet3: " Neil Horman
2014-04-21 14:59       ` [PATCH 0/X v5 14/14] pmd: Remove rte_pmd_init_all Neil Horman
2014-04-21 17:05       ` [PATCH v5 00/14] dpdk: Separate compile time linkage between eal lib and pmd's Neil Horman
2014-04-21 20:10       ` Stephen Hemminger
     [not found]         ` <20140421131000.743b6d9b-We1ePj4FEcvRI77zikRAJc56i+j3xesD0e7PPNI6Mm0@public.gmane.org>
2014-04-21 20:36           ` Neil Horman
2014-05-16 15:28       ` Neil Horman [this message]
     [not found]         ` <20140516152847.GB5432-B26myB8xz7F8NnZeBjwnZQMhkBWG/bsMQH7oEaQurus@public.gmane.org>
2014-05-16 15:39           ` Thomas Monjalon
2014-05-20 12:45       ` Thomas Monjalon
2014-05-20 14:13         ` Neil Horman

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20140516152847.GB5432@hmsreliant.think-freely.org \
    --to=nhorman-2xusbdqka4r54taoqtywwq@public.gmane.org \
    --cc=dev-VfR2kkLFssw@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.