From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.4 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7A667C35242 for ; Mon, 17 Feb 2020 06:08:52 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 52D1D2072C for ; Mon, 17 Feb 2020 06:08:52 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="OQf4Ri/j" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726620AbgBQGIe (ORCPT ); Mon, 17 Feb 2020 01:08:34 -0500 Received: from us-smtp-2.mimecast.com ([207.211.31.81]:36546 "EHLO us-smtp-1.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726415AbgBQGId (ORCPT ); Mon, 17 Feb 2020 01:08:33 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1581919712; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=GhhQHDShnd+KbggLHB4NhxmgV88eVkpntzyZ9x/aC1Y=; b=OQf4Ri/jr2s5lAJCiPhj6s1Lx2JIGCdxCzLIYqWvt0mzXLr48zMUD7PkFr7tDdeRcOhEP+ hSgVFyOIm0dqntnJKMmT4PCTVEBetDLBCPZQpJ98PpFesZhidQQ6X8oxODW5BQvNqq9ZOB AZU75P4+B8jVaDAj1tCdNJ/qFohoyCI= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-3-AdituZYSOqeZ40wGvdePjQ-1; Mon, 17 Feb 2020 01:08:26 -0500 X-MC-Unique: AdituZYSOqeZ40wGvdePjQ-1 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 77805800D50; Mon, 17 Feb 2020 06:08:23 +0000 (UTC) Received: from [10.72.12.250] (ovpn-12-250.pek2.redhat.com [10.72.12.250]) by smtp.corp.redhat.com (Postfix) with ESMTP id 0783787B12; Mon, 17 Feb 2020 06:08:04 +0000 (UTC) Subject: Re: [PATCH V2 3/5] vDPA: introduce vDPA bus To: Jason Gunthorpe Cc: mst@redhat.com, linux-kernel@vger.kernel.org, kvm@vger.kernel.org, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, tiwei.bie@intel.com, maxime.coquelin@redhat.com, cunming.liang@intel.com, zhihong.wang@intel.com, rob.miller@broadcom.com, xiao.w.wang@intel.com, haotian.wang@sifive.com, lingshan.zhu@intel.com, eperezma@redhat.com, lulu@redhat.com, parav@mellanox.com, kevin.tian@intel.com, stefanha@redhat.com, rdunlap@infradead.org, hch@infradead.org, aadam@redhat.com, jiri@mellanox.com, shahafs@mellanox.com, hanand@xilinx.com, mhabets@solarflare.com References: <20200210035608.10002-1-jasowang@redhat.com> <20200210035608.10002-4-jasowang@redhat.com> <20200211134746.GI4271@mellanox.com> <20200212125108.GS4271@mellanox.com> <12775659-1589-39e4-e344-b7a2c792b0f3@redhat.com> <20200213134128.GV4271@mellanox.com> <20200213150542.GW4271@mellanox.com> <8b3e6a9c-8bfd-fb3c-12a8-2d6a3879f1ae@redhat.com> <20200214135232.GB4271@mellanox.com> From: Jason Wang Message-ID: <01c86ebb-cf4b-691f-e682-2d6f93ddbcf7@redhat.com> Date: Mon, 17 Feb 2020 14:08:03 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 MIME-Version: 1.0 In-Reply-To: <20200214135232.GB4271@mellanox.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 Content-Transfer-Encoding: quoted-printable Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2020/2/14 =E4=B8=8B=E5=8D=889:52, Jason Gunthorpe wrote: > On Fri, Feb 14, 2020 at 11:23:27AM +0800, Jason Wang wrote: > >>>> Though all vDPA devices have the same programming interface, but the >>>> semantic is different. So it looks to me that use bus complies what >>>> class.rst said: >>>> >>>> " >>>> >>>> Each device class defines a set of semantics and a programming inter= face >>>> that devices of that class adhere to. Device drivers are the >>>> implementation of that programming interface for a particular device= on >>>> a particular bus. >>>> >>>> " >>> Here we are talking about the /dev/XX node that provides the >>> programming interface. >> >> I'm confused here, are you suggesting to use class to create char devi= ce in >> vhost-vdpa? That's fine but the comment should go for vhost-vdpa patch= . > Certainly yes, something creating many char devs should have a > class. That makes the sysfs work as expected > > I suppose this is vhost user? Actually not. Vhost-user is the vhost protocol that is used for userspace vhost=20 backend (usually though a UNIX domain socket). What's being done in the vhost-vpda is a new type of the vhost in kernel. > I admit I don't really see how this > vhost stuff works, all I see are global misc devices? Very unusual for > a new subsystem to be using global misc devices.. Vhost is not a subsystem right now, e.g for it's net implementation, it=20 was loosely coupled with a socket. I thought you were copied in the patch [1], maybe we can move vhost=20 related discussion there to avoid confusion. [1] https://lwn.net/Articles/811210/ > > I would have expected that a single VDPA device comes out as a single > char dev linked to only that VDPA device. > >>> All the vdpa devices have the same basic >>> chardev interface and discover any semantic variations 'in band' >> That's not true, char interface is only used for vhost. Kernel virtio = driver >> does not need char dev but a device on the virtio bus. > Okay, this is fine, but why do you need two busses to accomplish this? The reasons are: - vDPA ops is designed to be functional as a software assisted transport=20 (control path) for virtio, so it's fit for a new transport driver but=20 not directly into virtio bus. VOP use similar design. - virtio bus is designed for kernel drivers but not userspace, and it=20 can not be easily extended to support userspace driver but requires some=20 major refactoring. E.g the virtio bus operations requires the virtqueue=20 to be allocated by the transport driver. So it's cheaper and simpler to introduce a new bus instead of=20 refactoring a well known bus and API where brunches of drivers and=20 devices had been implemented for years. > > Shouldn't the 'struct virito_device' be the plug in point for HW > drivers I was talking about - and from there a vhost-user can connect > to the struct virtio_device to give it a char dev or a kernel driver > can connect to link it to another subsystem? From vhost point of view, it would only need to connect vDPA bus, no=20 need to go for virtio bus. Vhost device talks to vDPA device through=20 vDPA bus. Virito device talks to vDPA device through a new vDPA=20 transport driver. > > It is easy to see something is going wrong with this design because > the drivers/virtio/virtio_vdpa.c mainly contains a bunch of trampoline > functions reflecting identical calls from one ops struct to a > different ops struct. That's pretty normal, since part of the virtio ops could be 1:1 mapped=20 to some device function. If you see MMIO and PCI transport, you can see=20 something similar. The only difference is that in the case of VDPA the=20 function is assisted or emulated by hardware vDPA driver. > This suggests the 'vdpa' is some subclass of > 'virtio' and it is possibly better to model it by extending 'struct > virito_device' to include the vdpa specific stuff. Going for such kind of modeling, virtio-pci and virtio-mmio could be=20 also treated as a subclass of virtio as well, they were all implemented=20 via a dedicated transport driver. > > Where does the vhost-user char dev get invovled in with the v2 series? > Is that included? We're working on the a new version, but for the bus/driver part it=20 should be the same as version 1. Thanks > >>> Every class of virtio traffic is going to need a special HW driver to >>> enable VDPA, that special driver can create the correct vhost side >>> class device. >> Are you saying, e.g it's the charge of IFCVF driver to create vhost ch= ar dev >> and other stuffs? > No. > > Jason > From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jason Wang Subject: Re: [PATCH V2 3/5] vDPA: introduce vDPA bus Date: Mon, 17 Feb 2020 14:08:03 +0800 Message-ID: <01c86ebb-cf4b-691f-e682-2d6f93ddbcf7@redhat.com> References: <20200210035608.10002-1-jasowang@redhat.com> <20200210035608.10002-4-jasowang@redhat.com> <20200211134746.GI4271@mellanox.com> <20200212125108.GS4271@mellanox.com> <12775659-1589-39e4-e344-b7a2c792b0f3@redhat.com> <20200213134128.GV4271@mellanox.com> <20200213150542.GW4271@mellanox.com> <8b3e6a9c-8bfd-fb3c-12a8-2d6a3879f1ae@redhat.com> <20200214135232.GB4271@mellanox.com> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8"; Format="flowed" Content-Transfer-Encoding: base64 Return-path: In-Reply-To: <20200214135232.GB4271@mellanox.com> Content-Language: en-US List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: virtualization-bounces@lists.linux-foundation.org Sender: "Virtualization" To: Jason Gunthorpe Cc: kvm@vger.kernel.org, mst@redhat.com, mhabets@solarflare.com, virtualization@lists.linux-foundation.org, rob.miller@broadcom.com, lulu@redhat.com, hanand@xilinx.com, hch@infradead.org, eperezma@redhat.com, haotian.wang@sifive.com, shahafs@mellanox.com, parav@mellanox.com, jiri@mellanox.com, xiao.w.wang@intel.com, stefanha@redhat.com, zhihong.wang@intel.com, rdunlap@infradead.org, linux-kernel@vger.kernel.org, maxime.coquelin@redhat.com, netdev@vger.kernel.org, lingshan.zhu@intel.com List-Id: virtualization@lists.linuxfoundation.org Ck9uIDIwMjAvMi8xNCDkuIvljYg5OjUyLCBKYXNvbiBHdW50aG9ycGUgd3JvdGU6Cj4gT24gRnJp LCBGZWIgMTQsIDIwMjAgYXQgMTE6MjM6MjdBTSArMDgwMCwgSmFzb24gV2FuZyB3cm90ZToKPgo+ Pj4+IFRob3VnaCBhbGwgdkRQQSBkZXZpY2VzIGhhdmUgdGhlIHNhbWUgcHJvZ3JhbW1pbmcgaW50 ZXJmYWNlLCBidXQgdGhlCj4+Pj4gc2VtYW50aWMgaXMgZGlmZmVyZW50LiBTbyBpdCBsb29rcyB0 byBtZSB0aGF0IHVzZSBidXMgY29tcGxpZXMgd2hhdAo+Pj4+IGNsYXNzLnJzdCBzYWlkOgo+Pj4+ Cj4+Pj4gIgo+Pj4+Cj4+Pj4gRWFjaCBkZXZpY2UgY2xhc3MgZGVmaW5lcyBhIHNldCBvZiBzZW1h bnRpY3MgYW5kIGEgcHJvZ3JhbW1pbmcgaW50ZXJmYWNlCj4+Pj4gdGhhdCBkZXZpY2VzIG9mIHRo YXQgY2xhc3MgYWRoZXJlIHRvLiBEZXZpY2UgZHJpdmVycyBhcmUgdGhlCj4+Pj4gaW1wbGVtZW50 YXRpb24gb2YgdGhhdCBwcm9ncmFtbWluZyBpbnRlcmZhY2UgZm9yIGEgcGFydGljdWxhciBkZXZp Y2Ugb24KPj4+PiBhIHBhcnRpY3VsYXIgYnVzLgo+Pj4+Cj4+Pj4gIgo+Pj4gSGVyZSB3ZSBhcmUg dGFsa2luZyBhYm91dCB0aGUgL2Rldi9YWCBub2RlIHRoYXQgcHJvdmlkZXMgdGhlCj4+PiBwcm9n cmFtbWluZyBpbnRlcmZhY2UuCj4+Cj4+IEknbSBjb25mdXNlZCBoZXJlLCBhcmUgeW91IHN1Z2dl c3RpbmcgdG8gdXNlIGNsYXNzIHRvIGNyZWF0ZSBjaGFyIGRldmljZSBpbgo+PiB2aG9zdC12ZHBh PyBUaGF0J3MgZmluZSBidXQgdGhlIGNvbW1lbnQgc2hvdWxkIGdvIGZvciB2aG9zdC12ZHBhIHBh dGNoLgo+IENlcnRhaW5seSB5ZXMsIHNvbWV0aGluZyBjcmVhdGluZyBtYW55IGNoYXIgZGV2cyBz aG91bGQgaGF2ZSBhCj4gY2xhc3MuIFRoYXQgbWFrZXMgdGhlIHN5c2ZzIHdvcmsgYXMgZXhwZWN0 ZWQKPgo+IEkgc3VwcG9zZSB0aGlzIGlzIHZob3N0IHVzZXI/CgoKQWN0dWFsbHkgbm90LgoKVmhv c3QtdXNlciBpcyB0aGUgdmhvc3QgcHJvdG9jb2wgdGhhdCBpcyB1c2VkIGZvciB1c2Vyc3BhY2Ug dmhvc3QgCmJhY2tlbmQgKHVzdWFsbHkgdGhvdWdoIGEgVU5JWCBkb21haW4gc29ja2V0KS4KCldo YXQncyBiZWluZyBkb25lIGluIHRoZSB2aG9zdC12cGRhIGlzIGEgbmV3IHR5cGUgb2YgdGhlIHZo b3N0IGluIGtlcm5lbC4KCgo+IEkgYWRtaXQgSSBkb24ndCByZWFsbHkgc2VlIGhvdyB0aGlzCj4g dmhvc3Qgc3R1ZmYgd29ya3MsIGFsbCBJIHNlZSBhcmUgZ2xvYmFsIG1pc2MgZGV2aWNlcz8gVmVy eSB1bnVzdWFsIGZvcgo+IGEgbmV3IHN1YnN5c3RlbSB0byBiZSB1c2luZyBnbG9iYWwgbWlzYyBk ZXZpY2VzLi4KCgpWaG9zdCBpcyBub3QgYSBzdWJzeXN0ZW0gcmlnaHQgbm93LCBlLmcgZm9yIGl0 J3MgbmV0IGltcGxlbWVudGF0aW9uLCBpdCAKd2FzIGxvb3NlbHkgY291cGxlZCB3aXRoIGEgc29j a2V0LgoKSSB0aG91Z2h0IHlvdSB3ZXJlIGNvcGllZCBpbiB0aGUgcGF0Y2ggWzFdLCBtYXliZSB3 ZSBjYW4gbW92ZSB2aG9zdCAKcmVsYXRlZCBkaXNjdXNzaW9uIHRoZXJlIHRvIGF2b2lkIGNvbmZ1 c2lvbi4KClsxXSBodHRwczovL2x3bi5uZXQvQXJ0aWNsZXMvODExMjEwLwoKCj4KPiBJIHdvdWxk IGhhdmUgZXhwZWN0ZWQgdGhhdCBhIHNpbmdsZSBWRFBBIGRldmljZSBjb21lcyBvdXQgYXMgYSBz aW5nbGUKPiBjaGFyIGRldiBsaW5rZWQgdG8gb25seSB0aGF0IFZEUEEgZGV2aWNlLgo+Cj4+PiBB bGwgdGhlIHZkcGEgZGV2aWNlcyBoYXZlIHRoZSBzYW1lIGJhc2ljCj4+PiBjaGFyZGV2IGludGVy ZmFjZSBhbmQgZGlzY292ZXIgYW55IHNlbWFudGljIHZhcmlhdGlvbnMgJ2luIGJhbmQnCj4+IFRo YXQncyBub3QgdHJ1ZSwgY2hhciBpbnRlcmZhY2UgaXMgb25seSB1c2VkIGZvciB2aG9zdC4gS2Vy bmVsIHZpcnRpbyBkcml2ZXIKPj4gZG9lcyBub3QgbmVlZCBjaGFyIGRldiBidXQgYSBkZXZpY2Ug b24gdGhlIHZpcnRpbyBidXMuCj4gT2theSwgdGhpcyBpcyBmaW5lLCBidXQgd2h5IGRvIHlvdSBu ZWVkIHR3byBidXNzZXMgdG8gYWNjb21wbGlzaCB0aGlzPwoKClRoZSByZWFzb25zIGFyZToKCi0g dkRQQSBvcHMgaXMgZGVzaWduZWQgdG8gYmUgZnVuY3Rpb25hbCBhcyBhIHNvZnR3YXJlIGFzc2lz dGVkIHRyYW5zcG9ydCAKKGNvbnRyb2wgcGF0aCkgZm9yIHZpcnRpbywgc28gaXQncyBmaXQgZm9y IGEgbmV3IHRyYW5zcG9ydCBkcml2ZXIgYnV0IApub3QgZGlyZWN0bHkgaW50byB2aXJ0aW8gYnVz LiBWT1AgdXNlIHNpbWlsYXIgZGVzaWduLgotIHZpcnRpbyBidXMgaXMgZGVzaWduZWQgZm9yIGtl cm5lbCBkcml2ZXJzIGJ1dCBub3QgdXNlcnNwYWNlLCBhbmQgaXQgCmNhbiBub3QgYmUgZWFzaWx5 IGV4dGVuZGVkIHRvIHN1cHBvcnQgdXNlcnNwYWNlIGRyaXZlciBidXQgcmVxdWlyZXMgc29tZSAK bWFqb3IgcmVmYWN0b3JpbmcuIEUuZyB0aGUgdmlydGlvIGJ1cyBvcGVyYXRpb25zIHJlcXVpcmVz IHRoZSB2aXJ0cXVldWUgCnRvIGJlIGFsbG9jYXRlZCBieSB0aGUgdHJhbnNwb3J0IGRyaXZlci4K ClNvIGl0J3MgY2hlYXBlciBhbmQgc2ltcGxlciB0byBpbnRyb2R1Y2UgYSBuZXcgYnVzIGluc3Rl YWQgb2YgCnJlZmFjdG9yaW5nIGEgd2VsbCBrbm93biBidXMgYW5kIEFQSSB3aGVyZSBicnVuY2hl cyBvZiBkcml2ZXJzIGFuZCAKZGV2aWNlcyBoYWQgYmVlbiBpbXBsZW1lbnRlZCBmb3IgeWVhcnMu CgoKPgo+IFNob3VsZG4ndCB0aGUgJ3N0cnVjdCB2aXJpdG9fZGV2aWNlJyBiZSB0aGUgcGx1ZyBp biBwb2ludCBmb3IgSFcKPiBkcml2ZXJzIEkgd2FzIHRhbGtpbmcgYWJvdXQgLSBhbmQgZnJvbSB0 aGVyZSBhIHZob3N0LXVzZXIgY2FuIGNvbm5lY3QKPiB0byB0aGUgc3RydWN0IHZpcnRpb19kZXZp Y2UgdG8gZ2l2ZSBpdCBhIGNoYXIgZGV2IG9yIGEga2VybmVsIGRyaXZlcgo+IGNhbiBjb25uZWN0 IHRvIGxpbmsgaXQgdG8gYW5vdGhlciBzdWJzeXN0ZW0/CgoKIEZyb20gdmhvc3QgcG9pbnQgb2Yg dmlldywgaXQgd291bGQgb25seSBuZWVkIHRvIGNvbm5lY3QgdkRQQSBidXMsIG5vIApuZWVkIHRv IGdvIGZvciB2aXJ0aW8gYnVzLiBWaG9zdCBkZXZpY2UgdGFsa3MgdG8gdkRQQSBkZXZpY2UgdGhy b3VnaCAKdkRQQSBidXMuIFZpcml0byBkZXZpY2UgdGFsa3MgdG8gdkRQQSBkZXZpY2UgdGhyb3Vn aCBhIG5ldyB2RFBBIAp0cmFuc3BvcnQgZHJpdmVyLgoKCj4KPiBJdCBpcyBlYXN5IHRvIHNlZSBz b21ldGhpbmcgaXMgZ29pbmcgd3Jvbmcgd2l0aCB0aGlzIGRlc2lnbiBiZWNhdXNlCj4gdGhlIGRy aXZlcnMvdmlydGlvL3ZpcnRpb192ZHBhLmMgbWFpbmx5IGNvbnRhaW5zIGEgYnVuY2ggb2YgdHJh bXBvbGluZQo+IGZ1bmN0aW9ucyByZWZsZWN0aW5nIGlkZW50aWNhbCBjYWxscyBmcm9tIG9uZSBv cHMgc3RydWN0IHRvIGEKPiBkaWZmZXJlbnQgb3BzIHN0cnVjdC4KCgpUaGF0J3MgcHJldHR5IG5v cm1hbCwgc2luY2UgcGFydCBvZiB0aGUgdmlydGlvIG9wcyBjb3VsZCBiZSAxOjEgbWFwcGVkIAp0 byBzb21lIGRldmljZSBmdW5jdGlvbi4gSWYgeW91IHNlZSBNTUlPIGFuZCBQQ0kgdHJhbnNwb3J0 LCB5b3UgY2FuIHNlZSAKc29tZXRoaW5nIHNpbWlsYXIuIFRoZSBvbmx5IGRpZmZlcmVuY2UgaXMg dGhhdCBpbiB0aGUgY2FzZSBvZiBWRFBBIHRoZSAKZnVuY3Rpb24gaXMgYXNzaXN0ZWQgb3IgZW11 bGF0ZWQgYnkgaGFyZHdhcmUgdkRQQSBkcml2ZXIuCgoKPiAgIFRoaXMgc3VnZ2VzdHMgdGhlICd2 ZHBhJyBpcyBzb21lIHN1YmNsYXNzIG9mCj4gJ3ZpcnRpbycgYW5kIGl0IGlzIHBvc3NpYmx5IGJl dHRlciB0byBtb2RlbCBpdCBieSBleHRlbmRpbmcgJ3N0cnVjdAo+IHZpcml0b19kZXZpY2UnIHRv IGluY2x1ZGUgdGhlIHZkcGEgc3BlY2lmaWMgc3R1ZmYuCgoKR29pbmcgZm9yIHN1Y2gga2luZCBv ZiBtb2RlbGluZywgdmlydGlvLXBjaSBhbmQgdmlydGlvLW1taW8gY291bGQgYmUgCmFsc28gdHJl YXRlZCBhcyBhIHN1YmNsYXNzIG9mIHZpcnRpbyBhcyB3ZWxsLCB0aGV5IHdlcmUgYWxsIGltcGxl bWVudGVkIAp2aWEgYSBkZWRpY2F0ZWQgdHJhbnNwb3J0IGRyaXZlci4KCgo+Cj4gV2hlcmUgZG9l cyB0aGUgdmhvc3QtdXNlciBjaGFyIGRldiBnZXQgaW52b3ZsZWQgaW4gd2l0aCB0aGUgdjIgc2Vy aWVzPwo+IElzIHRoYXQgaW5jbHVkZWQ/CgoKV2UncmUgd29ya2luZyBvbiB0aGUgYSBuZXcgdmVy c2lvbiwgYnV0IGZvciB0aGUgYnVzL2RyaXZlciBwYXJ0IGl0IApzaG91bGQgYmUgdGhlIHNhbWUg YXMgdmVyc2lvbiAxLgoKVGhhbmtzCgoKPgo+Pj4gRXZlcnkgY2xhc3Mgb2YgdmlydGlvIHRyYWZm aWMgaXMgZ29pbmcgdG8gbmVlZCBhIHNwZWNpYWwgSFcgZHJpdmVyIHRvCj4+PiBlbmFibGUgVkRQ QSwgdGhhdCBzcGVjaWFsIGRyaXZlciBjYW4gY3JlYXRlIHRoZSBjb3JyZWN0IHZob3N0IHNpZGUK Pj4+IGNsYXNzIGRldmljZS4KPj4gQXJlIHlvdSBzYXlpbmcsIGUuZyBpdCdzIHRoZSBjaGFyZ2Ug b2YgSUZDVkYgZHJpdmVyIHRvIGNyZWF0ZSB2aG9zdCBjaGFyIGRldgo+PiBhbmQgb3RoZXIgc3R1 ZmZzPwo+IE5vLgo+Cj4gSmFzb24KPgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX18KVmlydHVhbGl6YXRpb24gbWFpbGluZyBsaXN0ClZpcnR1YWxpemF0aW9u QGxpc3RzLmxpbnV4LWZvdW5kYXRpb24ub3JnCmh0dHBzOi8vbGlzdHMubGludXhmb3VuZGF0aW9u Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3ZpcnR1YWxpemF0aW9u