From mboxrd@z Thu Jan  1 00:00:00 1970
From: "Zeng, Oak" <Oak.Zeng-5C7GfCeVMHo@public.gmane.org>
Subject: RE: [PATCH 1/2] drm/amdgpu: Export function to flush TLB of specific
 vm hub
Date: Wed, 7 Aug 2019 15:17:21 +0000
Message-ID: <BL0PR12MB2580FE8417C1C4AB87F4679780D40@BL0PR12MB2580.namprd12.prod.outlook.com>
References: <1564761834-19210-1-git-send-email-Oak.Zeng@amd.com>
 <855377a1-69ca-891e-1dad-5b93f57671da@gmail.com>
 <BL0PR12MB2580778BFD71E211AC18CFAF80D40@BL0PR12MB2580.namprd12.prod.outlook.com>
 <65784ad0-7693-9c98-82ee-66713c99f49b@gmail.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
Return-path: <amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>
In-Reply-To: <65784ad0-7693-9c98-82ee-66713c99f49b-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
Content-Language: en-US
List-Id: Discussion list for AMD gfx <amd-gfx.lists.freedesktop.org>
List-Unsubscribe: <https://lists.freedesktop.org/mailman/options/amd-gfx>,
 <mailto:amd-gfx-request-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org?subject=unsubscribe>
List-Archive: <https://lists.freedesktop.org/archives/amd-gfx>
List-Post: <mailto:amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>
List-Help: <mailto:amd-gfx-request-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org?subject=help>
List-Subscribe: <https://lists.freedesktop.org/mailman/listinfo/amd-gfx>,
 <mailto:amd-gfx-request-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org?subject=subscribe>
Errors-To: amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
Sender: "amd-gfx" <amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>
To: "Koenig, Christian" <Christian.Koenig-5C7GfCeVMHo@public.gmane.org>, "Kuehling, Felix" <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>, "amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org" <amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>, "Zhang, Hawking" <Hawking.Zhang-5C7GfCeVMHo@public.gmane.org>, "Deucher, Alexander" <Alexander.Deucher-5C7GfCeVMHo@public.gmane.org>
Cc: "Zhou1, Tao" <Tao.Zhou1-5C7GfCeVMHo@public.gmane.org>, "Liu, Shaoyun" <Shaoyun.Liu-5C7GfCeVMHo@public.gmane.org>

VGhhbmtzLiBJIHJlYWxpemVkIEkgZGlkbid0IHJlYWQgdGhlIGNvZGUgY2FyZWZ1bCBlbm91Z2gu
Li5UaGUgd29ya2Fyb3VuZCBpcyBvbmx5IGZvciBuYXZpMTAgYW5kIG5hdmkxMiAtIEkgZGlkbid0
IHJlYWQgdGhpcyBjb3JyZWN0bHkgYW5kIHdhcyB0aGlua2luZyBnZnhodWIgdGxiIGludmFsaWRh
dGlvbiB3YXMgZG9uZSB0d2ljZS4NCg0KSSB1bmRlcnN0YW5kIHRoZSBjb2RlcyBub3cuIEkgdGhp
bmsgdGhlIEhXIFNETUEgYnVnIGhhcyBiZWVuIGZpeGVkIGluIG5hdmkxNCBzbyB3ZSBkb24ndCBu
ZWVkIHRoYXQgV0EgZm9yIDE0Lg0KDQpSZWdhcmRzLA0KT2FrDQoNCi0tLS0tT3JpZ2luYWwgTWVz
c2FnZS0tLS0tDQpGcm9tOiBDaHJpc3RpYW4gS8O2bmlnIDxja29lbmlnLmxlaWNodHp1bWVya2Vu
QGdtYWlsLmNvbT4gDQpTZW50OiBXZWRuZXNkYXksIEF1Z3VzdCA3LCAyMDE5IDQ6NTEgQU0NClRv
OiBaZW5nLCBPYWsgPE9hay5aZW5nQGFtZC5jb20+OyBLdWVobGluZywgRmVsaXggPEZlbGl4Lkt1
ZWhsaW5nQGFtZC5jb20+OyBLb2VuaWcsIENocmlzdGlhbiA8Q2hyaXN0aWFuLktvZW5pZ0BhbWQu
Y29tPjsgYW1kLWdmeEBsaXN0cy5mcmVlZGVza3RvcC5vcmc7IFpoYW5nLCBIYXdraW5nIDxIYXdr
aW5nLlpoYW5nQGFtZC5jb20+OyBEZXVjaGVyLCBBbGV4YW5kZXIgPEFsZXhhbmRlci5EZXVjaGVy
QGFtZC5jb20+DQpDYzogWmhvdTEsIFRhbyA8VGFvLlpob3UxQGFtZC5jb20+OyBMaXUsIFNoYW95
dW4gPFNoYW95dW4uTGl1QGFtZC5jb20+DQpTdWJqZWN0OiBSZTogW1BBVENIIDEvMl0gZHJtL2Ft
ZGdwdTogRXhwb3J0IGZ1bmN0aW9uIHRvIGZsdXNoIFRMQiBvZiBzcGVjaWZpYyB2bSBodWINCg0K
PiBEb2VzIHRoZSBjb2RlZCBiZWxvdyBpbnZhbGlkYXRlIFRMQiBvbiBib3RoIG1tIGFuZCBnZngg
aHViPw0KTm8sIGp1c3QgdGhlIGdmeCBodWIuIFRoZSBWTUhVQnMgb24gTmF2aSBhcmUgdW5mb3J0
dW5hdGVseSByZWFsbHkgYnVnZ3ksIHNvIHdlIGhhZCB0byBkbyBhIGxvdCBvZiB3b3JrYXJvdW5k
cyB0byBnZXQgdGhlbSBpbnRvIGEgc3RhdGUgd2hlcmUgdGhleSBhY3R1YWxseSBkaWQgd2hhdCB3
YXMgZXhwZWN0ZWQgZnJvbSB0aGVtLg0KDQpPbmUgbWFqb3IgaXNzdWUgZm9yIGV4YW1wbGUgaXMg
dGhhdCB5b3UgY2FuJ3QgZG8gTU1JTyBiYXNlZCBWTSBpbnZhbGlkYXRpb24gd2hlbiB0aGUgZW5n
aW5lIGlzIGJ1c3kuIFRvIHdvcmsgYXJvdW5kIHRoaXMgd2UgZG8gdGhlIGludmFsaWRhdGlvbiB3
aXRoIHRoZSAoSUlSQykgU0RNQSBlbmdpbmUgYXMgc29vbiBhcyB0aGF0IG9uZSBpcyB3b3JraW5n
Lg0KDQpUaGUgaXMgdGhlIGNvZGUgeW91IGFyZSBub3RpbmcgYmVsb3cuDQoNClJlZ2FyZHMsDQpD
aHJpc3RpYW4uDQoNCkFtIDA3LjA4LjE5IHVtIDA0OjQwIHNjaHJpZWIgWmVuZywgT2FrOg0KPiBP
aywgd2lsbCBkbyBpdC4NCj4NCj4gQlRXLCBkb2VzIHRob3NlIGNvZGVzIGJlbG93IHJlYWxseSBu
ZWVkZWQsIGluIGZ1bmN0aW9uIA0KPiBnbWNfdjEwXzBfZmx1c2hfZ3B1X3RsYi4gSSB0aGluayBp
ZiB3ZSBoYXZlIHRoZSBidWcsIHRoZW4gYmVmb3JlIGJlbG93IA0KPiBjb2Rlcywgd2hlbiB3ZSBm
bHVzaCBUTEIgb2YgZ2Z4aHViIHRocm91Z2ggbW1pbywgaXQgaGFzIGFscmVhZHkgDQo+IHRyaWdn
ZXJlZCB0aGUgYnVnLiBBbHNvIGFzIHdlIGFscmVhZHkgaW52YWxpZGF0ZWQgdGxiIG9uIGJvdGgg
bW0gYW5kIA0KPiBnZnggaHViIChpbiB0aGUgc2FtZSBmdW5jdGlvbiBnbWNfdjEwXzBfZmx1c2hf
Z3B1X3RsYiksIHdoYXQgaXMgdGhlIA0KPiBwb2ludCBvZiBiZWxvdyBjb2Rlcz8gRG9lcyB0aGUg
Y29kZWQgYmVsb3cgaW52YWxpZGF0ZSBUTEIgb24gYm90aCBtbSANCj4gYW5kIGdmeCBodWI/IEFs
c28gQFpoYW5nLCBIYXdraW5nQERldWNoZXIsIEFsZXhhbmRlcg0KPg0KPiAJLyogVGhlIFNETUEg
b24gTmF2aSBoYXMgYSBidWcgd2hpY2ggY2FuIHRoZW9yZXRpY2FsbHkgcmVzdWx0IGluIG1lbW9y
eQ0KPiAJICogY29ycnVwdGlvbiBpZiBhbiBpbnZhbGlkYXRpb24gaGFwcGVucyBhdCB0aGUgc2Ft
ZSB0aW1lIGFzIGFuIFZBDQo+IAkgKiB0cmFuc2xhdGlvbi4gQXZvaWQgdGhpcyBieSBkb2luZyB0
aGUgaW52YWxpZGF0aW9uIGZyb20gdGhlIFNETUENCj4gCSAqIGl0c2VsZi4NCj4gCSAqLw0KPiAJ
ciA9IGFtZGdwdV9qb2JfYWxsb2Nfd2l0aF9pYihhZGV2LCAxNiAqIDQsICZqb2IpOw0KPiAJaWYg
KHIpDQo+IAkJZ290byBlcnJvcl9hbGxvYzsNCj4NCj4gCWpvYi0+dm1fcGRfYWRkciA9IGFtZGdw
dV9nbWNfcGRfYWRkcihhZGV2LT5nYXJ0LmJvKTsNCj4gCWpvYi0+dm1fbmVlZHNfZmx1c2ggPSB0
cnVlOw0KPiAJYW1kZ3B1X3JpbmdfcGFkX2liKHJpbmcsICZqb2ItPmlic1swXSk7DQo+IAlyID0g
YW1kZ3B1X2pvYl9zdWJtaXQoam9iLCAmYWRldi0+bW1hbi5lbnRpdHksDQo+IAkJCSAgICAgIEFN
REdQVV9GRU5DRV9PV05FUl9VTkRFRklORUQsICZmZW5jZSk7DQo+DQo+IFJlZ2FyZHMsDQo+IE9h
aw0KPg0KPiAtLS0tLU9yaWdpbmFsIE1lc3NhZ2UtLS0tLQ0KPiBGcm9tOiBDaHJpc3RpYW4gS8O2
bmlnIDxja29lbmlnLmxlaWNodHp1bWVya2VuQGdtYWlsLmNvbT4NCj4gU2VudDogTW9uZGF5LCBB
dWd1c3QgNSwgMjAxOSA1OjM3IEFNDQo+IFRvOiBaZW5nLCBPYWsgPE9hay5aZW5nQGFtZC5jb20+
OyBhbWQtZ2Z4QGxpc3RzLmZyZWVkZXNrdG9wLm9yZw0KPiBDYzogS3VlaGxpbmcsIEZlbGl4IDxG
ZWxpeC5LdWVobGluZ0BhbWQuY29tPjsgWmhvdTEsIFRhbyANCj4gPFRhby5aaG91MUBhbWQuY29t
PjsgTGl1LCBTaGFveXVuIDxTaGFveXVuLkxpdUBhbWQuY29tPg0KPiBTdWJqZWN0OiBSZTogW1BB
VENIIDEvMl0gZHJtL2FtZGdwdTogRXhwb3J0IGZ1bmN0aW9uIHRvIGZsdXNoIFRMQiBvZiANCj4g
c3BlY2lmaWMgdm0gaHViDQo+DQo+IEFtIDAyLjA4LjE5IHVtIDE4OjA0IHNjaHJpZWIgWmVuZywg
T2FrOg0KPj4gVGhpcyBpcyBmb3Iga2ZkIHRvIHJldXNlIGFtZGdwdSBUTEIgaW52YWxpZGF0aW9u
IGZ1bmN0aW9uLiBUaGVyZSBpcyANCj4+IGFscmVhZHkgYSBnbWMgZnVuY3Rpb24gZmx1c2hfZ3B1
X3RsYiB0byBmbHVzaCBUTEIgb24gYWxsIHZtIGh1Yi4gT24gDQo+PiBnZngxMCwga2ZkIG9ubHkg
bmVlZHMgdG8gZmx1c2ggVExCIG9uIGdmeCBodWIgYnV0IG5vdCBvbiBtbSBodWIuIFNvIA0KPj4g
ZXhwb3J0IGEgZnVuY3Rpb24gZm9yIEtGRCBmbHVzaCBUTEIgb25seSBvbiBnZnggaHViLg0KPiBJ
IHdvdWxkIHJhdGhlciBnbyBhaGVhZCBhbmQgYWRkIGFub3RoZXIgcGFyYW1ldGVyIHRvIGZsdXNo
X2dwdV90bGIgdG8gbm90ZSB3aGljaCBodWIgbmVlZHMgZmx1c2hpbmcuDQo+DQo+IFdlIGNhbiBw
cm9iYWJseSBlYXNpbHkgZXh0ZW5kIHRoZSBmZXcgY2FsbGVycyB0byBmbHVzaCBhbGwgaHVicyBu
ZWVkZWQuDQo+DQo+IENocmlzdGlhbi4NCj4NCj4+IENoYW5nZS1JZDogSTU4ZmYwMDk2OWY4ODQz
OGNmZDNkYzdlOWRlYjdiZmYwYzFiYjQxMzMNCj4+IFNpZ25lZC1vZmYtYnk6IE9hayBaZW5nIDxP
YWsuWmVuZ0BhbWQuY29tPg0KPj4gLS0tDQo+PiAgICBkcml2ZXJzL2dwdS9kcm0vYW1kL2FtZGdw
dS9hbWRncHVfZ21jLmggfCA0ICsrKysNCj4+ICAgIGRyaXZlcnMvZ3B1L2RybS9hbWQvYW1kZ3B1
L2dtY192MTBfMC5jICB8IDEgKw0KPj4gICAgMiBmaWxlcyBjaGFuZ2VkLCA1IGluc2VydGlvbnMo
KykNCj4+DQo+PiBkaWZmIC0tZ2l0IGEvZHJpdmVycy9ncHUvZHJtL2FtZC9hbWRncHUvYW1kZ3B1
X2dtYy5oDQo+PiBiL2RyaXZlcnMvZ3B1L2RybS9hbWQvYW1kZ3B1L2FtZGdwdV9nbWMuaA0KPj4g
aW5kZXggMDcxMTQ1YS4uMGJkNGE0ZiAxMDA2NDQNCj4+IC0tLSBhL2RyaXZlcnMvZ3B1L2RybS9h
bWQvYW1kZ3B1L2FtZGdwdV9nbWMuaA0KPj4gKysrIGIvZHJpdmVycy9ncHUvZHJtL2FtZC9hbWRn
cHUvYW1kZ3B1X2dtYy5oDQo+PiBAQCAtODgsNiArODgsOSBAQCBzdHJ1Y3QgYW1kZ3B1X3ZtaHVi
IHsNCj4+ICAgICAqIEdQVSBNQyBzdHJ1Y3R1cmVzLCBmdW5jdGlvbnMgJiBoZWxwZXJzDQo+PiAg
ICAgKi8NCj4+ICAgIHN0cnVjdCBhbWRncHVfZ21jX2Z1bmNzIHsNCj4+ICsJLyogZmx1c2ggdm0g
dGxiIG9mIHNwZWNpZmljIGh1YiAqLw0KPj4gKwl2b2lkICgqZmx1c2hfdm1faHViKShzdHJ1Y3Qg
YW1kZ3B1X2RldmljZSAqYWRldiwgdWludDMyX3Qgdm1pZCwNCj4+ICsJCQkJICAgdW5zaWduZWQg
aW50IHZtaHViLCB1aW50MzJfdCBmbHVzaF90eXBlKTsNCj4+ICAgIAkvKiBmbHVzaCB0aGUgdm0g
dGxiIHZpYSBtbWlvICovDQo+PiAgICAJdm9pZCAoKmZsdXNoX2dwdV90bGIpKHN0cnVjdCBhbWRn
cHVfZGV2aWNlICphZGV2LA0KPj4gICAgCQkJICAgICAgdWludDMyX3Qgdm1pZCwgdWludDMyX3Qg
Zmx1c2hfdHlwZSk7IEBAIC0xODAsNiArMTgzLDcgQEAgDQo+PiBzdHJ1Y3QgYW1kZ3B1X2dtYyB7
DQo+PiAgICAJc3RydWN0IHJhc19jb21tb25faWYgICAgKnJhc19pZjsNCj4+ICAgIH07DQo+PiAg
ICANCj4+ICsjZGVmaW5lIGFtZGdwdV9nbWNfZmx1c2hfdm1faHViKGFkZXYsIHZtaWQsIHZtaHVi
LCB0eXBlKSANCj4+ICsoKGFkZXYpLT5nbWMuZ21jX2Z1bmNzLT5mbHVzaF92bV9odWIoKGFkZXYp
LCAodm1pZCksICh2bWh1YiksDQo+PiArKHR5cGUpKSkNCj4+ICAgICNkZWZpbmUgYW1kZ3B1X2dt
Y19mbHVzaF9ncHVfdGxiKGFkZXYsIHZtaWQsIHR5cGUpIChhZGV2KS0+Z21jLmdtY19mdW5jcy0+
Zmx1c2hfZ3B1X3RsYigoYWRldiksICh2bWlkKSwgKHR5cGUpKQ0KPj4gICAgI2RlZmluZSBhbWRn
cHVfZ21jX2VtaXRfZmx1c2hfZ3B1X3RsYihyLCB2bWlkLCBhZGRyKSAociktPmFkZXYtPmdtYy5n
bWNfZnVuY3MtPmVtaXRfZmx1c2hfZ3B1X3RsYigociksICh2bWlkKSwgKGFkZHIpKQ0KPj4gICAg
I2RlZmluZSBhbWRncHVfZ21jX2VtaXRfcGFzaWRfbWFwcGluZyhyLCB2bWlkLCBwYXNpZCkgDQo+
PiAociktPmFkZXYtPmdtYy5nbWNfZnVuY3MtPmVtaXRfcGFzaWRfbWFwcGluZygociksICh2bWlk
KSwgKHBhc2lkKSkgDQo+PiBkaWZmIC0tZ2l0IGEvZHJpdmVycy9ncHUvZHJtL2FtZC9hbWRncHUv
Z21jX3YxMF8wLmMNCj4+IGIvZHJpdmVycy9ncHUvZHJtL2FtZC9hbWRncHUvZ21jX3YxMF8wLmMN
Cj4+IGluZGV4IDRlM2FjMTAuLjI0NzUxNWQgMTAwNjQ0DQo+PiAtLS0gYS9kcml2ZXJzL2dwdS9k
cm0vYW1kL2FtZGdwdS9nbWNfdjEwXzAuYw0KPj4gKysrIGIvZHJpdmVycy9ncHUvZHJtL2FtZC9h
bWRncHUvZ21jX3YxMF8wLmMNCj4+IEBAIC00MTYsNiArNDE2LDcgQEAgc3RhdGljIHZvaWQgZ21j
X3YxMF8wX2dldF92bV9wZGUoc3RydWN0IGFtZGdwdV9kZXZpY2UgKmFkZXYsIGludCBsZXZlbCwN
Cj4+ICAgIH0NCj4+ICAgIA0KPj4gICAgc3RhdGljIGNvbnN0IHN0cnVjdCBhbWRncHVfZ21jX2Z1
bmNzIGdtY192MTBfMF9nbWNfZnVuY3MgPSB7DQo+PiArCS5mbHVzaF92bV9odWIgPSBnbWNfdjEw
XzBfZmx1c2hfdm1faHViLA0KPj4gICAgCS5mbHVzaF9ncHVfdGxiID0gZ21jX3YxMF8wX2ZsdXNo
X2dwdV90bGIsDQo+PiAgICAJLmVtaXRfZmx1c2hfZ3B1X3RsYiA9IGdtY192MTBfMF9lbWl0X2Zs
dXNoX2dwdV90bGIsDQo+PiAgICAJLmVtaXRfcGFzaWRfbWFwcGluZyA9IGdtY192MTBfMF9lbWl0
X3Bhc2lkX21hcHBpbmcsDQo+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fDQo+IGFtZC1nZnggbWFpbGluZyBsaXN0DQo+IGFtZC1nZnhAbGlzdHMuZnJlZWRl
c2t0b3Aub3JnDQo+IGh0dHBzOi8vbGlzdHMuZnJlZWRlc2t0b3Aub3JnL21haWxtYW4vbGlzdGlu
Zm8vYW1kLWdmeA0KDQpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f
X19fXwphbWQtZ2Z4IG1haWxpbmcgbGlzdAphbWQtZ2Z4QGxpc3RzLmZyZWVkZXNrdG9wLm9yZwpo
dHRwczovL2xpc3RzLmZyZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2FtZC1nZng=