From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Chalamarla, Tirumalesh" Subject: Re: [PATCH] Revert "arm64: Increase the max granular size" Date: Wed, 12 Apr 2017 14:00:43 +0000 Message-ID: <725F073F-025B-48B9-9935-24EFEBF2B7DC@caviumnetworks.com> References: <1458120743-12145-1-git-send-email-opensource.ganesh@gmail.com> <20160321171403.GE25466@e104818-lin.cambridge.arm.com> <10fef112-37f1-0a1b-b5af-435acd032f01@codeaurora.org> <4525901c-45d4-6bd8-eec6-ae92977f16d1@codeaurora.org> <20170406155825.GA7705@e104818-lin.cambridge.arm.com> <08fa98de-760b-15bc-5220-fa449b08c118@codeaurora.org> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: Received: from mail-by2nam03on0085.outbound.protection.outlook.com ([104.47.42.85]:44000 "EHLO NAM03-BY2-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1752379AbdDLOAr (ORCPT ); Wed, 12 Apr 2017 10:00:47 -0400 In-Reply-To: <08fa98de-760b-15bc-5220-fa449b08c118@codeaurora.org> Content-Language: en-US Content-ID: <307D8BE93EACA34998A65E48232DDD49@namprd07.prod.outlook.com> Sender: linux-arm-msm-owner@vger.kernel.org List-Id: linux-arm-msm@vger.kernel.org To: Imran Khan , Ganesh Mahendran , Catalin Marinas Cc: "open list:ARM/QUALCOMM SUPPORT" , open list , "linux-arm-kernel@lists.infradead.org" DQoNCk9uIDQvMTEvMTcsIDEwOjEzIFBNLCAibGludXgtYXJtLWtlcm5lbCBvbiBiZWhhbGYgb2Yg SW1yYW4gS2hhbiIgPGxpbnV4LWFybS1rZXJuZWwtYm91bmNlc0BsaXN0cy5pbmZyYWRlYWQub3Jn IG9uIGJlaGFsZiBvZiBraW1yYW5AY29kZWF1cm9yYS5vcmc+IHdyb3RlOg0KDQogICAgT24gNC83 LzIwMTcgNzozNiBBTSwgR2FuZXNoIE1haGVuZHJhbiB3cm90ZToNCiAgICA+IDIwMTctMDQtMDYg MjM6NTggR01UKzA4OjAwIENhdGFsaW4gTWFyaW5hcyA8Y2F0YWxpbi5tYXJpbmFzQGFybS5jb20+ Og0KICAgID4+IE9uIFRodSwgQXByIDA2LCAyMDE3IGF0IDEyOjUyOjEzUE0gKzA1MzAsIEltcmFu IEtoYW4gd3JvdGU6DQogICAgPj4+IE9uIDQvNS8yMDE3IDEwOjEzIEFNLCBJbXJhbiBLaGFuIHdy b3RlOg0KICAgID4+Pj4+IFdlIG1heSBoYXZlIHRvIHJldmlzaXQgdGhpcyBsb2dpYyBhbmQgY29u c2lkZXIgTDFfQ0FDSEVfQllURVMgdGhlDQogICAgPj4+Pj4gX21pbmltdW1fIG9mIGNhY2hlIGxp bmUgc2l6ZXMgaW4gYXJtNjQgc3lzdGVtcyBzdXBwb3J0ZWQgYnkgdGhlIGtlcm5lbC4NCiAgICA+ Pj4+PiBEbyB5b3UgaGF2ZSBhbnkgYmVuY2htYXJrcyBvbiBDYXZpdW0gYm9hcmRzIHRoYXQgd291 bGQgc2hvdyBzaWduaWZpY2FudA0KICAgID4+Pj4+IGRlZ3JhZGF0aW9uIHdpdGggNjQtYnl0ZSBM MV9DQUNIRV9CWVRFUyB2cyAxMjg/DQogICAgPj4+Pj4NCiAgICA+Pj4+PiBGb3Igbm9uLWNvaGVy ZW50IERNQSwgdGhlIHNpbXBsZXN0IGlzIHRvIG1ha2UgQVJDSF9ETUFfTUlOQUxJR04gdGhlDQog ICAgPj4+Pj4gX21heGltdW1fIG9mIHRoZSBzdXBwb3J0ZWQgc3lzdGVtczoNCiAgICA+Pj4+Pg0K ICAgID4+Pj4+IGRpZmYgLS1naXQgYS9hcmNoL2FybTY0L2luY2x1ZGUvYXNtL2NhY2hlLmggYi9h cmNoL2FybTY0L2luY2x1ZGUvYXNtL2NhY2hlLmgNCiAgICA+Pj4+PiBpbmRleCA1MDgyYjMwYmMy YzAuLjRiNWQ3YjI3ZWRhZiAxMDA2NDQNCiAgICA+Pj4+PiAtLS0gYS9hcmNoL2FybTY0L2luY2x1 ZGUvYXNtL2NhY2hlLmgNCiAgICA+Pj4+PiArKysgYi9hcmNoL2FybTY0L2luY2x1ZGUvYXNtL2Nh Y2hlLmgNCiAgICA+Pj4+PiBAQCAtMTgsMTcgKzE4LDE3IEBADQogICAgPj4+Pj4NCiAgICA+Pj4+ PiAgI2luY2x1ZGUgPGFzbS9jYWNoZXR5cGUuaD4NCiAgICA+Pj4+Pg0KICAgID4+Pj4+IC0jZGVm aW5lIEwxX0NBQ0hFX1NISUZUICAgICAgICAgNw0KICAgID4+Pj4+ICsjZGVmaW5lIEwxX0NBQ0hF X1NISUZUICAgICAgICAgNg0KICAgID4+Pj4+ICAjZGVmaW5lIEwxX0NBQ0hFX0JZVEVTICAgICAg ICAgKDEgPDwgTDFfQ0FDSEVfU0hJRlQpDQogICAgPj4+Pj4NCiAgICA+Pj4+PiAgLyoNCiAgICA+ Pj4+PiAgICogTWVtb3J5IHJldHVybmVkIGJ5IGttYWxsb2MoKSBtYXkgYmUgdXNlZCBmb3IgRE1B LCBzbyB3ZSBtdXN0IG1ha2UNCiAgICA+Pj4+PiAtICogc3VyZSB0aGF0IGFsbCBzdWNoIGFsbG9j YXRpb25zIGFyZSBjYWNoZSBhbGlnbmVkLiBPdGhlcndpc2UsDQogICAgPj4+Pj4gLSAqIHVucmVs YXRlZCBjb2RlIG1heSBjYXVzZSBwYXJ0cyBvZiB0aGUgYnVmZmVyIHRvIGJlIHJlYWQgaW50byB0 aGUNCiAgICA+Pj4+PiAtICogY2FjaGUgYmVmb3JlIHRoZSB0cmFuc2ZlciBpcyBkb25lLCBjYXVz aW5nIG9sZCBkYXRhIHRvIGJlIHNlZW4gYnkNCiAgICA+Pj4+PiAtICogdGhlIENQVS4NCiAgICA+ Pj4+PiArICogc3VyZSB0aGF0IGFsbCBzdWNoIGFsbG9jYXRpb25zIGFyZSBhbGlnbmVkIHRvIHRo ZSBtYXhpbXVtICprbm93bioNCiAgICA+Pj4+PiArICogY2FjaGUgbGluZSBzaXplIG9uIEFSTXY4 IHN5c3RlbXMuIE90aGVyd2lzZSwgdW5yZWxhdGVkIGNvZGUgbWF5IGNhdXNlDQogICAgPj4+Pj4g KyAqIHBhcnRzIG9mIHRoZSBidWZmZXIgdG8gYmUgcmVhZCBpbnRvIHRoZSBjYWNoZSBiZWZvcmUg dGhlIHRyYW5zZmVyIGlzDQogICAgPj4+Pj4gKyAqIGRvbmUsIGNhdXNpbmcgb2xkIGRhdGEgdG8g YmUgc2VlbiBieSB0aGUgQ1BVLg0KICAgID4+Pj4+ICAgKi8NCiAgICA+Pj4+PiAtI2RlZmluZSBB UkNIX0RNQV9NSU5BTElHTiAgICAgIEwxX0NBQ0hFX0JZVEVTDQogICAgPj4+Pj4gKyNkZWZpbmUg QVJDSF9ETUFfTUlOQUxJR04gICAgICAoMTI4KQ0KICAgID4+Pj4+DQogICAgPj4+Pj4gICNpZm5k ZWYgX19BU1NFTUJMWV9fDQogICAgPj4+Pj4NCiAgICA+Pj4+PiBkaWZmIC0tZ2l0IGEvYXJjaC9h cm02NC9rZXJuZWwvY3B1ZmVhdHVyZS5jIGIvYXJjaC9hcm02NC9rZXJuZWwvY3B1ZmVhdHVyZS5j DQogICAgPj4+Pj4gaW5kZXggMzkyYzY3ZWI5ZmE2Li4zMGJhZmNhMWFlYmYgMTAwNjQ0DQogICAg Pj4+Pj4gLS0tIGEvYXJjaC9hcm02NC9rZXJuZWwvY3B1ZmVhdHVyZS5jDQogICAgPj4+Pj4gKysr IGIvYXJjaC9hcm02NC9rZXJuZWwvY3B1ZmVhdHVyZS5jDQogICAgPj4+Pj4gQEAgLTk3Niw5ICs5 NzYsOSBAQCB2b2lkIF9faW5pdCBzZXR1cF9jcHVfZmVhdHVyZXModm9pZCkNCiAgICA+Pj4+PiAg ICAgICAgIGlmICghY3dnKQ0KICAgID4+Pj4+ICAgICAgICAgICAgICAgICBwcl93YXJuKCJObyBD YWNoZSBXcml0ZWJhY2sgR3JhbnVsZSBpbmZvcm1hdGlvbiwgYXNzdW1pbmcNCiAgICA+Pj4+PiBj YWNoZSBsaW5lIHNpemUgJWRcbiIsDQogICAgPj4+Pj4gICAgICAgICAgICAgICAgICAgICAgICAg Y2xzKTsNCiAgICA+Pj4+PiAtICAgICAgIGlmIChMMV9DQUNIRV9CWVRFUyA8IGNscykNCiAgICA+ Pj4+PiAtICAgICAgICAgICAgICAgcHJfd2FybigiTDFfQ0FDSEVfQllURVMgc21hbGxlciB0aGFu IHRoZSBDYWNoZSBXcml0ZWJhY2sgR3JhbnVsZSAoJWQgPCAlZClcbiIsDQogICAgPj4+Pj4gLSAg ICAgICAgICAgICAgICAgICAgICAgTDFfQ0FDSEVfQllURVMsIGNscyk7DQogICAgPj4+Pj4gKyAg ICAgICBpZiAoQVJDSF9ETUFfTUlOQUxJR04gPCBjbHMpDQogICAgPj4+Pj4gKyAgICAgICAgICAg ICAgIHByX3dhcm4oIkFSQ0hfRE1BX01JTkFMSUdOIHNtYWxsZXIgdGhhbiB0aGUgQ2FjaGUgV3Jp dGViYWNrIEdyYW51bGUgKCVkIDwgJWQpXG4iLA0KICAgID4+Pj4+ICsgICAgICAgICAgICAgICAg ICAgICAgIEFSQ0hfRE1BX01JTkFMSUdOLCBjbHMpOw0KICAgID4+Pj4+ICB9DQogICAgPj4+Pj4N CiAgICA+Pj4+PiAgc3RhdGljIGJvb2wgX19tYXliZV91bnVzZWQNCiAgICA+Pj4+DQogICAgPj4+ PiBUaGlzIGNoYW5nZSB3YXMgZGlzY3Vzc2VkIGF0OiBbMV0gYnV0IHdhcyBub3QgY29uY2x1ZGVk IGFzIGFwcGFyZW50bHkgbm8gb25lDQogICAgPj4+PiBjYW1lIGJhY2sgd2l0aCB0ZXN0IHJlcG9y dCBhbmQgbnVtYmVycy4gQWZ0ZXIgaW5jbHVkaW5nIHRoaXMgY2hhbmdlIGluIG91cg0KICAgID4+ Pj4gbG9jYWwga2VybmVsIHdlIGFyZSBzZWVpbmcgc2lnbmlmaWNhbnQgdGhyb3VnaHB1dCBpbXBy b3ZlbWVudC4gRm9yIGV4YW1wbGUgd2l0aDoNCiAgICA+Pj4+DQogICAgPj4+PiBpcGVyZiAtYyAx OTIuMTY4LjEuMTgxIC1pIDEgLXcgMTI4SyAtdCA2MA0KICAgID4+Pj4NCiAgICA+Pj4+IFRoZSBh dmVyYWdlIHRocm91Z2hwdXQgaXMgaW1wcm92aW5nIGJ5IGFib3V0IDMwJSAoMjMwTWJwcyBmcm9t IDE4ME1icHMpLg0KICAgID4+Pj4gQ291bGQgeW91IHBsZWFzZSBsZXQgdXMga25vdyBpZiB0aGlz IGNoYW5nZSBjYW4gYmUgaW5jbHVkZWQgaW4gdXBzdHJlYW0ga2VybmVsLg0KICAgID4+Pj4NCiAg ICA+Pj4+IFsxXTogaHR0cHM6Ly9ncm91cHMuZ29vZ2xlLmNvbS9mb3J1bS8jIXRvcGljL2xpbnV4 Lmtlcm5lbC9QNDB5REI5MGVQcw0KICAgID4+Pg0KICAgID4+PiBDb3VsZCB5b3UgcGxlYXNlIHBy b3ZpZGUgc29tZSBmZWVkYmFjayBhYm91dCB0aGUgYWJvdmUgbWVudGlvbmVkIHF1ZXJ5ID8NCiAg ICA+Pg0KICAgID4+IERvIHlvdSBoYXZlIGFuIGV4cGxhbmF0aW9uIG9uIHRoZSBwZXJmb3JtYW5j ZSB2YXJpYXRpb24gd2hlbg0KICAgID4+IEwxX0NBQ0hFX0JZVEVTIGlzIGNoYW5nZWQ/IFdlJ2Qg bmVlZCB0byB1bmRlcnN0YW5kIGhvdyB0aGUgbmV0d29yayBzdGFjaw0KICAgID4+IGlzIGFmZmVj dGVkIGJ5IEwxX0NBQ0hFX0JZVEVTLCBpbiB3aGljaCBjb250ZXh0IGl0IHVzZXMgaXQgKGlzIGl0 IGZvcg0KICAgID4+IG5vbi1jb2hlcmVudCBETUE/KS4NCiAgICA+IA0KICAgID4gbmV0d29yayBz dGFjayB1c2UgU0tCX0RBVEFfQUxJR04gdG8gYWxpZ24uDQogICAgPiAtLS0NCiAgICA+ICNkZWZp bmUgU0tCX0RBVEFfQUxJR04oWCkgKCgoWCkgKyAoU01QX0NBQ0hFX0JZVEVTIC0gMSkpICYgXA0K ICAgID4gfihTTVBfQ0FDSEVfQllURVMgLSAxKSkNCiAgICA+IA0KICAgID4gI2RlZmluZSBTTVBf Q0FDSEVfQllURVMgTDFfQ0FDSEVfQllURVMNCiAgICA+IC0tLQ0KICAgID4gSSB0aGluayB0aGlz IGlzIHRoZSByZWFzb24gb2YgcGVyZm9ybWFuY2UgcmVncmVzc2lvbi4NCiAgICA+IA0KICAgIA0K ICAgIFllcyB0aGlzIGlzIHRoZSByZWFzb24gZm9yIHBlcmZvcm1hbmNlIHJlZ3Jlc3Npb24uIER1 ZSB0byBpbmNyZWFzZXMgTDEgY2FjaGUgYWxpZ25tZW50IHRoZSANCiAgICBvYmplY3QgaXMgY29t aW5nIGZyb20gbmV4dCBrbWFsbG9jIHNsYWIgYW5kIHNrYi0+dHJ1ZXNpemUgaXMgY2hhbmdpbmcg ZnJvbSAyMzA0IGJ5dGVzIHRvIA0KICAgIDQzNTIgYnl0ZXMuIFRoaXMgaW4gdHVybiBpbmNyZWFz ZXMgc2tfd21lbV9hbGxvYyB3aGljaCBjYXVzZXMgcXVldWluZyBvZiBsZXNzIHNlbmQgYnVmZmVy cy4NCiAgICANCldlIHRyaWVkIGRpZmZlcmVudCBiZW5jaG1hcmtzIGFuZCBmb3VuZCBub25lIHdo aWNoIHJlYWxseSBhZmZlY3RzIHdpdGggQ2FjaGUgbGluZSBjaGFuZ2UuIElmIHRoZXJlIGlzIG5v IGNvcnJlY3RuZXNzIGlzc3VlLA0KSSB0aGluayB3ZSBhcmUgZmluZSB3aXRoIHJldmVydGluZyB0 aGUgcGF0Y2guDQoNClRob3VnaCBJIHN0aWxsIHRoaW5rIGl0IGlzIGJlbmVmaWNpYXJ5IHRvIGRv IHNvbWUgbW9yZSBpbnZlc3RpZ2F0aW9uIGZvciB0aGUgcGVyZiBsb3NzLCB3aG8ga25vd3MgMzIg Yml0IGFsaWduIG9yIG5vIGFsaWduIG1pZ2h0IA0KR2l2ZSBldmVuIG1vcmUgcGVyZiBiZW5lZml0 LiANCg0KDQpUaGFua3MsDQpUaXJ1bWFsZXNoLiAgDQogICAgPj4NCiAgICA+PiBUaGUgQ2F2aXVt IGd1eXMgaGF2ZW4ndCBzaG93biBhbnkgbnVtYmVycyAoSUlVQykgdG8gYmFjayB0aGUNCiAgICA+ PiBMMV9DQUNIRV9CWVRFUyBwZXJmb3JtYW5jZSBpbXByb3ZlbWVudCBidXQgSSB3b3VsZCBub3Qg cmV2ZXJ0IHRoZQ0KICAgID4+IG9yaWdpbmFsIGNvbW1pdCBzaW5jZSBBUkNIX0RNQV9NSU5BTElH TiBkZWZpbml0ZWx5IG5lZWRzIHRvIGNvdmVyIHRoZQ0KICAgID4+IG1heGltdW0gYXZhaWxhYmxl IGNhY2hlIGxpbmUgc2l6ZSwgd2hpY2ggaXMgMTI4IGZvciB0aGVtLg0KICAgID4gDQogICAgPiBo b3cgYWJvdXQgZGVmaW5lIEwxX0NBQ0hFX1NISUZUIGxpa2UgYmVsb3c6DQogICAgPiAtLS0NCiAg ICA+ICNpZmRlZiBDT05GSUdfQVJNNjRfTDFfQ0FDSEVfU0hJRlQNCiAgICA+ICNkZWZpbmUgTDFf Q0FDSEVfU0hJRlQgQ09ORklHX0FSTTY0X0wxX0NBQ0hFX1NISUZUDQogICAgPiAjZWxzZQ0KICAg ID4gI2RlZmluZSBMMV9DQUNIRV9TSElGVCA3DQogICAgPiBlbmRpZg0KICAgID4gLS0tDQogICAg PiANCiAgICA+IFRoYW5rcw0KICAgID4gDQogICAgPj4NCiAgICA+PiAtLQ0KICAgID4+IENhdGFs aW4NCiAgICANCiAgICANCiAgICAtLSANCiAgICBRVUFMQ09NTSBJTkRJQSwgb24gYmVoYWxmIG9m IFF1YWxjb21tIElubm92YXRpb24gQ2VudGVyLCBJbmMuIGlzIGFcbm1lbWJlciBvZiB0aGUgQ29k ZSBBdXJvcmEgRm9ydW0sIGhvc3RlZCBieSBUaGUgTGludXggRm91bmRhdGlvbg0KICAgIA0KICAg IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fDQogICAgbGlu dXgtYXJtLWtlcm5lbCBtYWlsaW5nIGxpc3QNCiAgICBsaW51eC1hcm0ta2VybmVsQGxpc3RzLmlu ZnJhZGVhZC5vcmcNCiAgICBodHRwOi8vbGlzdHMuaW5mcmFkZWFkLm9yZy9tYWlsbWFuL2xpc3Rp bmZvL2xpbnV4LWFybS1rZXJuZWwNCiAgICANCg0K From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753680AbdDLOAx (ORCPT ); Wed, 12 Apr 2017 10:00:53 -0400 Received: from mail-by2nam03on0085.outbound.protection.outlook.com ([104.47.42.85]:44000 "EHLO NAM03-BY2-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1752379AbdDLOAr (ORCPT ); Wed, 12 Apr 2017 10:00:47 -0400 From: "Chalamarla, Tirumalesh" To: Imran Khan , Ganesh Mahendran , Catalin Marinas CC: "open list:ARM/QUALCOMM SUPPORT" , open list , "linux-arm-kernel@lists.infradead.org" Subject: Re: [PATCH] Revert "arm64: Increase the max granular size" Thread-Topic: [PATCH] Revert "arm64: Increase the max granular size" Thread-Index: AQHRf2q07H5kbo3Bx0+pHW/tbsCLGJ9fP6wAgATroICCViMSRIAAkAuAgACp54CACA/OAIAAHgwA Date: Wed, 12 Apr 2017 14:00:43 +0000 Message-ID: <725F073F-025B-48B9-9935-24EFEBF2B7DC@caviumnetworks.com> References: <1458120743-12145-1-git-send-email-opensource.ganesh@gmail.com> <20160321171403.GE25466@e104818-lin.cambridge.arm.com> <10fef112-37f1-0a1b-b5af-435acd032f01@codeaurora.org> <4525901c-45d4-6bd8-eec6-ae92977f16d1@codeaurora.org> <20170406155825.GA7705@e104818-lin.cambridge.arm.com> <08fa98de-760b-15bc-5220-fa449b08c118@codeaurora.org> In-Reply-To: <08fa98de-760b-15bc-5220-fa449b08c118@codeaurora.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/f.20.0.170309 authentication-results: codeaurora.org; dkim=none (message not signed) header.d=none;codeaurora.org; dmarc=none action=none header.from=cavium.com; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [2601:641:c080:3581:1d2f:7444:801:a39e] x-microsoft-exchange-diagnostics: 1;BLUPR0701MB1059;7:KJzZgBfCTRH+t757n8N4ik4SpQ2POLmj4LXMfyeVv2JkGGTEtKGJAZSGwcyhG6GR3+gWO81nk3P9f26qEMD4H7tqlabx2/ZfrElL1zP9Lk9lfibsQxs2mxA+lGynn12/T0aRPrRKyiM5hXDAgBHA255CCe/EBMOWg5f4/yEG4d9F6e4riFoYXqFb0j+lRvISe2hhLwsf2lZQ2xKfs2l8uVIRq2/F0U2a4UwseFESrKAX5Pk4d616Ctn/tXCWdT/LD9zLPEiQQ5xEaaAA++XCC0ac6kthjWIHJapuVK19URyqc694g1NxdBj8NZWQLDfTFfcWDci8kbX95QXF0AhuBQ== x-ms-office365-filtering-correlation-id: 5de5b9cb-5d97-400a-14b2-08d481ac4fc2 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001)(2017030254075)(201703131423075)(201703031133081);SRVR:BLUPR0701MB1059; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(180628864354917)(228788266533470)(258649278758335)(211936372134217); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040450)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(93006095)(93001095)(6041248)(201703131423075)(201702281528075)(201703061421075)(20161123564025)(20161123560025)(20161123555025)(20161123562025)(6072148);SRVR:BLUPR0701MB1059;BCL:0;PCL:0;RULEID:;SRVR:BLUPR0701MB1059; x-forefront-prvs: 027578BB13 x-forefront-antispam-report: SFV:NSPM;SFS:(10009020)(6009001)(39410400002)(39850400002)(39400400002)(39840400002)(39450400003)(377424004)(24454002)(377454003)(8676002)(81166006)(8936002)(122556002)(4001350100001)(189998001)(36756003)(6436002)(6486002)(39060400002)(77096006)(4326008)(6506006)(38730400002)(3660700001)(83506001)(2906002)(6246003)(53936002)(83716003)(82746002)(86362001)(2950100002)(3280700002)(93886004)(50986999)(2900100001)(33656002)(1720100001)(305945005)(5660300001)(7736002)(966004)(6512007)(6306002)(9686003)(53546009)(99286003)(229853002)(54356999)(54906002)(25786009)(76176999)(102836003)(6116002);DIR:OUT;SFP:1101;SCL:1;SRVR:BLUPR0701MB1059;H:BLUPR0701MB1060.namprd07.prod.outlook.com;FPR:;SPF:None;MLV:ovrnspm;PTR:InfoNoRecords;LANG:en; spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-ID: <307D8BE93EACA34998A65E48232DDD49@namprd07.prod.outlook.com> MIME-Version: 1.0 X-OriginatorOrg: cavium.com X-MS-Exchange-CrossTenant-originalarrivaltime: 12 Apr 2017 14:00:43.5777 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 711e4ccf-2e9b-4bcf-a551-4094005b6194 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR0701MB1059 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Transfer-Encoding: 8bit X-MIME-Autoconverted: from base64 to 8bit by mail.home.local id v3CE17Ku016927 On 4/11/17, 10:13 PM, "linux-arm-kernel on behalf of Imran Khan" wrote: On 4/7/2017 7:36 AM, Ganesh Mahendran wrote: > 2017-04-06 23:58 GMT+08:00 Catalin Marinas : >> On Thu, Apr 06, 2017 at 12:52:13PM +0530, Imran Khan wrote: >>> On 4/5/2017 10:13 AM, Imran Khan wrote: >>>>> We may have to revisit this logic and consider L1_CACHE_BYTES the >>>>> _minimum_ of cache line sizes in arm64 systems supported by the kernel. >>>>> Do you have any benchmarks on Cavium boards that would show significant >>>>> degradation with 64-byte L1_CACHE_BYTES vs 128? >>>>> >>>>> For non-coherent DMA, the simplest is to make ARCH_DMA_MINALIGN the >>>>> _maximum_ of the supported systems: >>>>> >>>>> diff --git a/arch/arm64/include/asm/cache.h b/arch/arm64/include/asm/cache.h >>>>> index 5082b30bc2c0..4b5d7b27edaf 100644 >>>>> --- a/arch/arm64/include/asm/cache.h >>>>> +++ b/arch/arm64/include/asm/cache.h >>>>> @@ -18,17 +18,17 @@ >>>>> >>>>> #include >>>>> >>>>> -#define L1_CACHE_SHIFT 7 >>>>> +#define L1_CACHE_SHIFT 6 >>>>> #define L1_CACHE_BYTES (1 << L1_CACHE_SHIFT) >>>>> >>>>> /* >>>>> * Memory returned by kmalloc() may be used for DMA, so we must make >>>>> - * sure that all such allocations are cache aligned. Otherwise, >>>>> - * unrelated code may cause parts of the buffer to be read into the >>>>> - * cache before the transfer is done, causing old data to be seen by >>>>> - * the CPU. >>>>> + * sure that all such allocations are aligned to the maximum *known* >>>>> + * cache line size on ARMv8 systems. Otherwise, unrelated code may cause >>>>> + * parts of the buffer to be read into the cache before the transfer is >>>>> + * done, causing old data to be seen by the CPU. >>>>> */ >>>>> -#define ARCH_DMA_MINALIGN L1_CACHE_BYTES >>>>> +#define ARCH_DMA_MINALIGN (128) >>>>> >>>>> #ifndef __ASSEMBLY__ >>>>> >>>>> diff --git a/arch/arm64/kernel/cpufeature.c b/arch/arm64/kernel/cpufeature.c >>>>> index 392c67eb9fa6..30bafca1aebf 100644 >>>>> --- a/arch/arm64/kernel/cpufeature.c >>>>> +++ b/arch/arm64/kernel/cpufeature.c >>>>> @@ -976,9 +976,9 @@ void __init setup_cpu_features(void) >>>>> if (!cwg) >>>>> pr_warn("No Cache Writeback Granule information, assuming >>>>> cache line size %d\n", >>>>> cls); >>>>> - if (L1_CACHE_BYTES < cls) >>>>> - pr_warn("L1_CACHE_BYTES smaller than the Cache Writeback Granule (%d < %d)\n", >>>>> - L1_CACHE_BYTES, cls); >>>>> + if (ARCH_DMA_MINALIGN < cls) >>>>> + pr_warn("ARCH_DMA_MINALIGN smaller than the Cache Writeback Granule (%d < %d)\n", >>>>> + ARCH_DMA_MINALIGN, cls); >>>>> } >>>>> >>>>> static bool __maybe_unused >>>> >>>> This change was discussed at: [1] but was not concluded as apparently no one >>>> came back with test report and numbers. After including this change in our >>>> local kernel we are seeing significant throughput improvement. For example with: >>>> >>>> iperf -c 192.168.1.181 -i 1 -w 128K -t 60 >>>> >>>> The average throughput is improving by about 30% (230Mbps from 180Mbps). >>>> Could you please let us know if this change can be included in upstream kernel. >>>> >>>> [1]: https://groups.google.com/forum/#!topic/linux.kernel/P40yDB90ePs >>> >>> Could you please provide some feedback about the above mentioned query ? >> >> Do you have an explanation on the performance variation when >> L1_CACHE_BYTES is changed? We'd need to understand how the network stack >> is affected by L1_CACHE_BYTES, in which context it uses it (is it for >> non-coherent DMA?). > > network stack use SKB_DATA_ALIGN to align. > --- > #define SKB_DATA_ALIGN(X) (((X) + (SMP_CACHE_BYTES - 1)) & \ > ~(SMP_CACHE_BYTES - 1)) > > #define SMP_CACHE_BYTES L1_CACHE_BYTES > --- > I think this is the reason of performance regression. > Yes this is the reason for performance regression. Due to increases L1 cache alignment the object is coming from next kmalloc slab and skb->truesize is changing from 2304 bytes to 4352 bytes. This in turn increases sk_wmem_alloc which causes queuing of less send buffers. We tried different benchmarks and found none which really affects with Cache line change. If there is no correctness issue, I think we are fine with reverting the patch. Though I still think it is beneficiary to do some more investigation for the perf loss, who knows 32 bit align or no align might Give even more perf benefit. Thanks, Tirumalesh. >> >> The Cavium guys haven't shown any numbers (IIUC) to back the >> L1_CACHE_BYTES performance improvement but I would not revert the >> original commit since ARCH_DMA_MINALIGN definitely needs to cover the >> maximum available cache line size, which is 128 for them. > > how about define L1_CACHE_SHIFT like below: > --- > #ifdef CONFIG_ARM64_L1_CACHE_SHIFT > #define L1_CACHE_SHIFT CONFIG_ARM64_L1_CACHE_SHIFT > #else > #define L1_CACHE_SHIFT 7 > endif > --- > > Thanks > >> >> -- >> Catalin -- QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a\nmember of the Code Aurora Forum, hosted by The Linux Foundation _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel From mboxrd@z Thu Jan 1 00:00:00 1970 From: Tirumalesh.Chalamarla@cavium.com (Chalamarla, Tirumalesh) Date: Wed, 12 Apr 2017 14:00:43 +0000 Subject: [PATCH] Revert "arm64: Increase the max granular size" In-Reply-To: <08fa98de-760b-15bc-5220-fa449b08c118@codeaurora.org> References: <1458120743-12145-1-git-send-email-opensource.ganesh@gmail.com> <20160321171403.GE25466@e104818-lin.cambridge.arm.com> <10fef112-37f1-0a1b-b5af-435acd032f01@codeaurora.org> <4525901c-45d4-6bd8-eec6-ae92977f16d1@codeaurora.org> <20170406155825.GA7705@e104818-lin.cambridge.arm.com> <08fa98de-760b-15bc-5220-fa449b08c118@codeaurora.org> Message-ID: <725F073F-025B-48B9-9935-24EFEBF2B7DC@caviumnetworks.com> To: linux-arm-kernel@lists.infradead.org List-Id: linux-arm-kernel.lists.infradead.org On 4/11/17, 10:13 PM, "linux-arm-kernel on behalf of Imran Khan" wrote: On 4/7/2017 7:36 AM, Ganesh Mahendran wrote: > 2017-04-06 23:58 GMT+08:00 Catalin Marinas : >> On Thu, Apr 06, 2017 at 12:52:13PM +0530, Imran Khan wrote: >>> On 4/5/2017 10:13 AM, Imran Khan wrote: >>>>> We may have to revisit this logic and consider L1_CACHE_BYTES the >>>>> _minimum_ of cache line sizes in arm64 systems supported by the kernel. >>>>> Do you have any benchmarks on Cavium boards that would show significant >>>>> degradation with 64-byte L1_CACHE_BYTES vs 128? >>>>> >>>>> For non-coherent DMA, the simplest is to make ARCH_DMA_MINALIGN the >>>>> _maximum_ of the supported systems: >>>>> >>>>> diff --git a/arch/arm64/include/asm/cache.h b/arch/arm64/include/asm/cache.h >>>>> index 5082b30bc2c0..4b5d7b27edaf 100644 >>>>> --- a/arch/arm64/include/asm/cache.h >>>>> +++ b/arch/arm64/include/asm/cache.h >>>>> @@ -18,17 +18,17 @@ >>>>> >>>>> #include >>>>> >>>>> -#define L1_CACHE_SHIFT 7 >>>>> +#define L1_CACHE_SHIFT 6 >>>>> #define L1_CACHE_BYTES (1 << L1_CACHE_SHIFT) >>>>> >>>>> /* >>>>> * Memory returned by kmalloc() may be used for DMA, so we must make >>>>> - * sure that all such allocations are cache aligned. Otherwise, >>>>> - * unrelated code may cause parts of the buffer to be read into the >>>>> - * cache before the transfer is done, causing old data to be seen by >>>>> - * the CPU. >>>>> + * sure that all such allocations are aligned to the maximum *known* >>>>> + * cache line size on ARMv8 systems. Otherwise, unrelated code may cause >>>>> + * parts of the buffer to be read into the cache before the transfer is >>>>> + * done, causing old data to be seen by the CPU. >>>>> */ >>>>> -#define ARCH_DMA_MINALIGN L1_CACHE_BYTES >>>>> +#define ARCH_DMA_MINALIGN (128) >>>>> >>>>> #ifndef __ASSEMBLY__ >>>>> >>>>> diff --git a/arch/arm64/kernel/cpufeature.c b/arch/arm64/kernel/cpufeature.c >>>>> index 392c67eb9fa6..30bafca1aebf 100644 >>>>> --- a/arch/arm64/kernel/cpufeature.c >>>>> +++ b/arch/arm64/kernel/cpufeature.c >>>>> @@ -976,9 +976,9 @@ void __init setup_cpu_features(void) >>>>> if (!cwg) >>>>> pr_warn("No Cache Writeback Granule information, assuming >>>>> cache line size %d\n", >>>>> cls); >>>>> - if (L1_CACHE_BYTES < cls) >>>>> - pr_warn("L1_CACHE_BYTES smaller than the Cache Writeback Granule (%d < %d)\n", >>>>> - L1_CACHE_BYTES, cls); >>>>> + if (ARCH_DMA_MINALIGN < cls) >>>>> + pr_warn("ARCH_DMA_MINALIGN smaller than the Cache Writeback Granule (%d < %d)\n", >>>>> + ARCH_DMA_MINALIGN, cls); >>>>> } >>>>> >>>>> static bool __maybe_unused >>>> >>>> This change was discussed at: [1] but was not concluded as apparently no one >>>> came back with test report and numbers. After including this change in our >>>> local kernel we are seeing significant throughput improvement. For example with: >>>> >>>> iperf -c 192.168.1.181 -i 1 -w 128K -t 60 >>>> >>>> The average throughput is improving by about 30% (230Mbps from 180Mbps). >>>> Could you please let us know if this change can be included in upstream kernel. >>>> >>>> [1]: https://groups.google.com/forum/#!topic/linux.kernel/P40yDB90ePs >>> >>> Could you please provide some feedback about the above mentioned query ? >> >> Do you have an explanation on the performance variation when >> L1_CACHE_BYTES is changed? We'd need to understand how the network stack >> is affected by L1_CACHE_BYTES, in which context it uses it (is it for >> non-coherent DMA?). > > network stack use SKB_DATA_ALIGN to align. > --- > #define SKB_DATA_ALIGN(X) (((X) + (SMP_CACHE_BYTES - 1)) & \ > ~(SMP_CACHE_BYTES - 1)) > > #define SMP_CACHE_BYTES L1_CACHE_BYTES > --- > I think this is the reason of performance regression. > Yes this is the reason for performance regression. Due to increases L1 cache alignment the object is coming from next kmalloc slab and skb->truesize is changing from 2304 bytes to 4352 bytes. This in turn increases sk_wmem_alloc which causes queuing of less send buffers. We tried different benchmarks and found none which really affects with Cache line change. If there is no correctness issue, I think we are fine with reverting the patch. Though I still think it is beneficiary to do some more investigation for the perf loss, who knows 32 bit align or no align might Give even more perf benefit. Thanks, Tirumalesh. >> >> The Cavium guys haven't shown any numbers (IIUC) to back the >> L1_CACHE_BYTES performance improvement but I would not revert the >> original commit since ARCH_DMA_MINALIGN definitely needs to cover the >> maximum available cache line size, which is 128 for them. > > how about define L1_CACHE_SHIFT like below: > --- > #ifdef CONFIG_ARM64_L1_CACHE_SHIFT > #define L1_CACHE_SHIFT CONFIG_ARM64_L1_CACHE_SHIFT > #else > #define L1_CACHE_SHIFT 7 > endif > --- > > Thanks > >> >> -- >> Catalin -- QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a\nmember of the Code Aurora Forum, hosted by The Linux Foundation _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel at lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel