From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932973AbcFOUvK (ORCPT ); Wed, 15 Jun 2016 16:51:10 -0400 Received: from mail-bl2on0076.outbound.protection.outlook.com ([65.55.169.76]:11663 "EHLO na01-bl2-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751061AbcFOUvH (ORCPT ); Wed, 15 Jun 2016 16:51:07 -0400 Authentication-Results: spf=pass (sender IP is 63.163.107.21) smtp.mailfrom=sandisk.com; vger.kernel.org; dkim=none (message not signed) header.d=none;vger.kernel.org; dmarc=bestguesspass action=none header.from=sandisk.com; X-AuditID: ac160c69-353ff70000000bcf-d4-5761be8f8071 Subject: Re: [PATCH 02/13] irq: Introduce IRQD_AFFINITY_MANAGED flag To: Keith Busch References: <1465934346-20648-1-git-send-email-hch@lst.de> <1465934346-20648-3-git-send-email-hch@lst.de> <0412b942-ea0d-d4eb-c724-8243d12ff6f3@sandisk.com> <20160615102311.GA16619@lst.de> <67ef7a1c-56e1-db2c-b038-f9784fc1f52f@sandisk.com> <20160615151415.GA1919@localhost.localdomain> <7f0b16bd-b39f-99e6-c1c1-6a508bf9bbbf@sandisk.com> <20160615160316.GB1919@localhost.localdomain> <86aa652b-48d0-a7bb-683e-bf43939aa811@sandisk.com> <20160615200655.GB7637@localhost.localdomain> <20160615201213.GC7637@localhost.localdomain> CC: Christoph Hellwig , "tglx@linutronix.de" , "axboe@fb.com" , "linux-block@vger.kernel.org" , "linux-pci@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "linux-kernel@vger.kernel.org" From: Bart Van Assche Message-ID: <7a61fe73-2808-70b4-e3b2-b6a924559d9d@sandisk.com> Date: Wed, 15 Jun 2016 22:50:53 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 In-Reply-To: <20160615201213.GC7637@localhost.localdomain> Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFuphkeLIzCtJLcpLzFFi42JZI8azSHfSvsRwg77HTBb/9xxjs1i5+iiT xb2jX5gs9t7Stri8aw6bxfxlT9ktzs47zmaxedNUZgcOj4nN79g9Fu95yeTx7tw5do/NS+o9 dt9sYPP4vEkugC2KyyYlNSezLLVI3y6BK6N72XfWgkscFbvfnGdsYLzM1sXIySEhYCKxatsz IJuLQ0hgLpPEt1ML2CGcHYwSTWuuwVVd3HwOqmopo8SS17cZQRLCAi4Sjde+MoPYIgLqEv9+ vYIqWsgi0bxtCQuIwyzwjkni9o0fYFVsAkYS397PZAGxeQXsJE6tmwS2gkVAVWLN+ytMILao QIRE768lUDWCEidnPgGyOTg4Bawk7l0DG8MsYCExc/55RghbXmL72znMILskBK6yShy6Mh1s jhDQRSeXzGeawCg8C8moWUj6ZyHpX8DIvIpRLDczpzg3PbXA0FSvODEvJbM4Wy85P3cTIySO Mncw3n3ifYhRgINRiYd3x5rEcCHWxLLiytxDjBIczEoivF83AYV4UxIrq1KL8uOLSnNSiw8x SnOwKInzut37EiYkkJ5YkpqdmlqQWgSTZeLglGpgrLWr/K9rZebZ814l5Pd34dkFR6dGWW7N OCXxSXlCEetta624m1Ne+pUF/nx4o1e0PzC+uK9ax4GpIbbi9qI8eSvTI6qxOfoHfKbMu/9Y dq+99qrlHdEfshomdNvMvsBRY1bfvsxresf8ru2qkxZn+FzTnGIRZ5J5UmD5/WmbPx/1Xb+p fXekEktxRqKhFnNRcSIA1O4iGZ8CAAA= X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFmpkluLIzCtJLcpLzFFi42Lh2siRortpf2K4wZw9ehb/9xxjs1i5+iiT xb2jX5gs9t7Stri8aw6bxfxlT9ktzs47zmaxedNUZgcOj4nN79g9Fu95yeTx7tw5do/NS+o9 dt9sYPP4vEkugC2KyyYlNSezLLVI3y6BK6N72XfWgkscFbvfnGdsYLzM1sXIySEhYCJxcfM5 IJuLQ0hgMaPEz/uPWEESwgIuEo3XvjKD2CIC6hL/fr2CKlrIItG8bQkLiMMs8I5J4s7Rr0wg VWwCRhLf3s9kAbF5BewkTq2bBLaCRUBVYs37K2A1ogIREr2/lkDVCEqcnPkEyObg4BSwkrh3 DWwZs4CZxLzND6FseYntb+cwT2Dkm4WkYxaSsllIyhYwMq9iFMvNzCnOTc8sMDTSK07MS8ks ztZLzs/dxAgOZM6oHYzXJ5ofYmTi4JRqYGS/PDl565MdGTebPHemRPALWq7RVPWbYbxgTeje 5SyHOhbzHj35uijo1brlvyqTbvReO+XdULZh75YPy1ffbru7fBnvFdvTpi++1551/sHIsFWv Xz5RqkCH9fie3btXzXeIUTgT/4jvhm7frlWOblXiy9ija79s61+yImj2zE1SX0RnXt8ZpfZE iaU4I9FQi7moOBEAvWo2wBQCAAA= X-EOPAttributedMessage: 0 X-Forefront-Antispam-Report: CIP:63.163.107.21;IPV:NLI;CTRY:US;EFV:NLI;SFV:NSPM;SFS:(10009020)(6009001)(7916002)(2980300002)(438002)(24454002)(377454003)(199003)(189002)(47776003)(53416004)(33646002)(86362001)(31686004)(50466002)(4326007)(106466001)(5003600100002)(2906002)(586003)(356003)(83506001)(8936002)(2270400002)(64126003)(36756003)(77096005)(6806005)(76176999)(189998001)(2950100001)(69596002)(87936001)(54356999)(93886004)(5008740100001)(8676002)(50986999)(92566002)(65806001)(65956001)(31696002)(81166006)(97736004)(23676002)(230700001)(110136002)(81156014)(4001350100001)(68736007)(65826006);DIR:OUT;SFP:1101;SCL:1;SRVR:DM2PR02MB527;H:milsmgep15.sandisk.com;FPR:;SPF:Pass;PTR:InfoDomainNonexistent;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: 1;BN1BFFO11FD025;1:jY68YCGrVThPbiFZZDYH8BcP+r5DCP4WlIwSGjABzsuZ+9Fc1iieqCmfSzK/kueAcdLOL0OlW2cnx2b1iSqUHljJp/7xw8PTh304PjHvYIbJ6ImfIgjgMtY91/coNnAQE4q2cWtGzmeH/FrVjhdgHPLIlIFB8xs8sXD4IlQBIcsP/GDZPielkngiZ9dQ8QU8w7fqUTqi+xvQOq3O0J6tHnd7ultL0Z/q6oQelp7Iqdnn8KujzdARWTPDTOyFmZcU6ZRpRB9iQiKfh5d+juc1mw9JxJIwhZf1xhCQr0IFHsY3AR07V+Askn5Xrp8UYN7ATu1hh883hZ3QvOwKTUygY/MAPOB+aChNk2kUORi9AetZZWcavdqxJUYrNIABvkuCsU4F8K+y/wazenuZ/MEfv3Hva3HOX/BbiAhxy+fvbNQQyxGCXrpjzV0s/ikFsOweZ9rqOkLkqAH+Gzmb0TOvv470jiaOfV22WGxaX2je1aJjsL0UDusBebNdcO9JShE0 X-MS-Office365-Filtering-Correlation-Id: 3f47783f-f477-4046-2957-08d3955ec34a X-Microsoft-Exchange-Diagnostics: 1;DM2PR02MB527;2:FZ3b7wn3CSHa6+MszskoEO0SRxXnMDHos0I+b5ONXVnTal2Zo20BxlE4C62zu6kwLBK6nFEoXg/7nudG0hg9MyqIPjVgtoIEh43VUg/1f7Mzv9RPkMlCJJ/uPX3MdK9me8xVPOCWAg2Pi5NC8G/q2w0U2DyntZl3X9566nLGcrNiJGEtUIRhVKBE2INiEve0;3:E31Yb/TBFPaRwwWZ+m8Xc4DLsRVM5dnIH82iCH46W13xK/5eRlU1lbKU5gCCn48GajeWem+DwlLvjTwGHjkCU80CnT4Wbs30pkYcFiUCsjg8S+ty+HDkWsTg2OjbdicqZHTkYWWoC6fRrLZjqZmudT+Ima/9kZw4y7T52pqnEDu7IIfTU/BClsQVQ0W6lmy3SneykIG7gTX+qDt1pqwhkjxHSsEKicKlciIqfaM3Z8z65mf+69s1nAnyZaID9jGtgZU1QzRfxF1Xx/FCAeWIGA== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(8251501002);SRVR:DM2PR02MB527; X-Microsoft-Exchange-Diagnostics: 1;DM2PR02MB527;25:sHsBtvbQ/HiPILGbVe26Gd3CrbGiyf4jNBNfubbR3El/u15dlErzk5nx4IGXC6sUTCE9QYXQEvO9K/QM5t1GeyJPj9XscrpEj3awa8paNIa0wP2Cnuc1AgCs2+xuxm3DK49pjuRW8QZm5akqObKyO9uA3irn4xDad87WweGsLLNAYjbJ01zWB4Nbjcxtx3WYoNOGBeA1RWKUQ8nUmBtTOmwMVqexRGZDQgCTHtZw8HmDkpoRAKddEEVKfcV59nui4PsPXiey2Kmk90gOR5n6qCspRiy3I8QytPlXeRibuchwc6H5UXmgxdHMCB2L3NuT6ZhK4cf005PXtqfaCXP74RxMRm/DOYLxIwgF6MZdrJNSeYKwXgD4mkTSFfOuTeBmNTCV8raXNGSHS9JQ/0NFD51iSoYCsIPjiv1R+757OtYz2Inhi8sJQHTi19qz52B4C6Un/43B0brDeesSy7ew9TsVeJGbL9ooYjPWRmFBc/iK9AgIOPs0sqv95t1Gcn7JU+02w06hPD727lk1ItZk29I/wAJMAgOmLZwEwSHBM5gwCzN5NmwaOmgqTlcpnKG8jz8OUnxQNYbxNef5e7Eq24AMVrVaadqXRPZtH5MrQF8Z65syZ44cInyiVfRo7PEXuqFMwTSNf2sUaI4E8CDsy/1INmDz6I6O9z0HtKawTkanzi0xhmj7BQS8I6OlvMa7pqfUieDHzS6ufGeNBT6LVN1c9vBNxQVW/3qD4x3aykS8cQX7DaDGs1E0QKOh/ahQBnKLwlXE02FoSkUEq0q2URbEZIijpeCWqWa5Xpaoxns= X-Microsoft-Exchange-Diagnostics: 1;DM2PR02MB527;20:ePv+4qXu5qxevZbDQ1JqZHSZ9KdrdsElEpToexU/7d4E9pNg3Yvy0gZTHx32kXH+6PR7sRC0VEizqUt/SHg/V0QLeewcMHuZSCHRS7ivY4aW4OrlLAsKz4OeF/RiHXWShYCmP2DeahkTpHuqJwlBBr2mgXqqVZ8BXaVMtNtamae70AYYvfvzp+yuywjiIS9MXWpozbE4avJ4YfRInOWhKgnzQx2lEM3TazB3ya9k77/CC0kHSsdoIIwAl0/pgTByhpGgMQsbqkW0t28HiB1C80A6HMLegy1lhoRjMkmH3/UaDmt9O7iZgyAVwSNLdMR2TrgTVpY554hY0NW0qp9hofBweSeItHjqAIAKPn5slGFNNO236AsmqRpt4wsBLXffUDVlUIwpNEzXy/lwJSUJPUuslihDX2xMkfQVRzQnGFJ8o2fkCzw12cH38+nWQli6Xu15PT9P2jv8Wv2TFQBD9qB4qeO4VTUfHPA4ezDdDoHH4+kBBdp1GQ5u1eGo3zzz;4:lUxTBJoX4UIY+lBCQRojSfVm3EbmHzvroDGEzsu8LVZJNtRA/1eLmHvi6C3iapt+yr8rB5ARUrwYTS2MnBnvK/ZT9HoVKW+W9Lf9ohCHHdu0VshvuQdvLDIRaGQoBjJKmsdpaoa/+AztSpXkCZ13HlzgPz8kq7uKB2itpiETtEizZ1o0f+rk03ymYeKriWf/5TztiS08Lb352q60R74xbYVlM0P/gRzgbIVPPx60s/oh62NFIO6bynNh5SdY98j/AgSbMga8MjNpc7ih3VuHQNf5L34M5wfr/NyhnIkxSW9FOz8yyLuEEeDGVOKESRLRX/uddBjaR1Tdgpd1n4BbBxZnULZqQXNCp3lPjL09V/jBYAsDJu5JrvC49c27axrwM14vRcHo9lmy4QUKaJNEMku8/nZ27qL848GnZefg7FE= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(601004)(2401047)(13016025)(13018025)(8121501046)(5005006)(10201501046)(3002001)(6055026);SRVR:DM2PR02MB527;BCL:0;PCL:0;RULEID:;SRVR:DM2PR02MB527; X-Forefront-PRVS: 09749A275C X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtETTJQUjAyTUI1Mjc7MjM6Zk5CSFFWYWhFMGc0eXQ5ZHRoSXZMbUlvSnkz?= =?utf-8?B?RWY4UFFnVFlJSjQ2SEVVQXVvSTZVLzlaVW05V0JMRkRFdGNLOXJBSVdhVXBn?= =?utf-8?B?NWppUmU4RldJNi9CU2FvRDZjb0Rjek82V2hNM0NlWXRveGlVdTlEZkltRmd1?= =?utf-8?B?Rk5lOXJyUHQ1RTlUd09EbWhsMDgyRnlaZDlVKzlGZkloeENyZjllOU11MGdE?= =?utf-8?B?VWZOYkpRdXVaV0tHYlBFaW83ejdGU1dTSXIzZkdRZGlBSmVIYmk3ZFZzeUcz?= =?utf-8?B?K0dkSDEzdmMwQi92SXNucTNSSjRidjlSZVpESGZicTFyWkZSZXJHdEJUWVRV?= =?utf-8?B?RTZHZlpvUFl2dVB3TzkwMnFiT3BLWXpwVDNZQ0xUK1lHdHBWTlpvRm94MFgv?= =?utf-8?B?YlpxZER3RTUvUEdvMHphNnoyK2oySHJHd2N4Z0VSTDQyUDNNbmtQZjB2Qmd4?= =?utf-8?B?QlNyVlVQWVBjNlJYaE96dGlPNHFPOWxiTkNYbk1vRUx6ZGhSOHpiSDF0dEtB?= =?utf-8?B?OGRERE9HekF5YnJOMEJXNkxycy95TzBNN29ldGxQbUdJa2xHZ1ZVazlPYzFa?= =?utf-8?B?Z01mMlBOM2RaQ1VXOExkT3JyTkJRcS9maVdJbjM1VnUzUlYrQmVOVTdYSm0w?= =?utf-8?B?dVMrTTlITFpoRWlIQm9kNmpVRnNjWDlna0VmOEFhN1dRdHBLVkZaRVJiU3JC?= =?utf-8?B?M0hxQ0hWWVFCL0ZCTC8zMUUreGFESURoRE9UM2hBNXBQN2krdG1Xc2JTSCt5?= =?utf-8?B?d0ppN1BMNDBkWUpYYWlobEFDUW9ZYlRpK2FKQ09wejZGK3ZGUzY3RlRxV3Q4?= =?utf-8?B?QW16TTgyL1J3T1hIaUZsbERuaXJvdm9xcXpzWFV5dDRsQ1BCaElHbTV0ZFA2?= =?utf-8?B?VldNSHdLYUhaRGp2N0Nzd3R4V1dPUmp2Uy80SEt2MlFMMXFuNU5GQ1RmV243?= =?utf-8?B?eWFDT2JIN1lMVWMvUGF2VDBGVGJXb0RhRkdHTzNiRmNncEtEWHppc3dCbFpN?= =?utf-8?B?Wnpzc2Z6MzBEZ21uZkRSZDEvd3RIby9ieFRqZkZxQzZzMjJjR3FNeWxGelpy?= =?utf-8?B?WENQZE1KREYrc3A5Yzd5YjNqd1pxbjc3UXhiSnJlS20vRnd3WC8zZHdET3dM?= =?utf-8?B?TWNnckI1azFkQ1dDT3F4c3VIeWFqVEwvZCtwMWQ1cElkc0s5RVQ4TWsyN2c0?= =?utf-8?B?cUlBQ3EyVGxBYVBERy9tNDRRQ3dIRFF1NDF6M0hpSys3MFlLMGJ2T3NueVVx?= =?utf-8?B?NHJsbFd5d2hYM1I2WGV4SEJMc0FXNXB3T3o4QmRIdElrSEx5eTdaM0FVWk9G?= =?utf-8?B?OXlybmUvM1dDYmFnMDdRdXpVb2tHOXBkQ2pmZFRMb2lqS0plcFM2UmJqeWt6?= =?utf-8?B?bFZkeXRUSlA2T0E5S3VCRnhvTU5QVzl1Q1ZWa29zWkZyR0hrQm1YbjczMTBS?= =?utf-8?B?WVRzWnBUbUdoQ2c5d1J4OE9yZXErWlprdGt4a1ZNOHVNMXNRUTFraE1OaHN1?= =?utf-8?B?S2daMW5mRU8veURXak9tNkJnVEpMWnozVHNsYnloZWVOUHZqRU5uQWJjUE50?= =?utf-8?B?M3FoSHFQU29xNnROT09uUU1RUnNXbm9ROUZOUy9BVWxmWllqWjcxc2J3UjJ4?= =?utf-8?B?Y0tGNjdnQ09oUjlYNFpyOWtLR2Z6UjEzN1lXZkRyWHQza1RiNFFKZTFrVWtJ?= =?utf-8?Q?N+b7ss4qTLUg/c22k=3D?= X-Microsoft-Exchange-Diagnostics: 1;DM2PR02MB527;5:SHerbjnwhD31YHjfyepCcd1Q6ya99jxyF4sP88f1FjAqYWe/SykpMQvWyije46GsuKuMoqUnfg04LJ3BH8pR/G44DUZmrHnka7cciu0gJBP0Mf4UTxFfxfC5agFqxlNdJB0f4oBpzjUwkfqvqz9Ebg==;24:JHsfjkHvu0NOpb0etLneg5p3E8cIt+jea62AiZP1T/qV43VqB2ztr96MY3ppRZYsocDZuVOqAlOZhRp3n8ctJF2SgctS2RqF27f5K0FC44o=;7:UQymEi7RfR4HHV5mRjC8ybxKtxRCsZ/sJIbNuwe/NTEfNwObcOZYcMkdHktkkREbrHUz7LsTfXsNkA12Vwa1uy6dZb3LItHXi+ru7WKMkIpfLw7gLU+lwzsADRr+rsea2BYbzHQjTrL4GZCv76DJhq9lHWC912AMaRuygCHp9nB/eQ5wGsyCVBaFxI/pF4qyGeB6IDoHO9sa3cxIX5bTnA==;20:3Ke/3UEth87fD+YoeHwta67n4M75RchmiuJ7AWw6E2m2VOrIo6OP8p5fS6HWBT66qeqSbspIvR5d2YX+o6wiP/KFXqfBDEvLjI9EULCYCYcU1U+L2kVn2wYYuRPQTv8imBGNv+it8b1OZRMkuqVKXyE/h9WtFLoUUUuskqBZeAVKp/j7ilBS6cxe9hkcYs2LbdNXvrbuvTxLUP2L0IqyCKeu58WsoVjLsOupRf5tbJlBz3FdFvI+7yQzcqAbvsTs SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: sandisk.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Jun 2016 20:51:01.7453 (UTC) X-MS-Exchange-CrossTenant-Id: fcd9ea9c-ae8c-460c-ab3c-3db42d7ac64d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=fcd9ea9c-ae8c-460c-ab3c-3db42d7ac64d;Ip=[63.163.107.21];Helo=[milsmgep15.sandisk.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM2PR02MB527 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 06/15/2016 10:12 PM, Keith Busch wrote: > On Wed, Jun 15, 2016 at 04:06:55PM -0400, Keith Busch wrote: >>> >>> 0: A0 B0 >>> 1: A1 B1 >>> 2: A2 B2 >>> 3: A3 B3 >>> 4: A4 B4 >>> 5: A5 B5 >>> 6: A6 B6 >>> 7: A7 B7 >>> 8: (none) >>> ... >>> 31: (none) >> >> I'll need to look at the follow on patches do to confirm, but that's >> not what this should do. All CPU's should have a vector assigned because >> every CPU needs to be assigned a submission context using a vector. In >> your example, every vector's affinity mask should be assigned to 4 CPUs: >> vector '8' starts over with A0 B0, '9' gets A1 B1, and so on. > > ^^^^^^ > > Sorry, I meant "CPU '8'", not "vector '8'". Hello Keith, Does it matter on x86 systems whether or not these interrupt vectors are also associated with a CPU with a higher CPU number? Although multiple bits can be set in /proc/irq//smp_affinity only the first bit counts on x86 platforms. In default_cpu_mask_to_apicid_and() it is easy to see that only the first bit that has been set in that mask counts on x86 systems. Bart.