From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id B73B9C4360F for ; Wed, 3 Apr 2019 15:48:09 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 88657206BA for ; Wed, 3 Apr 2019 15:48:09 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726947AbfDCPsH convert rfc822-to-8bit (ORCPT ); Wed, 3 Apr 2019 11:48:07 -0400 Received: from mx1.redhat.com ([209.132.183.28]:50336 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726151AbfDCPsG (ORCPT ); Wed, 3 Apr 2019 11:48:06 -0400 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 9D4A7368E7; Wed, 3 Apr 2019 15:48:05 +0000 (UTC) Received: from llong.remote.csb (dhcp-17-19.bos.redhat.com [10.18.17.19]) by smtp.corp.redhat.com (Postfix) with ESMTP id 5D51E18E42; Wed, 3 Apr 2019 15:48:03 +0000 (UTC) Subject: Re: [PATCH v2 3/5] locking/qspinlock: Introduce CNA into the slow path of qspinlock To: Alex Kogan , Peter Zijlstra Cc: linux@armlinux.org.uk, mingo@redhat.com, will.deacon@arm.com, arnd@arndb.de, linux-arch@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, tglx@linutronix.de, bp@alien8.de, hpa@zytor.com, x86@kernel.org, steven.sistare@oracle.com, daniel.m.jordan@oracle.com, dave.dice@oracle.com, rahul.x.yadav@oracle.com References: <20190329152006.110370-1-alex.kogan@oracle.com> <20190329152006.110370-4-alex.kogan@oracle.com> <60a3a2d8-d222-73aa-2df1-64c9d3fa3241@redhat.com> <20190402094320.GM11158@hirez.programming.kicks-ass.net> <6AEDE4F2-306A-4DF9-9307-9E3517C68A2B@oracle.com> From: Waiman Long Openpgp: preference=signencrypt Autocrypt: addr=longman@redhat.com; prefer-encrypt=mutual; keydata= xsFNBFgsZGsBEAC3l/RVYISY3M0SznCZOv8aWc/bsAgif1H8h0WPDrHnwt1jfFTB26EzhRea XQKAJiZbjnTotxXq1JVaWxJcNJL7crruYeFdv7WUJqJzFgHnNM/upZuGsDIJHyqBHWK5X9ZO jRyfqV/i3Ll7VIZobcRLbTfEJgyLTAHn2Ipcpt8mRg2cck2sC9+RMi45Epweu7pKjfrF8JUY r71uif2ThpN8vGpn+FKbERFt4hW2dV/3awVckxxHXNrQYIB3I/G6mUdEZ9yrVrAfLw5M3fVU CRnC6fbroC6/ztD40lyTQWbCqGERVEwHFYYoxrcGa8AzMXN9CN7bleHmKZrGxDFWbg4877zX 0YaLRypme4K0ULbnNVRQcSZ9UalTvAzjpyWnlnXCLnFjzhV7qsjozloLTkZjyHimSc3yllH7 VvP/lGHnqUk7xDymgRHNNn0wWPuOpR97J/r7V1mSMZlni/FVTQTRu87aQRYu3nKhcNJ47TGY evz/U0ltaZEU41t7WGBnC7RlxYtdXziEn5fC8b1JfqiP0OJVQfdIMVIbEw1turVouTovUA39 Qqa6Pd1oYTw+Bdm1tkx7di73qB3x4pJoC8ZRfEmPqSpmu42sijWSBUgYJwsziTW2SBi4hRjU h/Tm0NuU1/R1bgv/EzoXjgOM4ZlSu6Pv7ICpELdWSrvkXJIuIwARAQABzR9Mb25nbWFuIExv bmcgPGxsb25nQHJlZGhhdC5jb20+wsF/BBMBAgApBQJYLGRrAhsjBQkJZgGABwsJCAcDAgEG FQgCCQoLBBYCAwECHgECF4AACgkQbjBXZE7vHeYwBA//ZYxi4I/4KVrqc6oodVfwPnOVxvyY oKZGPXZXAa3swtPGmRFc8kGyIMZpVTqGJYGD9ZDezxpWIkVQDnKM9zw/qGarUVKzElGHcuFN ddtwX64yxDhA+3Og8MTy8+8ZucM4oNsbM9Dx171bFnHjWSka8o6qhK5siBAf9WXcPNogUk4S fMNYKxexcUayv750GK5E8RouG0DrjtIMYVJwu+p3X1bRHHDoieVfE1i380YydPd7mXa7FrRl 7unTlrxUyJSiBc83HgKCdFC8+ggmRVisbs+1clMsK++ehz08dmGlbQD8Fv2VK5KR2+QXYLU0 rRQjXk/gJ8wcMasuUcywnj8dqqO3kIS1EfshrfR/xCNSREcv2fwHvfJjprpoE9tiL1qP7Jrq 4tUYazErOEQJcE8Qm3fioh40w8YrGGYEGNA4do/jaHXm1iB9rShXE2jnmy3ttdAh3M8W2OMK 4B/Rlr+Awr2NlVdvEF7iL70kO+aZeOu20Lq6mx4Kvq/WyjZg8g+vYGCExZ7sd8xpncBSl7b3 99AIyT55HaJjrs5F3Rl8dAklaDyzXviwcxs+gSYvRCr6AMzevmfWbAILN9i1ZkfbnqVdpaag QmWlmPuKzqKhJP+OMYSgYnpd/vu5FBbc+eXpuhydKqtUVOWjtp5hAERNnSpD87i1TilshFQm TFxHDzbOwU0EWCxkawEQALAcdzzKsZbcdSi1kgjfce9AMjyxkkZxcGc6Rhwvt78d66qIFK9D Y9wfcZBpuFY/AcKEqjTo4FZ5LCa7/dXNwOXOdB1Jfp54OFUqiYUJFymFKInHQYlmoES9EJEU yy+2ipzy5yGbLh3ZqAXyZCTmUKBU7oz/waN7ynEP0S0DqdWgJnpEiFjFN4/ovf9uveUnjzB6 lzd0BDckLU4dL7aqe2ROIHyG3zaBMuPo66pN3njEr7IcyAL6aK/IyRrwLXoxLMQW7YQmFPSw drATP3WO0x8UGaXlGMVcaeUBMJlqTyN4Swr2BbqBcEGAMPjFCm6MjAPv68h5hEoB9zvIg+fq M1/Gs4D8H8kUjOEOYtmVQ5RZQschPJle95BzNwE3Y48ZH5zewgU7ByVJKSgJ9HDhwX8Ryuia 79r86qZeFjXOUXZjjWdFDKl5vaiRbNWCpuSG1R1Tm8o/rd2NZ6l8LgcK9UcpWorrPknbE/pm MUeZ2d3ss5G5Vbb0bYVFRtYQiCCfHAQHO6uNtA9IztkuMpMRQDUiDoApHwYUY5Dqasu4ZDJk bZ8lC6qc2NXauOWMDw43z9He7k6LnYm/evcD+0+YebxNsorEiWDgIW8Q/E+h6RMS9kW3Rv1N qd2nFfiC8+p9I/KLcbV33tMhF1+dOgyiL4bcYeR351pnyXBPA66ldNWvABEBAAHCwWUEGAEC AA8FAlgsZGsCGwwFCQlmAYAACgkQbjBXZE7vHeYxSQ/+PnnPrOkKHDHQew8Pq9w2RAOO8gMg 9Ty4L54CsTf21Mqc6GXj6LN3WbQta7CVA0bKeq0+WnmsZ9jkTNh8lJp0/RnZkSUsDT9Tza9r GB0svZnBJMFJgSMfmwa3cBttCh+vqDV3ZIVSG54nPmGfUQMFPlDHccjWIvTvyY3a9SLeamaR jOGye8MQAlAD40fTWK2no6L1b8abGtziTkNh68zfu3wjQkXk4kA4zHroE61PpS3oMD4AyI9L 7A4Zv0Cvs2MhYQ4Qbbmafr+NOhzuunm5CoaRi+762+c508TqgRqH8W1htZCzab0pXHRfywtv 0P+BMT7vN2uMBdhr8c0b/hoGqBTenOmFt71tAyyGcPgI3f7DUxy+cv3GzenWjrvf3uFpxYx4 yFQkUcu06wa61nCdxXU/BWFItryAGGdh2fFXnIYP8NZfdA+zmpymJXDQeMsAEHS0BLTVQ3+M 7W5Ak8p9V+bFMtteBgoM23bskH6mgOAw6Cj/USW4cAJ8b++9zE0/4Bv4iaY5bcsL+h7TqQBH Lk1eByJeVooUa/mqa2UdVJalc8B9NrAnLiyRsg72Nurwzvknv7anSgIkL+doXDaG21DgCYTD wGA5uquIgb8p3/ENgYpDPrsZ72CxVC2NEJjJwwnRBStjJOGQX4lV1uhN1XsZjBbRHdKF2W9g weim8xU= Organization: Red Hat Message-ID: Date: Wed, 3 Apr 2019 11:48:02 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <6AEDE4F2-306A-4DF9-9307-9E3517C68A2B@oracle.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8BIT Content-Language: en-US X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.30]); Wed, 03 Apr 2019 15:48:06 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 04/03/2019 11:39 AM, Alex Kogan wrote: > Peter, Longman, many thanks for your detailed comments! > > A few follow-up questions are inlined below. > >> On Apr 2, 2019, at 5:43 AM, Peter Zijlstra wrote: >> >> On Mon, Apr 01, 2019 at 10:36:19AM -0400, Waiman Long wrote: >>> On 03/29/2019 11:20 AM, Alex Kogan wrote: >>>> +config NUMA_AWARE_SPINLOCKS >>>> + bool "Numa-aware spinlocks" >>>> + depends on NUMA >>>> + default y >>>> + help >>>> + Introduce NUMA (Non Uniform Memory Access) awareness into >>>> + the slow path of spinlocks. >>>> + >>>> + The kernel will try to keep the lock on the same node, >>>> + thus reducing the number of remote cache misses, while >>>> + trading some of the short term fairness for better performance. >>>> + >>>> + Say N if you want absolute first come first serve fairness. >>>> + >>> The patch that I am looking for is to have a separate >>> numa_queued_spinlock_slowpath() that coexists with >>> native_queued_spinlock_slowpath() and >>> paravirt_queued_spinlock_slowpath(). At boot time, we select the most >>> appropriate one for the system at hand. > Is this how this selection works today for paravirt? > I see a PARAVIRT_SPINLOCKS config option, but IIUC you are talking about a different mechanism here. > Can you, please, elaborate or give me a link to a page that explains that? > >> Agreed; and until we have static_call, I think we can abuse the paravirt >> stuff for this. >> >> By the time we patch the paravirt stuff: >> >> check_bugs() >> alternative_instructions() >> apply_paravirt() >> >> we should already have enumerated the NODE topology and so nr_node_ids() >> should be set. >> >> So if we frob pv_ops.lock.queued_spin_lock_slowpath to >> numa_queued_spin_lock_slowpath before that, it should all get patched >> just right. >> >> That of course means the whole NUMA_AWARE_SPINLOCKS thing depends on >> PARAVIRT_SPINLOCK, which is a bit awkward… > Just to mention here, the patch so far does not address paravirt, but our goal is to add this support once we address all the concerns for the native version. > So we will end up with four variants for the queued_spinlock_slowpath() — one for each combination of native/paravirt and NUMA/non-NUMA. > Or perhaps we do not need a NUMA/paravirt variant? I don't expect we need a numa variant for paravirt. First of all, the NUMA information available in a VM guest is unreliable. So let just not go there. What we are looking for is to make sure your patch won't break the paravirt code. So testing the paravirt qspinlock should be part of your testing matrix. Cheers, Longman From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_PASS autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7D34CC4360F for ; Wed, 3 Apr 2019 15:48:13 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 4E7E7206BA for ; Wed, 3 Apr 2019 15:48:13 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="C0JbL9aR" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 4E7E7206BA Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+infradead-linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20170209; h=Sender: Content-Transfer-Encoding:Content-Type:Cc:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:Date: Message-ID:From:References:To:Subject:Reply-To:Content-ID:Content-Description :Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=81nMRyl8BaWSZk5FT0nVmkQZtMWdOPnOmo7rVciVg9I=; b=C0JbL9aRpBAvb6 RcL6xnzqOyzQwZBErjLwicznFRo1d7kCxM+RbXCarSqRyCZjEoGwSigR2NsCPMfHQztrXRhVYAEhH 3pvq1/VqqL6f123Mp7n/Lw+QkDATx8NVrTjkCldCLXzK+yRrWry27SogHhOrVZCW1V0a7e6fPpvH6 DuN3nYKyfDeKLosoIFEBSAxH6a/ANacpC53VT+jq+lV5IpZsNIQqvctuPNr5QLU360Qx/xJ/14WJc FdQL1KAHzLb3sFOobIeG8mk+gl36a6h9Zv7KIycaX7OJ0wbFAYsh71A+irl/sx4DB4R1hIaJhov4O Xx4++Q9kjZ2mlXleOVeg==; Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.90_1 #2 (Red Hat Linux)) id 1hBi7V-0001vF-Mq; Wed, 03 Apr 2019 15:48:09 +0000 Received: from mx1.redhat.com ([209.132.183.28]) by bombadil.infradead.org with esmtps (Exim 4.90_1 #2 (Red Hat Linux)) id 1hBi7S-0001us-OB for linux-arm-kernel@lists.infradead.org; Wed, 03 Apr 2019 15:48:08 +0000 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 9D4A7368E7; Wed, 3 Apr 2019 15:48:05 +0000 (UTC) Received: from llong.remote.csb (dhcp-17-19.bos.redhat.com [10.18.17.19]) by smtp.corp.redhat.com (Postfix) with ESMTP id 5D51E18E42; Wed, 3 Apr 2019 15:48:03 +0000 (UTC) Subject: Re: [PATCH v2 3/5] locking/qspinlock: Introduce CNA into the slow path of qspinlock To: Alex Kogan , Peter Zijlstra References: <20190329152006.110370-1-alex.kogan@oracle.com> <20190329152006.110370-4-alex.kogan@oracle.com> <60a3a2d8-d222-73aa-2df1-64c9d3fa3241@redhat.com> <20190402094320.GM11158@hirez.programming.kicks-ass.net> <6AEDE4F2-306A-4DF9-9307-9E3517C68A2B@oracle.com> From: Waiman Long Openpgp: preference=signencrypt Autocrypt: addr=longman@redhat.com; prefer-encrypt=mutual; keydata= xsFNBFgsZGsBEAC3l/RVYISY3M0SznCZOv8aWc/bsAgif1H8h0WPDrHnwt1jfFTB26EzhRea XQKAJiZbjnTotxXq1JVaWxJcNJL7crruYeFdv7WUJqJzFgHnNM/upZuGsDIJHyqBHWK5X9ZO jRyfqV/i3Ll7VIZobcRLbTfEJgyLTAHn2Ipcpt8mRg2cck2sC9+RMi45Epweu7pKjfrF8JUY r71uif2ThpN8vGpn+FKbERFt4hW2dV/3awVckxxHXNrQYIB3I/G6mUdEZ9yrVrAfLw5M3fVU CRnC6fbroC6/ztD40lyTQWbCqGERVEwHFYYoxrcGa8AzMXN9CN7bleHmKZrGxDFWbg4877zX 0YaLRypme4K0ULbnNVRQcSZ9UalTvAzjpyWnlnXCLnFjzhV7qsjozloLTkZjyHimSc3yllH7 VvP/lGHnqUk7xDymgRHNNn0wWPuOpR97J/r7V1mSMZlni/FVTQTRu87aQRYu3nKhcNJ47TGY evz/U0ltaZEU41t7WGBnC7RlxYtdXziEn5fC8b1JfqiP0OJVQfdIMVIbEw1turVouTovUA39 Qqa6Pd1oYTw+Bdm1tkx7di73qB3x4pJoC8ZRfEmPqSpmu42sijWSBUgYJwsziTW2SBi4hRjU h/Tm0NuU1/R1bgv/EzoXjgOM4ZlSu6Pv7ICpELdWSrvkXJIuIwARAQABzR9Mb25nbWFuIExv bmcgPGxsb25nQHJlZGhhdC5jb20+wsF/BBMBAgApBQJYLGRrAhsjBQkJZgGABwsJCAcDAgEG FQgCCQoLBBYCAwECHgECF4AACgkQbjBXZE7vHeYwBA//ZYxi4I/4KVrqc6oodVfwPnOVxvyY oKZGPXZXAa3swtPGmRFc8kGyIMZpVTqGJYGD9ZDezxpWIkVQDnKM9zw/qGarUVKzElGHcuFN ddtwX64yxDhA+3Og8MTy8+8ZucM4oNsbM9Dx171bFnHjWSka8o6qhK5siBAf9WXcPNogUk4S fMNYKxexcUayv750GK5E8RouG0DrjtIMYVJwu+p3X1bRHHDoieVfE1i380YydPd7mXa7FrRl 7unTlrxUyJSiBc83HgKCdFC8+ggmRVisbs+1clMsK++ehz08dmGlbQD8Fv2VK5KR2+QXYLU0 rRQjXk/gJ8wcMasuUcywnj8dqqO3kIS1EfshrfR/xCNSREcv2fwHvfJjprpoE9tiL1qP7Jrq 4tUYazErOEQJcE8Qm3fioh40w8YrGGYEGNA4do/jaHXm1iB9rShXE2jnmy3ttdAh3M8W2OMK 4B/Rlr+Awr2NlVdvEF7iL70kO+aZeOu20Lq6mx4Kvq/WyjZg8g+vYGCExZ7sd8xpncBSl7b3 99AIyT55HaJjrs5F3Rl8dAklaDyzXviwcxs+gSYvRCr6AMzevmfWbAILN9i1ZkfbnqVdpaag QmWlmPuKzqKhJP+OMYSgYnpd/vu5FBbc+eXpuhydKqtUVOWjtp5hAERNnSpD87i1TilshFQm TFxHDzbOwU0EWCxkawEQALAcdzzKsZbcdSi1kgjfce9AMjyxkkZxcGc6Rhwvt78d66qIFK9D Y9wfcZBpuFY/AcKEqjTo4FZ5LCa7/dXNwOXOdB1Jfp54OFUqiYUJFymFKInHQYlmoES9EJEU yy+2ipzy5yGbLh3ZqAXyZCTmUKBU7oz/waN7ynEP0S0DqdWgJnpEiFjFN4/ovf9uveUnjzB6 lzd0BDckLU4dL7aqe2ROIHyG3zaBMuPo66pN3njEr7IcyAL6aK/IyRrwLXoxLMQW7YQmFPSw drATP3WO0x8UGaXlGMVcaeUBMJlqTyN4Swr2BbqBcEGAMPjFCm6MjAPv68h5hEoB9zvIg+fq M1/Gs4D8H8kUjOEOYtmVQ5RZQschPJle95BzNwE3Y48ZH5zewgU7ByVJKSgJ9HDhwX8Ryuia 79r86qZeFjXOUXZjjWdFDKl5vaiRbNWCpuSG1R1Tm8o/rd2NZ6l8LgcK9UcpWorrPknbE/pm MUeZ2d3ss5G5Vbb0bYVFRtYQiCCfHAQHO6uNtA9IztkuMpMRQDUiDoApHwYUY5Dqasu4ZDJk bZ8lC6qc2NXauOWMDw43z9He7k6LnYm/evcD+0+YebxNsorEiWDgIW8Q/E+h6RMS9kW3Rv1N qd2nFfiC8+p9I/KLcbV33tMhF1+dOgyiL4bcYeR351pnyXBPA66ldNWvABEBAAHCwWUEGAEC AA8FAlgsZGsCGwwFCQlmAYAACgkQbjBXZE7vHeYxSQ/+PnnPrOkKHDHQew8Pq9w2RAOO8gMg 9Ty4L54CsTf21Mqc6GXj6LN3WbQta7CVA0bKeq0+WnmsZ9jkTNh8lJp0/RnZkSUsDT9Tza9r GB0svZnBJMFJgSMfmwa3cBttCh+vqDV3ZIVSG54nPmGfUQMFPlDHccjWIvTvyY3a9SLeamaR jOGye8MQAlAD40fTWK2no6L1b8abGtziTkNh68zfu3wjQkXk4kA4zHroE61PpS3oMD4AyI9L 7A4Zv0Cvs2MhYQ4Qbbmafr+NOhzuunm5CoaRi+762+c508TqgRqH8W1htZCzab0pXHRfywtv 0P+BMT7vN2uMBdhr8c0b/hoGqBTenOmFt71tAyyGcPgI3f7DUxy+cv3GzenWjrvf3uFpxYx4 yFQkUcu06wa61nCdxXU/BWFItryAGGdh2fFXnIYP8NZfdA+zmpymJXDQeMsAEHS0BLTVQ3+M 7W5Ak8p9V+bFMtteBgoM23bskH6mgOAw6Cj/USW4cAJ8b++9zE0/4Bv4iaY5bcsL+h7TqQBH Lk1eByJeVooUa/mqa2UdVJalc8B9NrAnLiyRsg72Nurwzvknv7anSgIkL+doXDaG21DgCYTD wGA5uquIgb8p3/ENgYpDPrsZ72CxVC2NEJjJwwnRBStjJOGQX4lV1uhN1XsZjBbRHdKF2W9g weim8xU= Organization: Red Hat Message-ID: Date: Wed, 3 Apr 2019 11:48:02 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <6AEDE4F2-306A-4DF9-9307-9E3517C68A2B@oracle.com> Content-Language: en-US X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.30]); Wed, 03 Apr 2019 15:48:06 +0000 (UTC) X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20190403_084806_821960_4ABBEE1F X-CRM114-Status: GOOD ( 21.24 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: linux-arch@vger.kernel.org, arnd@arndb.de, dave.dice@oracle.com, x86@kernel.org, will.deacon@arm.com, linux@armlinux.org.uk, linux-kernel@vger.kernel.org, rahul.x.yadav@oracle.com, mingo@redhat.com, bp@alien8.de, hpa@zytor.com, steven.sistare@oracle.com, tglx@linutronix.de, daniel.m.jordan@oracle.com, linux-arm-kernel@lists.infradead.org Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+infradead-linux-arm-kernel=archiver.kernel.org@lists.infradead.org T24gMDQvMDMvMjAxOSAxMTozOSBBTSwgQWxleCBLb2dhbiB3cm90ZToKPiBQZXRlciwgTG9uZ21h biwgbWFueSB0aGFua3MgZm9yIHlvdXIgZGV0YWlsZWQgY29tbWVudHMhCj4KPiBBIGZldyBmb2xs b3ctdXAgcXVlc3Rpb25zIGFyZSBpbmxpbmVkIGJlbG93Lgo+Cj4+IE9uIEFwciAyLCAyMDE5LCBh dCA1OjQzIEFNLCBQZXRlciBaaWpsc3RyYSA8cGV0ZXJ6QGluZnJhZGVhZC5vcmc+IHdyb3RlOgo+ Pgo+PiBPbiBNb24sIEFwciAwMSwgMjAxOSBhdCAxMDozNjoxOUFNIC0wNDAwLCBXYWltYW4gTG9u ZyB3cm90ZToKPj4+IE9uIDAzLzI5LzIwMTkgMTE6MjAgQU0sIEFsZXggS29nYW4gd3JvdGU6Cj4+ Pj4gK2NvbmZpZyBOVU1BX0FXQVJFX1NQSU5MT0NLUwo+Pj4+ICsJYm9vbCAiTnVtYS1hd2FyZSBz cGlubG9ja3MiCj4+Pj4gKwlkZXBlbmRzIG9uIE5VTUEKPj4+PiArCWRlZmF1bHQgeQo+Pj4+ICsJ aGVscAo+Pj4+ICsJICBJbnRyb2R1Y2UgTlVNQSAoTm9uIFVuaWZvcm0gTWVtb3J5IEFjY2Vzcykg YXdhcmVuZXNzIGludG8KPj4+PiArCSAgdGhlIHNsb3cgcGF0aCBvZiBzcGlubG9ja3MuCj4+Pj4g Kwo+Pj4+ICsJICBUaGUga2VybmVsIHdpbGwgdHJ5IHRvIGtlZXAgdGhlIGxvY2sgb24gdGhlIHNh bWUgbm9kZSwKPj4+PiArCSAgdGh1cyByZWR1Y2luZyB0aGUgbnVtYmVyIG9mIHJlbW90ZSBjYWNo ZSBtaXNzZXMsIHdoaWxlCj4+Pj4gKwkgIHRyYWRpbmcgc29tZSBvZiB0aGUgc2hvcnQgdGVybSBm YWlybmVzcyBmb3IgYmV0dGVyIHBlcmZvcm1hbmNlLgo+Pj4+ICsKPj4+PiArCSAgU2F5IE4gaWYg eW91IHdhbnQgYWJzb2x1dGUgZmlyc3QgY29tZSBmaXJzdCBzZXJ2ZSBmYWlybmVzcy4KPj4+PiAr Cj4+PiBUaGUgcGF0Y2ggdGhhdCBJIGFtIGxvb2tpbmcgZm9yIGlzIHRvIGhhdmUgYSBzZXBhcmF0 ZQo+Pj4gbnVtYV9xdWV1ZWRfc3BpbmxvY2tfc2xvd3BhdGgoKSB0aGF0IGNvZXhpc3RzIHdpdGgK Pj4+IG5hdGl2ZV9xdWV1ZWRfc3BpbmxvY2tfc2xvd3BhdGgoKSBhbmQKPj4+IHBhcmF2aXJ0X3F1 ZXVlZF9zcGlubG9ja19zbG93cGF0aCgpLiBBdCBib290IHRpbWUsIHdlIHNlbGVjdCB0aGUgbW9z dAo+Pj4gYXBwcm9wcmlhdGUgb25lIGZvciB0aGUgc3lzdGVtIGF0IGhhbmQuCj4gSXMgdGhpcyBo b3cgdGhpcyBzZWxlY3Rpb24gd29ya3MgdG9kYXkgZm9yIHBhcmF2aXJ0Pwo+IEkgc2VlIGEgUEFS QVZJUlRfU1BJTkxPQ0tTIGNvbmZpZyBvcHRpb24sIGJ1dCBJSVVDIHlvdSBhcmUgdGFsa2luZyBh Ym91dCBhIGRpZmZlcmVudCBtZWNoYW5pc20gaGVyZS4KPiBDYW4geW91LCBwbGVhc2UsIGVsYWJv cmF0ZSBvciBnaXZlIG1lIGEgbGluayB0byBhIHBhZ2UgdGhhdCBleHBsYWlucyB0aGF0Pwo+Cj4+ IEFncmVlZDsgYW5kIHVudGlsIHdlIGhhdmUgc3RhdGljX2NhbGwsIEkgdGhpbmsgd2UgY2FuIGFi dXNlIHRoZSBwYXJhdmlydAo+PiBzdHVmZiBmb3IgdGhpcy4KPj4KPj4gQnkgdGhlIHRpbWUgd2Ug cGF0Y2ggdGhlIHBhcmF2aXJ0IHN0dWZmOgo+Pgo+PiAgY2hlY2tfYnVncygpCj4+ICAgIGFsdGVy bmF0aXZlX2luc3RydWN0aW9ucygpCj4+ICAgICAgYXBwbHlfcGFyYXZpcnQoKQo+Pgo+PiB3ZSBz aG91bGQgYWxyZWFkeSBoYXZlIGVudW1lcmF0ZWQgdGhlIE5PREUgdG9wb2xvZ3kgYW5kIHNvIG5y X25vZGVfaWRzKCkKPj4gc2hvdWxkIGJlIHNldC4KPj4KPj4gU28gaWYgd2UgZnJvYiBwdl9vcHMu bG9jay5xdWV1ZWRfc3Bpbl9sb2NrX3Nsb3dwYXRoIHRvCj4+IG51bWFfcXVldWVkX3NwaW5fbG9j a19zbG93cGF0aCBiZWZvcmUgdGhhdCwgaXQgc2hvdWxkIGFsbCBnZXQgcGF0Y2hlZAo+PiBqdXN0 IHJpZ2h0Lgo+Pgo+PiBUaGF0IG9mIGNvdXJzZSBtZWFucyB0aGUgd2hvbGUgTlVNQV9BV0FSRV9T UElOTE9DS1MgdGhpbmcgZGVwZW5kcyBvbgo+PiBQQVJBVklSVF9TUElOTE9DSywgd2hpY2ggaXMg YSBiaXQgYXdrd2FyZOKApgo+IEp1c3QgdG8gbWVudGlvbiBoZXJlLCB0aGUgcGF0Y2ggc28gZmFy IGRvZXMgbm90IGFkZHJlc3MgcGFyYXZpcnQsIGJ1dCBvdXIgZ29hbCBpcyB0byBhZGQgdGhpcyBz dXBwb3J0IG9uY2Ugd2UgYWRkcmVzcyBhbGwgdGhlIGNvbmNlcm5zIGZvciB0aGUgbmF0aXZlIHZl cnNpb24uCj4gU28gd2Ugd2lsbCBlbmQgdXAgd2l0aCBmb3VyIHZhcmlhbnRzIGZvciB0aGUgcXVl dWVkX3NwaW5sb2NrX3Nsb3dwYXRoKCkg4oCUIG9uZSBmb3IgZWFjaCBjb21iaW5hdGlvbiBvZiBu YXRpdmUvcGFyYXZpcnQgYW5kIE5VTUEvbm9uLU5VTUEuCj4gT3IgcGVyaGFwcyB3ZSBkbyBub3Qg bmVlZCBhIE5VTUEvcGFyYXZpcnQgdmFyaWFudD8KCkkgZG9uJ3QgZXhwZWN0IHdlIG5lZWQgYSBu dW1hIHZhcmlhbnQgZm9yIHBhcmF2aXJ0LiBGaXJzdCBvZiBhbGwsIHRoZQpOVU1BIGluZm9ybWF0 aW9uIGF2YWlsYWJsZSBpbiBhIFZNIGd1ZXN0IGlzIHVucmVsaWFibGUuIFNvIGxldCBqdXN0IG5v dApnbyB0aGVyZS4gV2hhdCB3ZSBhcmUgbG9va2luZyBmb3IgaXMgdG8gbWFrZSBzdXJlIHlvdXIg cGF0Y2ggd29uJ3QgYnJlYWsKdGhlIHBhcmF2aXJ0IGNvZGUuIFNvIHRlc3RpbmcgdGhlIHBhcmF2 aXJ0IHFzcGlubG9jayBzaG91bGQgYmUgcGFydCBvZgp5b3VyIHRlc3RpbmcgbWF0cml4LgoKQ2hl ZXJzLApMb25nbWFuCgoKCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fXwpsaW51eC1hcm0ta2VybmVsIG1haWxpbmcgbGlzdApsaW51eC1hcm0ta2VybmVsQGxp c3RzLmluZnJhZGVhZC5vcmcKaHR0cDovL2xpc3RzLmluZnJhZGVhZC5vcmcvbWFpbG1hbi9saXN0 aW5mby9saW51eC1hcm0ta2VybmVsCg==