From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751532AbeAZL3s (ORCPT ); Fri, 26 Jan 2018 06:29:48 -0500 Received: from mail-eopbgr20111.outbound.protection.outlook.com ([40.107.2.111]:20930 "EHLO EUR02-VE1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751219AbeAZL3p (ORCPT ); Fri, 26 Jan 2018 06:29:45 -0500 Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=eshatokhin@virtuozzo.com; Subject: Re: [PATCH v5 0/3] livepatch: introduce atomic replace To: Petr Mladek , Jason Baron Cc: linux-kernel@vger.kernel.org, live-patching@vger.kernel.org, jpoimboe@redhat.com, jeyu@kernel.org, jikos@kernel.org, mbenes@suse.cz, joe.lawrence@redhat.com References: <86cac2eb-0de4-bae7-f633-5ad03297880d@akamai.com> <20180126102326.u5jscbbgburrzatp@pathway.suse.cz> From: Evgenii Shatokhin Message-ID: Date: Fri, 26 Jan 2018 14:29:36 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.5.2 MIME-Version: 1.0 In-Reply-To: <20180126102326.u5jscbbgburrzatp@pathway.suse.cz> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [95.25.142.121] X-ClientProxiedBy: VI1PR0501CA0018.eurprd05.prod.outlook.com (2603:10a6:800:92::28) To VI1PR0802MB2445.eurprd08.prod.outlook.com (2603:10a6:800:bb::12) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 201bb76b-a0c7-421f-c848-08d564b017d6 X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(5600026)(4604075)(2017052603307)(7153060)(7193020);SRVR:VI1PR0802MB2445; X-Microsoft-Exchange-Diagnostics: 1;VI1PR0802MB2445;3:kwU/FF8WelI8SmkRU6RCHgF7wYGjHseOTC/oNpia5sirBKYicT9HFwD2IWOlPhMwYJwRBl01bb9Zl0NIQcK6LLhjZJPIxNOLSFGSQm0hX/saPIexTumZh6kicqc/dJkEf6TH6d7r9xxGjp2vQ5Pd8BSO4r+nSrzrpXSmgQCac1T/jkzPmJGiCaYfYBcF06PIPX6OrsyGiRbpbpPWsKxMa6PEbSuYh5VDbdpEc5ZdrJ9GrfNoHVRzK8J5t0nF3mqX;25:9j0EEhu0tIih+Y6AA7guUEeFXKhjuOEZEhNh5czSK7yFbyJOcUvh9aaCnSFGTOkV+vzoflZIl7g3PtlsZ3DWtSlsoFbty3ZeVS8yUTsK7OntpU0yNf+6MdVvl3DLAXmmRY8ZaRY2bVKrKQo5PQBxO06I2fqjbD1vIcBkbI/RWlVcVuN//nPmm6NtGa1XPFCZcYHJ04PDEyAaQajh1Rp7yQZTy3P6kUGaRzpYrkuQy7BtaP55Hp9Dm0f+I8bXSbwIQRFtyRkKfsDZROMKcbPDBUULGfUSH4RchQn/1QKLRdEQh5Er8RmkzVZGdqX8V0ay3lo8JV+wcnskw+QVQpHGbg==;31:xVSItVLjrfPt5/HdPCsP6D+bVXvnhcFZuXnx6CQ5eCKgOAGxD23UnoqDRNVtxbeKsoiql7onHNibRlTrNM/ooI8z6wI299Bt7CMuZ/SjHPsszegkEp0HifdggfTs3he9CHP3HGJX4AE2uj9gIbzSZETGW8I6a+/0Sn3V991IYN5HRkCmgwbGDuvsXqMmF/7LKCYL/1Q1iqWLJ8W1dp8cbDCIDLpJMNYt26vSMbWGuow= X-MS-TrafficTypeDiagnostic: VI1PR0802MB2445: X-Microsoft-Exchange-Diagnostics: 1;VI1PR0802MB2445;20:Iu3+bn4GWMuw/4Vi5olmCm+fZMhVKA5yUiByqQl3H9LuSjaGvWUUmGVJsciDlOEVFT9NNvfELBNFjtnXSY0rt57sW/U4jzusGjJe/tFt2crvLR2Dt1whU7uu5VC6oe3Zz+tw4WPGcycMJvfvN4YCE1mwVyvQ7dEQZkoxC7uslMRqG+aVB9yy3UjNxmjp04wagdHCU/QeePLjq0ru9VN+01cI3dcMBrY86fsYiBMby4j1g9wi9aMa+WsrQXP1iJ2sDl4m4I4S7v7kvTAz74PRLJoehqq8mOUItCZbErslgVVKRflIQ022IJBzdvKPDacHi9y2mwNGL5pCS1hIDtPEPnt8nI8v066/F0dr/vyjRYdjVOcZwtU26IhBzyvTsOMiqRwUdRQ6/0sPa01E8MjwpZGWhxnbce6CoeLaWHctSw4=;4:DDh2vDM4/f/+0m4tCvELn7IvWXegKDXbwCs7Tpp0IQMXh7r6Ygn6Lv82dlUYoThVY8owW2PHGJVxMI/F3Qd2/llSDEsrnOh9PF8SP+PM3p1UZjBlxVCsXpORdIItAEYzG5Wr6kOYjU5X1CdMT59AAwP+d+jEEqj6uyAvzIXEkIeoVJCt7DpQZ2eGt202b6wWdlE4zWmjui+wbqaxNjzhcVxCCaItnfJUhSHIKK8c7Sv6z0EKbt3+YtidhcYdSOQvP4MLxMSzX5WL5EdQDm+B++lvfMGsaHiDXU+bSMSYkXPIoJVBMfJGOr/VSbbjBrwf X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(788757137089); X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040501)(2401047)(5005006)(8121501046)(3002001)(10201501046)(3231023)(2400081)(944501161)(93006095)(93001095)(6041288)(20161123560045)(20161123562045)(20161123558120)(20161123564045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011);SRVR:VI1PR0802MB2445;BCL:0;PCL:0;RULEID:;SRVR:VI1PR0802MB2445; X-Forefront-PRVS: 05641FD966 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(6049001)(39380400002)(366004)(396003)(39830400003)(376002)(346002)(199004)(189003)(377424004)(6666003)(105586002)(478600001)(6246003)(65826007)(31686004)(50466002)(2950100002)(66066001)(65956001)(117156002)(8676002)(65806001)(93886005)(53936002)(106356001)(25786009)(316002)(5660300001)(16576012)(186003)(16526019)(110136005)(97736004)(77096007)(83506002)(230700001)(67846002)(58126008)(68736007)(229853002)(3846002)(86362001)(31696002)(76176011)(52116002)(59450400001)(23676004)(4326008)(52146003)(386003)(8936002)(6116002)(6486002)(53546011)(81156014)(81166006)(64126003)(7736002)(2906002)(47776003)(2486003)(36756003)(305945005)(26005);DIR:OUT;SFP:1102;SCL:1;SRVR:VI1PR0802MB2445;H:[192.168.0.101];FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtWSTFQUjA4MDJNQjI0NDU7MjM6RWRNSEtsTkdHQjl2WE1XeXJ6RzYyMC91?= =?utf-8?B?K0NBYkRQV1FWeHNienVIazJuMmEyV0lGNWdLckpFSlBQTTdnLzdvSzE3MmRv?= =?utf-8?B?MTFPYXBhOVZkRWQ3SEFtbWJvTmEyaGJCNzdVMURkcWhHdk90QjJ0ZmF1VDVn?= =?utf-8?B?aDU2VjJDUDRCSGJQeDcwUG9qMnF0T2dVZWx6ZEc4dDJhV3VYckk5TVh2K3Br?= =?utf-8?B?cHF5USt0dGVjNURUYngxK2tIc2JtTUVndDNLZkgwR1UxV3NSOEVJZk54QWQ1?= =?utf-8?B?VlhIbEN6ZTRMYXdsaDBRbmtWOFJSWFc0YVRXZUJVOTFlRk1GVjlZSlVRb01j?= =?utf-8?B?d0x6YjFia3VSZmR6dDhQQ3p1R0J2VXJxaVZYWjcwVEVCNnJjUTJGd0lUQzdT?= =?utf-8?B?YU1PUVYwUFlLcitqc2VBT0lxeGsrTVRLcmxnQlVhUTU3Y2R3K0d3azUyMVJ4?= =?utf-8?B?aGQ2Yzhqd2dHdGdPWGVGWjNSSE54djJ2enpFMWVEeTJjcTBwWllCV0tORzdq?= =?utf-8?B?RzlxMGc1dGtTVTRJYVlZWUdBQ2FlTEVaRDI4OEt2UUIweHBYRHB2amVNbDg4?= =?utf-8?B?VW95Ly93dllWS1F1SVY1RDk4Ym9lL1J1K3J6QmxwT3RXWjRkcEVITkNTWmcw?= =?utf-8?B?cmdCaDFDQXRtaG9weDA4aS9KaHp4a3hBSjYvejdlcE9sblZmY0FGZXQ1SXls?= =?utf-8?B?R0diV2tDYTZORitYc1ZtZnc4bGRXWlZuSko4dUVJU0hRMXBrNFFVdkNudFhK?= =?utf-8?B?UFQrcXkzYWtQeUgrUHo5Y21ERVh1U3pjUzdVY1E0ZVM3REIrcThHM0tjTVlL?= =?utf-8?B?NmhleXprTEwrQWhEUllaSVEzOTZIcm1uM0pPeXF1b21OYWJyNUs2bUpiNmZV?= =?utf-8?B?b1lrazdhckRXOUV6ZlovZnZJUDFlRzhEdFY3TVpyVHFxVTRac2JwZThTSTky?= =?utf-8?B?TTVJWU5BZWx3S0pBL0haeHJtdXlqbW5sZ0ZLUUxrUVN0OUxhSXh4ZXJrUnBR?= =?utf-8?B?d3Y1Z3NpWnp4REs2Y2k0dDdPQkgvbHZwVHRzUDdrNmRVcDEwWmsvbEFiTkpv?= =?utf-8?B?bkFnbEc4NWxKRjlpWW13U0pHZURRYm9UUDQ3UjMxVkZlL1ZkZ21JQlpCaXNl?= =?utf-8?B?TGMxVEVZNG9tSzdxUWNscFp3dlo0clM3TldRZkptV3F5M1FtWEVXNnJ5cG9q?= =?utf-8?B?MldySUlnSU96NDlWSlliVjdCUW1MSElGTnQ1Njl0TGlmdVM1UmxiRjJ1WDk2?= =?utf-8?B?TE5OelFFaDE2QkdyR3BzdTBXa2NlS2J6VzJwNE1hbmJyRzlyM2ZqdS9LblpJ?= =?utf-8?B?MUFWcDRKbTJFK0xBVXB4L0JmY25qOE12Wk4xd3JLMDExbmR3cnphQ2k3dkpN?= =?utf-8?B?OVFVK2QyMWU2Q1pEd3doWUJRUGdKTmdPV1NvUTlMUExVbzJHQzZzYzhwTUlk?= =?utf-8?B?UUhwbGt6RWxEdjJWdnhPNkxYcm5KdTV2b21wdDFKWElsM0U0emY4TllTTFda?= =?utf-8?B?Tm02S3JmNGM1SVNHcnRuOERzNWdjdDBDdFBzbWViY1ZTVm1lcFFaSmpEVkpz?= =?utf-8?B?MHMyc2syVWN3UTJuNVduWHUzSDBQSE1uMlErT29nMjMxME5qWEpYUkl6aFQv?= =?utf-8?B?bjhOaFNaTWZiTHcrcDZ3STdkRE1EaFMwVlpRb2g0MmdQTmlTSEVlcndQNVdG?= =?utf-8?B?WmRET0RRcmsxbUhWVHR3R3V5NUVOeTFjTVErc2srYnlTRW5pL3JLcXRjU08y?= =?utf-8?B?SzNjSkM4V3htVVByR0xpQTZyMEtPa083N0diRVVEa0xTWFhwUXNZUnpVLzZH?= =?utf-8?B?clkzZm5URlZRY1lLK01WM09ha2JCUEc5Rmtvb291emVOc1FGb0g2RUxBclJn?= =?utf-8?B?cjdEZnJGc0w2MXJxeWE5UUJ4a3hseVNyN3J2eEtaK3lSY3dIUEd6U1hQdFNh?= =?utf-8?B?YjFqMlUxekpHM3RiRXF6YTdQbkp4R3ptZFNpS0doNFhxRVpFcjBlYzBVM2s0?= =?utf-8?B?MENMdWxxaXhBN2tjVlVIVDJJSjBEV1ZXc1BMVzZBPT0=?= X-Microsoft-Exchange-Diagnostics: 1;VI1PR0802MB2445;6:DbQ7AeSdmFzjWfoxe2O+lr6KUNhrWVKx5LPRj0v6Ad8rZ3thcYE9l6xwSGDFWuHT82JHiaJSGcj9xs3Caoo7rK4Sqr4LHqMJC0nnu7pMLpsJIxrXY3wJlcd0CFeVdOfATfuFSP6FlIrxPZodWJeSXjSmPPR4oJmpxfWmAPbY18krbOytst9mQ5MlQp/NDXJk6MlNgHD9O+nsPzFgfknxmN7nRn+S9pij4gFkiObJT6VUKkTYFYfTUtKhQ5QlIUZs5/JSi/lAwZu6ZNEgt7YZX2dRJRmx5poaCTNWs0MW/se2OO5dLQGQeuINnt4MPUbt9a0pRzDX5GPDHbxIgA7xeNijpdHGYj8utaVPqw/pWXM=;5:ifG/qVIHaoIrK9p3cdIcihbgjE2KC8k791fXZU1dMOWaP0wRHzzzN7H1IqDYgH6fBkhkyD5Q58bgCDSbXZqWbZVFA9EXjbVXG2+QhJT7RC7MFxxKR5EYFVZZII5x2bDs1buxqxNaivzLuvUhlrzzcPxF1Wjyoa6fPDSwMAd2hKg=;24:hD3EvDCkZ0GwSgChwhDVBskYpBRZi2T2y+nkxcENHmdIQqjF5+SXFRoJBJKPJgImH+9aZPsFvLUdDdOZyKlBtQDTx4Lj5aEjcPB6C68Lfuc=;7:YvaeJune0uyve2Crv8gbUWmod9M0U9Ds/Ag0JWTHiDyMMU7e6PCdzUeKTkhNEcGSGpggoWF0O0XHHsyySy/G5AFOWBR1a29aDbbpxbxw3/PCs/U6bexOq3nVe1pXPDcWcXmjsr9q5tfFYVgaKu/v5ZjPv1K1YIgykQ0L/eW4SrrujL6Igpnn2x/BUNcSX9OVb8MA8IZ9bqySKWjzBcbJrhAGAu0wmkuauu95JUCYRdv1ars518aGzNrZ8LN1/v1x SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;VI1PR0802MB2445;20:TTTZrowMWcWuSUEU/TGVCXJcxyWbBmauNIAwkfd6s+8XaBYwHoT8QLxvvKDGec/u3SUJ6owjmsEJywI0jfIUtRS5Z5TQ9hdrcZ5x5D8Bc5o5PRcu/3oiatE9oaoBMFDP4OchlYcBf5SAg89giciNJAFwzfHqzzrjSs3S8EZhYFI= X-OriginatorOrg: virtuozzo.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Jan 2018 11:29:41.3516 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 201bb76b-a0c7-421f-c848-08d564b017d6 X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 0bc7f26d-0264-416e-a6fc-8352af79c58f X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR0802MB2445 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 26.01.2018 13:23, Petr Mladek wrote: > On Fri 2018-01-19 16:10:42, Jason Baron wrote: >> >> >> On 01/19/2018 02:20 PM, Evgenii Shatokhin wrote: >>> On 12.01.2018 22:55, Jason Baron wrote: >>> There is one more thing that might need attention here. In my >>> experiments with this patch series, I saw that unpatch callbacks are not >>> called for the older binary patch (the one being replaced). >> >> So I think the pre_unpatch() can be called for any prior livepatch >> modules from __klp_enable_patch(). Perhaps in reverse order of loading >> (if there is more than one), and *before* the pre_patch() for the >> livepatch module being loaded. Then, if it sucessfully patches in >> klp_complete_transition() the post_unpatch() can be called for any prior >> livepatch modules as well. I think again it makes sense to call the >> post_unpatch() for prior modules *before* the post_patch() for the >> current livepatch modules. > > I played with this when working on v6. And I am not sure if it is > worth it. > > The main reason is that we are talking about cumulative patches. > They are supposed to preserve most of the existing changes and > just remove and/or add few changes. The older patches might or > might not expect to be replaced this way. > > If we would decide to run callbacks from the replaced patches > then it would make sense to run the one from the new patch > first. It is because we might need to do some hacks to preserve > the already existing changes. > > We might need something like this for __klp_enable_patch(): > > static int klp_run_pre_patch_callbacks(struct klp_patch *patch) > { > struct klp_patch *old_patch; > struct klp_object *old_obj; > int ret; > > list_for_each_entry_reverse(old_patch, &klp_patches, list) { > if (!old_patch->enabled && old_patch != patch) > continue; > > klp_for_each_object(old_patch, old_obj) { > if (!klp_is_object_loaded()) > continue; > > if (old_patch == patch) { > /* pre_patch from new patch */ > ret = klp_pre_patch_callback(obj); > if (ret) > return ret; > if (!patch->replace) > return; > } else { > /* preunpatch from replaced patches */ > klp_pre_unpatch_callback(obj); > } > } > } > > return 0; > } > > This was quite hairy. Alternative would be: > > static void klp_run_pre_unpatch_callbacks_when_replacing(struct klp_patch *patch) > { > struct klp_patch *old_patch; > struct klp_object *old_obj; > > if (WARN_ON(!patch->replace)) > return; > > list_for_each_entry_reverse(old_patch, &klp_patches, list) { > if (!old_patch->enabled || old_patch == patch) > continue; > > klp_for_each_object(old_patch, old_obj) { > if (!klp_is_object_loaded()) > continue; > > klp_pre_unpatch_callback(obj); > } > } > } > > static int klp_run_pre_patch_callbacks(struct klp_patch *patch) > { > struct klp_object *old_obj; > int ret; > > klp_for_each_object(patch, old_obj) { > if (!klp_is_object_loaded()) > continue; > > ret = klp_pre_patch_callback(obj); > if (ret) > return ret; > } > > if (patch->replace) > klp_run_pre_unpatch_callbacks_when_replacing(patch); > > return 0; > } > > 2nd variant is easier to read but a lot of code. And this is only > what we would need for __klp_enable_patch(). But we would need > solution also for: > > klp_cancel_transition(); > klp_try_transition(); (2 variants for patching and unpatching) > klp_module_coming(); > klp_module_going(); > > > > So, we are talking about a lot of rather non-trivial code. > IMHO, it might be easier to run just the callbacks from > the new patch. In reality, the author should always know > what it might be replacing and what needs to be done. > > By other words, it might be much easier to handle all > situations in a single script in the new patch. Alternative > would be doing crazy hacks to prevent the older scripts from > destroying what we would like to keep. We would need to > keep in mind interactions between the scripts and > the order in which they are called. > > Or do you plan to use cumulative patches to simply > get rid of any other "random" livepatches with something > completely different? In this case, it might be much more > safe to disable the older patches a normal way. In my experience, it was quite convenient sometimes to just "replace all binary patches the user currently has loaded with this single one". No matter what these original binary patches did and where they came from. Another problematic situation is when you need to actually downgrade a cumulative patch. Should be rare, but... Well, I think we will disable the old patches explicitly in these cases, before loading of the new one. May be fragile but easier to maintain. > > I would suggest to just document the current behavior. > We should create Documentation/livepatch/cummulative-patches.txt > anyway. Yes, this would be helpful, because the behaviour is not very obvious. Regards, Evgenii > > Best Regards, > Petr > . >