From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 22875C77B6E for ; Fri, 14 Apr 2023 03:27:30 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id A5271900003; Thu, 13 Apr 2023 23:27:29 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id A0317900002; Thu, 13 Apr 2023 23:27:29 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 8A3A4900003; Thu, 13 Apr 2023 23:27:29 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 77207900002 for ; Thu, 13 Apr 2023 23:27:29 -0400 (EDT) Received: from smtpin21.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id 44FAC404EF for ; Fri, 14 Apr 2023 03:27:29 +0000 (UTC) X-FDA: 80678561418.21.7EC183B Received: from boar.tulip.relay.mailchannels.net (boar.tulip.relay.mailchannels.net [23.83.218.250]) by imf30.hostedemail.com (Postfix) with ESMTP id 1189D80004 for ; Fri, 14 Apr 2023 03:27:25 +0000 (UTC) Authentication-Results: imf30.hostedemail.com; dkim=pass header.d=stancevic.com header.s=dreamhost header.b=vhwHM4Nc; spf=pass (imf30.hostedemail.com: domain of dragan@stancevic.com designates 23.83.218.250 as permitted sender) smtp.mailfrom=dragan@stancevic.com; arc=pass ("mailchannels.net:s=arc-2022:i=1"); dmarc=none ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1681442847; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=FThEB5rx1CmZDbeaRmPeZu6YcPOHSHQi0j3F5edbnoQ=; b=lfmSXGzqk9GOytpGTxzrrh/gET+HRIwDX/9RgBoJsIsr2n61JFZpjbwWsB0myzSpaqfVuH T3+/eenI7kruZuruU/TZFeH1K1VnUw6i0KQJba9EVhx0eYrjUjKuiD4v7TvuBY+jx3+OSX x6GjvQEWTQHOwqkAv64P1pnfP+T+Y44= ARC-Authentication-Results: i=2; imf30.hostedemail.com; dkim=pass header.d=stancevic.com header.s=dreamhost header.b=vhwHM4Nc; spf=pass (imf30.hostedemail.com: domain of dragan@stancevic.com designates 23.83.218.250 as permitted sender) smtp.mailfrom=dragan@stancevic.com; arc=pass ("mailchannels.net:s=arc-2022:i=1"); dmarc=none ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1681442847; a=rsa-sha256; cv=pass; b=EFnOo8r33SVbGnqTRYRt4WFTBV3nt5LKP88O+LRnh5zKEqW+cv2NsAcrLRov7TPDgnD7Gf 9R0h4YJ0ldafBsWvccqzMzhxAxKYzXdK90oDZkI4DuWRKYGy2oswvY+qLnPn2q9WQhCBF/ H/qP945BSGRhYnlQl5hqAWHO0mJd+hE= X-Sender-Id: dreamhost|x-authsender|dragan@stancevic.com Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id 9815C501E67; Fri, 14 Apr 2023 03:27:21 +0000 (UTC) Received: from pdx1-sub0-mail-a207.dreamhost.com (unknown [127.0.0.6]) (Authenticated sender: dreamhost) by relay.mailchannels.net (Postfix) with ESMTPA id F3304501DD3; Fri, 14 Apr 2023 03:27:20 +0000 (UTC) ARC-Seal: i=1; s=arc-2022; d=mailchannels.net; t=1681442841; a=rsa-sha256; cv=none; b=aLYTobt89cI8jjAp1guUouiR0WtNxd9bZwF5N1GyFLasNytN4GfGNrtNONIzLzgh+FhM+P QTzWq2uUZs2BjktGkfprmUCZHxOBHJjtmRSn0FJzxeS4/zh2RFxZIbmukyGfq9PV1eIFZP G/gE73RVXBQor5/c//UhHqPxtcJ+HVy6lKL2Nar0qmwavhCcrlg0iImnRJfeyTEjejBWgj 0cVMo5Y0FF8QmrvyHSIKWxb+TcOWNvsxa/BS96jx9GpKtg01TH94DfIB4vYw2CGmqbvIZE RWZJtaHDi+I6GcDMYNfj+FA4bSgg8knmJM5ZJGSCVmSO1b//QQuy8pophHvhZA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=mailchannels.net; s=arc-2022; t=1681442841; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=FThEB5rx1CmZDbeaRmPeZu6YcPOHSHQi0j3F5edbnoQ=; b=dDLw11ltNqCt9qDHR7yodbKWA/GaZvkjP+Ksswu2Ytl9ArGLbdEwCFMgGbcHhEnKwAVPy4 W346lhJPu9yR5n6AwPge+aUrvPJEGT+wFC5NdfzOF1Cp6mha9aswJ6AN/rEZcQjVxijGpJ JWsc8h5nNYQ2wEQdKZDnRkHCnMl/ZOLv1FdBQTUunTFicWMXqXeaZ70ACQdrhj8flrWScV YUlahTE2/BYQybuYLJ9I4ubSHAnucSvg1fycZUAxoe27LKizL68vLLJp1GYBZMgnjlZRPM 8OwGfTGZ71dBV8okWHbntygLCfFYiyXhJ9wpFHhNnpXS67K07BWTu0eLh0KylA== ARC-Authentication-Results: i=1; rspamd-548d6c8f77-4kznw; auth=pass smtp.auth=dreamhost smtp.mailfrom=dragan@stancevic.com X-Sender-Id: dreamhost|x-authsender|dragan@stancevic.com X-MC-Relay: Neutral X-MailChannels-SenderId: dreamhost|x-authsender|dragan@stancevic.com X-MailChannels-Auth-Id: dreamhost X-Share-Towering: 2619d92b38461706_1681442841422_2092118245 X-MC-Loop-Signature: 1681442841422:3568380269 X-MC-Ingress-Time: 1681442841422 Received: from pdx1-sub0-mail-a207.dreamhost.com (pop.dreamhost.com [64.90.62.162]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384) by 100.125.42.185 (trex/6.7.2); Fri, 14 Apr 2023 03:27:21 +0000 Received: from [192.168.1.31] (99-160-136-52.lightspeed.nsvltn.sbcglobal.net [99.160.136.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) (Authenticated sender: dragan@stancevic.com) by pdx1-sub0-mail-a207.dreamhost.com (Postfix) with ESMTPSA id 4PyMMC489qz29; Thu, 13 Apr 2023 20:27:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=stancevic.com; s=dreamhost; t=1681442840; bh=FThEB5rx1CmZDbeaRmPeZu6YcPOHSHQi0j3F5edbnoQ=; h=Date:Subject:To:Cc:From:Content-Type:Content-Transfer-Encoding; b=vhwHM4NczR6ICPelvWMlkJsD/Z6+WmJ4mpjkWHpnpsG9LwaF7BsdLSmqi3X8VR0PD Qs3zsKe83peWKKv+IwiQ2m8xx0leg+Ir62/X9iH1P8zINu4aRMrwntR8PLLfGhInTN vVXR615SOr94Qb7gOp2GdOveOrp7v/Isf3Ks8V6Z+5xk5W/kGv8fALkgar2/GVpheT l0Sl+f8e8zAq/QCH2sn5ScEF5z2RoEKFkOBY81k8XUf3n/vHTR5ovq3OgT6LQdaJdI oUxlU5UA61u+HccLjgr2jgvXP34AWSiMhe/0UxcnlElRrBDQBhIsC09F2ARS4rnHQq YH2pQDxxDZZ0w== Message-ID: <14f90e3f-f438-01b5-8f25-05b0f1cf2148@stancevic.com> Date: Thu, 13 Apr 2023 22:27:18 -0500 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.9.0 Subject: Re: [LSF/MM/BPF TOPIC] BoF VM live migration over CXL memory Content-Language: en-US To: Kyungsan Kim Cc: lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, linux-cxl@vger.kernel.org, a.manzanares@samsung.com, viacheslav.dubeyko@bytedance.com, dan.j.williams@intel.com, seungjun.ha@samsung.com, wj28.lee@samsung.com References: <5d1156eb-02ae-a6cc-54bb-db3df3ca0597@stancevic.com> <20230410030532.427842-1-ks0204.kim@samsung.com> From: Dragan Stancevic In-Reply-To: <20230410030532.427842-1-ks0204.kim@samsung.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspam-User: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 1189D80004 X-Stat-Signature: 148o8rncfe4drxhkrtb1iyx1u9wb3k1z X-HE-Tag: 1681442845-894489 X-HE-Meta: U2FsdGVkX18rp+NYuvpzbGyjA9zdg1fKQuMHnl6oiYsOlQivvtNSeD8lINIViSfN3zPk81r2r7hIgWfP711QfQnK12U5+rtXphlc6mFql5B7Q5wjcy/99nb+S9deTFQuwLRRp+1Tfp8vfJtYlwZM7r1sZw9ghGEBaJo5wQIx0raJNDhhrYO9iRB6SMStAKVd6P1gy4EOMkTU1l/6b3OLsHNsH9kh0EoNNcDWKIrYUe7FP0YcT4neVt2hZ8GOmf2bD+qAj5C9wcqGOs0+/9JOwnF6Ot2DS2AiT6zoFeDF6uJCVDdqUNc4Apt9mmLMz0fyKuc7E6Y1mG2yUUVJF/iY55do4ULfJxua8YEetmxpcA+Uoe8eJD4EW3THuVuRWLtKRuLZw5kS2mX0hDOZBM/oIVdn/M2PY3fJ8oYc/hnQkdFudrI8Wg7rhDScTnDXVZRwB7a1XLy8YfK48+e7ZqGjO/ZC/Jfk0i20YjosMduhc3EMQe5Pe3KhDG/11OzGCYRU/BhwL3zRjs3pN4R8WEH0d6EF3JyWt1AAQP7chSFhFNCNTck++vkVeHHWg6TfJ8joTU5c+lW7vCPPspfs3X9IEYsrUTtRVm0O7dzvKTqLObOF4AzbHHAAD9hRfjcI+yeqebzrDG2PbT7jKeKbQqNZ3eLlPANXxB3cgDOmT33yefzdeF8+f2To+Cq3DdTmrjegPHW8aJ9ExKLKO0qL21NR6uN/d5p18H7dZ5z0GPYsbo2Ru6GtW35eDJyQRPo+OjmMsySbsSUNWOKMPz26aKn0+xQL7satttBowagIz6E0FlyLXUt1z3Y8qlOdNecsqZbp5cuz8SxdZ+NXReXPrZXXm8EyubVYsE2Zzs+89lZQlEvjg0YynskJ9Dl0CB9uQb+3rweCgxTkuNqA76mpNK2K3h4nhmxiw7dDBiPGIgkDCje2mOe0audvVEFtS9VN9C8iRx08u95eM1fLqhH3mBa sp7pViJS 77KMQ9uYdNFu8Kg4AsU0rQf8VRd0i5qDMt6oPnoiJCKIXRu056kL0yrkfVWXWmOzK34OUlyVbQf0yiFPbi4XFyu6rPLm2cVlOdBcBhiSRLI0tvt+6bmrq68aV9N71c6pdKRq0URJHI1Hl3WvUa9N/SnK9LLXa838UmfctEoDAhqJBkRTUgmG69VYrQ3/4cOwxDGCbFfVWp9ldKq46fzGstBIXAnm3Cd6GeEQStXTNVRHpMOJ/cX676ccvo04iAxE/OcqzX8AFD5NInPK+wQQ9cXcdPna+dStk0ZG1AWorCkt3wSr/oXTGzTzDHNH8iEDAsYfA0gGrx/7v2XXQ2LfPQLzORd2z37OUEWFAALzpolVdf0ZkMX69VX0cDQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi Kyungsan- On 4/9/23 22:05, Kyungsan Kim wrote: >> Hi folks- >> >> if it's not too late for the schedule... >> >> I am starting to tackle VM live migration and hypervisor clustering over >> switched CXL memory[1][2], intended for cloud virtualization types of loads. >> >> I'd be interested in doing a small BoF session with some slides and get >> into a discussion/brainstorming with other people that deal with VM/LM >> cloud loads. Among other things to discuss would be page migrations over >> switched CXL memory, shared in-memory ABI to allow VM hand-off between >> hypervisors, etc... >> >> A few of us discussed some of this under the ZONE_XMEM thread, but I >> figured it might be better to start a separate thread. >> >> If there is interested, thank you. > > I would like join the discussion as well. > Let me kindly suggest it would be more great if it includes the data flow of VM/hypervisor as background and kernel interaction expected. Thank you for the suggestion, have you had a chance to check out http://nil-migration.org/ I have a high-level data flow between hypervisors, both for VM migration and hypervisor clustering. If that is not enough, I can definitely throw more things together. Let me know, thank you >> >> >> [1]. High-level overview available at http://nil-migration.org/ >> [2]. Based on CXL spec 3.0 >> >> -- >> Peace can only come as a natural consequence >> of universal enlightenment -Dr. Nikola Tesla > -- -- Peace can only come as a natural consequence of universal enlightenment -Dr. Nikola Tesla