From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.1 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 66DC6C3F2D1 for ; Wed, 4 Mar 2020 19:47:01 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 201602166E for ; Wed, 4 Mar 2020 19:47:01 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b="ron8VX5F" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 201602166E Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=oracle.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:38970 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1j9Zyu-0001CY-Ab for qemu-devel@archiver.kernel.org; Wed, 04 Mar 2020 14:47:00 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:47831) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1j9Zxo-0000LW-IK for qemu-devel@nongnu.org; Wed, 04 Mar 2020 14:45:54 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1j9Zxj-0001L5-1b for qemu-devel@nongnu.org; Wed, 04 Mar 2020 14:45:51 -0500 Received: from userp2130.oracle.com ([156.151.31.86]:60638) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1j9Zxi-0001KT-Lw for qemu-devel@nongnu.org; Wed, 04 Mar 2020 14:45:46 -0500 Received: from pps.filterd (userp2130.oracle.com [127.0.0.1]) by userp2130.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 024JXtc9033518; Wed, 4 Mar 2020 19:45:35 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : to : cc : references : from : message-id : date : mime-version : in-reply-to : content-type : content-transfer-encoding; s=corp-2020-01-29; bh=4dGqHlEHA+OxCXFyO6C92XmWAqF75aiRFltVhLs8XSU=; b=ron8VX5FNfLH1NnQ4QaIPMJmT9jkO9GCVsx0Y659UdhjseXdxjFt6PqEE3tW67gplsRT lApb3YxJkARUAtfhHrqSRkScw6T4sjVd96Hpd46v4hJABdkoUTkj232UNgHiwJk2lnWf n3TmaNMqucnYdYHLTa0YSCgwNQjz2cRuF/DHSE69WXKPPelTvn1L5pMCHQ9MKwf70f7O zwfZz59OzL1XrVmbUHvVJXmPnkAah8dJ8DsA+ouIxvFxTyJQq2KZ9EssjOuoFkK1yC3e Od+Xti/11wR05a4cvBGPjw3oVeSVsnD6p3FjGJ/BODNVaLyZ8O9+FlzJwrMzdoPFcn5f BA== Received: from aserp3030.oracle.com (aserp3030.oracle.com [141.146.126.71]) by userp2130.oracle.com with ESMTP id 2yffcurmth-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 04 Mar 2020 19:45:35 +0000 Received: from pps.filterd (aserp3030.oracle.com [127.0.0.1]) by aserp3030.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 024JhDUc130023; Wed, 4 Mar 2020 19:45:35 GMT Received: from userv0121.oracle.com (userv0121.oracle.com [156.151.31.72]) by aserp3030.oracle.com with ESMTP id 2yg1h1jeep-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 04 Mar 2020 19:45:34 +0000 Received: from abhmp0001.oracle.com (abhmp0001.oracle.com [141.146.116.7]) by userv0121.oracle.com (8.14.4/8.13.8) with ESMTP id 024JjVLp027573; Wed, 4 Mar 2020 19:45:31 GMT Received: from [10.152.34.2] (/10.152.34.2) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Wed, 04 Mar 2020 11:45:31 -0800 Subject: Re: [PATCH v5 40/50] multi-process/mig: build migration module in the remote process To: "Dr. David Alan Gilbert" References: <96a495711764282ff90504cec6734eff563ceb4d.1582576372.git.jag.raman@oracle.com> <20200304155859.GG4104@work-vm> From: Jag Raman Organization: Oracle Corporation Message-ID: <240f3182-80bb-f808-f93a-a41634eaff54@oracle.com> Date: Wed, 4 Mar 2020 14:45:28 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.5.0 MIME-Version: 1.0 In-Reply-To: <20200304155859.GG4104@work-vm> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9550 signatures=668685 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 phishscore=0 suspectscore=0 malwarescore=0 mlxlogscore=999 mlxscore=0 spamscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2001150001 definitions=main-2003040128 X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9550 signatures=668685 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 mlxscore=0 bulkscore=0 adultscore=0 suspectscore=0 spamscore=0 malwarescore=0 impostorscore=0 priorityscore=1501 mlxlogscore=999 lowpriorityscore=0 clxscore=1015 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2001150001 definitions=main-2003040128 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x [generic] [fuzzy] X-Received-From: 156.151.31.86 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: elena.ufimtseva@oracle.com, fam@euphon.net, swapnil.ingle@nutanix.com, john.g.johnson@oracle.com, qemu-devel@nongnu.org, kraxel@redhat.com, quintela@redhat.com, mst@redhat.com, armbru@redhat.com, kanth.ghatraju@oracle.com, felipe@nutanix.com, thuth@redhat.com, ehabkost@redhat.com, konrad.wilk@oracle.com, liran.alon@oracle.com, stefanha@redhat.com, thanos.makatos@nutanix.com, rth@twiddle.net, kwolf@redhat.com, berrange@redhat.com, mreitz@redhat.com, ross.lagerwall@citrix.com, marcandre.lureau@gmail.com, pbonzini@redhat.com Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On 3/4/2020 10:58 AM, Dr. David Alan Gilbert wrote: > * Jagannathan Raman (jag.raman@oracle.com) wrote: >> Add Makefile support to enable migration in remote process >> >> Signed-off-by: Elena Ufimtseva >> Signed-off-by: John G Johnson >> Signed-off-by: Jagannathan Raman >> --- >> Makefile.objs | 4 +++- >> Makefile.target | 1 + >> migration/Makefile.objs | 13 ++++++++++++- >> net/Makefile.objs | 2 ++ >> softmmu/vl.c | 2 -- >> stubs/migration.c | 49 +++++++++++++++++++++++++++++++++++++++++++++++++ >> stubs/net-stub.c | 21 +++++++++++++++++++++ >> stubs/qapi-misc.c | 2 ++ >> stubs/replay.c | 8 ++++++++ >> stubs/vl-stub.c | 24 ++++++++++++++++++++++++ >> vl-parse.c | 3 +++ >> 11 files changed, 125 insertions(+), 4 deletions(-) >> >> diff --git a/Makefile.objs b/Makefile.objs >> index 4b5db09..65009da 100644 >> --- a/Makefile.objs >> +++ b/Makefile.objs >> @@ -74,6 +74,8 @@ common-obj-y += qdev-monitor.o device-hotplug.o >> common-obj-$(CONFIG_WIN32) += os-win32.o >> common-obj-$(CONFIG_POSIX) += os-posix.o >> >> +remote-pci-obj-$(CONFIG_POSIX) += os-posix.o >> + >> common-obj-$(CONFIG_LINUX) += fsdev/ >> >> common-obj-y += accel/ >> @@ -104,11 +106,11 @@ common-obj-y += vl-parse.o >> >> ####################################################################### >> # qapi >> - >> common-obj-y += qapi/ >> >> endif # CONFIG_SOFTMMU >> >> +remote-pci-obj-$(CONFIG_MPQEMU) += net/ >> remote-pci-obj-$(CONFIG_MPQEMU) += qapi/ >> remote-pci-obj-$(CONFIG_MPQEMU) += blockdev-nbd.o >> remote-pci-obj-$(CONFIG_MPQEMU) += job-qmp.o >> diff --git a/Makefile.target b/Makefile.target >> index 4ead5c3..4012ae5 100644 >> --- a/Makefile.target >> +++ b/Makefile.target >> @@ -240,6 +240,7 @@ all-remote-pci-obj-y += exec.o >> all-remote-pci-obj-y += exec-vary.o >> all-remote-pci-obj-y += ioport.o >> all-remote-pci-obj-y += cpus.o >> +all-remote-pci-obj-y += migration/ram.o >> endif >> >> remote-pci-obj-y := >> diff --git a/migration/Makefile.objs b/migration/Makefile.objs >> index e7cdc76..21f9d8d 100644 >> --- a/migration/Makefile.objs >> +++ b/migration/Makefile.objs >> @@ -15,4 +15,15 @@ common-obj-$(CONFIG_LIVE_BLOCK_MIGRATION) += block.o >> >> rdma.o-libs := $(RDMA_LIBS) >> >> -remote-pci-obj-$(CONFIG_MPQEMU) += qemu-file.o vmstate.o qjson.o vmstate-types.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += migration.o socket.o fd.o exec.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += tls.o channel.o savevm.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += colo.o colo-failover.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += vmstate.o vmstate-types.o page_cache.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += qemu-file.o global_state.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += qemu-file-channel.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += xbzrle.o postcopy-ram.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += qjson.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += block-dirty-bitmap.o >> +remote-pci-obj-$(CONFIG_RDMA) += rdma.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += block.o >> +remote-pci-obj-$(CONFIG_MPQEMU) += multifd.o > > Hmm, are you really going to want all this lot in your remote process? > Assuming it's just devices, I can understand the first line or two, but > it seems odd to have all of this. Yeah, we ended up needing to compile these in to enable migration. We are only using "fd" to enable migration. Although we don't use tls, xbzrle, rdma, multifd, etc... for example, the migration code does support these protocols and, therefore, we had to compile them in. Thank you! -- Jag > > Dave > >> diff --git a/net/Makefile.objs b/net/Makefile.objs >> index c5d076d..a8ad986 100644 >> --- a/net/Makefile.objs >> +++ b/net/Makefile.objs >> @@ -30,3 +30,5 @@ common-obj-$(CONFIG_WIN32) += tap-win32.o >> vde.o-libs = $(VDE_LIBS) >> >> common-obj-$(CONFIG_CAN_BUS) += can/ >> + >> +remote-pci-obj-$(CONFIG_MPQEMU) += announce.o >> diff --git a/softmmu/vl.c b/softmmu/vl.c >> index 4a4f52c..42d5682 100644 >> --- a/softmmu/vl.c >> +++ b/softmmu/vl.c >> @@ -128,7 +128,6 @@ const char* keyboard_layout = NULL; >> ram_addr_t ram_size; >> const char *mem_path = NULL; >> int mem_prealloc = 0; /* force preallocation of physical target memory */ >> -bool enable_mlock = false; >> bool enable_cpu_pm = false; >> int nb_nics; >> NICInfo nd_table[MAX_NICS]; >> @@ -168,7 +167,6 @@ const char *prom_envs[MAX_PROM_ENVS]; >> int boot_menu; >> bool boot_strict; >> uint8_t *boot_splash_filedata; >> -int only_migratable; /* turn it off unless user states otherwise */ >> bool wakeup_suspend_enabled; >> >> int icount_align_option; >> diff --git a/stubs/migration.c b/stubs/migration.c >> index 28ccf80..dbd12db 100644 >> --- a/stubs/migration.c >> +++ b/stubs/migration.c >> @@ -6,6 +6,35 @@ >> #include "qapi/qapi-types-migration.h" >> #include "qapi/qapi-commands-migration.h" >> #include "qapi/qapi-types-net.h" >> +#include "net/filter.h" >> +#include "net/colo-compare.h" >> + >> +#pragma weak qmp_query_migrate_capabilities >> +#pragma weak qmp_query_migrate_parameters >> +#pragma weak migrate_announce_params >> +#pragma weak qmp_query_migrate >> +#pragma weak qmp_migrate_set_capabilities >> +#pragma weak qmp_migrate_set_parameters >> +#pragma weak qmp_migrate_incoming >> +#pragma weak qmp_migrate_recover >> +#pragma weak qmp_migrate_pause >> +#pragma weak qmp_migrate >> +#pragma weak qmp_migrate_cancel >> +#pragma weak qmp_migrate_continue >> +#pragma weak qmp_migrate_set_cache_size >> +#pragma weak qmp_query_migrate_cache_size >> +#pragma weak qmp_migrate_set_speed >> +#pragma weak qmp_migrate_set_downtime >> +#pragma weak qmp_migrate_start_postcopy >> +#pragma weak migration_global_dump >> +#pragma weak save_snapshot >> +#pragma weak qmp_xen_save_devices_state >> +#pragma weak load_snapshot >> +#pragma weak qmp_xen_set_replication >> +#pragma weak qmp_query_xen_replication_status >> +#pragma weak qmp_xen_colo_do_checkpoint >> +#pragma weak qmp_query_colo_status >> +#pragma weak qmp_x_colo_lost_heartbeat >> >> MigrationInfo *qmp_query_migrate(Error **errp) >> { >> @@ -160,3 +189,23 @@ AnnounceParameters *migrate_announce_params(void) >> >> return NULL; >> } >> + >> +void colo_notify_filters_event(int event, Error **errp) >> +{ >> + qemu_debug_assert(0); >> +} >> + >> +void colo_notify_compares_event(void *opaque, int event, Error **errp) >> +{ >> + qemu_debug_assert(0); >> +} >> + >> +void colo_compare_register_notifier(Notifier *notify) >> +{ >> + qemu_debug_assert(0); >> +} >> + >> +void colo_compare_unregister_notifier(Notifier *notify) >> +{ >> + qemu_debug_assert(0); >> +} >> diff --git a/stubs/net-stub.c b/stubs/net-stub.c >> index 962827e..ddfd1e4 100644 >> --- a/stubs/net-stub.c >> +++ b/stubs/net-stub.c >> @@ -5,6 +5,8 @@ >> #include "qapi/qapi-commands-net.h" >> #include "qapi/qapi-commands-rocker.h" >> >> +#pragma weak qmp_announce_self >> + >> int qemu_find_net_clients_except(const char *id, NetClientState **ncs, >> NetClientDriver type, int max) >> { >> @@ -98,3 +100,22 @@ void netdev_add(QemuOpts *opts, Error **errp) >> { >> qemu_debug_assert(0); >> } >> + >> +NetClientState *qemu_get_queue(NICState *nic) >> +{ >> + qemu_debug_assert(0); >> + >> + return NULL; >> +} >> + >> +ssize_t qemu_send_packet_raw(NetClientState *nc, const uint8_t *buf, int size) >> +{ >> + qemu_debug_assert(0); >> + >> + return 0; >> +} >> + >> +void qemu_foreach_nic(qemu_nic_foreach func, void *opaque) >> +{ >> + qemu_debug_assert(0); >> +} >> diff --git a/stubs/qapi-misc.c b/stubs/qapi-misc.c >> index 3eeedd9..824eac1 100644 >> --- a/stubs/qapi-misc.c >> +++ b/stubs/qapi-misc.c >> @@ -5,6 +5,8 @@ >> #include "./qapi/qapi-types-dump.h" >> #include "qapi/qapi-commands-dump.h" >> >> +#pragma weak qmp_xen_load_devices_state >> + >> void qmp_dump_guest_memory(bool paging, const char *file, >> bool has_detach, bool detach, >> bool has_begin, int64_t begin, bool has_length, >> diff --git a/stubs/replay.c b/stubs/replay.c >> index 9b53c0c..6fc7850 100644 >> --- a/stubs/replay.c >> +++ b/stubs/replay.c >> @@ -1,4 +1,5 @@ >> #include "qemu/osdep.h" >> +#include "qemu-common.h" >> #include "sysemu/replay.h" >> >> ReplayMode replay_mode; >> @@ -106,3 +107,10 @@ void replay_account_executed_instructions(void) >> void replay_add_blocker(Error *reason) >> { >> } >> + >> +bool replay_can_snapshot(void) >> +{ >> + qemu_debug_assert(0); >> + >> + return false; >> +} >> diff --git a/stubs/vl-stub.c b/stubs/vl-stub.c >> index 606f078..5f308c1 100644 >> --- a/stubs/vl-stub.c >> +++ b/stubs/vl-stub.c >> @@ -14,6 +14,8 @@ >> #include "disas/disas.h" >> #include "audio/audio.h" >> >> +#pragma weak qemu_add_exit_notifier >> + >> bool tcg_allowed; >> bool xen_allowed; >> bool boot_strict; >> @@ -169,3 +171,25 @@ int wav_start_capture(AudioState *state, CaptureState *s, const char *path, >> >> return -1; >> } >> + >> +void qemu_system_killed(int signal, pid_t pid) >> +{ >> + qemu_debug_assert(0); >> +} >> + >> +void qemu_system_reset(ShutdownCause reason) >> +{ >> + qemu_debug_assert(0); >> +} >> + >> +bool runstate_store(char *str, size_t size) >> +{ >> + qemu_debug_assert(0); >> + >> + return false; >> +} >> + >> +void qemu_add_exit_notifier(Notifier *notify) >> +{ >> + qemu_debug_assert(0); >> +} >> diff --git a/vl-parse.c b/vl-parse.c >> index 1f6a3f0..423f4a0 100644 >> --- a/vl-parse.c >> +++ b/vl-parse.c >> @@ -27,6 +27,9 @@ >> >> #include "vl.h" >> >> +int only_migratable; /* turn it off unless user states otherwise */ >> +bool enable_mlock; >> + >> /***********************************************************/ >> /* QEMU Block devices */ >> >> -- >> 1.8.3.1 >> > -- > Dr. David Alan Gilbert / dgilbert@redhat.com / Manchester, UK >