* [Qemu-devel] [PATCH v5 0/3] Add max-ram-below-4g (was Add pci_hole_min_size machine option) @ 2014-06-06 17:52 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-06 17:52 UTC (permalink / raw) To: xen-devel, qemu-devel, Stefano Stabellini Cc: Igor Mammedov, Don Slutz, Andreas Färber, Anthony Liguori, Michael S. Tsirkin Changes v4 to v5: Re-work based on: https://github.com/imammedo/qemu/commits/memory-hotplug-v11 And so it now depends on this patch set. Stefano Stabellini: #3 "xen-hvm: Pass is_default to xen_hvm_init" Acked-by Minor change of pmc to pcms. Changes v3 to v4: Split out #2 "GlobalProperty: Display warning about unused -global" rebase on e00fcfe (origin/master) rename xen-all to xen-hvm Adjust #1 "xen-hvm: Fix xen_hvm_init() to adjust pc memory layout" Switch Acked-by & Signed-off-by rebase on master Rework #3 "xen-hvm: Pass is_default to xen_hvm_init": To pass is_default instead of max_ram_below_4g. Also did not add "Acked-by: Stefano Stabellini" since code changed a lot. Andreas Färber: all: Remove dot at end of subject #3 "xen-hvm: Pass is_default to xen_hvm_init" Adjust comment formatting. Andreas Färber, Paolo Bonzini, Marcel Apfelbaum: rework to use "opts per machine" Drop old #3, new #2. Changes v2 to v3: Stefano Stabellini: Acked-by #1 "xen-all: Fix xen_hvm_init() to adjust pc memory" Adjust for code readability #4 "xen-all: Pass max_ram_below_4g to xen_hvm_init." Set max_ram_below_4g always and use it to calculate above_4g_mem_size, below_4g_mem_size. Changes v1 to v2: Michael S. Tsirkin: Rename option. Only add it to machine types that support it. Split into 4 parts. 1/4 -- xen-all: Fix xen_hvm_init() to adjust pc memory layout This looks to be a possible bug that has yet to be found. below_4g_mem_size and above_4g_mem_size are stored in PcGuestInfo (pc_guest_info_init) which are currently not "correct". This and 4/4 change the same lines. 2/4 -- GlobalProperty: Display warning about unused -global My testing showed that setting a global property on an object that is not used is not reported at all. This is added to help when the new global is set but not used. The negative not_used was picked so that all static objects are assumed to be used even when they are not. 3/4 -- pc & q35: Add new object pc-memory-layout The objects that it might make sense to add this property to all get created too late. So add a new object just to hold this property. Name it so that it is expected that only pc (and q35) machine types support it. 4/4 -- xen-all: Pass max_ram_below_4g to xen_hvm_init Seprate the xen only part of the change. Currectly based on patch 1/4 Don Slutz (3): xen-hvm: Fix xen_hvm_init() to adjust pc memory layout pc & q35: Add new machine opt max-ram-below-4g xen-hvm: Pass is_default to xen_hvm_init hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ hw/i386/pc_piix.c | 41 ++++++++++++++++++++++++++--------------- hw/i386/pc_q35.c | 39 +++++++++++++++++++++++++-------------- include/hw/i386/pc.h | 3 +++ include/hw/xen/xen.h | 3 ++- vl.c | 4 ++++ xen-hvm-stub.c | 3 ++- xen-hvm.c | 46 +++++++++++++++++++++++++++------------------- 8 files changed, 127 insertions(+), 50 deletions(-) -- 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* [PATCH v5 0/3] Add max-ram-below-4g (was Add pci_hole_min_size machine option) @ 2014-06-06 17:52 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-06 17:52 UTC (permalink / raw) To: xen-devel, qemu-devel, Stefano Stabellini Cc: Igor Mammedov, Don Slutz, Andreas Färber, Anthony Liguori, Michael S. Tsirkin Changes v4 to v5: Re-work based on: https://github.com/imammedo/qemu/commits/memory-hotplug-v11 And so it now depends on this patch set. Stefano Stabellini: #3 "xen-hvm: Pass is_default to xen_hvm_init" Acked-by Minor change of pmc to pcms. Changes v3 to v4: Split out #2 "GlobalProperty: Display warning about unused -global" rebase on e00fcfe (origin/master) rename xen-all to xen-hvm Adjust #1 "xen-hvm: Fix xen_hvm_init() to adjust pc memory layout" Switch Acked-by & Signed-off-by rebase on master Rework #3 "xen-hvm: Pass is_default to xen_hvm_init": To pass is_default instead of max_ram_below_4g. Also did not add "Acked-by: Stefano Stabellini" since code changed a lot. Andreas Färber: all: Remove dot at end of subject #3 "xen-hvm: Pass is_default to xen_hvm_init" Adjust comment formatting. Andreas Färber, Paolo Bonzini, Marcel Apfelbaum: rework to use "opts per machine" Drop old #3, new #2. Changes v2 to v3: Stefano Stabellini: Acked-by #1 "xen-all: Fix xen_hvm_init() to adjust pc memory" Adjust for code readability #4 "xen-all: Pass max_ram_below_4g to xen_hvm_init." Set max_ram_below_4g always and use it to calculate above_4g_mem_size, below_4g_mem_size. Changes v1 to v2: Michael S. Tsirkin: Rename option. Only add it to machine types that support it. Split into 4 parts. 1/4 -- xen-all: Fix xen_hvm_init() to adjust pc memory layout This looks to be a possible bug that has yet to be found. below_4g_mem_size and above_4g_mem_size are stored in PcGuestInfo (pc_guest_info_init) which are currently not "correct". This and 4/4 change the same lines. 2/4 -- GlobalProperty: Display warning about unused -global My testing showed that setting a global property on an object that is not used is not reported at all. This is added to help when the new global is set but not used. The negative not_used was picked so that all static objects are assumed to be used even when they are not. 3/4 -- pc & q35: Add new object pc-memory-layout The objects that it might make sense to add this property to all get created too late. So add a new object just to hold this property. Name it so that it is expected that only pc (and q35) machine types support it. 4/4 -- xen-all: Pass max_ram_below_4g to xen_hvm_init Seprate the xen only part of the change. Currectly based on patch 1/4 Don Slutz (3): xen-hvm: Fix xen_hvm_init() to adjust pc memory layout pc & q35: Add new machine opt max-ram-below-4g xen-hvm: Pass is_default to xen_hvm_init hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ hw/i386/pc_piix.c | 41 ++++++++++++++++++++++++++--------------- hw/i386/pc_q35.c | 39 +++++++++++++++++++++++++-------------- include/hw/i386/pc.h | 3 +++ include/hw/xen/xen.h | 3 ++- vl.c | 4 ++++ xen-hvm-stub.c | 3 ++- xen-hvm.c | 46 +++++++++++++++++++++++++++------------------- 8 files changed, 127 insertions(+), 50 deletions(-) -- 1.8.4 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel ^ permalink raw reply [flat|nested] 53+ messages in thread
* [Qemu-devel] [PATCH v5 1/3] xen-hvm: Fix xen_hvm_init() to adjust pc memory layout 2014-06-06 17:52 ` Don Slutz @ 2014-06-06 17:52 ` Don Slutz -1 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-06 17:52 UTC (permalink / raw) To: xen-devel, qemu-devel, Stefano Stabellini Cc: Igor Mammedov, Don Slutz, Andreas Färber, Anthony Liguori, Michael S. Tsirkin This is just below_4g_mem_size and above_4g_mem_size which is used later in QEMU. Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> Signed-off-by: Don Slutz <dslutz@verizon.com> --- v5: No change v4: Switch Acked-by & Signed-off-by rebase on master v3: Add Acked-by: Stefano Stabellini v2: No change hw/i386/pc_piix.c | 31 ++++++++++++++++--------------- hw/i386/pc_q35.c | 29 +++++++++++++++-------------- include/hw/xen/xen.h | 3 ++- xen-hvm-stub.c | 3 ++- xen-hvm.c | 24 ++++++++++++++---------- 5 files changed, 49 insertions(+), 41 deletions(-) diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c index a13e8d6..40f6eaf 100644 --- a/hw/i386/pc_piix.c +++ b/hw/i386/pc_piix.c @@ -99,21 +99,6 @@ static void pc_init1(MachineState *machine, FWCfgState *fw_cfg = NULL; PcGuestInfo *guest_info; - if (xen_enabled() && xen_hvm_init(&ram_memory) != 0) { - fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); - exit(1); - } - - icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); - object_property_add_child(qdev_get_machine(), "icc-bridge", - OBJECT(icc_bridge), NULL); - - pc_cpus_init(machine->cpu_model, icc_bridge); - - if (kvm_enabled() && kvmclock_enabled) { - kvmclock_create(); - } - /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). * If it doesn't, we need to split it in chunks below and above 4G. * In any case, try to make sure that guest addresses aligned at @@ -130,6 +115,22 @@ static void pc_init1(MachineState *machine, below_4g_mem_size = machine->ram_size; } + if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, + &ram_memory) != 0) { + fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); + exit(1); + } + + icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); + object_property_add_child(qdev_get_machine(), "icc-bridge", + OBJECT(icc_bridge), NULL); + + pc_cpus_init(machine->cpu_model, icc_bridge); + + if (kvm_enabled() && kvmclock_enabled) { + kvmclock_create(); + } + if (pci_enabled) { pci_memory = g_new(MemoryRegion, 1); memory_region_init(pci_memory, NULL, "pci", UINT64_MAX); diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c index 629eb2d..e28ce40 100644 --- a/hw/i386/pc_q35.c +++ b/hw/i386/pc_q35.c @@ -86,20 +86,6 @@ static void pc_q35_init(MachineState *machine) DeviceState *icc_bridge; PcGuestInfo *guest_info; - if (xen_enabled() && xen_hvm_init(&ram_memory) != 0) { - fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); - exit(1); - } - - icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); - object_property_add_child(qdev_get_machine(), "icc-bridge", - OBJECT(icc_bridge), NULL); - - pc_cpus_init(machine->cpu_model, icc_bridge); - pc_acpi_init("q35-acpi-dsdt.aml"); - - kvmclock_create(); - /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping * also known as MMCFG). @@ -118,6 +104,21 @@ static void pc_q35_init(MachineState *machine) below_4g_mem_size = machine->ram_size; } + if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, + &ram_memory) != 0) { + fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); + exit(1); + } + + icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); + object_property_add_child(qdev_get_machine(), "icc-bridge", + OBJECT(icc_bridge), NULL); + + pc_cpus_init(machine->cpu_model, icc_bridge); + pc_acpi_init("q35-acpi-dsdt.aml"); + + kvmclock_create(); + /* pci enabled */ if (pci_enabled) { pci_memory = g_new(MemoryRegion, 1); diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h index 85fda3d..f71f2d8 100644 --- a/include/hw/xen/xen.h +++ b/include/hw/xen/xen.h @@ -37,10 +37,11 @@ void xen_cmos_set_s3_resume(void *opaque, int irq, int level); qemu_irq *xen_interrupt_controller_init(void); int xen_init(MachineClass *mc); -int xen_hvm_init(MemoryRegion **ram_memory); void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) +int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, + MemoryRegion **ram_memory); void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, struct MemoryRegion *mr); void xen_modified_memory(ram_addr_t start, ram_addr_t length); diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c index 4eb27b5..2d98696 100644 --- a/xen-hvm-stub.c +++ b/xen-hvm-stub.c @@ -51,7 +51,8 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) { } -int xen_hvm_init(MemoryRegion **ram_memory) +int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, + MemoryRegion **ram_memory) { return 0; } diff --git a/xen-hvm.c b/xen-hvm.c index a64486c..a0b6b5d 100644 --- a/xen-hvm.c +++ b/xen-hvm.c @@ -155,10 +155,11 @@ qemu_irq *xen_interrupt_controller_init(void) /* Memory Ops */ -static void xen_ram_init(ram_addr_t ram_size, MemoryRegion **ram_memory_p) +static void xen_ram_init(ram_addr_t *below_4g_mem_size, + ram_addr_t *above_4g_mem_size, + ram_addr_t ram_size, MemoryRegion **ram_memory_p) { MemoryRegion *sysmem = get_system_memory(); - ram_addr_t below_4g_mem_size, above_4g_mem_size = 0; ram_addr_t block_len; block_len = ram_size; @@ -173,10 +174,11 @@ static void xen_ram_init(ram_addr_t ram_size, MemoryRegion **ram_memory_p) vmstate_register_ram_global(&ram_memory); if (ram_size >= HVM_BELOW_4G_RAM_END) { - above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; - below_4g_mem_size = HVM_BELOW_4G_RAM_END; + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; } else { - below_4g_mem_size = ram_size; + *above_4g_mem_size = 0; + *below_4g_mem_size = ram_size; } memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", @@ -189,12 +191,13 @@ static void xen_ram_init(ram_addr_t ram_size, MemoryRegion **ram_memory_p) * the Options ROM, so it is registered here as RAM. */ memory_region_init_alias(&ram_lo, NULL, "xen.ram.lo", - &ram_memory, 0xc0000, below_4g_mem_size - 0xc0000); + &ram_memory, 0xc0000, + *below_4g_mem_size - 0xc0000); memory_region_add_subregion(sysmem, 0xc0000, &ram_lo); - if (above_4g_mem_size > 0) { + if (*above_4g_mem_size > 0) { memory_region_init_alias(&ram_hi, NULL, "xen.ram.hi", &ram_memory, 0x100000000ULL, - above_4g_mem_size); + *above_4g_mem_size); memory_region_add_subregion(sysmem, 0x100000000ULL, &ram_hi); } } @@ -958,7 +961,8 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) xc_set_hvm_param(xen_xc, xen_domid, HVM_PARAM_ACPI_S_STATE, 0); } -int xen_hvm_init(MemoryRegion **ram_memory) +int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, + MemoryRegion **ram_memory) { int i, rc; unsigned long ioreq_pfn; @@ -1036,7 +1040,7 @@ int xen_hvm_init(MemoryRegion **ram_memory) /* Init RAM management */ xen_map_cache_init(xen_phys_offset_to_gaddr, state); - xen_ram_init(ram_size, ram_memory); + xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); -- 1.8.4 ^ permalink raw reply related [flat|nested] 53+ messages in thread
* [PATCH v5 1/3] xen-hvm: Fix xen_hvm_init() to adjust pc memory layout @ 2014-06-06 17:52 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-06 17:52 UTC (permalink / raw) To: xen-devel, qemu-devel, Stefano Stabellini Cc: Igor Mammedov, Don Slutz, Andreas Färber, Anthony Liguori, Michael S. Tsirkin This is just below_4g_mem_size and above_4g_mem_size which is used later in QEMU. Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> Signed-off-by: Don Slutz <dslutz@verizon.com> --- v5: No change v4: Switch Acked-by & Signed-off-by rebase on master v3: Add Acked-by: Stefano Stabellini v2: No change hw/i386/pc_piix.c | 31 ++++++++++++++++--------------- hw/i386/pc_q35.c | 29 +++++++++++++++-------------- include/hw/xen/xen.h | 3 ++- xen-hvm-stub.c | 3 ++- xen-hvm.c | 24 ++++++++++++++---------- 5 files changed, 49 insertions(+), 41 deletions(-) diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c index a13e8d6..40f6eaf 100644 --- a/hw/i386/pc_piix.c +++ b/hw/i386/pc_piix.c @@ -99,21 +99,6 @@ static void pc_init1(MachineState *machine, FWCfgState *fw_cfg = NULL; PcGuestInfo *guest_info; - if (xen_enabled() && xen_hvm_init(&ram_memory) != 0) { - fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); - exit(1); - } - - icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); - object_property_add_child(qdev_get_machine(), "icc-bridge", - OBJECT(icc_bridge), NULL); - - pc_cpus_init(machine->cpu_model, icc_bridge); - - if (kvm_enabled() && kvmclock_enabled) { - kvmclock_create(); - } - /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). * If it doesn't, we need to split it in chunks below and above 4G. * In any case, try to make sure that guest addresses aligned at @@ -130,6 +115,22 @@ static void pc_init1(MachineState *machine, below_4g_mem_size = machine->ram_size; } + if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, + &ram_memory) != 0) { + fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); + exit(1); + } + + icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); + object_property_add_child(qdev_get_machine(), "icc-bridge", + OBJECT(icc_bridge), NULL); + + pc_cpus_init(machine->cpu_model, icc_bridge); + + if (kvm_enabled() && kvmclock_enabled) { + kvmclock_create(); + } + if (pci_enabled) { pci_memory = g_new(MemoryRegion, 1); memory_region_init(pci_memory, NULL, "pci", UINT64_MAX); diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c index 629eb2d..e28ce40 100644 --- a/hw/i386/pc_q35.c +++ b/hw/i386/pc_q35.c @@ -86,20 +86,6 @@ static void pc_q35_init(MachineState *machine) DeviceState *icc_bridge; PcGuestInfo *guest_info; - if (xen_enabled() && xen_hvm_init(&ram_memory) != 0) { - fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); - exit(1); - } - - icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); - object_property_add_child(qdev_get_machine(), "icc-bridge", - OBJECT(icc_bridge), NULL); - - pc_cpus_init(machine->cpu_model, icc_bridge); - pc_acpi_init("q35-acpi-dsdt.aml"); - - kvmclock_create(); - /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping * also known as MMCFG). @@ -118,6 +104,21 @@ static void pc_q35_init(MachineState *machine) below_4g_mem_size = machine->ram_size; } + if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, + &ram_memory) != 0) { + fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); + exit(1); + } + + icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); + object_property_add_child(qdev_get_machine(), "icc-bridge", + OBJECT(icc_bridge), NULL); + + pc_cpus_init(machine->cpu_model, icc_bridge); + pc_acpi_init("q35-acpi-dsdt.aml"); + + kvmclock_create(); + /* pci enabled */ if (pci_enabled) { pci_memory = g_new(MemoryRegion, 1); diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h index 85fda3d..f71f2d8 100644 --- a/include/hw/xen/xen.h +++ b/include/hw/xen/xen.h @@ -37,10 +37,11 @@ void xen_cmos_set_s3_resume(void *opaque, int irq, int level); qemu_irq *xen_interrupt_controller_init(void); int xen_init(MachineClass *mc); -int xen_hvm_init(MemoryRegion **ram_memory); void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) +int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, + MemoryRegion **ram_memory); void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, struct MemoryRegion *mr); void xen_modified_memory(ram_addr_t start, ram_addr_t length); diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c index 4eb27b5..2d98696 100644 --- a/xen-hvm-stub.c +++ b/xen-hvm-stub.c @@ -51,7 +51,8 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) { } -int xen_hvm_init(MemoryRegion **ram_memory) +int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, + MemoryRegion **ram_memory) { return 0; } diff --git a/xen-hvm.c b/xen-hvm.c index a64486c..a0b6b5d 100644 --- a/xen-hvm.c +++ b/xen-hvm.c @@ -155,10 +155,11 @@ qemu_irq *xen_interrupt_controller_init(void) /* Memory Ops */ -static void xen_ram_init(ram_addr_t ram_size, MemoryRegion **ram_memory_p) +static void xen_ram_init(ram_addr_t *below_4g_mem_size, + ram_addr_t *above_4g_mem_size, + ram_addr_t ram_size, MemoryRegion **ram_memory_p) { MemoryRegion *sysmem = get_system_memory(); - ram_addr_t below_4g_mem_size, above_4g_mem_size = 0; ram_addr_t block_len; block_len = ram_size; @@ -173,10 +174,11 @@ static void xen_ram_init(ram_addr_t ram_size, MemoryRegion **ram_memory_p) vmstate_register_ram_global(&ram_memory); if (ram_size >= HVM_BELOW_4G_RAM_END) { - above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; - below_4g_mem_size = HVM_BELOW_4G_RAM_END; + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; } else { - below_4g_mem_size = ram_size; + *above_4g_mem_size = 0; + *below_4g_mem_size = ram_size; } memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", @@ -189,12 +191,13 @@ static void xen_ram_init(ram_addr_t ram_size, MemoryRegion **ram_memory_p) * the Options ROM, so it is registered here as RAM. */ memory_region_init_alias(&ram_lo, NULL, "xen.ram.lo", - &ram_memory, 0xc0000, below_4g_mem_size - 0xc0000); + &ram_memory, 0xc0000, + *below_4g_mem_size - 0xc0000); memory_region_add_subregion(sysmem, 0xc0000, &ram_lo); - if (above_4g_mem_size > 0) { + if (*above_4g_mem_size > 0) { memory_region_init_alias(&ram_hi, NULL, "xen.ram.hi", &ram_memory, 0x100000000ULL, - above_4g_mem_size); + *above_4g_mem_size); memory_region_add_subregion(sysmem, 0x100000000ULL, &ram_hi); } } @@ -958,7 +961,8 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) xc_set_hvm_param(xen_xc, xen_domid, HVM_PARAM_ACPI_S_STATE, 0); } -int xen_hvm_init(MemoryRegion **ram_memory) +int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, + MemoryRegion **ram_memory) { int i, rc; unsigned long ioreq_pfn; @@ -1036,7 +1040,7 @@ int xen_hvm_init(MemoryRegion **ram_memory) /* Init RAM management */ xen_map_cache_init(xen_phys_offset_to_gaddr, state); - xen_ram_init(ram_size, ram_memory); + xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); -- 1.8.4 ^ permalink raw reply related [flat|nested] 53+ messages in thread
* [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-06 17:52 ` Don Slutz @ 2014-06-06 17:52 ` Don Slutz -1 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-06 17:52 UTC (permalink / raw) To: xen-devel, qemu-devel, Stefano Stabellini Cc: Igor Mammedov, Don Slutz, Andreas Färber, Anthony Liguori, Michael S. Tsirkin This is a pc & q35 only machine opt. One use is to allow for more ram in a 32bit guest for example: -machine pc,max-ram-below-4g=3.75G If you add enough PCI devices then all mmio for them will not fit below 4G which may not be the layout the user wanted. This allows you to increase the below 4G address space that PCI devices can use (aka decrease ram below 4G) and therefore in more cases not have any mmio that is above 4G. For example using "-machine pc,max-ram-below-4g=2G" on the command line will limit the amount of ram that is below 4G to 2G. Signed-off-by: Don Slutz <dslutz@verizon.com> --- v5: Re-work based on: https://github.com/imammedo/qemu/commits/memory-hotplug-v11 hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ hw/i386/pc_piix.c | 15 ++++++++++++--- hw/i386/pc_q35.c | 15 ++++++++++++--- include/hw/i386/pc.h | 3 +++ vl.c | 4 ++++ 5 files changed, 69 insertions(+), 6 deletions(-) diff --git a/hw/i386/pc.c b/hw/i386/pc.c index 7cdba10..bccb746 100644 --- a/hw/i386/pc.c +++ b/hw/i386/pc.c @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, visit_type_int(v, &value, name, errp); } +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, + void *opaque, const char *name, + Error **errp) +{ + PCMachineState *pcms = PC_MACHINE(obj); + uint64_t value = pcms->max_ram_below_4g; + + visit_type_size(v, &value, name, errp); +} + +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, + void *opaque, const char *name, + Error **errp) +{ + PCMachineState *pcms = PC_MACHINE(obj); + Error *error = NULL; + uint64_t value; + + visit_type_size(v, &value, name, &error); + if (error) { + error_propagate(errp, error); + return; + } + if (value > (1ULL << 32)) { + error_set(&error, ERROR_CLASS_GENERIC_ERROR, + "Machine option 'max-ram-below-4g=%"PRIu64 + "' expects size less then or equal to 4G", value); + error_propagate(errp, error); + return; + } + + pcms->max_ram_below_4g = value; +} + static void pc_machine_initfn(Object *obj) { object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", pc_machine_get_hotplug_memory_region_size, NULL, NULL, NULL, NULL); + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", + pc_machine_get_max_ram_below_4g, + pc_machine_set_max_ram_below_4g, + NULL, NULL, NULL); } static void pc_machine_class_init(ObjectClass *oc, void *data) diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c index 40f6eaf..25f4727 100644 --- a/hw/i386/pc_piix.c +++ b/hw/i386/pc_piix.c @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, DeviceState *icc_bridge; FWCfgState *fw_cfg = NULL; PcGuestInfo *guest_info; + Object *mo = qdev_get_machine(); + PCMachineState *pcms = PC_MACHINE(mo); + ram_addr_t lowmem = 0xe0000000; + + if (pcms && pcms->max_ram_below_4g) { + lowmem = pcms->max_ram_below_4g; + } /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). * If it doesn't, we need to split it in chunks below and above 4G. @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, * For old machine types, use whatever split we used historically to avoid * breaking migration. */ - if (machine->ram_size >= 0xe0000000) { - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; + if (machine->ram_size >= lowmem) { + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { + lowmem = 0xc0000000; + } above_4g_mem_size = machine->ram_size - lowmem; below_4g_mem_size = lowmem; } else { @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, } icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); - object_property_add_child(qdev_get_machine(), "icc-bridge", + object_property_add_child(mo, "icc-bridge", OBJECT(icc_bridge), NULL); pc_cpus_init(machine->cpu_model, icc_bridge); diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c index e28ce40..155cdf1 100644 --- a/hw/i386/pc_q35.c +++ b/hw/i386/pc_q35.c @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) PCIDevice *ahci; DeviceState *icc_bridge; PcGuestInfo *guest_info; + Object *mo = qdev_get_machine(); + PCMachineState *pcms = PC_MACHINE(mo); + ram_addr_t lowmem = 0xb0000000; + + if (pcms && pcms->max_ram_below_4g) { + lowmem = pcms->max_ram_below_4g; + } /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) * For old machine types, use whatever split we used historically to avoid * breaking migration. */ - if (machine->ram_size >= 0xb0000000) { - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; + if (machine->ram_size >= lowmem) { + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { + lowmem = 0x800000000; + } above_4g_mem_size = machine->ram_size - lowmem; below_4g_mem_size = lowmem; } else { @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) } icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); - object_property_add_child(qdev_get_machine(), "icc-bridge", + object_property_add_child(mo, "icc-bridge", OBJECT(icc_bridge), NULL); pc_cpus_init(machine->cpu_model, icc_bridge); diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h index 19530bd..2d8b562 100644 --- a/include/hw/i386/pc.h +++ b/include/hw/i386/pc.h @@ -32,10 +32,13 @@ struct PCMachineState { MemoryRegion hotplug_memory; HotplugHandler *acpi_dev; + + uint64_t max_ram_below_4g; }; #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" /** * PCMachineClass: diff --git a/vl.c b/vl.c index 5e77a27..cffb9c5 100644 --- a/vl.c +++ b/vl.c @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { .name = "kvm-type", .type = QEMU_OPT_STRING, .help = "Specifies the KVM virtualization mode (HV, PR)", + },{ + .name = PC_MACHINE_MAX_RAM_BELOW_4G, + .type = QEMU_OPT_SIZE, + .help = "maximum ram below the 4G boundary (32bit boundary)", }, { /* End of list */ } }, -- 1.8.4 ^ permalink raw reply related [flat|nested] 53+ messages in thread
* [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-06 17:52 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-06 17:52 UTC (permalink / raw) To: xen-devel, qemu-devel, Stefano Stabellini Cc: Igor Mammedov, Don Slutz, Andreas Färber, Anthony Liguori, Michael S. Tsirkin This is a pc & q35 only machine opt. One use is to allow for more ram in a 32bit guest for example: -machine pc,max-ram-below-4g=3.75G If you add enough PCI devices then all mmio for them will not fit below 4G which may not be the layout the user wanted. This allows you to increase the below 4G address space that PCI devices can use (aka decrease ram below 4G) and therefore in more cases not have any mmio that is above 4G. For example using "-machine pc,max-ram-below-4g=2G" on the command line will limit the amount of ram that is below 4G to 2G. Signed-off-by: Don Slutz <dslutz@verizon.com> --- v5: Re-work based on: https://github.com/imammedo/qemu/commits/memory-hotplug-v11 hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ hw/i386/pc_piix.c | 15 ++++++++++++--- hw/i386/pc_q35.c | 15 ++++++++++++--- include/hw/i386/pc.h | 3 +++ vl.c | 4 ++++ 5 files changed, 69 insertions(+), 6 deletions(-) diff --git a/hw/i386/pc.c b/hw/i386/pc.c index 7cdba10..bccb746 100644 --- a/hw/i386/pc.c +++ b/hw/i386/pc.c @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, visit_type_int(v, &value, name, errp); } +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, + void *opaque, const char *name, + Error **errp) +{ + PCMachineState *pcms = PC_MACHINE(obj); + uint64_t value = pcms->max_ram_below_4g; + + visit_type_size(v, &value, name, errp); +} + +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, + void *opaque, const char *name, + Error **errp) +{ + PCMachineState *pcms = PC_MACHINE(obj); + Error *error = NULL; + uint64_t value; + + visit_type_size(v, &value, name, &error); + if (error) { + error_propagate(errp, error); + return; + } + if (value > (1ULL << 32)) { + error_set(&error, ERROR_CLASS_GENERIC_ERROR, + "Machine option 'max-ram-below-4g=%"PRIu64 + "' expects size less then or equal to 4G", value); + error_propagate(errp, error); + return; + } + + pcms->max_ram_below_4g = value; +} + static void pc_machine_initfn(Object *obj) { object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", pc_machine_get_hotplug_memory_region_size, NULL, NULL, NULL, NULL); + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", + pc_machine_get_max_ram_below_4g, + pc_machine_set_max_ram_below_4g, + NULL, NULL, NULL); } static void pc_machine_class_init(ObjectClass *oc, void *data) diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c index 40f6eaf..25f4727 100644 --- a/hw/i386/pc_piix.c +++ b/hw/i386/pc_piix.c @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, DeviceState *icc_bridge; FWCfgState *fw_cfg = NULL; PcGuestInfo *guest_info; + Object *mo = qdev_get_machine(); + PCMachineState *pcms = PC_MACHINE(mo); + ram_addr_t lowmem = 0xe0000000; + + if (pcms && pcms->max_ram_below_4g) { + lowmem = pcms->max_ram_below_4g; + } /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). * If it doesn't, we need to split it in chunks below and above 4G. @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, * For old machine types, use whatever split we used historically to avoid * breaking migration. */ - if (machine->ram_size >= 0xe0000000) { - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; + if (machine->ram_size >= lowmem) { + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { + lowmem = 0xc0000000; + } above_4g_mem_size = machine->ram_size - lowmem; below_4g_mem_size = lowmem; } else { @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, } icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); - object_property_add_child(qdev_get_machine(), "icc-bridge", + object_property_add_child(mo, "icc-bridge", OBJECT(icc_bridge), NULL); pc_cpus_init(machine->cpu_model, icc_bridge); diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c index e28ce40..155cdf1 100644 --- a/hw/i386/pc_q35.c +++ b/hw/i386/pc_q35.c @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) PCIDevice *ahci; DeviceState *icc_bridge; PcGuestInfo *guest_info; + Object *mo = qdev_get_machine(); + PCMachineState *pcms = PC_MACHINE(mo); + ram_addr_t lowmem = 0xb0000000; + + if (pcms && pcms->max_ram_below_4g) { + lowmem = pcms->max_ram_below_4g; + } /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) * For old machine types, use whatever split we used historically to avoid * breaking migration. */ - if (machine->ram_size >= 0xb0000000) { - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; + if (machine->ram_size >= lowmem) { + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { + lowmem = 0x800000000; + } above_4g_mem_size = machine->ram_size - lowmem; below_4g_mem_size = lowmem; } else { @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) } icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); - object_property_add_child(qdev_get_machine(), "icc-bridge", + object_property_add_child(mo, "icc-bridge", OBJECT(icc_bridge), NULL); pc_cpus_init(machine->cpu_model, icc_bridge); diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h index 19530bd..2d8b562 100644 --- a/include/hw/i386/pc.h +++ b/include/hw/i386/pc.h @@ -32,10 +32,13 @@ struct PCMachineState { MemoryRegion hotplug_memory; HotplugHandler *acpi_dev; + + uint64_t max_ram_below_4g; }; #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" /** * PCMachineClass: diff --git a/vl.c b/vl.c index 5e77a27..cffb9c5 100644 --- a/vl.c +++ b/vl.c @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { .name = "kvm-type", .type = QEMU_OPT_STRING, .help = "Specifies the KVM virtualization mode (HV, PR)", + },{ + .name = PC_MACHINE_MAX_RAM_BELOW_4G, + .type = QEMU_OPT_SIZE, + .help = "maximum ram below the 4G boundary (32bit boundary)", }, { /* End of list */ } }, -- 1.8.4 ^ permalink raw reply related [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-06 17:52 ` Don Slutz @ 2014-06-08 15:40 ` Michael S. Tsirkin -1 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-08 15:40 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > This is a pc & q35 only machine opt. One use is to allow for more > ram in a 32bit guest for example: > > -machine pc,max-ram-below-4g=3.75G > > If you add enough PCI devices then all mmio for them will not fit > below 4G which may not be the layout the user wanted. This allows > you to increase the below 4G address space that PCI devices can use > (aka decrease ram below 4G) and therefore in more cases not have any > mmio that is above 4G. > > For example using "-machine pc,max-ram-below-4g=2G" on the command > line will limit the amount of ram that is below 4G to 2G. > > Signed-off-by: Don Slutz <dslutz@verizon.com> > --- > v5: > Re-work based on: > > https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > > hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > hw/i386/pc_piix.c | 15 ++++++++++++--- > hw/i386/pc_q35.c | 15 ++++++++++++--- > include/hw/i386/pc.h | 3 +++ > vl.c | 4 ++++ > 5 files changed, 69 insertions(+), 6 deletions(-) > > diff --git a/hw/i386/pc.c b/hw/i386/pc.c > index 7cdba10..bccb746 100644 > --- a/hw/i386/pc.c > +++ b/hw/i386/pc.c > @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > visit_type_int(v, &value, name, errp); > } > > +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > + void *opaque, const char *name, > + Error **errp) > +{ > + PCMachineState *pcms = PC_MACHINE(obj); > + uint64_t value = pcms->max_ram_below_4g; > + > + visit_type_size(v, &value, name, errp); > +} > + > +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > + void *opaque, const char *name, > + Error **errp) > +{ > + PCMachineState *pcms = PC_MACHINE(obj); > + Error *error = NULL; > + uint64_t value; > + > + visit_type_size(v, &value, name, &error); > + if (error) { > + error_propagate(errp, error); > + return; > + } > + if (value > (1ULL << 32)) { > + error_set(&error, ERROR_CLASS_GENERIC_ERROR, > + "Machine option 'max-ram-below-4g=%"PRIu64 > + "' expects size less then or equal to 4G", value); less than > + error_propagate(errp, error); > + return; > + } > + > + pcms->max_ram_below_4g = value; > +} > + > static void pc_machine_initfn(Object *obj) > { > object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > pc_machine_get_hotplug_memory_region_size, > NULL, NULL, NULL, NULL); > + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > + pc_machine_get_max_ram_below_4g, > + pc_machine_set_max_ram_below_4g, > + NULL, NULL, NULL); > } > > static void pc_machine_class_init(ObjectClass *oc, void *data) > diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > index 40f6eaf..25f4727 100644 > --- a/hw/i386/pc_piix.c > +++ b/hw/i386/pc_piix.c > @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > DeviceState *icc_bridge; > FWCfgState *fw_cfg = NULL; > PcGuestInfo *guest_info; > + Object *mo = qdev_get_machine(); > + PCMachineState *pcms = PC_MACHINE(mo); > + ram_addr_t lowmem = 0xe0000000; > + > + if (pcms && pcms->max_ram_below_4g) { Is pcms ever NULL? If yes why? > + lowmem = pcms->max_ram_below_4g; > + } > > /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > * If it doesn't, we need to split it in chunks below and above 4G. > @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > * For old machine types, use whatever split we used historically to avoid > * breaking migration. > */ > - if (machine->ram_size >= 0xe0000000) { > - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > + if (machine->ram_size >= lowmem) { > + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > + lowmem = 0xc0000000; > + } > above_4g_mem_size = machine->ram_size - lowmem; > below_4g_mem_size = lowmem; > } else { So why do we need gigabyte_align anymore? Can't we set property to 0xc0000000 by default, and override for old machine types? Also, a value that isn't a multiple of 1G will lead to bad performance for large machines which do have above_4g_mem_size. Let's detect and print a warning. > @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > } > > icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > - object_property_add_child(qdev_get_machine(), "icc-bridge", > + object_property_add_child(mo, "icc-bridge", > OBJECT(icc_bridge), NULL); > > pc_cpus_init(machine->cpu_model, icc_bridge); > diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > index e28ce40..155cdf1 100644 > --- a/hw/i386/pc_q35.c > +++ b/hw/i386/pc_q35.c > @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > PCIDevice *ahci; > DeviceState *icc_bridge; > PcGuestInfo *guest_info; > + Object *mo = qdev_get_machine(); > + PCMachineState *pcms = PC_MACHINE(mo); > + ram_addr_t lowmem = 0xb0000000; > + > + if (pcms && pcms->max_ram_below_4g) { > + lowmem = pcms->max_ram_below_4g; > + } > > /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > * For old machine types, use whatever split we used historically to avoid > * breaking migration. > */ > - if (machine->ram_size >= 0xb0000000) { > - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > + if (machine->ram_size >= lowmem) { > + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > + lowmem = 0x800000000; > + } > above_4g_mem_size = machine->ram_size - lowmem; > below_4g_mem_size = lowmem; > } else { > @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > } > > icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > - object_property_add_child(qdev_get_machine(), "icc-bridge", > + object_property_add_child(mo, "icc-bridge", > OBJECT(icc_bridge), NULL); > > pc_cpus_init(machine->cpu_model, icc_bridge); > diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > index 19530bd..2d8b562 100644 > --- a/include/hw/i386/pc.h > +++ b/include/hw/i386/pc.h > @@ -32,10 +32,13 @@ struct PCMachineState { > MemoryRegion hotplug_memory; > > HotplugHandler *acpi_dev; > + > + uint64_t max_ram_below_4g; > }; > > #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > /** > * PCMachineClass: > diff --git a/vl.c b/vl.c > index 5e77a27..cffb9c5 100644 > --- a/vl.c > +++ b/vl.c > @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > .name = "kvm-type", > .type = QEMU_OPT_STRING, > .help = "Specifies the KVM virtualization mode (HV, PR)", > + },{ > + .name = PC_MACHINE_MAX_RAM_BELOW_4G, > + .type = QEMU_OPT_SIZE, > + .help = "maximum ram below the 4G boundary (32bit boundary)", > }, > { /* End of list */ } > }, > -- > 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-08 15:40 ` Michael S. Tsirkin 0 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-08 15:40 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > This is a pc & q35 only machine opt. One use is to allow for more > ram in a 32bit guest for example: > > -machine pc,max-ram-below-4g=3.75G > > If you add enough PCI devices then all mmio for them will not fit > below 4G which may not be the layout the user wanted. This allows > you to increase the below 4G address space that PCI devices can use > (aka decrease ram below 4G) and therefore in more cases not have any > mmio that is above 4G. > > For example using "-machine pc,max-ram-below-4g=2G" on the command > line will limit the amount of ram that is below 4G to 2G. > > Signed-off-by: Don Slutz <dslutz@verizon.com> > --- > v5: > Re-work based on: > > https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > > hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > hw/i386/pc_piix.c | 15 ++++++++++++--- > hw/i386/pc_q35.c | 15 ++++++++++++--- > include/hw/i386/pc.h | 3 +++ > vl.c | 4 ++++ > 5 files changed, 69 insertions(+), 6 deletions(-) > > diff --git a/hw/i386/pc.c b/hw/i386/pc.c > index 7cdba10..bccb746 100644 > --- a/hw/i386/pc.c > +++ b/hw/i386/pc.c > @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > visit_type_int(v, &value, name, errp); > } > > +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > + void *opaque, const char *name, > + Error **errp) > +{ > + PCMachineState *pcms = PC_MACHINE(obj); > + uint64_t value = pcms->max_ram_below_4g; > + > + visit_type_size(v, &value, name, errp); > +} > + > +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > + void *opaque, const char *name, > + Error **errp) > +{ > + PCMachineState *pcms = PC_MACHINE(obj); > + Error *error = NULL; > + uint64_t value; > + > + visit_type_size(v, &value, name, &error); > + if (error) { > + error_propagate(errp, error); > + return; > + } > + if (value > (1ULL << 32)) { > + error_set(&error, ERROR_CLASS_GENERIC_ERROR, > + "Machine option 'max-ram-below-4g=%"PRIu64 > + "' expects size less then or equal to 4G", value); less than > + error_propagate(errp, error); > + return; > + } > + > + pcms->max_ram_below_4g = value; > +} > + > static void pc_machine_initfn(Object *obj) > { > object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > pc_machine_get_hotplug_memory_region_size, > NULL, NULL, NULL, NULL); > + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > + pc_machine_get_max_ram_below_4g, > + pc_machine_set_max_ram_below_4g, > + NULL, NULL, NULL); > } > > static void pc_machine_class_init(ObjectClass *oc, void *data) > diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > index 40f6eaf..25f4727 100644 > --- a/hw/i386/pc_piix.c > +++ b/hw/i386/pc_piix.c > @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > DeviceState *icc_bridge; > FWCfgState *fw_cfg = NULL; > PcGuestInfo *guest_info; > + Object *mo = qdev_get_machine(); > + PCMachineState *pcms = PC_MACHINE(mo); > + ram_addr_t lowmem = 0xe0000000; > + > + if (pcms && pcms->max_ram_below_4g) { Is pcms ever NULL? If yes why? > + lowmem = pcms->max_ram_below_4g; > + } > > /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > * If it doesn't, we need to split it in chunks below and above 4G. > @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > * For old machine types, use whatever split we used historically to avoid > * breaking migration. > */ > - if (machine->ram_size >= 0xe0000000) { > - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > + if (machine->ram_size >= lowmem) { > + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > + lowmem = 0xc0000000; > + } > above_4g_mem_size = machine->ram_size - lowmem; > below_4g_mem_size = lowmem; > } else { So why do we need gigabyte_align anymore? Can't we set property to 0xc0000000 by default, and override for old machine types? Also, a value that isn't a multiple of 1G will lead to bad performance for large machines which do have above_4g_mem_size. Let's detect and print a warning. > @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > } > > icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > - object_property_add_child(qdev_get_machine(), "icc-bridge", > + object_property_add_child(mo, "icc-bridge", > OBJECT(icc_bridge), NULL); > > pc_cpus_init(machine->cpu_model, icc_bridge); > diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > index e28ce40..155cdf1 100644 > --- a/hw/i386/pc_q35.c > +++ b/hw/i386/pc_q35.c > @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > PCIDevice *ahci; > DeviceState *icc_bridge; > PcGuestInfo *guest_info; > + Object *mo = qdev_get_machine(); > + PCMachineState *pcms = PC_MACHINE(mo); > + ram_addr_t lowmem = 0xb0000000; > + > + if (pcms && pcms->max_ram_below_4g) { > + lowmem = pcms->max_ram_below_4g; > + } > > /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > * For old machine types, use whatever split we used historically to avoid > * breaking migration. > */ > - if (machine->ram_size >= 0xb0000000) { > - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > + if (machine->ram_size >= lowmem) { > + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > + lowmem = 0x800000000; > + } > above_4g_mem_size = machine->ram_size - lowmem; > below_4g_mem_size = lowmem; > } else { > @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > } > > icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > - object_property_add_child(qdev_get_machine(), "icc-bridge", > + object_property_add_child(mo, "icc-bridge", > OBJECT(icc_bridge), NULL); > > pc_cpus_init(machine->cpu_model, icc_bridge); > diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > index 19530bd..2d8b562 100644 > --- a/include/hw/i386/pc.h > +++ b/include/hw/i386/pc.h > @@ -32,10 +32,13 @@ struct PCMachineState { > MemoryRegion hotplug_memory; > > HotplugHandler *acpi_dev; > + > + uint64_t max_ram_below_4g; > }; > > #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > /** > * PCMachineClass: > diff --git a/vl.c b/vl.c > index 5e77a27..cffb9c5 100644 > --- a/vl.c > +++ b/vl.c > @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > .name = "kvm-type", > .type = QEMU_OPT_STRING, > .help = "Specifies the KVM virtualization mode (HV, PR)", > + },{ > + .name = PC_MACHINE_MAX_RAM_BELOW_4G, > + .type = QEMU_OPT_SIZE, > + .help = "maximum ram below the 4G boundary (32bit boundary)", > }, > { /* End of list */ } > }, > -- > 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-08 15:40 ` Michael S. Tsirkin @ 2014-06-09 14:20 ` Don Slutz -1 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-09 14:20 UTC (permalink / raw) To: Michael S. Tsirkin, Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/08/14 11:40, Michael S. Tsirkin wrote: > On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: >> This is a pc & q35 only machine opt. One use is to allow for more >> ram in a 32bit guest for example: >> >> -machine pc,max-ram-below-4g=3.75G >> >> If you add enough PCI devices then all mmio for them will not fit >> below 4G which may not be the layout the user wanted. This allows >> you to increase the below 4G address space that PCI devices can use >> (aka decrease ram below 4G) and therefore in more cases not have any >> mmio that is above 4G. >> >> For example using "-machine pc,max-ram-below-4g=2G" on the command >> line will limit the amount of ram that is below 4G to 2G. >> >> Signed-off-by: Don Slutz <dslutz@verizon.com> >> --- >> v5: >> Re-work based on: >> >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 >> >> >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ >> hw/i386/pc_piix.c | 15 ++++++++++++--- >> hw/i386/pc_q35.c | 15 ++++++++++++--- >> include/hw/i386/pc.h | 3 +++ >> vl.c | 4 ++++ >> 5 files changed, 69 insertions(+), 6 deletions(-) >> >> diff --git a/hw/i386/pc.c b/hw/i386/pc.c >> index 7cdba10..bccb746 100644 >> --- a/hw/i386/pc.c >> +++ b/hw/i386/pc.c >> @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, >> visit_type_int(v, &value, name, errp); >> } >> >> +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, >> + void *opaque, const char *name, >> + Error **errp) >> +{ >> + PCMachineState *pcms = PC_MACHINE(obj); >> + uint64_t value = pcms->max_ram_below_4g; >> + >> + visit_type_size(v, &value, name, errp); >> +} >> + >> +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, >> + void *opaque, const char *name, >> + Error **errp) >> +{ >> + PCMachineState *pcms = PC_MACHINE(obj); >> + Error *error = NULL; >> + uint64_t value; >> + >> + visit_type_size(v, &value, name, &error); >> + if (error) { >> + error_propagate(errp, error); >> + return; >> + } >> + if (value > (1ULL << 32)) { >> + error_set(&error, ERROR_CLASS_GENERIC_ERROR, >> + "Machine option 'max-ram-below-4g=%"PRIu64 >> + "' expects size less then or equal to 4G", value); > less than But the test is greater then. So "not greater then" is "less then or equal". Or did you want the test changed? >> + error_propagate(errp, error); >> + return; >> + } >> + >> + pcms->max_ram_below_4g = value; >> +} >> + >> static void pc_machine_initfn(Object *obj) >> { >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", >> pc_machine_get_hotplug_memory_region_size, >> NULL, NULL, NULL, NULL); >> + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", >> + pc_machine_get_max_ram_below_4g, >> + pc_machine_set_max_ram_below_4g, >> + NULL, NULL, NULL); >> } >> >> static void pc_machine_class_init(ObjectClass *oc, void *data) >> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >> index 40f6eaf..25f4727 100644 >> --- a/hw/i386/pc_piix.c >> +++ b/hw/i386/pc_piix.c >> @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, >> DeviceState *icc_bridge; >> FWCfgState *fw_cfg = NULL; >> PcGuestInfo *guest_info; >> + Object *mo = qdev_get_machine(); >> + PCMachineState *pcms = PC_MACHINE(mo); >> + ram_addr_t lowmem = 0xe0000000; >> + >> + if (pcms && pcms->max_ram_below_4g) { > Is pcms ever NULL? If yes why? Not that I know of. I would be happy to convert this to an assert(pcms). >> + lowmem = pcms->max_ram_below_4g; >> + } >> >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). >> * If it doesn't, we need to split it in chunks below and above 4G. >> @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, >> * For old machine types, use whatever split we used historically to avoid >> * breaking migration. >> */ >> - if (machine->ram_size >= 0xe0000000) { >> - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; >> + if (machine->ram_size >= lowmem) { >> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >> + lowmem = 0xc0000000; >> + } >> above_4g_mem_size = machine->ram_size - lowmem; >> below_4g_mem_size = lowmem; >> } else { > > So why do we need gigabyte_align anymore? Because of qemu 2.0 and the user is not required to specify this option. > Can't we set property to 0xc0000000 by default, and > override for old machine types? There is a strange compatibility part here. Since this code includes ram_size (see: http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html ) and xen has a different default. > Also, a value that isn't a multiple of 1G will lead to bad > performance for large machines which do have above_4g_mem_size. > Let's detect and print a warning. Will Do. -Don Slutz > > >> @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, >> } >> >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >> - object_property_add_child(qdev_get_machine(), "icc-bridge", >> + object_property_add_child(mo, "icc-bridge", >> OBJECT(icc_bridge), NULL); >> >> pc_cpus_init(machine->cpu_model, icc_bridge); >> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >> index e28ce40..155cdf1 100644 >> --- a/hw/i386/pc_q35.c >> +++ b/hw/i386/pc_q35.c >> @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) >> PCIDevice *ahci; >> DeviceState *icc_bridge; >> PcGuestInfo *guest_info; >> + Object *mo = qdev_get_machine(); >> + PCMachineState *pcms = PC_MACHINE(mo); >> + ram_addr_t lowmem = 0xb0000000; >> + >> + if (pcms && pcms->max_ram_below_4g) { >> + lowmem = pcms->max_ram_below_4g; >> + } >> >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping >> @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) >> * For old machine types, use whatever split we used historically to avoid >> * breaking migration. >> */ >> - if (machine->ram_size >= 0xb0000000) { >> - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; >> + if (machine->ram_size >= lowmem) { >> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >> + lowmem = 0x800000000; >> + } >> above_4g_mem_size = machine->ram_size - lowmem; >> below_4g_mem_size = lowmem; >> } else { >> @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) >> } >> >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >> - object_property_add_child(qdev_get_machine(), "icc-bridge", >> + object_property_add_child(mo, "icc-bridge", >> OBJECT(icc_bridge), NULL); >> >> pc_cpus_init(machine->cpu_model, icc_bridge); >> diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h >> index 19530bd..2d8b562 100644 >> --- a/include/hw/i386/pc.h >> +++ b/include/hw/i386/pc.h >> @@ -32,10 +32,13 @@ struct PCMachineState { >> MemoryRegion hotplug_memory; >> >> HotplugHandler *acpi_dev; >> + >> + uint64_t max_ram_below_4g; >> }; >> >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" >> +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" >> >> /** >> * PCMachineClass: >> diff --git a/vl.c b/vl.c >> index 5e77a27..cffb9c5 100644 >> --- a/vl.c >> +++ b/vl.c >> @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { >> .name = "kvm-type", >> .type = QEMU_OPT_STRING, >> .help = "Specifies the KVM virtualization mode (HV, PR)", >> + },{ >> + .name = PC_MACHINE_MAX_RAM_BELOW_4G, >> + .type = QEMU_OPT_SIZE, >> + .help = "maximum ram below the 4G boundary (32bit boundary)", >> }, >> { /* End of list */ } >> }, >> -- >> 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-09 14:20 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-09 14:20 UTC (permalink / raw) To: Michael S. Tsirkin, Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/08/14 11:40, Michael S. Tsirkin wrote: > On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: >> This is a pc & q35 only machine opt. One use is to allow for more >> ram in a 32bit guest for example: >> >> -machine pc,max-ram-below-4g=3.75G >> >> If you add enough PCI devices then all mmio for them will not fit >> below 4G which may not be the layout the user wanted. This allows >> you to increase the below 4G address space that PCI devices can use >> (aka decrease ram below 4G) and therefore in more cases not have any >> mmio that is above 4G. >> >> For example using "-machine pc,max-ram-below-4g=2G" on the command >> line will limit the amount of ram that is below 4G to 2G. >> >> Signed-off-by: Don Slutz <dslutz@verizon.com> >> --- >> v5: >> Re-work based on: >> >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 >> >> >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ >> hw/i386/pc_piix.c | 15 ++++++++++++--- >> hw/i386/pc_q35.c | 15 ++++++++++++--- >> include/hw/i386/pc.h | 3 +++ >> vl.c | 4 ++++ >> 5 files changed, 69 insertions(+), 6 deletions(-) >> >> diff --git a/hw/i386/pc.c b/hw/i386/pc.c >> index 7cdba10..bccb746 100644 >> --- a/hw/i386/pc.c >> +++ b/hw/i386/pc.c >> @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, >> visit_type_int(v, &value, name, errp); >> } >> >> +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, >> + void *opaque, const char *name, >> + Error **errp) >> +{ >> + PCMachineState *pcms = PC_MACHINE(obj); >> + uint64_t value = pcms->max_ram_below_4g; >> + >> + visit_type_size(v, &value, name, errp); >> +} >> + >> +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, >> + void *opaque, const char *name, >> + Error **errp) >> +{ >> + PCMachineState *pcms = PC_MACHINE(obj); >> + Error *error = NULL; >> + uint64_t value; >> + >> + visit_type_size(v, &value, name, &error); >> + if (error) { >> + error_propagate(errp, error); >> + return; >> + } >> + if (value > (1ULL << 32)) { >> + error_set(&error, ERROR_CLASS_GENERIC_ERROR, >> + "Machine option 'max-ram-below-4g=%"PRIu64 >> + "' expects size less then or equal to 4G", value); > less than But the test is greater then. So "not greater then" is "less then or equal". Or did you want the test changed? >> + error_propagate(errp, error); >> + return; >> + } >> + >> + pcms->max_ram_below_4g = value; >> +} >> + >> static void pc_machine_initfn(Object *obj) >> { >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", >> pc_machine_get_hotplug_memory_region_size, >> NULL, NULL, NULL, NULL); >> + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", >> + pc_machine_get_max_ram_below_4g, >> + pc_machine_set_max_ram_below_4g, >> + NULL, NULL, NULL); >> } >> >> static void pc_machine_class_init(ObjectClass *oc, void *data) >> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >> index 40f6eaf..25f4727 100644 >> --- a/hw/i386/pc_piix.c >> +++ b/hw/i386/pc_piix.c >> @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, >> DeviceState *icc_bridge; >> FWCfgState *fw_cfg = NULL; >> PcGuestInfo *guest_info; >> + Object *mo = qdev_get_machine(); >> + PCMachineState *pcms = PC_MACHINE(mo); >> + ram_addr_t lowmem = 0xe0000000; >> + >> + if (pcms && pcms->max_ram_below_4g) { > Is pcms ever NULL? If yes why? Not that I know of. I would be happy to convert this to an assert(pcms). >> + lowmem = pcms->max_ram_below_4g; >> + } >> >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). >> * If it doesn't, we need to split it in chunks below and above 4G. >> @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, >> * For old machine types, use whatever split we used historically to avoid >> * breaking migration. >> */ >> - if (machine->ram_size >= 0xe0000000) { >> - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; >> + if (machine->ram_size >= lowmem) { >> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >> + lowmem = 0xc0000000; >> + } >> above_4g_mem_size = machine->ram_size - lowmem; >> below_4g_mem_size = lowmem; >> } else { > > So why do we need gigabyte_align anymore? Because of qemu 2.0 and the user is not required to specify this option. > Can't we set property to 0xc0000000 by default, and > override for old machine types? There is a strange compatibility part here. Since this code includes ram_size (see: http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html ) and xen has a different default. > Also, a value that isn't a multiple of 1G will lead to bad > performance for large machines which do have above_4g_mem_size. > Let's detect and print a warning. Will Do. -Don Slutz > > >> @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, >> } >> >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >> - object_property_add_child(qdev_get_machine(), "icc-bridge", >> + object_property_add_child(mo, "icc-bridge", >> OBJECT(icc_bridge), NULL); >> >> pc_cpus_init(machine->cpu_model, icc_bridge); >> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >> index e28ce40..155cdf1 100644 >> --- a/hw/i386/pc_q35.c >> +++ b/hw/i386/pc_q35.c >> @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) >> PCIDevice *ahci; >> DeviceState *icc_bridge; >> PcGuestInfo *guest_info; >> + Object *mo = qdev_get_machine(); >> + PCMachineState *pcms = PC_MACHINE(mo); >> + ram_addr_t lowmem = 0xb0000000; >> + >> + if (pcms && pcms->max_ram_below_4g) { >> + lowmem = pcms->max_ram_below_4g; >> + } >> >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping >> @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) >> * For old machine types, use whatever split we used historically to avoid >> * breaking migration. >> */ >> - if (machine->ram_size >= 0xb0000000) { >> - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; >> + if (machine->ram_size >= lowmem) { >> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >> + lowmem = 0x800000000; >> + } >> above_4g_mem_size = machine->ram_size - lowmem; >> below_4g_mem_size = lowmem; >> } else { >> @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) >> } >> >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >> - object_property_add_child(qdev_get_machine(), "icc-bridge", >> + object_property_add_child(mo, "icc-bridge", >> OBJECT(icc_bridge), NULL); >> >> pc_cpus_init(machine->cpu_model, icc_bridge); >> diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h >> index 19530bd..2d8b562 100644 >> --- a/include/hw/i386/pc.h >> +++ b/include/hw/i386/pc.h >> @@ -32,10 +32,13 @@ struct PCMachineState { >> MemoryRegion hotplug_memory; >> >> HotplugHandler *acpi_dev; >> + >> + uint64_t max_ram_below_4g; >> }; >> >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" >> +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" >> >> /** >> * PCMachineClass: >> diff --git a/vl.c b/vl.c >> index 5e77a27..cffb9c5 100644 >> --- a/vl.c >> +++ b/vl.c >> @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { >> .name = "kvm-type", >> .type = QEMU_OPT_STRING, >> .help = "Specifies the KVM virtualization mode (HV, PR)", >> + },{ >> + .name = PC_MACHINE_MAX_RAM_BELOW_4G, >> + .type = QEMU_OPT_SIZE, >> + .help = "maximum ram below the 4G boundary (32bit boundary)", >> }, >> { /* End of list */ } >> }, >> -- >> 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-09 14:20 ` Don Slutz @ 2014-06-09 14:38 ` Michael S. Tsirkin -1 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-09 14:38 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: > On 06/08/14 11:40, Michael S. Tsirkin wrote: > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > >>This is a pc & q35 only machine opt. One use is to allow for more > >>ram in a 32bit guest for example: > >> > >>-machine pc,max-ram-below-4g=3.75G > >> > >>If you add enough PCI devices then all mmio for them will not fit > >>below 4G which may not be the layout the user wanted. This allows > >>you to increase the below 4G address space that PCI devices can use > >>(aka decrease ram below 4G) and therefore in more cases not have any > >>mmio that is above 4G. > >> > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > >>line will limit the amount of ram that is below 4G to 2G. > >> > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > >>--- > >>v5: > >> Re-work based on: > >> > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > >> > >> > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > >> include/hw/i386/pc.h | 3 +++ > >> vl.c | 4 ++++ > >> 5 files changed, 69 insertions(+), 6 deletions(-) > >> > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > >>index 7cdba10..bccb746 100644 > >>--- a/hw/i386/pc.c > >>+++ b/hw/i386/pc.c > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > >> visit_type_int(v, &value, name, errp); > >> } > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > >>+ void *opaque, const char *name, > >>+ Error **errp) > >>+{ > >>+ PCMachineState *pcms = PC_MACHINE(obj); > >>+ uint64_t value = pcms->max_ram_below_4g; > >>+ > >>+ visit_type_size(v, &value, name, errp); > >>+} > >>+ > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > >>+ void *opaque, const char *name, > >>+ Error **errp) > >>+{ > >>+ PCMachineState *pcms = PC_MACHINE(obj); > >>+ Error *error = NULL; > >>+ uint64_t value; > >>+ > >>+ visit_type_size(v, &value, name, &error); > >>+ if (error) { > >>+ error_propagate(errp, error); > >>+ return; > >>+ } > >>+ if (value > (1ULL << 32)) { > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > >>+ "' expects size less then or equal to 4G", value); > >less than > > But the test is greater then. So "not greater then" is "less then or equal". > Or did you want the test changed? No, just correcting English: less than, not less then :) > >>+ error_propagate(errp, error); > >>+ return; > >>+ } > >>+ > >>+ pcms->max_ram_below_4g = value; > >>+} > >>+ > >> static void pc_machine_initfn(Object *obj) > >> { > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > >> pc_machine_get_hotplug_memory_region_size, > >> NULL, NULL, NULL, NULL); > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > >>+ pc_machine_get_max_ram_below_4g, > >>+ pc_machine_set_max_ram_below_4g, > >>+ NULL, NULL, NULL); > >> } > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > >>index 40f6eaf..25f4727 100644 > >>--- a/hw/i386/pc_piix.c > >>+++ b/hw/i386/pc_piix.c > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > >> DeviceState *icc_bridge; > >> FWCfgState *fw_cfg = NULL; > >> PcGuestInfo *guest_info; > >>+ Object *mo = qdev_get_machine(); > >>+ PCMachineState *pcms = PC_MACHINE(mo); > >>+ ram_addr_t lowmem = 0xe0000000; > >>+ > >>+ if (pcms && pcms->max_ram_below_4g) { > >Is pcms ever NULL? If yes why? > > Not that I know of. I would be happy to convert this to an assert(pcms). In fact, PC_MACHINE already includes an assert doesn't it? So no need to check it everywhere. > >>+ lowmem = pcms->max_ram_below_4g; > >>+ } > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > >> * If it doesn't, we need to split it in chunks below and above 4G. > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > >> * For old machine types, use whatever split we used historically to avoid > >> * breaking migration. > >> */ > >>- if (machine->ram_size >= 0xe0000000) { > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > >>+ if (machine->ram_size >= lowmem) { > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > >>+ lowmem = 0xc0000000; > >>+ } > >> above_4g_mem_size = machine->ram_size - lowmem; > >> below_4g_mem_size = lowmem; > >> } else { > > > >So why do we need gigabyte_align anymore? > > Because of qemu 2.0 and the user is not required to specify this option. > > >Can't we set property to 0xc0000000 by default, and > >override for old machine types? > > There is a strange compatibility part here. Since this code includes ram_size (see: > > http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html > > ) and xen has a different default. > So instead of default 0, it would be preferable to set the default to the actual value, and let user override it. Or if that's too hard, set max_ram_below_4g instead of setting gigabyte_align. gigabyte_align switches everywhere is messy enough, adding max_ram_below_4g into mix is just too messy. > >Also, a value that isn't a multiple of 1G will lead to bad > >performance for large machines which do have above_4g_mem_size. > >Let's detect and print a warning. > > Will Do. > > -Don Slutz > > > > > > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > >> } > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > >>+ object_property_add_child(mo, "icc-bridge", > >> OBJECT(icc_bridge), NULL); > >> pc_cpus_init(machine->cpu_model, icc_bridge); > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > >>index e28ce40..155cdf1 100644 > >>--- a/hw/i386/pc_q35.c > >>+++ b/hw/i386/pc_q35.c > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > >> PCIDevice *ahci; > >> DeviceState *icc_bridge; > >> PcGuestInfo *guest_info; > >>+ Object *mo = qdev_get_machine(); > >>+ PCMachineState *pcms = PC_MACHINE(mo); > >>+ ram_addr_t lowmem = 0xb0000000; > >>+ > >>+ if (pcms && pcms->max_ram_below_4g) { > >>+ lowmem = pcms->max_ram_below_4g; > >>+ } > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > >> * For old machine types, use whatever split we used historically to avoid > >> * breaking migration. > >> */ > >>- if (machine->ram_size >= 0xb0000000) { > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > >>+ if (machine->ram_size >= lowmem) { > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > >>+ lowmem = 0x800000000; > >>+ } > >> above_4g_mem_size = machine->ram_size - lowmem; > >> below_4g_mem_size = lowmem; > >> } else { > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > >> } > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > >>+ object_property_add_child(mo, "icc-bridge", > >> OBJECT(icc_bridge), NULL); > >> pc_cpus_init(machine->cpu_model, icc_bridge); > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > >>index 19530bd..2d8b562 100644 > >>--- a/include/hw/i386/pc.h > >>+++ b/include/hw/i386/pc.h > >>@@ -32,10 +32,13 @@ struct PCMachineState { > >> MemoryRegion hotplug_memory; > >> HotplugHandler *acpi_dev; > >>+ > >>+ uint64_t max_ram_below_4g; > >> }; > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > >> /** > >> * PCMachineClass: > >>diff --git a/vl.c b/vl.c > >>index 5e77a27..cffb9c5 100644 > >>--- a/vl.c > >>+++ b/vl.c > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > >> .name = "kvm-type", > >> .type = QEMU_OPT_STRING, > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > >>+ },{ > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > >>+ .type = QEMU_OPT_SIZE, > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > >> }, > >> { /* End of list */ } > >> }, > >>-- > >>1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-09 14:38 ` Michael S. Tsirkin 0 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-09 14:38 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: > On 06/08/14 11:40, Michael S. Tsirkin wrote: > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > >>This is a pc & q35 only machine opt. One use is to allow for more > >>ram in a 32bit guest for example: > >> > >>-machine pc,max-ram-below-4g=3.75G > >> > >>If you add enough PCI devices then all mmio for them will not fit > >>below 4G which may not be the layout the user wanted. This allows > >>you to increase the below 4G address space that PCI devices can use > >>(aka decrease ram below 4G) and therefore in more cases not have any > >>mmio that is above 4G. > >> > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > >>line will limit the amount of ram that is below 4G to 2G. > >> > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > >>--- > >>v5: > >> Re-work based on: > >> > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > >> > >> > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > >> include/hw/i386/pc.h | 3 +++ > >> vl.c | 4 ++++ > >> 5 files changed, 69 insertions(+), 6 deletions(-) > >> > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > >>index 7cdba10..bccb746 100644 > >>--- a/hw/i386/pc.c > >>+++ b/hw/i386/pc.c > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > >> visit_type_int(v, &value, name, errp); > >> } > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > >>+ void *opaque, const char *name, > >>+ Error **errp) > >>+{ > >>+ PCMachineState *pcms = PC_MACHINE(obj); > >>+ uint64_t value = pcms->max_ram_below_4g; > >>+ > >>+ visit_type_size(v, &value, name, errp); > >>+} > >>+ > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > >>+ void *opaque, const char *name, > >>+ Error **errp) > >>+{ > >>+ PCMachineState *pcms = PC_MACHINE(obj); > >>+ Error *error = NULL; > >>+ uint64_t value; > >>+ > >>+ visit_type_size(v, &value, name, &error); > >>+ if (error) { > >>+ error_propagate(errp, error); > >>+ return; > >>+ } > >>+ if (value > (1ULL << 32)) { > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > >>+ "' expects size less then or equal to 4G", value); > >less than > > But the test is greater then. So "not greater then" is "less then or equal". > Or did you want the test changed? No, just correcting English: less than, not less then :) > >>+ error_propagate(errp, error); > >>+ return; > >>+ } > >>+ > >>+ pcms->max_ram_below_4g = value; > >>+} > >>+ > >> static void pc_machine_initfn(Object *obj) > >> { > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > >> pc_machine_get_hotplug_memory_region_size, > >> NULL, NULL, NULL, NULL); > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > >>+ pc_machine_get_max_ram_below_4g, > >>+ pc_machine_set_max_ram_below_4g, > >>+ NULL, NULL, NULL); > >> } > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > >>index 40f6eaf..25f4727 100644 > >>--- a/hw/i386/pc_piix.c > >>+++ b/hw/i386/pc_piix.c > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > >> DeviceState *icc_bridge; > >> FWCfgState *fw_cfg = NULL; > >> PcGuestInfo *guest_info; > >>+ Object *mo = qdev_get_machine(); > >>+ PCMachineState *pcms = PC_MACHINE(mo); > >>+ ram_addr_t lowmem = 0xe0000000; > >>+ > >>+ if (pcms && pcms->max_ram_below_4g) { > >Is pcms ever NULL? If yes why? > > Not that I know of. I would be happy to convert this to an assert(pcms). In fact, PC_MACHINE already includes an assert doesn't it? So no need to check it everywhere. > >>+ lowmem = pcms->max_ram_below_4g; > >>+ } > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > >> * If it doesn't, we need to split it in chunks below and above 4G. > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > >> * For old machine types, use whatever split we used historically to avoid > >> * breaking migration. > >> */ > >>- if (machine->ram_size >= 0xe0000000) { > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > >>+ if (machine->ram_size >= lowmem) { > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > >>+ lowmem = 0xc0000000; > >>+ } > >> above_4g_mem_size = machine->ram_size - lowmem; > >> below_4g_mem_size = lowmem; > >> } else { > > > >So why do we need gigabyte_align anymore? > > Because of qemu 2.0 and the user is not required to specify this option. > > >Can't we set property to 0xc0000000 by default, and > >override for old machine types? > > There is a strange compatibility part here. Since this code includes ram_size (see: > > http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html > > ) and xen has a different default. > So instead of default 0, it would be preferable to set the default to the actual value, and let user override it. Or if that's too hard, set max_ram_below_4g instead of setting gigabyte_align. gigabyte_align switches everywhere is messy enough, adding max_ram_below_4g into mix is just too messy. > >Also, a value that isn't a multiple of 1G will lead to bad > >performance for large machines which do have above_4g_mem_size. > >Let's detect and print a warning. > > Will Do. > > -Don Slutz > > > > > > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > >> } > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > >>+ object_property_add_child(mo, "icc-bridge", > >> OBJECT(icc_bridge), NULL); > >> pc_cpus_init(machine->cpu_model, icc_bridge); > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > >>index e28ce40..155cdf1 100644 > >>--- a/hw/i386/pc_q35.c > >>+++ b/hw/i386/pc_q35.c > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > >> PCIDevice *ahci; > >> DeviceState *icc_bridge; > >> PcGuestInfo *guest_info; > >>+ Object *mo = qdev_get_machine(); > >>+ PCMachineState *pcms = PC_MACHINE(mo); > >>+ ram_addr_t lowmem = 0xb0000000; > >>+ > >>+ if (pcms && pcms->max_ram_below_4g) { > >>+ lowmem = pcms->max_ram_below_4g; > >>+ } > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > >> * For old machine types, use whatever split we used historically to avoid > >> * breaking migration. > >> */ > >>- if (machine->ram_size >= 0xb0000000) { > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > >>+ if (machine->ram_size >= lowmem) { > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > >>+ lowmem = 0x800000000; > >>+ } > >> above_4g_mem_size = machine->ram_size - lowmem; > >> below_4g_mem_size = lowmem; > >> } else { > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > >> } > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > >>+ object_property_add_child(mo, "icc-bridge", > >> OBJECT(icc_bridge), NULL); > >> pc_cpus_init(machine->cpu_model, icc_bridge); > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > >>index 19530bd..2d8b562 100644 > >>--- a/include/hw/i386/pc.h > >>+++ b/include/hw/i386/pc.h > >>@@ -32,10 +32,13 @@ struct PCMachineState { > >> MemoryRegion hotplug_memory; > >> HotplugHandler *acpi_dev; > >>+ > >>+ uint64_t max_ram_below_4g; > >> }; > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > >> /** > >> * PCMachineClass: > >>diff --git a/vl.c b/vl.c > >>index 5e77a27..cffb9c5 100644 > >>--- a/vl.c > >>+++ b/vl.c > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > >> .name = "kvm-type", > >> .type = QEMU_OPT_STRING, > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > >>+ },{ > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > >>+ .type = QEMU_OPT_SIZE, > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > >> }, > >> { /* End of list */ } > >> }, > >>-- > >>1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-09 14:38 ` Michael S. Tsirkin (?) @ 2014-06-09 15:10 ` Marcel Apfelbaum 2014-06-09 15:37 ` Igor Mammedov -1 siblings, 1 reply; 53+ messages in thread From: Marcel Apfelbaum @ 2014-06-09 15:10 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber Hi, On Mon, 2014-06-09 at 17:38 +0300, Michael S. Tsirkin wrote: > On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: > > On 06/08/14 11:40, Michael S. Tsirkin wrote: > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > >>This is a pc & q35 only machine opt. One use is to allow for more > > >>ram in a 32bit guest for example: > > >> > > >>-machine pc,max-ram-below-4g=3.75G > > >> > > >>If you add enough PCI devices then all mmio for them will not fit > > >>below 4G which may not be the layout the user wanted. This allows > > >>you to increase the below 4G address space that PCI devices can use > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > >>mmio that is above 4G. > > >> > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > >>line will limit the amount of ram that is below 4G to 2G. > > >> > > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > > >>--- > > >>v5: > > >> Re-work based on: > > >> > > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > >> > > >> > > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > > >> include/hw/i386/pc.h | 3 +++ > > >> vl.c | 4 ++++ > > >> 5 files changed, 69 insertions(+), 6 deletions(-) > > >> > > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > > >>index 7cdba10..bccb746 100644 > > >>--- a/hw/i386/pc.c > > >>+++ b/hw/i386/pc.c > > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > > >> visit_type_int(v, &value, name, errp); > > >> } > > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > > >>+ void *opaque, const char *name, > > >>+ Error **errp) > > >>+{ > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > >>+ uint64_t value = pcms->max_ram_below_4g; > > >>+ > > >>+ visit_type_size(v, &value, name, errp); > > >>+} > > >>+ > > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > > >>+ void *opaque, const char *name, > > >>+ Error **errp) > > >>+{ > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > >>+ Error *error = NULL; > > >>+ uint64_t value; > > >>+ > > >>+ visit_type_size(v, &value, name, &error); > > >>+ if (error) { > > >>+ error_propagate(errp, error); > > >>+ return; > > >>+ } > > >>+ if (value > (1ULL << 32)) { > > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > > >>+ "' expects size less then or equal to 4G", value); > > >less than > > > > But the test is greater then. So "not greater then" is "less then or equal". > > Or did you want the test changed? > > No, just correcting English: less than, not less then :) > > > >>+ error_propagate(errp, error); > > >>+ return; > > >>+ } > > >>+ > > >>+ pcms->max_ram_below_4g = value; > > >>+} > > >>+ > > >> static void pc_machine_initfn(Object *obj) > > >> { > > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > > >> pc_machine_get_hotplug_memory_region_size, > > >> NULL, NULL, NULL, NULL); > > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > > >>+ pc_machine_get_max_ram_below_4g, > > >>+ pc_machine_set_max_ram_below_4g, > > >>+ NULL, NULL, NULL); Maybe you can add here a sane default and avoid comparison with 0 any time you use it. If you think you need value per machine type, you can add it to compat props. I don't see how is related, so you may not want to do so. > > >> } > > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > > >>index 40f6eaf..25f4727 100644 > > >>--- a/hw/i386/pc_piix.c > > >>+++ b/hw/i386/pc_piix.c > > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > > >> DeviceState *icc_bridge; > > >> FWCfgState *fw_cfg = NULL; > > >> PcGuestInfo *guest_info; > > >>+ Object *mo = qdev_get_machine(); > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > >>+ ram_addr_t lowmem = 0xe0000000; > > >>+ > > >>+ if (pcms && pcms->max_ram_below_4g) { >From my QOM understanding, max_ram_below_4g is a private field, so it not should be used directly. You can use QOMs object_property_get or add a pc_machine wrapper for getting/setting the field. > > >Is pcms ever NULL? If yes why? > > > > Not that I know of. I would be happy to convert this to an assert(pcms). > > In fact, PC_MACHINE already includes an assert doesn't it? > So no need to check it everywhere. +1. No need for assert here. Is already done by OBJECT_CHECK. Hope I helped, Marcel > > > >>+ lowmem = pcms->max_ram_below_4g; > > >>+ } > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > > >> * If it doesn't, we need to split it in chunks below and above 4G. > > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > > >> * For old machine types, use whatever split we used historically to avoid > > >> * breaking migration. > > >> */ > > >>- if (machine->ram_size >= 0xe0000000) { > > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > > >>+ if (machine->ram_size >= lowmem) { > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > >>+ lowmem = 0xc0000000; > > >>+ } > > >> above_4g_mem_size = machine->ram_size - lowmem; > > >> below_4g_mem_size = lowmem; > > >> } else { > > > > > >So why do we need gigabyte_align anymore? > > > > Because of qemu 2.0 and the user is not required to specify this option. > > > > >Can't we set property to 0xc0000000 by default, and > > >override for old machine types? > > > > There is a strange compatibility part here. Since this code includes ram_size (see: > > > > http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html > > > > ) and xen has a different default. > > > > So instead of default 0, it would be preferable to set the default to the > actual value, and let user override it. > > Or if that's too hard, set max_ram_below_4g instead of setting > gigabyte_align. gigabyte_align switches everywhere is messy > enough, adding max_ram_below_4g into mix is just too messy. > > > > > >Also, a value that isn't a multiple of 1G will lead to bad > > >performance for large machines which do have above_4g_mem_size. > > >Let's detect and print a warning. > > > > Will Do. > > > > -Don Slutz > > > > > > > > > > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > > >> } > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > >>+ object_property_add_child(mo, "icc-bridge", > > >> OBJECT(icc_bridge), NULL); > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > > >>index e28ce40..155cdf1 100644 > > >>--- a/hw/i386/pc_q35.c > > >>+++ b/hw/i386/pc_q35.c > > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > > >> PCIDevice *ahci; > > >> DeviceState *icc_bridge; > > >> PcGuestInfo *guest_info; > > >>+ Object *mo = qdev_get_machine(); > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > >>+ ram_addr_t lowmem = 0xb0000000; > > >>+ > > >>+ if (pcms && pcms->max_ram_below_4g) { > > >>+ lowmem = pcms->max_ram_below_4g; > > >>+ } > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > > >> * For old machine types, use whatever split we used historically to avoid > > >> * breaking migration. > > >> */ > > >>- if (machine->ram_size >= 0xb0000000) { > > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > > >>+ if (machine->ram_size >= lowmem) { > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > >>+ lowmem = 0x800000000; > > >>+ } > > >> above_4g_mem_size = machine->ram_size - lowmem; > > >> below_4g_mem_size = lowmem; > > >> } else { > > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > > >> } > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > >>+ object_property_add_child(mo, "icc-bridge", > > >> OBJECT(icc_bridge), NULL); > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > > >>index 19530bd..2d8b562 100644 > > >>--- a/include/hw/i386/pc.h > > >>+++ b/include/hw/i386/pc.h > > >>@@ -32,10 +32,13 @@ struct PCMachineState { > > >> MemoryRegion hotplug_memory; > > >> HotplugHandler *acpi_dev; > > >>+ > > >>+ uint64_t max_ram_below_4g; > > >> }; > > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > >> /** > > >> * PCMachineClass: > > >>diff --git a/vl.c b/vl.c > > >>index 5e77a27..cffb9c5 100644 > > >>--- a/vl.c > > >>+++ b/vl.c > > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > > >> .name = "kvm-type", > > >> .type = QEMU_OPT_STRING, > > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > > >>+ },{ > > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > > >>+ .type = QEMU_OPT_SIZE, > > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > > >> }, > > >> { /* End of list */ } > > >> }, > > >>-- > > >>1.8.4 > ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-09 15:10 ` [Qemu-devel] " Marcel Apfelbaum @ 2014-06-09 15:37 ` Igor Mammedov 0 siblings, 0 replies; 53+ messages in thread From: Igor Mammedov @ 2014-06-09 15:37 UTC (permalink / raw) To: Marcel Apfelbaum Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Don Slutz, Anthony Liguori, Andreas Färber On Mon, 09 Jun 2014 18:10:27 +0300 Marcel Apfelbaum <marcel.a@redhat.com> wrote: > Hi, > > On Mon, 2014-06-09 at 17:38 +0300, Michael S. Tsirkin wrote: > > On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: > > > On 06/08/14 11:40, Michael S. Tsirkin wrote: > > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > > >>This is a pc & q35 only machine opt. One use is to allow for more > > > >>ram in a 32bit guest for example: > > > >> > > > >>-machine pc,max-ram-below-4g=3.75G > > > >> > > > >>If you add enough PCI devices then all mmio for them will not fit > > > >>below 4G which may not be the layout the user wanted. This allows > > > >>you to increase the below 4G address space that PCI devices can use > > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > > >>mmio that is above 4G. > > > >> > > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > > >>line will limit the amount of ram that is below 4G to 2G. > > > >> > > > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > > > >>--- > > > >>v5: > > > >> Re-work based on: > > > >> > > > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > > >> > > > >> > > > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > > > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > > > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > > > >> include/hw/i386/pc.h | 3 +++ > > > >> vl.c | 4 ++++ > > > >> 5 files changed, 69 insertions(+), 6 deletions(-) > > > >> > > > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > > > >>index 7cdba10..bccb746 100644 > > > >>--- a/hw/i386/pc.c > > > >>+++ b/hw/i386/pc.c > > > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > > > >> visit_type_int(v, &value, name, errp); > > > >> } > > > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > > > >>+ void *opaque, const char *name, > > > >>+ Error **errp) > > > >>+{ > > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > > >>+ uint64_t value = pcms->max_ram_below_4g; > > > >>+ > > > >>+ visit_type_size(v, &value, name, errp); > > > >>+} > > > >>+ > > > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > > > >>+ void *opaque, const char *name, > > > >>+ Error **errp) > > > >>+{ > > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > > >>+ Error *error = NULL; > > > >>+ uint64_t value; > > > >>+ > > > >>+ visit_type_size(v, &value, name, &error); > > > >>+ if (error) { > > > >>+ error_propagate(errp, error); > > > >>+ return; > > > >>+ } > > > >>+ if (value > (1ULL << 32)) { > > > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > > > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > > > >>+ "' expects size less then or equal to 4G", value); > > > >less than > > > > > > But the test is greater then. So "not greater then" is "less then or equal". > > > Or did you want the test changed? > > > > No, just correcting English: less than, not less then :) > > > > > >>+ error_propagate(errp, error); > > > >>+ return; > > > >>+ } > > > >>+ > > > >>+ pcms->max_ram_below_4g = value; > > > >>+} > > > >>+ > > > >> static void pc_machine_initfn(Object *obj) > > > >> { > > > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > > > >> pc_machine_get_hotplug_memory_region_size, > > > >> NULL, NULL, NULL, NULL); > > > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > > > >>+ pc_machine_get_max_ram_below_4g, > > > >>+ pc_machine_set_max_ram_below_4g, > > > >>+ NULL, NULL, NULL); > Maybe you can add here a sane default and avoid comparison with 0 > any time you use it. +1 > If you think you need value per machine type, you can add it to > compat props. I don't see how is related, so you may not want to do so. Using compat_props would be great however does compat_props work for machine type itself already? > > > > >> } > > > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > > > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > > > >>index 40f6eaf..25f4727 100644 > > > >>--- a/hw/i386/pc_piix.c > > > >>+++ b/hw/i386/pc_piix.c > > > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > > > >> DeviceState *icc_bridge; > > > >> FWCfgState *fw_cfg = NULL; > > > >> PcGuestInfo *guest_info; > > > >>+ Object *mo = qdev_get_machine(); > > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > > >>+ ram_addr_t lowmem = 0xe0000000; > > > >>+ > > > >>+ if (pcms && pcms->max_ram_below_4g) { > From my QOM understanding, max_ram_below_4g is a private field, > so it not should be used directly. > You can use QOMs object_property_get or add a pc_machine wrapper > for getting/setting the field. pc_init1() is sort of private function of PCMachine, so there is no much point to use verbose getters/setters internally unless there is checks behind setter. > > > > >Is pcms ever NULL? If yes why? > > > > > > Not that I know of. I would be happy to convert this to an assert(pcms). > > > > In fact, PC_MACHINE already includes an assert doesn't it? > > So no need to check it everywhere. > > +1. No need for assert here. Is already done by OBJECT_CHECK. > > Hope I helped, > Marcel > > > > > > >>+ lowmem = pcms->max_ram_below_4g; > > > >>+ } > > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > > > >> * If it doesn't, we need to split it in chunks below and above 4G. > > > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > > > >> * For old machine types, use whatever split we used historically to avoid > > > >> * breaking migration. > > > >> */ > > > >>- if (machine->ram_size >= 0xe0000000) { > > > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > > > >>+ if (machine->ram_size >= lowmem) { > > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > > >>+ lowmem = 0xc0000000; > > > >>+ } > > > >> above_4g_mem_size = machine->ram_size - lowmem; > > > >> below_4g_mem_size = lowmem; > > > >> } else { > > > > > > > >So why do we need gigabyte_align anymore? > > > > > > Because of qemu 2.0 and the user is not required to specify this option. > > > > > > >Can't we set property to 0xc0000000 by default, and > > > >override for old machine types? > > > > > > There is a strange compatibility part here. Since this code includes ram_size (see: > > > > > > http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html > > > > > > ) and xen has a different default. > > > > > > > So instead of default 0, it would be preferable to set the default to the > > actual value, and let user override it. > > > > Or if that's too hard, set max_ram_below_4g instead of setting > > gigabyte_align. gigabyte_align switches everywhere is messy > > enough, adding max_ram_below_4g into mix is just too messy. > > > > > > > > > >Also, a value that isn't a multiple of 1G will lead to bad > > > >performance for large machines which do have above_4g_mem_size. > > > >Let's detect and print a warning. > > > > > > Will Do. > > > > > > -Don Slutz > > > > > > > > > > > > > > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > > > >> } > > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > > >>+ object_property_add_child(mo, "icc-bridge", > > > >> OBJECT(icc_bridge), NULL); > > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > > > >>index e28ce40..155cdf1 100644 > > > >>--- a/hw/i386/pc_q35.c > > > >>+++ b/hw/i386/pc_q35.c > > > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > > > >> PCIDevice *ahci; > > > >> DeviceState *icc_bridge; > > > >> PcGuestInfo *guest_info; > > > >>+ Object *mo = qdev_get_machine(); > > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > > >>+ ram_addr_t lowmem = 0xb0000000; > > > >>+ > > > >>+ if (pcms && pcms->max_ram_below_4g) { > > > >>+ lowmem = pcms->max_ram_below_4g; > > > >>+ } > > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > > > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > > > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > > > >> * For old machine types, use whatever split we used historically to avoid > > > >> * breaking migration. > > > >> */ > > > >>- if (machine->ram_size >= 0xb0000000) { > > > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > > > >>+ if (machine->ram_size >= lowmem) { > > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > > >>+ lowmem = 0x800000000; > > > >>+ } > > > >> above_4g_mem_size = machine->ram_size - lowmem; > > > >> below_4g_mem_size = lowmem; > > > >> } else { > > > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > > > >> } > > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > > >>+ object_property_add_child(mo, "icc-bridge", > > > >> OBJECT(icc_bridge), NULL); > > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > > > >>index 19530bd..2d8b562 100644 > > > >>--- a/include/hw/i386/pc.h > > > >>+++ b/include/hw/i386/pc.h > > > >>@@ -32,10 +32,13 @@ struct PCMachineState { > > > >> MemoryRegion hotplug_memory; > > > >> HotplugHandler *acpi_dev; > > > >>+ > > > >>+ uint64_t max_ram_below_4g; > > > >> }; > > > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > > > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > > > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > > >> /** > > > >> * PCMachineClass: > > > >>diff --git a/vl.c b/vl.c > > > >>index 5e77a27..cffb9c5 100644 > > > >>--- a/vl.c > > > >>+++ b/vl.c > > > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > > > >> .name = "kvm-type", > > > >> .type = QEMU_OPT_STRING, > > > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > > > >>+ },{ > > > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > > > >>+ .type = QEMU_OPT_SIZE, > > > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > > > >> }, > > > >> { /* End of list */ } > > > >> }, > > > >>-- > > > >>1.8.4 > > > > > -- Regards, Igor ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-09 15:37 ` Igor Mammedov 0 siblings, 0 replies; 53+ messages in thread From: Igor Mammedov @ 2014-06-09 15:37 UTC (permalink / raw) To: Marcel Apfelbaum Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Don Slutz, Anthony Liguori, Andreas Färber On Mon, 09 Jun 2014 18:10:27 +0300 Marcel Apfelbaum <marcel.a@redhat.com> wrote: > Hi, > > On Mon, 2014-06-09 at 17:38 +0300, Michael S. Tsirkin wrote: > > On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: > > > On 06/08/14 11:40, Michael S. Tsirkin wrote: > > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > > >>This is a pc & q35 only machine opt. One use is to allow for more > > > >>ram in a 32bit guest for example: > > > >> > > > >>-machine pc,max-ram-below-4g=3.75G > > > >> > > > >>If you add enough PCI devices then all mmio for them will not fit > > > >>below 4G which may not be the layout the user wanted. This allows > > > >>you to increase the below 4G address space that PCI devices can use > > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > > >>mmio that is above 4G. > > > >> > > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > > >>line will limit the amount of ram that is below 4G to 2G. > > > >> > > > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > > > >>--- > > > >>v5: > > > >> Re-work based on: > > > >> > > > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > > >> > > > >> > > > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > > > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > > > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > > > >> include/hw/i386/pc.h | 3 +++ > > > >> vl.c | 4 ++++ > > > >> 5 files changed, 69 insertions(+), 6 deletions(-) > > > >> > > > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > > > >>index 7cdba10..bccb746 100644 > > > >>--- a/hw/i386/pc.c > > > >>+++ b/hw/i386/pc.c > > > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > > > >> visit_type_int(v, &value, name, errp); > > > >> } > > > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > > > >>+ void *opaque, const char *name, > > > >>+ Error **errp) > > > >>+{ > > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > > >>+ uint64_t value = pcms->max_ram_below_4g; > > > >>+ > > > >>+ visit_type_size(v, &value, name, errp); > > > >>+} > > > >>+ > > > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > > > >>+ void *opaque, const char *name, > > > >>+ Error **errp) > > > >>+{ > > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > > >>+ Error *error = NULL; > > > >>+ uint64_t value; > > > >>+ > > > >>+ visit_type_size(v, &value, name, &error); > > > >>+ if (error) { > > > >>+ error_propagate(errp, error); > > > >>+ return; > > > >>+ } > > > >>+ if (value > (1ULL << 32)) { > > > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > > > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > > > >>+ "' expects size less then or equal to 4G", value); > > > >less than > > > > > > But the test is greater then. So "not greater then" is "less then or equal". > > > Or did you want the test changed? > > > > No, just correcting English: less than, not less then :) > > > > > >>+ error_propagate(errp, error); > > > >>+ return; > > > >>+ } > > > >>+ > > > >>+ pcms->max_ram_below_4g = value; > > > >>+} > > > >>+ > > > >> static void pc_machine_initfn(Object *obj) > > > >> { > > > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > > > >> pc_machine_get_hotplug_memory_region_size, > > > >> NULL, NULL, NULL, NULL); > > > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > > > >>+ pc_machine_get_max_ram_below_4g, > > > >>+ pc_machine_set_max_ram_below_4g, > > > >>+ NULL, NULL, NULL); > Maybe you can add here a sane default and avoid comparison with 0 > any time you use it. +1 > If you think you need value per machine type, you can add it to > compat props. I don't see how is related, so you may not want to do so. Using compat_props would be great however does compat_props work for machine type itself already? > > > > >> } > > > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > > > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > > > >>index 40f6eaf..25f4727 100644 > > > >>--- a/hw/i386/pc_piix.c > > > >>+++ b/hw/i386/pc_piix.c > > > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > > > >> DeviceState *icc_bridge; > > > >> FWCfgState *fw_cfg = NULL; > > > >> PcGuestInfo *guest_info; > > > >>+ Object *mo = qdev_get_machine(); > > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > > >>+ ram_addr_t lowmem = 0xe0000000; > > > >>+ > > > >>+ if (pcms && pcms->max_ram_below_4g) { > From my QOM understanding, max_ram_below_4g is a private field, > so it not should be used directly. > You can use QOMs object_property_get or add a pc_machine wrapper > for getting/setting the field. pc_init1() is sort of private function of PCMachine, so there is no much point to use verbose getters/setters internally unless there is checks behind setter. > > > > >Is pcms ever NULL? If yes why? > > > > > > Not that I know of. I would be happy to convert this to an assert(pcms). > > > > In fact, PC_MACHINE already includes an assert doesn't it? > > So no need to check it everywhere. > > +1. No need for assert here. Is already done by OBJECT_CHECK. > > Hope I helped, > Marcel > > > > > > >>+ lowmem = pcms->max_ram_below_4g; > > > >>+ } > > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > > > >> * If it doesn't, we need to split it in chunks below and above 4G. > > > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > > > >> * For old machine types, use whatever split we used historically to avoid > > > >> * breaking migration. > > > >> */ > > > >>- if (machine->ram_size >= 0xe0000000) { > > > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > > > >>+ if (machine->ram_size >= lowmem) { > > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > > >>+ lowmem = 0xc0000000; > > > >>+ } > > > >> above_4g_mem_size = machine->ram_size - lowmem; > > > >> below_4g_mem_size = lowmem; > > > >> } else { > > > > > > > >So why do we need gigabyte_align anymore? > > > > > > Because of qemu 2.0 and the user is not required to specify this option. > > > > > > >Can't we set property to 0xc0000000 by default, and > > > >override for old machine types? > > > > > > There is a strange compatibility part here. Since this code includes ram_size (see: > > > > > > http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html > > > > > > ) and xen has a different default. > > > > > > > So instead of default 0, it would be preferable to set the default to the > > actual value, and let user override it. > > > > Or if that's too hard, set max_ram_below_4g instead of setting > > gigabyte_align. gigabyte_align switches everywhere is messy > > enough, adding max_ram_below_4g into mix is just too messy. > > > > > > > > > >Also, a value that isn't a multiple of 1G will lead to bad > > > >performance for large machines which do have above_4g_mem_size. > > > >Let's detect and print a warning. > > > > > > Will Do. > > > > > > -Don Slutz > > > > > > > > > > > > > > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > > > >> } > > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > > >>+ object_property_add_child(mo, "icc-bridge", > > > >> OBJECT(icc_bridge), NULL); > > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > > > >>index e28ce40..155cdf1 100644 > > > >>--- a/hw/i386/pc_q35.c > > > >>+++ b/hw/i386/pc_q35.c > > > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > > > >> PCIDevice *ahci; > > > >> DeviceState *icc_bridge; > > > >> PcGuestInfo *guest_info; > > > >>+ Object *mo = qdev_get_machine(); > > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > > >>+ ram_addr_t lowmem = 0xb0000000; > > > >>+ > > > >>+ if (pcms && pcms->max_ram_below_4g) { > > > >>+ lowmem = pcms->max_ram_below_4g; > > > >>+ } > > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > > > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > > > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > > > >> * For old machine types, use whatever split we used historically to avoid > > > >> * breaking migration. > > > >> */ > > > >>- if (machine->ram_size >= 0xb0000000) { > > > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > > > >>+ if (machine->ram_size >= lowmem) { > > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > > >>+ lowmem = 0x800000000; > > > >>+ } > > > >> above_4g_mem_size = machine->ram_size - lowmem; > > > >> below_4g_mem_size = lowmem; > > > >> } else { > > > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > > > >> } > > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > > >>+ object_property_add_child(mo, "icc-bridge", > > > >> OBJECT(icc_bridge), NULL); > > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > > > >>index 19530bd..2d8b562 100644 > > > >>--- a/include/hw/i386/pc.h > > > >>+++ b/include/hw/i386/pc.h > > > >>@@ -32,10 +32,13 @@ struct PCMachineState { > > > >> MemoryRegion hotplug_memory; > > > >> HotplugHandler *acpi_dev; > > > >>+ > > > >>+ uint64_t max_ram_below_4g; > > > >> }; > > > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > > > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > > > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > > >> /** > > > >> * PCMachineClass: > > > >>diff --git a/vl.c b/vl.c > > > >>index 5e77a27..cffb9c5 100644 > > > >>--- a/vl.c > > > >>+++ b/vl.c > > > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > > > >> .name = "kvm-type", > > > >> .type = QEMU_OPT_STRING, > > > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > > > >>+ },{ > > > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > > > >>+ .type = QEMU_OPT_SIZE, > > > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > > > >> }, > > > >> { /* End of list */ } > > > >> }, > > > >>-- > > > >>1.8.4 > > > > > -- Regards, Igor ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-09 15:37 ` Igor Mammedov @ 2014-06-09 17:33 ` Marcel Apfelbaum -1 siblings, 0 replies; 53+ messages in thread From: Marcel Apfelbaum @ 2014-06-09 17:33 UTC (permalink / raw) To: Igor Mammedov Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Don Slutz, Anthony Liguori, Andreas Färber On Mon, 2014-06-09 at 17:37 +0200, Igor Mammedov wrote: > On Mon, 09 Jun 2014 18:10:27 +0300 > Marcel Apfelbaum <marcel.a@redhat.com> wrote: > > > Hi, > > > > On Mon, 2014-06-09 at 17:38 +0300, Michael S. Tsirkin wrote: > > > On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: > > > > On 06/08/14 11:40, Michael S. Tsirkin wrote: > > > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > > > >>This is a pc & q35 only machine opt. One use is to allow for more > > > > >>ram in a 32bit guest for example: > > > > >> > > > > >>-machine pc,max-ram-below-4g=3.75G > > > > >> > > > > >>If you add enough PCI devices then all mmio for them will not fit > > > > >>below 4G which may not be the layout the user wanted. This allows > > > > >>you to increase the below 4G address space that PCI devices can use > > > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > > > >>mmio that is above 4G. > > > > >> > > > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > > > >>line will limit the amount of ram that is below 4G to 2G. > > > > >> > > > > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > > > > >>--- > > > > >>v5: > > > > >> Re-work based on: > > > > >> > > > > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > > > >> > > > > >> > > > > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > > > > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > > > > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > > > > >> include/hw/i386/pc.h | 3 +++ > > > > >> vl.c | 4 ++++ > > > > >> 5 files changed, 69 insertions(+), 6 deletions(-) > > > > >> > > > > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > > > > >>index 7cdba10..bccb746 100644 > > > > >>--- a/hw/i386/pc.c > > > > >>+++ b/hw/i386/pc.c > > > > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > > > > >> visit_type_int(v, &value, name, errp); > > > > >> } > > > > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > > > > >>+ void *opaque, const char *name, > > > > >>+ Error **errp) > > > > >>+{ > > > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > > > >>+ uint64_t value = pcms->max_ram_below_4g; > > > > >>+ > > > > >>+ visit_type_size(v, &value, name, errp); > > > > >>+} > > > > >>+ > > > > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > > > > >>+ void *opaque, const char *name, > > > > >>+ Error **errp) > > > > >>+{ > > > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > > > >>+ Error *error = NULL; > > > > >>+ uint64_t value; > > > > >>+ > > > > >>+ visit_type_size(v, &value, name, &error); > > > > >>+ if (error) { > > > > >>+ error_propagate(errp, error); > > > > >>+ return; > > > > >>+ } > > > > >>+ if (value > (1ULL << 32)) { > > > > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > > > > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > > > > >>+ "' expects size less then or equal to 4G", value); > > > > >less than > > > > > > > > But the test is greater then. So "not greater then" is "less then or equal". > > > > Or did you want the test changed? > > > > > > No, just correcting English: less than, not less then :) > > > > > > > >>+ error_propagate(errp, error); > > > > >>+ return; > > > > >>+ } > > > > >>+ > > > > >>+ pcms->max_ram_below_4g = value; > > > > >>+} > > > > >>+ > > > > >> static void pc_machine_initfn(Object *obj) > > > > >> { > > > > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > > > > >> pc_machine_get_hotplug_memory_region_size, > > > > >> NULL, NULL, NULL, NULL); > > > > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > > > > >>+ pc_machine_get_max_ram_below_4g, > > > > >>+ pc_machine_set_max_ram_below_4g, > > > > >>+ NULL, NULL, NULL); > > Maybe you can add here a sane default and avoid comparison with 0 > > any time you use it. > +1 > > > If you think you need value per machine type, you can add it to > > compat props. I don't see how is related, so you may not want to do so. > Using compat_props would be great however does compat_props work for machine > type itself already? Now that you are mentioning it, I was hoping that compat_props are converted into QemuOpts or something and then mapped into machine properties. I'll look into it. > > > > > > > >> } > > > > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > > > > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > > > > >>index 40f6eaf..25f4727 100644 > > > > >>--- a/hw/i386/pc_piix.c > > > > >>+++ b/hw/i386/pc_piix.c > > > > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > > > > >> DeviceState *icc_bridge; > > > > >> FWCfgState *fw_cfg = NULL; > > > > >> PcGuestInfo *guest_info; > > > > >>+ Object *mo = qdev_get_machine(); > > > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > > > >>+ ram_addr_t lowmem = 0xe0000000; > > > > >>+ > > > > >>+ if (pcms && pcms->max_ram_below_4g) { > > From my QOM understanding, max_ram_below_4g is a private field, > > so it not should be used directly. > > You can use QOMs object_property_get or add a pc_machine wrapper > > for getting/setting the field. > pc_init1() is sort of private function of PCMachine, so there is no much > point to use verbose getters/setters internally unless there is checks behind > setter. I was just being QOM's advocate :). That being said, I'll not argue here, as it is not a major issue. Thanks, Marcel > > > > > > > >Is pcms ever NULL? If yes why? > > > > > > > > Not that I know of. I would be happy to convert this to an assert(pcms). > > > > > > In fact, PC_MACHINE already includes an assert doesn't it? > > > So no need to check it everywhere. > > > > +1. No need for assert here. Is already done by OBJECT_CHECK. > > > > Hope I helped, > > Marcel > > > > > > > > > >>+ lowmem = pcms->max_ram_below_4g; > > > > >>+ } > > > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > > > > >> * If it doesn't, we need to split it in chunks below and above 4G. > > > > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > > > > >> * For old machine types, use whatever split we used historically to avoid > > > > >> * breaking migration. > > > > >> */ > > > > >>- if (machine->ram_size >= 0xe0000000) { > > > > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > > > > >>+ if (machine->ram_size >= lowmem) { > > > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > > > >>+ lowmem = 0xc0000000; > > > > >>+ } > > > > >> above_4g_mem_size = machine->ram_size - lowmem; > > > > >> below_4g_mem_size = lowmem; > > > > >> } else { > > > > > > > > > >So why do we need gigabyte_align anymore? > > > > > > > > Because of qemu 2.0 and the user is not required to specify this option. > > > > > > > > >Can't we set property to 0xc0000000 by default, and > > > > >override for old machine types? > > > > > > > > There is a strange compatibility part here. Since this code includes ram_size (see: > > > > > > > > http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html > > > > > > > > ) and xen has a different default. > > > > > > > > > > So instead of default 0, it would be preferable to set the default to the > > > actual value, and let user override it. > > > > > > Or if that's too hard, set max_ram_below_4g instead of setting > > > gigabyte_align. gigabyte_align switches everywhere is messy > > > enough, adding max_ram_below_4g into mix is just too messy. > > > > > > > > > > > > > >Also, a value that isn't a multiple of 1G will lead to bad > > > > >performance for large machines which do have above_4g_mem_size. > > > > >Let's detect and print a warning. > > > > > > > > Will Do. > > > > > > > > -Don Slutz > > > > > > > > > > > > > > > > > > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > > > > >> } > > > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > > > >>+ object_property_add_child(mo, "icc-bridge", > > > > >> OBJECT(icc_bridge), NULL); > > > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > > > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > > > > >>index e28ce40..155cdf1 100644 > > > > >>--- a/hw/i386/pc_q35.c > > > > >>+++ b/hw/i386/pc_q35.c > > > > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > > > > >> PCIDevice *ahci; > > > > >> DeviceState *icc_bridge; > > > > >> PcGuestInfo *guest_info; > > > > >>+ Object *mo = qdev_get_machine(); > > > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > > > >>+ ram_addr_t lowmem = 0xb0000000; > > > > >>+ > > > > >>+ if (pcms && pcms->max_ram_below_4g) { > > > > >>+ lowmem = pcms->max_ram_below_4g; > > > > >>+ } > > > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > > > > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > > > > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > > > > >> * For old machine types, use whatever split we used historically to avoid > > > > >> * breaking migration. > > > > >> */ > > > > >>- if (machine->ram_size >= 0xb0000000) { > > > > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > > > > >>+ if (machine->ram_size >= lowmem) { > > > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > > > >>+ lowmem = 0x800000000; > > > > >>+ } > > > > >> above_4g_mem_size = machine->ram_size - lowmem; > > > > >> below_4g_mem_size = lowmem; > > > > >> } else { > > > > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > > > > >> } > > > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > > > >>+ object_property_add_child(mo, "icc-bridge", > > > > >> OBJECT(icc_bridge), NULL); > > > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > > > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > > > > >>index 19530bd..2d8b562 100644 > > > > >>--- a/include/hw/i386/pc.h > > > > >>+++ b/include/hw/i386/pc.h > > > > >>@@ -32,10 +32,13 @@ struct PCMachineState { > > > > >> MemoryRegion hotplug_memory; > > > > >> HotplugHandler *acpi_dev; > > > > >>+ > > > > >>+ uint64_t max_ram_below_4g; > > > > >> }; > > > > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > > > > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > > > > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > > > >> /** > > > > >> * PCMachineClass: > > > > >>diff --git a/vl.c b/vl.c > > > > >>index 5e77a27..cffb9c5 100644 > > > > >>--- a/vl.c > > > > >>+++ b/vl.c > > > > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > > > > >> .name = "kvm-type", > > > > >> .type = QEMU_OPT_STRING, > > > > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > > > > >>+ },{ > > > > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > > > > >>+ .type = QEMU_OPT_SIZE, > > > > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > > > > >> }, > > > > >> { /* End of list */ } > > > > >> }, > > > > >>-- > > > > >>1.8.4 > > > > > > > > > > > ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-09 17:33 ` Marcel Apfelbaum 0 siblings, 0 replies; 53+ messages in thread From: Marcel Apfelbaum @ 2014-06-09 17:33 UTC (permalink / raw) To: Igor Mammedov Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Don Slutz, Anthony Liguori, Andreas Färber On Mon, 2014-06-09 at 17:37 +0200, Igor Mammedov wrote: > On Mon, 09 Jun 2014 18:10:27 +0300 > Marcel Apfelbaum <marcel.a@redhat.com> wrote: > > > Hi, > > > > On Mon, 2014-06-09 at 17:38 +0300, Michael S. Tsirkin wrote: > > > On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: > > > > On 06/08/14 11:40, Michael S. Tsirkin wrote: > > > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > > > >>This is a pc & q35 only machine opt. One use is to allow for more > > > > >>ram in a 32bit guest for example: > > > > >> > > > > >>-machine pc,max-ram-below-4g=3.75G > > > > >> > > > > >>If you add enough PCI devices then all mmio for them will not fit > > > > >>below 4G which may not be the layout the user wanted. This allows > > > > >>you to increase the below 4G address space that PCI devices can use > > > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > > > >>mmio that is above 4G. > > > > >> > > > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > > > >>line will limit the amount of ram that is below 4G to 2G. > > > > >> > > > > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > > > > >>--- > > > > >>v5: > > > > >> Re-work based on: > > > > >> > > > > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > > > >> > > > > >> > > > > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > > > > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > > > > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > > > > >> include/hw/i386/pc.h | 3 +++ > > > > >> vl.c | 4 ++++ > > > > >> 5 files changed, 69 insertions(+), 6 deletions(-) > > > > >> > > > > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > > > > >>index 7cdba10..bccb746 100644 > > > > >>--- a/hw/i386/pc.c > > > > >>+++ b/hw/i386/pc.c > > > > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > > > > >> visit_type_int(v, &value, name, errp); > > > > >> } > > > > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > > > > >>+ void *opaque, const char *name, > > > > >>+ Error **errp) > > > > >>+{ > > > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > > > >>+ uint64_t value = pcms->max_ram_below_4g; > > > > >>+ > > > > >>+ visit_type_size(v, &value, name, errp); > > > > >>+} > > > > >>+ > > > > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > > > > >>+ void *opaque, const char *name, > > > > >>+ Error **errp) > > > > >>+{ > > > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > > > >>+ Error *error = NULL; > > > > >>+ uint64_t value; > > > > >>+ > > > > >>+ visit_type_size(v, &value, name, &error); > > > > >>+ if (error) { > > > > >>+ error_propagate(errp, error); > > > > >>+ return; > > > > >>+ } > > > > >>+ if (value > (1ULL << 32)) { > > > > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > > > > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > > > > >>+ "' expects size less then or equal to 4G", value); > > > > >less than > > > > > > > > But the test is greater then. So "not greater then" is "less then or equal". > > > > Or did you want the test changed? > > > > > > No, just correcting English: less than, not less then :) > > > > > > > >>+ error_propagate(errp, error); > > > > >>+ return; > > > > >>+ } > > > > >>+ > > > > >>+ pcms->max_ram_below_4g = value; > > > > >>+} > > > > >>+ > > > > >> static void pc_machine_initfn(Object *obj) > > > > >> { > > > > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > > > > >> pc_machine_get_hotplug_memory_region_size, > > > > >> NULL, NULL, NULL, NULL); > > > > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > > > > >>+ pc_machine_get_max_ram_below_4g, > > > > >>+ pc_machine_set_max_ram_below_4g, > > > > >>+ NULL, NULL, NULL); > > Maybe you can add here a sane default and avoid comparison with 0 > > any time you use it. > +1 > > > If you think you need value per machine type, you can add it to > > compat props. I don't see how is related, so you may not want to do so. > Using compat_props would be great however does compat_props work for machine > type itself already? Now that you are mentioning it, I was hoping that compat_props are converted into QemuOpts or something and then mapped into machine properties. I'll look into it. > > > > > > > >> } > > > > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > > > > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > > > > >>index 40f6eaf..25f4727 100644 > > > > >>--- a/hw/i386/pc_piix.c > > > > >>+++ b/hw/i386/pc_piix.c > > > > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > > > > >> DeviceState *icc_bridge; > > > > >> FWCfgState *fw_cfg = NULL; > > > > >> PcGuestInfo *guest_info; > > > > >>+ Object *mo = qdev_get_machine(); > > > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > > > >>+ ram_addr_t lowmem = 0xe0000000; > > > > >>+ > > > > >>+ if (pcms && pcms->max_ram_below_4g) { > > From my QOM understanding, max_ram_below_4g is a private field, > > so it not should be used directly. > > You can use QOMs object_property_get or add a pc_machine wrapper > > for getting/setting the field. > pc_init1() is sort of private function of PCMachine, so there is no much > point to use verbose getters/setters internally unless there is checks behind > setter. I was just being QOM's advocate :). That being said, I'll not argue here, as it is not a major issue. Thanks, Marcel > > > > > > > >Is pcms ever NULL? If yes why? > > > > > > > > Not that I know of. I would be happy to convert this to an assert(pcms). > > > > > > In fact, PC_MACHINE already includes an assert doesn't it? > > > So no need to check it everywhere. > > > > +1. No need for assert here. Is already done by OBJECT_CHECK. > > > > Hope I helped, > > Marcel > > > > > > > > > >>+ lowmem = pcms->max_ram_below_4g; > > > > >>+ } > > > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > > > > >> * If it doesn't, we need to split it in chunks below and above 4G. > > > > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > > > > >> * For old machine types, use whatever split we used historically to avoid > > > > >> * breaking migration. > > > > >> */ > > > > >>- if (machine->ram_size >= 0xe0000000) { > > > > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > > > > >>+ if (machine->ram_size >= lowmem) { > > > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > > > >>+ lowmem = 0xc0000000; > > > > >>+ } > > > > >> above_4g_mem_size = machine->ram_size - lowmem; > > > > >> below_4g_mem_size = lowmem; > > > > >> } else { > > > > > > > > > >So why do we need gigabyte_align anymore? > > > > > > > > Because of qemu 2.0 and the user is not required to specify this option. > > > > > > > > >Can't we set property to 0xc0000000 by default, and > > > > >override for old machine types? > > > > > > > > There is a strange compatibility part here. Since this code includes ram_size (see: > > > > > > > > http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html > > > > > > > > ) and xen has a different default. > > > > > > > > > > So instead of default 0, it would be preferable to set the default to the > > > actual value, and let user override it. > > > > > > Or if that's too hard, set max_ram_below_4g instead of setting > > > gigabyte_align. gigabyte_align switches everywhere is messy > > > enough, adding max_ram_below_4g into mix is just too messy. > > > > > > > > > > > > > >Also, a value that isn't a multiple of 1G will lead to bad > > > > >performance for large machines which do have above_4g_mem_size. > > > > >Let's detect and print a warning. > > > > > > > > Will Do. > > > > > > > > -Don Slutz > > > > > > > > > > > > > > > > > > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > > > > >> } > > > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > > > >>+ object_property_add_child(mo, "icc-bridge", > > > > >> OBJECT(icc_bridge), NULL); > > > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > > > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > > > > >>index e28ce40..155cdf1 100644 > > > > >>--- a/hw/i386/pc_q35.c > > > > >>+++ b/hw/i386/pc_q35.c > > > > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > > > > >> PCIDevice *ahci; > > > > >> DeviceState *icc_bridge; > > > > >> PcGuestInfo *guest_info; > > > > >>+ Object *mo = qdev_get_machine(); > > > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > > > >>+ ram_addr_t lowmem = 0xb0000000; > > > > >>+ > > > > >>+ if (pcms && pcms->max_ram_below_4g) { > > > > >>+ lowmem = pcms->max_ram_below_4g; > > > > >>+ } > > > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > > > > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > > > > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > > > > >> * For old machine types, use whatever split we used historically to avoid > > > > >> * breaking migration. > > > > >> */ > > > > >>- if (machine->ram_size >= 0xb0000000) { > > > > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > > > > >>+ if (machine->ram_size >= lowmem) { > > > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > > > >>+ lowmem = 0x800000000; > > > > >>+ } > > > > >> above_4g_mem_size = machine->ram_size - lowmem; > > > > >> below_4g_mem_size = lowmem; > > > > >> } else { > > > > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > > > > >> } > > > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > > > >>+ object_property_add_child(mo, "icc-bridge", > > > > >> OBJECT(icc_bridge), NULL); > > > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > > > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > > > > >>index 19530bd..2d8b562 100644 > > > > >>--- a/include/hw/i386/pc.h > > > > >>+++ b/include/hw/i386/pc.h > > > > >>@@ -32,10 +32,13 @@ struct PCMachineState { > > > > >> MemoryRegion hotplug_memory; > > > > >> HotplugHandler *acpi_dev; > > > > >>+ > > > > >>+ uint64_t max_ram_below_4g; > > > > >> }; > > > > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > > > > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > > > > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > > > >> /** > > > > >> * PCMachineClass: > > > > >>diff --git a/vl.c b/vl.c > > > > >>index 5e77a27..cffb9c5 100644 > > > > >>--- a/vl.c > > > > >>+++ b/vl.c > > > > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > > > > >> .name = "kvm-type", > > > > >> .type = QEMU_OPT_STRING, > > > > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > > > > >>+ },{ > > > > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > > > > >>+ .type = QEMU_OPT_SIZE, > > > > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > > > > >> }, > > > > >> { /* End of list */ } > > > > >> }, > > > > >>-- > > > > >>1.8.4 > > > > > > > > > > > ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-09 17:33 ` Marcel Apfelbaum @ 2014-06-09 20:03 ` Don Slutz -1 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-09 20:03 UTC (permalink / raw) To: Marcel Apfelbaum, Igor Mammedov, Gerd Hoffmann Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Don Slutz, Anthony Liguori, Andreas Färber On 06/09/14 13:33, Marcel Apfelbaum wrote: > On Mon, 2014-06-09 at 17:37 +0200, Igor Mammedov wrote: >> On Mon, 09 Jun 2014 18:10:27 +0300 >> Marcel Apfelbaum <marcel.a@redhat.com> wrote: >> >>> Hi, >>> >>> On Mon, 2014-06-09 at 17:38 +0300, Michael S. Tsirkin wrote: >>>> On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: >>>>> On 06/08/14 11:40, Michael S. Tsirkin wrote: >>>>>> On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: >>>>>>> This is a pc & q35 only machine opt. One use is to allow for more >>>>>>> ram in a 32bit guest for example: >>>>>>> >>>>>>> -machine pc,max-ram-below-4g=3.75G >>>>>>> >>>>>>> If you add enough PCI devices then all mmio for them will not fit >>>>>>> below 4G which may not be the layout the user wanted. This allows >>>>>>> you to increase the below 4G address space that PCI devices can use >>>>>>> (aka decrease ram below 4G) and therefore in more cases not have any >>>>>>> mmio that is above 4G. >>>>>>> >>>>>>> For example using "-machine pc,max-ram-below-4g=2G" on the command >>>>>>> line will limit the amount of ram that is below 4G to 2G. >>>>>>> >>>>>>> Signed-off-by: Don Slutz <dslutz@verizon.com> >>>>>>> --- >>>>>>> v5: >>>>>>> Re-work based on: >>>>>>> >>>>>>> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 >>>>>>> >>>>>>> >>>>>>> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ >>>>>>> hw/i386/pc_piix.c | 15 ++++++++++++--- >>>>>>> hw/i386/pc_q35.c | 15 ++++++++++++--- >>>>>>> include/hw/i386/pc.h | 3 +++ >>>>>>> vl.c | 4 ++++ >>>>>>> 5 files changed, 69 insertions(+), 6 deletions(-) >>>>>>> >>>>>>> diff --git a/hw/i386/pc.c b/hw/i386/pc.c >>>>>>> index 7cdba10..bccb746 100644 >>>>>>> --- a/hw/i386/pc.c >>>>>>> +++ b/hw/i386/pc.c >>>>>>> @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, >>>>>>> visit_type_int(v, &value, name, errp); >>>>>>> } >>>>>>> +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, >>>>>>> + void *opaque, const char *name, >>>>>>> + Error **errp) >>>>>>> +{ >>>>>>> + PCMachineState *pcms = PC_MACHINE(obj); >>>>>>> + uint64_t value = pcms->max_ram_below_4g; >>>>>>> + >>>>>>> + visit_type_size(v, &value, name, errp); >>>>>>> +} >>>>>>> + >>>>>>> +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, >>>>>>> + void *opaque, const char *name, >>>>>>> + Error **errp) >>>>>>> +{ >>>>>>> + PCMachineState *pcms = PC_MACHINE(obj); >>>>>>> + Error *error = NULL; >>>>>>> + uint64_t value; >>>>>>> + >>>>>>> + visit_type_size(v, &value, name, &error); >>>>>>> + if (error) { >>>>>>> + error_propagate(errp, error); >>>>>>> + return; >>>>>>> + } >>>>>>> + if (value > (1ULL << 32)) { >>>>>>> + error_set(&error, ERROR_CLASS_GENERIC_ERROR, >>>>>>> + "Machine option 'max-ram-below-4g=%"PRIu64 >>>>>>> + "' expects size less then or equal to 4G", value); >>>>>> less than >>>>> But the test is greater then. So "not greater then" is "less then or equal". >>>>> Or did you want the test changed? >>>> No, just correcting English: less than, not less then :) >>>> >>>>>>> + error_propagate(errp, error); >>>>>>> + return; >>>>>>> + } >>>>>>> + >>>>>>> + pcms->max_ram_below_4g = value; >>>>>>> +} >>>>>>> + >>>>>>> static void pc_machine_initfn(Object *obj) >>>>>>> { >>>>>>> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", >>>>>>> pc_machine_get_hotplug_memory_region_size, >>>>>>> NULL, NULL, NULL, NULL); >>>>>>> + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", >>>>>>> + pc_machine_get_max_ram_below_4g, >>>>>>> + pc_machine_set_max_ram_below_4g, >>>>>>> + NULL, NULL, NULL); >>> Maybe you can add here a sane default and avoid comparison with 0 >>> any time you use it. >> +1 >> The basic problem is that there is no simple default. For pc-i440fx-1.7, pc-q35-1.7 and all older versions there are 2 values: xen_enabled() ==> 3.75G !xen_enabled() ==> 3.5G pc-i440fx-2.0 and pc-q35-2.0(q35 has different numbers but the same logic) have 3 values: xen_enabled() ==> 3.75G !xen_enabled() && ram_size <= 3.5G ==> 3.5G !xen_enabled() && ram_size > 3.5G ==> 3.0G Gerd has more on this in: http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html >>> If you think you need value per machine type, you can add it to >>> compat props. I don't see how is related, so you may not want to do so. I need more then 1 value per machine type. So I do not see how one default would work. -Don Slutz >> Using compat_props would be great however does compat_props work for machine >> type itself already? > Now that you are mentioning it, I was hoping that compat_props are converted > into QemuOpts or something and then mapped into machine properties. > I'll look into it. > >>>>>>> } >>>>>>> static void pc_machine_class_init(ObjectClass *oc, void *data) >>>>>>> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >>>>>>> index 40f6eaf..25f4727 100644 >>>>>>> --- a/hw/i386/pc_piix.c >>>>>>> +++ b/hw/i386/pc_piix.c >>>>>>> @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, >>>>>>> DeviceState *icc_bridge; >>>>>>> FWCfgState *fw_cfg = NULL; >>>>>>> PcGuestInfo *guest_info; >>>>>>> + Object *mo = qdev_get_machine(); >>>>>>> + PCMachineState *pcms = PC_MACHINE(mo); >>>>>>> + ram_addr_t lowmem = 0xe0000000; >>>>>>> + >>>>>>> + if (pcms && pcms->max_ram_below_4g) { >>> From my QOM understanding, max_ram_below_4g is a private field, >>> so it not should be used directly. >>> You can use QOMs object_property_get or add a pc_machine wrapper >>> for getting/setting the field. >> pc_init1() is sort of private function of PCMachine, so there is no much >> point to use verbose getters/setters internally unless there is checks behind >> setter. > I was just being QOM's advocate :). That being said, I'll not argue here, > as it is not a major issue. > > > Thanks, > Marcel > >>>>>> Is pcms ever NULL? If yes why? >>>>> Not that I know of. I would be happy to convert this to an assert(pcms). >>>> In fact, PC_MACHINE already includes an assert doesn't it? >>>> So no need to check it everywhere. >>> +1. No need for assert here. Is already done by OBJECT_CHECK. >>> >>> Hope I helped, >>> Marcel >>> >>>>>>> + lowmem = pcms->max_ram_below_4g; >>>>>>> + } >>>>>>> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). >>>>>>> * If it doesn't, we need to split it in chunks below and above 4G. >>>>>>> @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, >>>>>>> * For old machine types, use whatever split we used historically to avoid >>>>>>> * breaking migration. >>>>>>> */ >>>>>>> - if (machine->ram_size >= 0xe0000000) { >>>>>>> - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; >>>>>>> + if (machine->ram_size >= lowmem) { >>>>>>> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >>>>>>> + lowmem = 0xc0000000; >>>>>>> + } >>>>>>> above_4g_mem_size = machine->ram_size - lowmem; >>>>>>> below_4g_mem_size = lowmem; >>>>>>> } else { >>>>>> So why do we need gigabyte_align anymore? >>>>> Because of qemu 2.0 and the user is not required to specify this option. >>>>> >>>>>> Can't we set property to 0xc0000000 by default, and >>>>>> override for old machine types? >>>>> There is a strange compatibility part here. Since this code includes ram_size (see: >>>>> >>>>> http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html >>>>> >>>>> ) and xen has a different default. >>>>> >>>> So instead of default 0, it would be preferable to set the default to the >>>> actual value, and let user override it. >>>> >>>> Or if that's too hard, set max_ram_below_4g instead of setting >>>> gigabyte_align. gigabyte_align switches everywhere is messy >>>> enough, adding max_ram_below_4g into mix is just too messy. >>>> >>>> >>>> >>>>>> Also, a value that isn't a multiple of 1G will lead to bad >>>>>> performance for large machines which do have above_4g_mem_size. >>>>>> Let's detect and print a warning. >>>>> Will Do. >>>>> >>>>> -Don Slutz >>>>> >>>>>> >>>>>>> @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, >>>>>>> } >>>>>>> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >>>>>>> - object_property_add_child(qdev_get_machine(), "icc-bridge", >>>>>>> + object_property_add_child(mo, "icc-bridge", >>>>>>> OBJECT(icc_bridge), NULL); >>>>>>> pc_cpus_init(machine->cpu_model, icc_bridge); >>>>>>> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >>>>>>> index e28ce40..155cdf1 100644 >>>>>>> --- a/hw/i386/pc_q35.c >>>>>>> +++ b/hw/i386/pc_q35.c >>>>>>> @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) >>>>>>> PCIDevice *ahci; >>>>>>> DeviceState *icc_bridge; >>>>>>> PcGuestInfo *guest_info; >>>>>>> + Object *mo = qdev_get_machine(); >>>>>>> + PCMachineState *pcms = PC_MACHINE(mo); >>>>>>> + ram_addr_t lowmem = 0xb0000000; >>>>>>> + >>>>>>> + if (pcms && pcms->max_ram_below_4g) { >>>>>>> + lowmem = pcms->max_ram_below_4g; >>>>>>> + } >>>>>>> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory >>>>>>> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping >>>>>>> @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) >>>>>>> * For old machine types, use whatever split we used historically to avoid >>>>>>> * breaking migration. >>>>>>> */ >>>>>>> - if (machine->ram_size >= 0xb0000000) { >>>>>>> - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; >>>>>>> + if (machine->ram_size >= lowmem) { >>>>>>> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >>>>>>> + lowmem = 0x800000000; >>>>>>> + } >>>>>>> above_4g_mem_size = machine->ram_size - lowmem; >>>>>>> below_4g_mem_size = lowmem; >>>>>>> } else { >>>>>>> @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) >>>>>>> } >>>>>>> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >>>>>>> - object_property_add_child(qdev_get_machine(), "icc-bridge", >>>>>>> + object_property_add_child(mo, "icc-bridge", >>>>>>> OBJECT(icc_bridge), NULL); >>>>>>> pc_cpus_init(machine->cpu_model, icc_bridge); >>>>>>> diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h >>>>>>> index 19530bd..2d8b562 100644 >>>>>>> --- a/include/hw/i386/pc.h >>>>>>> +++ b/include/hw/i386/pc.h >>>>>>> @@ -32,10 +32,13 @@ struct PCMachineState { >>>>>>> MemoryRegion hotplug_memory; >>>>>>> HotplugHandler *acpi_dev; >>>>>>> + >>>>>>> + uint64_t max_ram_below_4g; >>>>>>> }; >>>>>>> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" >>>>>>> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" >>>>>>> +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" >>>>>>> /** >>>>>>> * PCMachineClass: >>>>>>> diff --git a/vl.c b/vl.c >>>>>>> index 5e77a27..cffb9c5 100644 >>>>>>> --- a/vl.c >>>>>>> +++ b/vl.c >>>>>>> @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { >>>>>>> .name = "kvm-type", >>>>>>> .type = QEMU_OPT_STRING, >>>>>>> .help = "Specifies the KVM virtualization mode (HV, PR)", >>>>>>> + },{ >>>>>>> + .name = PC_MACHINE_MAX_RAM_BELOW_4G, >>>>>>> + .type = QEMU_OPT_SIZE, >>>>>>> + .help = "maximum ram below the 4G boundary (32bit boundary)", >>>>>>> }, >>>>>>> { /* End of list */ } >>>>>>> }, >>>>>>> -- >>>>>>> 1.8.4 >>> >>> >> > > ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-09 20:03 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-09 20:03 UTC (permalink / raw) To: Marcel Apfelbaum, Igor Mammedov, Gerd Hoffmann Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Don Slutz, Anthony Liguori, Andreas Färber On 06/09/14 13:33, Marcel Apfelbaum wrote: > On Mon, 2014-06-09 at 17:37 +0200, Igor Mammedov wrote: >> On Mon, 09 Jun 2014 18:10:27 +0300 >> Marcel Apfelbaum <marcel.a@redhat.com> wrote: >> >>> Hi, >>> >>> On Mon, 2014-06-09 at 17:38 +0300, Michael S. Tsirkin wrote: >>>> On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: >>>>> On 06/08/14 11:40, Michael S. Tsirkin wrote: >>>>>> On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: >>>>>>> This is a pc & q35 only machine opt. One use is to allow for more >>>>>>> ram in a 32bit guest for example: >>>>>>> >>>>>>> -machine pc,max-ram-below-4g=3.75G >>>>>>> >>>>>>> If you add enough PCI devices then all mmio for them will not fit >>>>>>> below 4G which may not be the layout the user wanted. This allows >>>>>>> you to increase the below 4G address space that PCI devices can use >>>>>>> (aka decrease ram below 4G) and therefore in more cases not have any >>>>>>> mmio that is above 4G. >>>>>>> >>>>>>> For example using "-machine pc,max-ram-below-4g=2G" on the command >>>>>>> line will limit the amount of ram that is below 4G to 2G. >>>>>>> >>>>>>> Signed-off-by: Don Slutz <dslutz@verizon.com> >>>>>>> --- >>>>>>> v5: >>>>>>> Re-work based on: >>>>>>> >>>>>>> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 >>>>>>> >>>>>>> >>>>>>> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ >>>>>>> hw/i386/pc_piix.c | 15 ++++++++++++--- >>>>>>> hw/i386/pc_q35.c | 15 ++++++++++++--- >>>>>>> include/hw/i386/pc.h | 3 +++ >>>>>>> vl.c | 4 ++++ >>>>>>> 5 files changed, 69 insertions(+), 6 deletions(-) >>>>>>> >>>>>>> diff --git a/hw/i386/pc.c b/hw/i386/pc.c >>>>>>> index 7cdba10..bccb746 100644 >>>>>>> --- a/hw/i386/pc.c >>>>>>> +++ b/hw/i386/pc.c >>>>>>> @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, >>>>>>> visit_type_int(v, &value, name, errp); >>>>>>> } >>>>>>> +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, >>>>>>> + void *opaque, const char *name, >>>>>>> + Error **errp) >>>>>>> +{ >>>>>>> + PCMachineState *pcms = PC_MACHINE(obj); >>>>>>> + uint64_t value = pcms->max_ram_below_4g; >>>>>>> + >>>>>>> + visit_type_size(v, &value, name, errp); >>>>>>> +} >>>>>>> + >>>>>>> +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, >>>>>>> + void *opaque, const char *name, >>>>>>> + Error **errp) >>>>>>> +{ >>>>>>> + PCMachineState *pcms = PC_MACHINE(obj); >>>>>>> + Error *error = NULL; >>>>>>> + uint64_t value; >>>>>>> + >>>>>>> + visit_type_size(v, &value, name, &error); >>>>>>> + if (error) { >>>>>>> + error_propagate(errp, error); >>>>>>> + return; >>>>>>> + } >>>>>>> + if (value > (1ULL << 32)) { >>>>>>> + error_set(&error, ERROR_CLASS_GENERIC_ERROR, >>>>>>> + "Machine option 'max-ram-below-4g=%"PRIu64 >>>>>>> + "' expects size less then or equal to 4G", value); >>>>>> less than >>>>> But the test is greater then. So "not greater then" is "less then or equal". >>>>> Or did you want the test changed? >>>> No, just correcting English: less than, not less then :) >>>> >>>>>>> + error_propagate(errp, error); >>>>>>> + return; >>>>>>> + } >>>>>>> + >>>>>>> + pcms->max_ram_below_4g = value; >>>>>>> +} >>>>>>> + >>>>>>> static void pc_machine_initfn(Object *obj) >>>>>>> { >>>>>>> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", >>>>>>> pc_machine_get_hotplug_memory_region_size, >>>>>>> NULL, NULL, NULL, NULL); >>>>>>> + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", >>>>>>> + pc_machine_get_max_ram_below_4g, >>>>>>> + pc_machine_set_max_ram_below_4g, >>>>>>> + NULL, NULL, NULL); >>> Maybe you can add here a sane default and avoid comparison with 0 >>> any time you use it. >> +1 >> The basic problem is that there is no simple default. For pc-i440fx-1.7, pc-q35-1.7 and all older versions there are 2 values: xen_enabled() ==> 3.75G !xen_enabled() ==> 3.5G pc-i440fx-2.0 and pc-q35-2.0(q35 has different numbers but the same logic) have 3 values: xen_enabled() ==> 3.75G !xen_enabled() && ram_size <= 3.5G ==> 3.5G !xen_enabled() && ram_size > 3.5G ==> 3.0G Gerd has more on this in: http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html >>> If you think you need value per machine type, you can add it to >>> compat props. I don't see how is related, so you may not want to do so. I need more then 1 value per machine type. So I do not see how one default would work. -Don Slutz >> Using compat_props would be great however does compat_props work for machine >> type itself already? > Now that you are mentioning it, I was hoping that compat_props are converted > into QemuOpts or something and then mapped into machine properties. > I'll look into it. > >>>>>>> } >>>>>>> static void pc_machine_class_init(ObjectClass *oc, void *data) >>>>>>> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >>>>>>> index 40f6eaf..25f4727 100644 >>>>>>> --- a/hw/i386/pc_piix.c >>>>>>> +++ b/hw/i386/pc_piix.c >>>>>>> @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, >>>>>>> DeviceState *icc_bridge; >>>>>>> FWCfgState *fw_cfg = NULL; >>>>>>> PcGuestInfo *guest_info; >>>>>>> + Object *mo = qdev_get_machine(); >>>>>>> + PCMachineState *pcms = PC_MACHINE(mo); >>>>>>> + ram_addr_t lowmem = 0xe0000000; >>>>>>> + >>>>>>> + if (pcms && pcms->max_ram_below_4g) { >>> From my QOM understanding, max_ram_below_4g is a private field, >>> so it not should be used directly. >>> You can use QOMs object_property_get or add a pc_machine wrapper >>> for getting/setting the field. >> pc_init1() is sort of private function of PCMachine, so there is no much >> point to use verbose getters/setters internally unless there is checks behind >> setter. > I was just being QOM's advocate :). That being said, I'll not argue here, > as it is not a major issue. > > > Thanks, > Marcel > >>>>>> Is pcms ever NULL? If yes why? >>>>> Not that I know of. I would be happy to convert this to an assert(pcms). >>>> In fact, PC_MACHINE already includes an assert doesn't it? >>>> So no need to check it everywhere. >>> +1. No need for assert here. Is already done by OBJECT_CHECK. >>> >>> Hope I helped, >>> Marcel >>> >>>>>>> + lowmem = pcms->max_ram_below_4g; >>>>>>> + } >>>>>>> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). >>>>>>> * If it doesn't, we need to split it in chunks below and above 4G. >>>>>>> @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, >>>>>>> * For old machine types, use whatever split we used historically to avoid >>>>>>> * breaking migration. >>>>>>> */ >>>>>>> - if (machine->ram_size >= 0xe0000000) { >>>>>>> - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; >>>>>>> + if (machine->ram_size >= lowmem) { >>>>>>> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >>>>>>> + lowmem = 0xc0000000; >>>>>>> + } >>>>>>> above_4g_mem_size = machine->ram_size - lowmem; >>>>>>> below_4g_mem_size = lowmem; >>>>>>> } else { >>>>>> So why do we need gigabyte_align anymore? >>>>> Because of qemu 2.0 and the user is not required to specify this option. >>>>> >>>>>> Can't we set property to 0xc0000000 by default, and >>>>>> override for old machine types? >>>>> There is a strange compatibility part here. Since this code includes ram_size (see: >>>>> >>>>> http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html >>>>> >>>>> ) and xen has a different default. >>>>> >>>> So instead of default 0, it would be preferable to set the default to the >>>> actual value, and let user override it. >>>> >>>> Or if that's too hard, set max_ram_below_4g instead of setting >>>> gigabyte_align. gigabyte_align switches everywhere is messy >>>> enough, adding max_ram_below_4g into mix is just too messy. >>>> >>>> >>>> >>>>>> Also, a value that isn't a multiple of 1G will lead to bad >>>>>> performance for large machines which do have above_4g_mem_size. >>>>>> Let's detect and print a warning. >>>>> Will Do. >>>>> >>>>> -Don Slutz >>>>> >>>>>> >>>>>>> @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, >>>>>>> } >>>>>>> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >>>>>>> - object_property_add_child(qdev_get_machine(), "icc-bridge", >>>>>>> + object_property_add_child(mo, "icc-bridge", >>>>>>> OBJECT(icc_bridge), NULL); >>>>>>> pc_cpus_init(machine->cpu_model, icc_bridge); >>>>>>> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >>>>>>> index e28ce40..155cdf1 100644 >>>>>>> --- a/hw/i386/pc_q35.c >>>>>>> +++ b/hw/i386/pc_q35.c >>>>>>> @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) >>>>>>> PCIDevice *ahci; >>>>>>> DeviceState *icc_bridge; >>>>>>> PcGuestInfo *guest_info; >>>>>>> + Object *mo = qdev_get_machine(); >>>>>>> + PCMachineState *pcms = PC_MACHINE(mo); >>>>>>> + ram_addr_t lowmem = 0xb0000000; >>>>>>> + >>>>>>> + if (pcms && pcms->max_ram_below_4g) { >>>>>>> + lowmem = pcms->max_ram_below_4g; >>>>>>> + } >>>>>>> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory >>>>>>> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping >>>>>>> @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) >>>>>>> * For old machine types, use whatever split we used historically to avoid >>>>>>> * breaking migration. >>>>>>> */ >>>>>>> - if (machine->ram_size >= 0xb0000000) { >>>>>>> - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; >>>>>>> + if (machine->ram_size >= lowmem) { >>>>>>> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >>>>>>> + lowmem = 0x800000000; >>>>>>> + } >>>>>>> above_4g_mem_size = machine->ram_size - lowmem; >>>>>>> below_4g_mem_size = lowmem; >>>>>>> } else { >>>>>>> @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) >>>>>>> } >>>>>>> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >>>>>>> - object_property_add_child(qdev_get_machine(), "icc-bridge", >>>>>>> + object_property_add_child(mo, "icc-bridge", >>>>>>> OBJECT(icc_bridge), NULL); >>>>>>> pc_cpus_init(machine->cpu_model, icc_bridge); >>>>>>> diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h >>>>>>> index 19530bd..2d8b562 100644 >>>>>>> --- a/include/hw/i386/pc.h >>>>>>> +++ b/include/hw/i386/pc.h >>>>>>> @@ -32,10 +32,13 @@ struct PCMachineState { >>>>>>> MemoryRegion hotplug_memory; >>>>>>> HotplugHandler *acpi_dev; >>>>>>> + >>>>>>> + uint64_t max_ram_below_4g; >>>>>>> }; >>>>>>> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" >>>>>>> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" >>>>>>> +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" >>>>>>> /** >>>>>>> * PCMachineClass: >>>>>>> diff --git a/vl.c b/vl.c >>>>>>> index 5e77a27..cffb9c5 100644 >>>>>>> --- a/vl.c >>>>>>> +++ b/vl.c >>>>>>> @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { >>>>>>> .name = "kvm-type", >>>>>>> .type = QEMU_OPT_STRING, >>>>>>> .help = "Specifies the KVM virtualization mode (HV, PR)", >>>>>>> + },{ >>>>>>> + .name = PC_MACHINE_MAX_RAM_BELOW_4G, >>>>>>> + .type = QEMU_OPT_SIZE, >>>>>>> + .help = "maximum ram below the 4G boundary (32bit boundary)", >>>>>>> }, >>>>>>> { /* End of list */ } >>>>>>> }, >>>>>>> -- >>>>>>> 1.8.4 >>> >>> >> > > ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-09 14:38 ` Michael S. Tsirkin @ 2014-06-09 19:13 ` Don Slutz -1 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-09 19:13 UTC (permalink / raw) To: Michael S. Tsirkin, Don Slutz, Gerd Hoffmann Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/09/14 10:38, Michael S. Tsirkin wrote: > On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: >> On 06/08/14 11:40, Michael S. Tsirkin wrote: >>> On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: >>>> This is a pc & q35 only machine opt. One use is to allow for more >>>> ram in a 32bit guest for example: >>>> >>>> -machine pc,max-ram-below-4g=3.75G >>>> >>>> If you add enough PCI devices then all mmio for them will not fit >>>> below 4G which may not be the layout the user wanted. This allows >>>> you to increase the below 4G address space that PCI devices can use >>>> (aka decrease ram below 4G) and therefore in more cases not have any >>>> mmio that is above 4G. >>>> >>>> For example using "-machine pc,max-ram-below-4g=2G" on the command >>>> line will limit the amount of ram that is below 4G to 2G. >>>> >>>> Signed-off-by: Don Slutz <dslutz@verizon.com> >>>> --- >>>> v5: >>>> Re-work based on: >>>> >>>> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 >>>> >>>> >>>> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ >>>> hw/i386/pc_piix.c | 15 ++++++++++++--- >>>> hw/i386/pc_q35.c | 15 ++++++++++++--- >>>> include/hw/i386/pc.h | 3 +++ >>>> vl.c | 4 ++++ >>>> 5 files changed, 69 insertions(+), 6 deletions(-) >>>> >>>> diff --git a/hw/i386/pc.c b/hw/i386/pc.c >>>> index 7cdba10..bccb746 100644 >>>> --- a/hw/i386/pc.c >>>> +++ b/hw/i386/pc.c >>>> @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, >>>> visit_type_int(v, &value, name, errp); >>>> } >>>> +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, >>>> + void *opaque, const char *name, >>>> + Error **errp) >>>> +{ >>>> + PCMachineState *pcms = PC_MACHINE(obj); >>>> + uint64_t value = pcms->max_ram_below_4g; >>>> + >>>> + visit_type_size(v, &value, name, errp); >>>> +} >>>> + >>>> +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, >>>> + void *opaque, const char *name, >>>> + Error **errp) >>>> +{ >>>> + PCMachineState *pcms = PC_MACHINE(obj); >>>> + Error *error = NULL; >>>> + uint64_t value; >>>> + >>>> + visit_type_size(v, &value, name, &error); >>>> + if (error) { >>>> + error_propagate(errp, error); >>>> + return; >>>> + } >>>> + if (value > (1ULL << 32)) { >>>> + error_set(&error, ERROR_CLASS_GENERIC_ERROR, >>>> + "Machine option 'max-ram-below-4g=%"PRIu64 >>>> + "' expects size less then or equal to 4G", value); >>> less than >> But the test is greater then. So "not greater then" is "less then or equal". >> Or did you want the test changed? > No, just correcting English: less than, not less then :) > Sigh, will fix. >>>> + error_propagate(errp, error); >>>> + return; >>>> + } >>>> + >>>> + pcms->max_ram_below_4g = value; >>>> +} >>>> + >>>> static void pc_machine_initfn(Object *obj) >>>> { >>>> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", >>>> pc_machine_get_hotplug_memory_region_size, >>>> NULL, NULL, NULL, NULL); >>>> + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", >>>> + pc_machine_get_max_ram_below_4g, >>>> + pc_machine_set_max_ram_below_4g, >>>> + NULL, NULL, NULL); >>>> } >>>> static void pc_machine_class_init(ObjectClass *oc, void *data) >>>> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >>>> index 40f6eaf..25f4727 100644 >>>> --- a/hw/i386/pc_piix.c >>>> +++ b/hw/i386/pc_piix.c >>>> @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, >>>> DeviceState *icc_bridge; >>>> FWCfgState *fw_cfg = NULL; >>>> PcGuestInfo *guest_info; >>>> + Object *mo = qdev_get_machine(); >>>> + PCMachineState *pcms = PC_MACHINE(mo); >>>> + ram_addr_t lowmem = 0xe0000000; >>>> + >>>> + if (pcms && pcms->max_ram_below_4g) { >>> Is pcms ever NULL? If yes why? >> Not that I know of. I would be happy to convert this to an assert(pcms). > In fact, PC_MACHINE already includes an assert doesn't it? > So no need to check it everywhere. You are right. And I also found: static void pc_init1(MachineState *machine, int pci_enabled, int kvmclock_enabled) { PCMachineState *pc_machine = PC_MACHINE(machine); ... PCMachineState *pcms = PC_MACHINE(mo); ... and so I will drop the add of pcms. >>>> + lowmem = pcms->max_ram_below_4g; >>>> + } >>>> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). >>>> * If it doesn't, we need to split it in chunks below and above 4G. >>>> @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, >>>> * For old machine types, use whatever split we used historically to avoid >>>> * breaking migration. >>>> */ >>>> - if (machine->ram_size >= 0xe0000000) { >>>> - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; >>>> + if (machine->ram_size >= lowmem) { >>>> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >>>> + lowmem = 0xc0000000; >>>> + } >>>> above_4g_mem_size = machine->ram_size - lowmem; >>>> below_4g_mem_size = lowmem; >>>> } else { >>> So why do we need gigabyte_align anymore? >> Because of qemu 2.0 and the user is not required to specify this option. >> >>> Can't we set property to 0xc0000000 by default, and >>> override for old machine types? >> There is a strange compatibility part here. Since this code includes ram_size (see: >> >> http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html >> >> ) and xen has a different default. >> > So instead of default 0, it would be preferable to set the default to the > actual value, and let user override it. > > Or if that's too hard, set max_ram_below_4g instead of setting > gigabyte_align. gigabyte_align switches everywhere is messy > enough, adding max_ram_below_4g into mix is just too messy. > I do not see a way to encode the default since for QEMU 2.0 it depends on the specified ram size: > This is intentional. > If we can fit all ram into low memory, because it is less than 3.5G, > we'll do that (pc machine type, q35 numbers are different but logic is > the same). This way 32bit (+non-PAE) guests can continue to have up to > 3.5G memory. > If we can't fit all ram into low memory (thus the guest should be able > to access ram above 4G anyway), then we'll cut off at a gigabyte > boundary (3G for pc machine type). This way our ram is nicely > gigabyte-aligned and we can get best performance benefits from huge > pages. > The size of the pci hole changing in the second case is only a side > effect, it's not the main reason for the change. > cheers, > Gerd So migration of a QEMU 2.0 pc to QEMU 2.1 without gigabyte_align would require the user to specify the correct value of max-ram-below-4g. When you add xen into the mix I do not see a way to get right of gigabyte_align. You have 3 cases: 1) old xen (without max-ram-below-4g), QEMU 2.1 or later. Will expect that QEMU acts as if max-ram-below-4g=3.75G was specified. I.E. gigabyte_align is ignored. Note: xen 4.4 asks for "pc,accel=xen" in some cases. 2) new xen (with max-ram-below-4g), QEMU 2.0 or earlier. Will expect that QEMU acts as if max-ram-below-4g=3.75G was specified. If any other value requested, the error from QEMU is ok. 3) new xen (with max-ram-below-4g), QEMU 2.1 or later. Expects that max-ram-below-4g works. In summary, the migration of QEMU pc-i440fx-2.0 and pc-q35-2.0 guests for accel=tcg, accel=kvm, accel=xen needs the gigabyte_align mess. -Don Slutz > >>> Also, a value that isn't a multiple of 1G will lead to bad >>> performance for large machines which do have above_4g_mem_size. >>> Let's detect and print a warning. >> Will Do. >> >> -Don Slutz >> >>> >>>> @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, >>>> } >>>> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >>>> - object_property_add_child(qdev_get_machine(), "icc-bridge", >>>> + object_property_add_child(mo, "icc-bridge", >>>> OBJECT(icc_bridge), NULL); >>>> pc_cpus_init(machine->cpu_model, icc_bridge); >>>> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >>>> index e28ce40..155cdf1 100644 >>>> --- a/hw/i386/pc_q35.c >>>> +++ b/hw/i386/pc_q35.c >>>> @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) >>>> PCIDevice *ahci; >>>> DeviceState *icc_bridge; >>>> PcGuestInfo *guest_info; >>>> + Object *mo = qdev_get_machine(); >>>> + PCMachineState *pcms = PC_MACHINE(mo); >>>> + ram_addr_t lowmem = 0xb0000000; >>>> + >>>> + if (pcms && pcms->max_ram_below_4g) { >>>> + lowmem = pcms->max_ram_below_4g; >>>> + } >>>> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory >>>> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping >>>> @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) >>>> * For old machine types, use whatever split we used historically to avoid >>>> * breaking migration. >>>> */ >>>> - if (machine->ram_size >= 0xb0000000) { >>>> - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; >>>> + if (machine->ram_size >= lowmem) { >>>> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >>>> + lowmem = 0x800000000; >>>> + } >>>> above_4g_mem_size = machine->ram_size - lowmem; >>>> below_4g_mem_size = lowmem; >>>> } else { >>>> @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) >>>> } >>>> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >>>> - object_property_add_child(qdev_get_machine(), "icc-bridge", >>>> + object_property_add_child(mo, "icc-bridge", >>>> OBJECT(icc_bridge), NULL); >>>> pc_cpus_init(machine->cpu_model, icc_bridge); >>>> diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h >>>> index 19530bd..2d8b562 100644 >>>> --- a/include/hw/i386/pc.h >>>> +++ b/include/hw/i386/pc.h >>>> @@ -32,10 +32,13 @@ struct PCMachineState { >>>> MemoryRegion hotplug_memory; >>>> HotplugHandler *acpi_dev; >>>> + >>>> + uint64_t max_ram_below_4g; >>>> }; >>>> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" >>>> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" >>>> +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" >>>> /** >>>> * PCMachineClass: >>>> diff --git a/vl.c b/vl.c >>>> index 5e77a27..cffb9c5 100644 >>>> --- a/vl.c >>>> +++ b/vl.c >>>> @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { >>>> .name = "kvm-type", >>>> .type = QEMU_OPT_STRING, >>>> .help = "Specifies the KVM virtualization mode (HV, PR)", >>>> + },{ >>>> + .name = PC_MACHINE_MAX_RAM_BELOW_4G, >>>> + .type = QEMU_OPT_SIZE, >>>> + .help = "maximum ram below the 4G boundary (32bit boundary)", >>>> }, >>>> { /* End of list */ } >>>> }, >>>> -- >>>> 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-09 19:13 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-09 19:13 UTC (permalink / raw) To: Michael S. Tsirkin, Don Slutz, Gerd Hoffmann Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/09/14 10:38, Michael S. Tsirkin wrote: > On Mon, Jun 09, 2014 at 10:20:57AM -0400, Don Slutz wrote: >> On 06/08/14 11:40, Michael S. Tsirkin wrote: >>> On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: >>>> This is a pc & q35 only machine opt. One use is to allow for more >>>> ram in a 32bit guest for example: >>>> >>>> -machine pc,max-ram-below-4g=3.75G >>>> >>>> If you add enough PCI devices then all mmio for them will not fit >>>> below 4G which may not be the layout the user wanted. This allows >>>> you to increase the below 4G address space that PCI devices can use >>>> (aka decrease ram below 4G) and therefore in more cases not have any >>>> mmio that is above 4G. >>>> >>>> For example using "-machine pc,max-ram-below-4g=2G" on the command >>>> line will limit the amount of ram that is below 4G to 2G. >>>> >>>> Signed-off-by: Don Slutz <dslutz@verizon.com> >>>> --- >>>> v5: >>>> Re-work based on: >>>> >>>> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 >>>> >>>> >>>> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ >>>> hw/i386/pc_piix.c | 15 ++++++++++++--- >>>> hw/i386/pc_q35.c | 15 ++++++++++++--- >>>> include/hw/i386/pc.h | 3 +++ >>>> vl.c | 4 ++++ >>>> 5 files changed, 69 insertions(+), 6 deletions(-) >>>> >>>> diff --git a/hw/i386/pc.c b/hw/i386/pc.c >>>> index 7cdba10..bccb746 100644 >>>> --- a/hw/i386/pc.c >>>> +++ b/hw/i386/pc.c >>>> @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, >>>> visit_type_int(v, &value, name, errp); >>>> } >>>> +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, >>>> + void *opaque, const char *name, >>>> + Error **errp) >>>> +{ >>>> + PCMachineState *pcms = PC_MACHINE(obj); >>>> + uint64_t value = pcms->max_ram_below_4g; >>>> + >>>> + visit_type_size(v, &value, name, errp); >>>> +} >>>> + >>>> +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, >>>> + void *opaque, const char *name, >>>> + Error **errp) >>>> +{ >>>> + PCMachineState *pcms = PC_MACHINE(obj); >>>> + Error *error = NULL; >>>> + uint64_t value; >>>> + >>>> + visit_type_size(v, &value, name, &error); >>>> + if (error) { >>>> + error_propagate(errp, error); >>>> + return; >>>> + } >>>> + if (value > (1ULL << 32)) { >>>> + error_set(&error, ERROR_CLASS_GENERIC_ERROR, >>>> + "Machine option 'max-ram-below-4g=%"PRIu64 >>>> + "' expects size less then or equal to 4G", value); >>> less than >> But the test is greater then. So "not greater then" is "less then or equal". >> Or did you want the test changed? > No, just correcting English: less than, not less then :) > Sigh, will fix. >>>> + error_propagate(errp, error); >>>> + return; >>>> + } >>>> + >>>> + pcms->max_ram_below_4g = value; >>>> +} >>>> + >>>> static void pc_machine_initfn(Object *obj) >>>> { >>>> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", >>>> pc_machine_get_hotplug_memory_region_size, >>>> NULL, NULL, NULL, NULL); >>>> + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", >>>> + pc_machine_get_max_ram_below_4g, >>>> + pc_machine_set_max_ram_below_4g, >>>> + NULL, NULL, NULL); >>>> } >>>> static void pc_machine_class_init(ObjectClass *oc, void *data) >>>> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >>>> index 40f6eaf..25f4727 100644 >>>> --- a/hw/i386/pc_piix.c >>>> +++ b/hw/i386/pc_piix.c >>>> @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, >>>> DeviceState *icc_bridge; >>>> FWCfgState *fw_cfg = NULL; >>>> PcGuestInfo *guest_info; >>>> + Object *mo = qdev_get_machine(); >>>> + PCMachineState *pcms = PC_MACHINE(mo); >>>> + ram_addr_t lowmem = 0xe0000000; >>>> + >>>> + if (pcms && pcms->max_ram_below_4g) { >>> Is pcms ever NULL? If yes why? >> Not that I know of. I would be happy to convert this to an assert(pcms). > In fact, PC_MACHINE already includes an assert doesn't it? > So no need to check it everywhere. You are right. And I also found: static void pc_init1(MachineState *machine, int pci_enabled, int kvmclock_enabled) { PCMachineState *pc_machine = PC_MACHINE(machine); ... PCMachineState *pcms = PC_MACHINE(mo); ... and so I will drop the add of pcms. >>>> + lowmem = pcms->max_ram_below_4g; >>>> + } >>>> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). >>>> * If it doesn't, we need to split it in chunks below and above 4G. >>>> @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, >>>> * For old machine types, use whatever split we used historically to avoid >>>> * breaking migration. >>>> */ >>>> - if (machine->ram_size >= 0xe0000000) { >>>> - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; >>>> + if (machine->ram_size >= lowmem) { >>>> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >>>> + lowmem = 0xc0000000; >>>> + } >>>> above_4g_mem_size = machine->ram_size - lowmem; >>>> below_4g_mem_size = lowmem; >>>> } else { >>> So why do we need gigabyte_align anymore? >> Because of qemu 2.0 and the user is not required to specify this option. >> >>> Can't we set property to 0xc0000000 by default, and >>> override for old machine types? >> There is a strange compatibility part here. Since this code includes ram_size (see: >> >> http://lists.gnu.org/archive/html/qemu-devel/2014-02/msg05146.html >> >> ) and xen has a different default. >> > So instead of default 0, it would be preferable to set the default to the > actual value, and let user override it. > > Or if that's too hard, set max_ram_below_4g instead of setting > gigabyte_align. gigabyte_align switches everywhere is messy > enough, adding max_ram_below_4g into mix is just too messy. > I do not see a way to encode the default since for QEMU 2.0 it depends on the specified ram size: > This is intentional. > If we can fit all ram into low memory, because it is less than 3.5G, > we'll do that (pc machine type, q35 numbers are different but logic is > the same). This way 32bit (+non-PAE) guests can continue to have up to > 3.5G memory. > If we can't fit all ram into low memory (thus the guest should be able > to access ram above 4G anyway), then we'll cut off at a gigabyte > boundary (3G for pc machine type). This way our ram is nicely > gigabyte-aligned and we can get best performance benefits from huge > pages. > The size of the pci hole changing in the second case is only a side > effect, it's not the main reason for the change. > cheers, > Gerd So migration of a QEMU 2.0 pc to QEMU 2.1 without gigabyte_align would require the user to specify the correct value of max-ram-below-4g. When you add xen into the mix I do not see a way to get right of gigabyte_align. You have 3 cases: 1) old xen (without max-ram-below-4g), QEMU 2.1 or later. Will expect that QEMU acts as if max-ram-below-4g=3.75G was specified. I.E. gigabyte_align is ignored. Note: xen 4.4 asks for "pc,accel=xen" in some cases. 2) new xen (with max-ram-below-4g), QEMU 2.0 or earlier. Will expect that QEMU acts as if max-ram-below-4g=3.75G was specified. If any other value requested, the error from QEMU is ok. 3) new xen (with max-ram-below-4g), QEMU 2.1 or later. Expects that max-ram-below-4g works. In summary, the migration of QEMU pc-i440fx-2.0 and pc-q35-2.0 guests for accel=tcg, accel=kvm, accel=xen needs the gigabyte_align mess. -Don Slutz > >>> Also, a value that isn't a multiple of 1G will lead to bad >>> performance for large machines which do have above_4g_mem_size. >>> Let's detect and print a warning. >> Will Do. >> >> -Don Slutz >> >>> >>>> @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, >>>> } >>>> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >>>> - object_property_add_child(qdev_get_machine(), "icc-bridge", >>>> + object_property_add_child(mo, "icc-bridge", >>>> OBJECT(icc_bridge), NULL); >>>> pc_cpus_init(machine->cpu_model, icc_bridge); >>>> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >>>> index e28ce40..155cdf1 100644 >>>> --- a/hw/i386/pc_q35.c >>>> +++ b/hw/i386/pc_q35.c >>>> @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) >>>> PCIDevice *ahci; >>>> DeviceState *icc_bridge; >>>> PcGuestInfo *guest_info; >>>> + Object *mo = qdev_get_machine(); >>>> + PCMachineState *pcms = PC_MACHINE(mo); >>>> + ram_addr_t lowmem = 0xb0000000; >>>> + >>>> + if (pcms && pcms->max_ram_below_4g) { >>>> + lowmem = pcms->max_ram_below_4g; >>>> + } >>>> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory >>>> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping >>>> @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) >>>> * For old machine types, use whatever split we used historically to avoid >>>> * breaking migration. >>>> */ >>>> - if (machine->ram_size >= 0xb0000000) { >>>> - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; >>>> + if (machine->ram_size >= lowmem) { >>>> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >>>> + lowmem = 0x800000000; >>>> + } >>>> above_4g_mem_size = machine->ram_size - lowmem; >>>> below_4g_mem_size = lowmem; >>>> } else { >>>> @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) >>>> } >>>> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >>>> - object_property_add_child(qdev_get_machine(), "icc-bridge", >>>> + object_property_add_child(mo, "icc-bridge", >>>> OBJECT(icc_bridge), NULL); >>>> pc_cpus_init(machine->cpu_model, icc_bridge); >>>> diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h >>>> index 19530bd..2d8b562 100644 >>>> --- a/include/hw/i386/pc.h >>>> +++ b/include/hw/i386/pc.h >>>> @@ -32,10 +32,13 @@ struct PCMachineState { >>>> MemoryRegion hotplug_memory; >>>> HotplugHandler *acpi_dev; >>>> + >>>> + uint64_t max_ram_below_4g; >>>> }; >>>> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" >>>> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" >>>> +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" >>>> /** >>>> * PCMachineClass: >>>> diff --git a/vl.c b/vl.c >>>> index 5e77a27..cffb9c5 100644 >>>> --- a/vl.c >>>> +++ b/vl.c >>>> @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { >>>> .name = "kvm-type", >>>> .type = QEMU_OPT_STRING, >>>> .help = "Specifies the KVM virtualization mode (HV, PR)", >>>> + },{ >>>> + .name = PC_MACHINE_MAX_RAM_BELOW_4G, >>>> + .type = QEMU_OPT_SIZE, >>>> + .help = "maximum ram below the 4G boundary (32bit boundary)", >>>> }, >>>> { /* End of list */ } >>>> }, >>>> -- >>>> 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-09 19:13 ` Don Slutz @ 2014-06-10 7:36 ` Gerd Hoffmann -1 siblings, 0 replies; 53+ messages in thread From: Gerd Hoffmann @ 2014-06-10 7:36 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber Hi, > > So instead of default 0, it would be preferable to set the default to the > > actual value, and let user override it. > > > > Or if that's too hard, set max_ram_below_4g instead of setting > > gigabyte_align. gigabyte_align switches everywhere is messy > > enough, adding max_ram_below_4g into mix is just too messy. > > > > I do not see a way to encode the default since for QEMU 2.0 it depends on the specified ram size: > > > This is intentional. > > > If we can fit all ram into low memory, because it is less than 3.5G, > > we'll do that (pc machine type, q35 numbers are different but logic is > > the same). This way 32bit (+non-PAE) guests can continue to have up to > > 3.5G memory. > > > If we can't fit all ram into low memory (thus the guest should be able > > to access ram above 4G anyway), then we'll cut off at a gigabyte > > boundary (3G for pc machine type). This way our ram is nicely > > gigabyte-aligned and we can get best performance benefits from huge > > pages. > > > The size of the pci hole changing in the second case is only a side > > effect, it's not the main reason for the change. > > > cheers, > > Gerd > > So migration of a QEMU 2.0 pc to QEMU 2.1 without gigabyte_align would require the user > to specify the correct value of max-ram-below-4g. You are expected to use the same machine type on both ends for live migration. That is the whole point why the gigabyte alignment logic is activated for new machine types only: Just -M pc-<version> should be enough to make the machine config and the vmstate wire format compatible even with different qemu versions on both ends, without requiring the user manually specifying obscure parameters. > When you add xen into the mix I do not see a way to get right of gigabyte_align. > > You have 3 cases: > > 1) old xen (without max-ram-below-4g), QEMU 2.1 or later. > Will expect that QEMU acts as if max-ram-below-4g=3.75G was specified. > I.E. gigabyte_align is ignored. Note: xen 4.4 asks for "pc,accel=xen" in some cases. IMO xen should use a versioned machine type to make live migration more reliable. IIRC this was discussed anyway for other reasons (see xen-platform-pci discussions, picking pc-i440fx-1.6 IIRC). That should also make qemu use the memory layout expected by old xen. > 3) new xen (with max-ram-below-4g), QEMU 2.1 or later. > Expects that max-ram-below-4g works. Newer xen versions can switch to a newer machine type, once it knows how to deal with the changes: other memory layout, new config switches, whatever else might have changed ... cheers, Gerd ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-10 7:36 ` Gerd Hoffmann 0 siblings, 0 replies; 53+ messages in thread From: Gerd Hoffmann @ 2014-06-10 7:36 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber Hi, > > So instead of default 0, it would be preferable to set the default to the > > actual value, and let user override it. > > > > Or if that's too hard, set max_ram_below_4g instead of setting > > gigabyte_align. gigabyte_align switches everywhere is messy > > enough, adding max_ram_below_4g into mix is just too messy. > > > > I do not see a way to encode the default since for QEMU 2.0 it depends on the specified ram size: > > > This is intentional. > > > If we can fit all ram into low memory, because it is less than 3.5G, > > we'll do that (pc machine type, q35 numbers are different but logic is > > the same). This way 32bit (+non-PAE) guests can continue to have up to > > 3.5G memory. > > > If we can't fit all ram into low memory (thus the guest should be able > > to access ram above 4G anyway), then we'll cut off at a gigabyte > > boundary (3G for pc machine type). This way our ram is nicely > > gigabyte-aligned and we can get best performance benefits from huge > > pages. > > > The size of the pci hole changing in the second case is only a side > > effect, it's not the main reason for the change. > > > cheers, > > Gerd > > So migration of a QEMU 2.0 pc to QEMU 2.1 without gigabyte_align would require the user > to specify the correct value of max-ram-below-4g. You are expected to use the same machine type on both ends for live migration. That is the whole point why the gigabyte alignment logic is activated for new machine types only: Just -M pc-<version> should be enough to make the machine config and the vmstate wire format compatible even with different qemu versions on both ends, without requiring the user manually specifying obscure parameters. > When you add xen into the mix I do not see a way to get right of gigabyte_align. > > You have 3 cases: > > 1) old xen (without max-ram-below-4g), QEMU 2.1 or later. > Will expect that QEMU acts as if max-ram-below-4g=3.75G was specified. > I.E. gigabyte_align is ignored. Note: xen 4.4 asks for "pc,accel=xen" in some cases. IMO xen should use a versioned machine type to make live migration more reliable. IIRC this was discussed anyway for other reasons (see xen-platform-pci discussions, picking pc-i440fx-1.6 IIRC). That should also make qemu use the memory layout expected by old xen. > 3) new xen (with max-ram-below-4g), QEMU 2.1 or later. > Expects that max-ram-below-4g works. Newer xen versions can switch to a newer machine type, once it knows how to deal with the changes: other memory layout, new config switches, whatever else might have changed ... cheers, Gerd ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-10 7:36 ` Gerd Hoffmann @ 2014-06-17 17:51 ` Don Slutz -1 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-17 17:51 UTC (permalink / raw) To: Gerd Hoffmann, Don Slutz Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/10/14 03:36, Gerd Hoffmann wrote: > Hi, > >>> So instead of default 0, it would be preferable to set the default to the >>> actual value, and let user override it. >>> >>> Or if that's too hard, set max_ram_below_4g instead of setting >>> gigabyte_align. gigabyte_align switches everywhere is messy >>> enough, adding max_ram_below_4g into mix is just too messy. >>> >> I do not see a way to encode the default since for QEMU 2.0 it depends on the specified ram size: >> >>> This is intentional. >>> If we can fit all ram into low memory, because it is less than 3.5G, >>> we'll do that (pc machine type, q35 numbers are different but logic is >>> the same). This way 32bit (+non-PAE) guests can continue to have up to >>> 3.5G memory. >>> If we can't fit all ram into low memory (thus the guest should be able >>> to access ram above 4G anyway), then we'll cut off at a gigabyte >>> boundary (3G for pc machine type). This way our ram is nicely >>> gigabyte-aligned and we can get best performance benefits from huge >>> pages. >>> The size of the pci hole changing in the second case is only a side >>> effect, it's not the main reason for the change. >>> cheers, >>> Gerd >> So migration of a QEMU 2.0 pc to QEMU 2.1 without gigabyte_align would require the user >> to specify the correct value of max-ram-below-4g. > You are expected to use the same machine type on both ends for live > migration. That is the whole point why the gigabyte alignment logic is > activated for new machine types only: Just -M pc-<version> should be > enough to make the machine config and the vmstate wire format compatible > even with different qemu versions on both ends, without requiring the > user manually specifying obscure parameters. > I agree. >> When you add xen into the mix I do not see a way to get right of gigabyte_align. >> >> You have 3 cases: >> >> 1) old xen (without max-ram-below-4g), QEMU 2.1 or later. >> Will expect that QEMU acts as if max-ram-below-4g=3.75G was specified. >> I.E. gigabyte_align is ignored. Note: xen 4.4 asks for "pc,accel=xen" in some cases. > IMO xen should use a versioned machine type to make live migration more > reliable. IIRC this was discussed anyway for other reasons (see > xen-platform-pci discussions, picking pc-i440fx-1.6 IIRC). That is happening as far as I know and does not directly impact this patch set. > That should > also make qemu use the memory layout expected by old xen. Currently xen just ignores the memory layout that QEMU sets up and does it's own way. So no, this does not make QEMU use the memory layout expected by old xen. Patch #1 (xen-hvm: Fix xen_hvm_init) is all about letting the rest of QEMU know about the changed memory layout. This patch and patch #3 (xen-hvm: Pass is_default to xen_hvm_init) are in addition to allowing QEMU to have more memory layouts but also allows xen to have more memory layouts like a gigabyte aligned one. >> 3) new xen (with max-ram-below-4g), QEMU 2.1 or later. >> Expects that max-ram-below-4g works. > Newer xen versions can switch to a newer machine type, once it knows how > to deal with the changes: other memory layout, new config switches, > whatever else might have changed ... Yes -Don Slutz > cheers, > Gerd > > ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-17 17:51 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-17 17:51 UTC (permalink / raw) To: Gerd Hoffmann, Don Slutz Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/10/14 03:36, Gerd Hoffmann wrote: > Hi, > >>> So instead of default 0, it would be preferable to set the default to the >>> actual value, and let user override it. >>> >>> Or if that's too hard, set max_ram_below_4g instead of setting >>> gigabyte_align. gigabyte_align switches everywhere is messy >>> enough, adding max_ram_below_4g into mix is just too messy. >>> >> I do not see a way to encode the default since for QEMU 2.0 it depends on the specified ram size: >> >>> This is intentional. >>> If we can fit all ram into low memory, because it is less than 3.5G, >>> we'll do that (pc machine type, q35 numbers are different but logic is >>> the same). This way 32bit (+non-PAE) guests can continue to have up to >>> 3.5G memory. >>> If we can't fit all ram into low memory (thus the guest should be able >>> to access ram above 4G anyway), then we'll cut off at a gigabyte >>> boundary (3G for pc machine type). This way our ram is nicely >>> gigabyte-aligned and we can get best performance benefits from huge >>> pages. >>> The size of the pci hole changing in the second case is only a side >>> effect, it's not the main reason for the change. >>> cheers, >>> Gerd >> So migration of a QEMU 2.0 pc to QEMU 2.1 without gigabyte_align would require the user >> to specify the correct value of max-ram-below-4g. > You are expected to use the same machine type on both ends for live > migration. That is the whole point why the gigabyte alignment logic is > activated for new machine types only: Just -M pc-<version> should be > enough to make the machine config and the vmstate wire format compatible > even with different qemu versions on both ends, without requiring the > user manually specifying obscure parameters. > I agree. >> When you add xen into the mix I do not see a way to get right of gigabyte_align. >> >> You have 3 cases: >> >> 1) old xen (without max-ram-below-4g), QEMU 2.1 or later. >> Will expect that QEMU acts as if max-ram-below-4g=3.75G was specified. >> I.E. gigabyte_align is ignored. Note: xen 4.4 asks for "pc,accel=xen" in some cases. > IMO xen should use a versioned machine type to make live migration more > reliable. IIRC this was discussed anyway for other reasons (see > xen-platform-pci discussions, picking pc-i440fx-1.6 IIRC). That is happening as far as I know and does not directly impact this patch set. > That should > also make qemu use the memory layout expected by old xen. Currently xen just ignores the memory layout that QEMU sets up and does it's own way. So no, this does not make QEMU use the memory layout expected by old xen. Patch #1 (xen-hvm: Fix xen_hvm_init) is all about letting the rest of QEMU know about the changed memory layout. This patch and patch #3 (xen-hvm: Pass is_default to xen_hvm_init) are in addition to allowing QEMU to have more memory layouts but also allows xen to have more memory layouts like a gigabyte aligned one. >> 3) new xen (with max-ram-below-4g), QEMU 2.1 or later. >> Expects that max-ram-below-4g works. > Newer xen versions can switch to a newer machine type, once it knows how > to deal with the changes: other memory layout, new config switches, > whatever else might have changed ... Yes -Don Slutz > cheers, > Gerd > > ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-17 17:51 ` Don Slutz @ 2014-06-18 9:52 ` Gerd Hoffmann -1 siblings, 0 replies; 53+ messages in thread From: Gerd Hoffmann @ 2014-06-18 9:52 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber Hi, > > IMO xen should use a versioned machine type to make live migration more > > reliable. IIRC this was discussed anyway for other reasons (see > > xen-platform-pci discussions, picking pc-i440fx-1.6 IIRC). > > That is happening as far as I know and does not directly impact this > patch set. > > > That should > > also make qemu use the memory layout expected by old xen. > > Currently xen just ignores the memory layout that QEMU sets up > and does it's own way. So no, this does not make QEMU use the > memory layout expected by old xen. Why? "-M pc-i440fx-1.6" will make qemu use the same memory layout it used to have before gbalign support was added. And that should match what old xen versions are setting up ... cheers, Gerd ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-18 9:52 ` Gerd Hoffmann 0 siblings, 0 replies; 53+ messages in thread From: Gerd Hoffmann @ 2014-06-18 9:52 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber Hi, > > IMO xen should use a versioned machine type to make live migration more > > reliable. IIRC this was discussed anyway for other reasons (see > > xen-platform-pci discussions, picking pc-i440fx-1.6 IIRC). > > That is happening as far as I know and does not directly impact this > patch set. > > > That should > > also make qemu use the memory layout expected by old xen. > > Currently xen just ignores the memory layout that QEMU sets up > and does it's own way. So no, this does not make QEMU use the > memory layout expected by old xen. Why? "-M pc-i440fx-1.6" will make qemu use the same memory layout it used to have before gbalign support was added. And that should match what old xen versions are setting up ... cheers, Gerd ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-06 17:52 ` Don Slutz @ 2014-06-17 18:22 ` Michael S. Tsirkin -1 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-17 18:22 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > This is a pc & q35 only machine opt. One use is to allow for more > ram in a 32bit guest for example: > > -machine pc,max-ram-below-4g=3.75G > > If you add enough PCI devices then all mmio for them will not fit > below 4G which may not be the layout the user wanted. This allows > you to increase the below 4G address space that PCI devices can use > (aka decrease ram below 4G) and therefore in more cases not have any > mmio that is above 4G. > > For example using "-machine pc,max-ram-below-4g=2G" on the command > line will limit the amount of ram that is below 4G to 2G. I'm not sure I get it. All this only has effect if you have >4G RAM, right? Presumably you then have a 64 bit guest so why does it care about memory/MMIO being below 4G? > > Signed-off-by: Don Slutz <dslutz@verizon.com> > --- > v5: > Re-work based on: > > https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > > hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > hw/i386/pc_piix.c | 15 ++++++++++++--- > hw/i386/pc_q35.c | 15 ++++++++++++--- > include/hw/i386/pc.h | 3 +++ > vl.c | 4 ++++ > 5 files changed, 69 insertions(+), 6 deletions(-) > > diff --git a/hw/i386/pc.c b/hw/i386/pc.c > index 7cdba10..bccb746 100644 > --- a/hw/i386/pc.c > +++ b/hw/i386/pc.c > @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > visit_type_int(v, &value, name, errp); > } > > +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > + void *opaque, const char *name, > + Error **errp) > +{ > + PCMachineState *pcms = PC_MACHINE(obj); > + uint64_t value = pcms->max_ram_below_4g; > + > + visit_type_size(v, &value, name, errp); > +} > + > +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > + void *opaque, const char *name, > + Error **errp) > +{ > + PCMachineState *pcms = PC_MACHINE(obj); > + Error *error = NULL; > + uint64_t value; > + > + visit_type_size(v, &value, name, &error); > + if (error) { > + error_propagate(errp, error); > + return; > + } > + if (value > (1ULL << 32)) { > + error_set(&error, ERROR_CLASS_GENERIC_ERROR, > + "Machine option 'max-ram-below-4g=%"PRIu64 > + "' expects size less then or equal to 4G", value); > + error_propagate(errp, error); > + return; > + } > + > + pcms->max_ram_below_4g = value; > +} > + > static void pc_machine_initfn(Object *obj) > { > object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > pc_machine_get_hotplug_memory_region_size, > NULL, NULL, NULL, NULL); > + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > + pc_machine_get_max_ram_below_4g, > + pc_machine_set_max_ram_below_4g, > + NULL, NULL, NULL); > } > > static void pc_machine_class_init(ObjectClass *oc, void *data) > diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > index 40f6eaf..25f4727 100644 > --- a/hw/i386/pc_piix.c > +++ b/hw/i386/pc_piix.c > @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > DeviceState *icc_bridge; > FWCfgState *fw_cfg = NULL; > PcGuestInfo *guest_info; > + Object *mo = qdev_get_machine(); > + PCMachineState *pcms = PC_MACHINE(mo); > + ram_addr_t lowmem = 0xe0000000; > + > + if (pcms && pcms->max_ram_below_4g) { > + lowmem = pcms->max_ram_below_4g; > + } > > /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > * If it doesn't, we need to split it in chunks below and above 4G. > @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > * For old machine types, use whatever split we used historically to avoid > * breaking migration. > */ > - if (machine->ram_size >= 0xe0000000) { > - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > + if (machine->ram_size >= lowmem) { > + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > + lowmem = 0xc0000000; > + } > above_4g_mem_size = machine->ram_size - lowmem; > below_4g_mem_size = lowmem; > } else { > @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > } > > icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > - object_property_add_child(qdev_get_machine(), "icc-bridge", > + object_property_add_child(mo, "icc-bridge", > OBJECT(icc_bridge), NULL); > > pc_cpus_init(machine->cpu_model, icc_bridge); > diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > index e28ce40..155cdf1 100644 > --- a/hw/i386/pc_q35.c > +++ b/hw/i386/pc_q35.c > @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > PCIDevice *ahci; > DeviceState *icc_bridge; > PcGuestInfo *guest_info; > + Object *mo = qdev_get_machine(); > + PCMachineState *pcms = PC_MACHINE(mo); > + ram_addr_t lowmem = 0xb0000000; > + > + if (pcms && pcms->max_ram_below_4g) { > + lowmem = pcms->max_ram_below_4g; > + } > > /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > * For old machine types, use whatever split we used historically to avoid > * breaking migration. > */ > - if (machine->ram_size >= 0xb0000000) { > - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > + if (machine->ram_size >= lowmem) { > + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > + lowmem = 0x800000000; > + } > above_4g_mem_size = machine->ram_size - lowmem; > below_4g_mem_size = lowmem; > } else { > @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > } > > icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > - object_property_add_child(qdev_get_machine(), "icc-bridge", > + object_property_add_child(mo, "icc-bridge", > OBJECT(icc_bridge), NULL); > > pc_cpus_init(machine->cpu_model, icc_bridge); > diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > index 19530bd..2d8b562 100644 > --- a/include/hw/i386/pc.h > +++ b/include/hw/i386/pc.h > @@ -32,10 +32,13 @@ struct PCMachineState { > MemoryRegion hotplug_memory; > > HotplugHandler *acpi_dev; > + > + uint64_t max_ram_below_4g; > }; > > #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > /** > * PCMachineClass: > diff --git a/vl.c b/vl.c > index 5e77a27..cffb9c5 100644 > --- a/vl.c > +++ b/vl.c > @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > .name = "kvm-type", > .type = QEMU_OPT_STRING, > .help = "Specifies the KVM virtualization mode (HV, PR)", > + },{ > + .name = PC_MACHINE_MAX_RAM_BELOW_4G, > + .type = QEMU_OPT_SIZE, > + .help = "maximum ram below the 4G boundary (32bit boundary)", > }, > { /* End of list */ } > }, > -- > 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-17 18:22 ` Michael S. Tsirkin 0 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-17 18:22 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > This is a pc & q35 only machine opt. One use is to allow for more > ram in a 32bit guest for example: > > -machine pc,max-ram-below-4g=3.75G > > If you add enough PCI devices then all mmio for them will not fit > below 4G which may not be the layout the user wanted. This allows > you to increase the below 4G address space that PCI devices can use > (aka decrease ram below 4G) and therefore in more cases not have any > mmio that is above 4G. > > For example using "-machine pc,max-ram-below-4g=2G" on the command > line will limit the amount of ram that is below 4G to 2G. I'm not sure I get it. All this only has effect if you have >4G RAM, right? Presumably you then have a 64 bit guest so why does it care about memory/MMIO being below 4G? > > Signed-off-by: Don Slutz <dslutz@verizon.com> > --- > v5: > Re-work based on: > > https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > > hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > hw/i386/pc_piix.c | 15 ++++++++++++--- > hw/i386/pc_q35.c | 15 ++++++++++++--- > include/hw/i386/pc.h | 3 +++ > vl.c | 4 ++++ > 5 files changed, 69 insertions(+), 6 deletions(-) > > diff --git a/hw/i386/pc.c b/hw/i386/pc.c > index 7cdba10..bccb746 100644 > --- a/hw/i386/pc.c > +++ b/hw/i386/pc.c > @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > visit_type_int(v, &value, name, errp); > } > > +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > + void *opaque, const char *name, > + Error **errp) > +{ > + PCMachineState *pcms = PC_MACHINE(obj); > + uint64_t value = pcms->max_ram_below_4g; > + > + visit_type_size(v, &value, name, errp); > +} > + > +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > + void *opaque, const char *name, > + Error **errp) > +{ > + PCMachineState *pcms = PC_MACHINE(obj); > + Error *error = NULL; > + uint64_t value; > + > + visit_type_size(v, &value, name, &error); > + if (error) { > + error_propagate(errp, error); > + return; > + } > + if (value > (1ULL << 32)) { > + error_set(&error, ERROR_CLASS_GENERIC_ERROR, > + "Machine option 'max-ram-below-4g=%"PRIu64 > + "' expects size less then or equal to 4G", value); > + error_propagate(errp, error); > + return; > + } > + > + pcms->max_ram_below_4g = value; > +} > + > static void pc_machine_initfn(Object *obj) > { > object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > pc_machine_get_hotplug_memory_region_size, > NULL, NULL, NULL, NULL); > + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > + pc_machine_get_max_ram_below_4g, > + pc_machine_set_max_ram_below_4g, > + NULL, NULL, NULL); > } > > static void pc_machine_class_init(ObjectClass *oc, void *data) > diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > index 40f6eaf..25f4727 100644 > --- a/hw/i386/pc_piix.c > +++ b/hw/i386/pc_piix.c > @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > DeviceState *icc_bridge; > FWCfgState *fw_cfg = NULL; > PcGuestInfo *guest_info; > + Object *mo = qdev_get_machine(); > + PCMachineState *pcms = PC_MACHINE(mo); > + ram_addr_t lowmem = 0xe0000000; > + > + if (pcms && pcms->max_ram_below_4g) { > + lowmem = pcms->max_ram_below_4g; > + } > > /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > * If it doesn't, we need to split it in chunks below and above 4G. > @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > * For old machine types, use whatever split we used historically to avoid > * breaking migration. > */ > - if (machine->ram_size >= 0xe0000000) { > - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > + if (machine->ram_size >= lowmem) { > + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > + lowmem = 0xc0000000; > + } > above_4g_mem_size = machine->ram_size - lowmem; > below_4g_mem_size = lowmem; > } else { > @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > } > > icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > - object_property_add_child(qdev_get_machine(), "icc-bridge", > + object_property_add_child(mo, "icc-bridge", > OBJECT(icc_bridge), NULL); > > pc_cpus_init(machine->cpu_model, icc_bridge); > diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > index e28ce40..155cdf1 100644 > --- a/hw/i386/pc_q35.c > +++ b/hw/i386/pc_q35.c > @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > PCIDevice *ahci; > DeviceState *icc_bridge; > PcGuestInfo *guest_info; > + Object *mo = qdev_get_machine(); > + PCMachineState *pcms = PC_MACHINE(mo); > + ram_addr_t lowmem = 0xb0000000; > + > + if (pcms && pcms->max_ram_below_4g) { > + lowmem = pcms->max_ram_below_4g; > + } > > /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > * For old machine types, use whatever split we used historically to avoid > * breaking migration. > */ > - if (machine->ram_size >= 0xb0000000) { > - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > + if (machine->ram_size >= lowmem) { > + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > + lowmem = 0x800000000; > + } > above_4g_mem_size = machine->ram_size - lowmem; > below_4g_mem_size = lowmem; > } else { > @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > } > > icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > - object_property_add_child(qdev_get_machine(), "icc-bridge", > + object_property_add_child(mo, "icc-bridge", > OBJECT(icc_bridge), NULL); > > pc_cpus_init(machine->cpu_model, icc_bridge); > diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > index 19530bd..2d8b562 100644 > --- a/include/hw/i386/pc.h > +++ b/include/hw/i386/pc.h > @@ -32,10 +32,13 @@ struct PCMachineState { > MemoryRegion hotplug_memory; > > HotplugHandler *acpi_dev; > + > + uint64_t max_ram_below_4g; > }; > > #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > /** > * PCMachineClass: > diff --git a/vl.c b/vl.c > index 5e77a27..cffb9c5 100644 > --- a/vl.c > +++ b/vl.c > @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > .name = "kvm-type", > .type = QEMU_OPT_STRING, > .help = "Specifies the KVM virtualization mode (HV, PR)", > + },{ > + .name = PC_MACHINE_MAX_RAM_BELOW_4G, > + .type = QEMU_OPT_SIZE, > + .help = "maximum ram below the 4G boundary (32bit boundary)", > }, > { /* End of list */ } > }, > -- > 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-17 18:22 ` Michael S. Tsirkin @ 2014-06-17 18:44 ` Don Slutz -1 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-17 18:44 UTC (permalink / raw) To: Michael S. Tsirkin, Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/17/14 14:22, Michael S. Tsirkin wrote: > On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: >> This is a pc & q35 only machine opt. One use is to allow for more >> ram in a 32bit guest for example: >> >> -machine pc,max-ram-below-4g=3.75G >> >> If you add enough PCI devices then all mmio for them will not fit >> below 4G which may not be the layout the user wanted. This allows >> you to increase the below 4G address space that PCI devices can use >> (aka decrease ram below 4G) and therefore in more cases not have any >> mmio that is above 4G. >> >> For example using "-machine pc,max-ram-below-4g=2G" on the command >> line will limit the amount of ram that is below 4G to 2G. > I'm not sure I get it. > > All this only has effect if you have >4G RAM, right? Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. -machine pc,max-ram-below-4g=2G -m 3G Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > Presumably you then have a 64 bit guest so why does it > care about memory/MMIO being below 4G? It is not the guest that matters, it is all the PCI devices in use. There are ones (all old hardware) that only support 32bit addresses. When using these you may need more room. Also pci-passthru of real hardware that is 32bit only may require this. -Don Slutz > > >> Signed-off-by: Don Slutz <dslutz@verizon.com> >> --- >> v5: >> Re-work based on: >> >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 >> >> >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ >> hw/i386/pc_piix.c | 15 ++++++++++++--- >> hw/i386/pc_q35.c | 15 ++++++++++++--- >> include/hw/i386/pc.h | 3 +++ >> vl.c | 4 ++++ >> 5 files changed, 69 insertions(+), 6 deletions(-) >> >> diff --git a/hw/i386/pc.c b/hw/i386/pc.c >> index 7cdba10..bccb746 100644 >> --- a/hw/i386/pc.c >> +++ b/hw/i386/pc.c >> @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, >> visit_type_int(v, &value, name, errp); >> } >> >> +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, >> + void *opaque, const char *name, >> + Error **errp) >> +{ >> + PCMachineState *pcms = PC_MACHINE(obj); >> + uint64_t value = pcms->max_ram_below_4g; >> + >> + visit_type_size(v, &value, name, errp); >> +} >> + >> +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, >> + void *opaque, const char *name, >> + Error **errp) >> +{ >> + PCMachineState *pcms = PC_MACHINE(obj); >> + Error *error = NULL; >> + uint64_t value; >> + >> + visit_type_size(v, &value, name, &error); >> + if (error) { >> + error_propagate(errp, error); >> + return; >> + } >> + if (value > (1ULL << 32)) { >> + error_set(&error, ERROR_CLASS_GENERIC_ERROR, >> + "Machine option 'max-ram-below-4g=%"PRIu64 >> + "' expects size less then or equal to 4G", value); >> + error_propagate(errp, error); >> + return; >> + } >> + >> + pcms->max_ram_below_4g = value; >> +} >> + >> static void pc_machine_initfn(Object *obj) >> { >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", >> pc_machine_get_hotplug_memory_region_size, >> NULL, NULL, NULL, NULL); >> + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", >> + pc_machine_get_max_ram_below_4g, >> + pc_machine_set_max_ram_below_4g, >> + NULL, NULL, NULL); >> } >> >> static void pc_machine_class_init(ObjectClass *oc, void *data) >> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >> index 40f6eaf..25f4727 100644 >> --- a/hw/i386/pc_piix.c >> +++ b/hw/i386/pc_piix.c >> @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, >> DeviceState *icc_bridge; >> FWCfgState *fw_cfg = NULL; >> PcGuestInfo *guest_info; >> + Object *mo = qdev_get_machine(); >> + PCMachineState *pcms = PC_MACHINE(mo); >> + ram_addr_t lowmem = 0xe0000000; >> + >> + if (pcms && pcms->max_ram_below_4g) { >> + lowmem = pcms->max_ram_below_4g; >> + } >> >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). >> * If it doesn't, we need to split it in chunks below and above 4G. >> @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, >> * For old machine types, use whatever split we used historically to avoid >> * breaking migration. >> */ >> - if (machine->ram_size >= 0xe0000000) { >> - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; >> + if (machine->ram_size >= lowmem) { >> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >> + lowmem = 0xc0000000; >> + } >> above_4g_mem_size = machine->ram_size - lowmem; >> below_4g_mem_size = lowmem; >> } else { >> @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, >> } >> >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >> - object_property_add_child(qdev_get_machine(), "icc-bridge", >> + object_property_add_child(mo, "icc-bridge", >> OBJECT(icc_bridge), NULL); >> >> pc_cpus_init(machine->cpu_model, icc_bridge); >> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >> index e28ce40..155cdf1 100644 >> --- a/hw/i386/pc_q35.c >> +++ b/hw/i386/pc_q35.c >> @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) >> PCIDevice *ahci; >> DeviceState *icc_bridge; >> PcGuestInfo *guest_info; >> + Object *mo = qdev_get_machine(); >> + PCMachineState *pcms = PC_MACHINE(mo); >> + ram_addr_t lowmem = 0xb0000000; >> + >> + if (pcms && pcms->max_ram_below_4g) { >> + lowmem = pcms->max_ram_below_4g; >> + } >> >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping >> @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) >> * For old machine types, use whatever split we used historically to avoid >> * breaking migration. >> */ >> - if (machine->ram_size >= 0xb0000000) { >> - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; >> + if (machine->ram_size >= lowmem) { >> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >> + lowmem = 0x800000000; >> + } >> above_4g_mem_size = machine->ram_size - lowmem; >> below_4g_mem_size = lowmem; >> } else { >> @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) >> } >> >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >> - object_property_add_child(qdev_get_machine(), "icc-bridge", >> + object_property_add_child(mo, "icc-bridge", >> OBJECT(icc_bridge), NULL); >> >> pc_cpus_init(machine->cpu_model, icc_bridge); >> diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h >> index 19530bd..2d8b562 100644 >> --- a/include/hw/i386/pc.h >> +++ b/include/hw/i386/pc.h >> @@ -32,10 +32,13 @@ struct PCMachineState { >> MemoryRegion hotplug_memory; >> >> HotplugHandler *acpi_dev; >> + >> + uint64_t max_ram_below_4g; >> }; >> >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" >> +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" >> >> /** >> * PCMachineClass: >> diff --git a/vl.c b/vl.c >> index 5e77a27..cffb9c5 100644 >> --- a/vl.c >> +++ b/vl.c >> @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { >> .name = "kvm-type", >> .type = QEMU_OPT_STRING, >> .help = "Specifies the KVM virtualization mode (HV, PR)", >> + },{ >> + .name = PC_MACHINE_MAX_RAM_BELOW_4G, >> + .type = QEMU_OPT_SIZE, >> + .help = "maximum ram below the 4G boundary (32bit boundary)", >> }, >> { /* End of list */ } >> }, >> -- >> 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-17 18:44 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-17 18:44 UTC (permalink / raw) To: Michael S. Tsirkin, Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/17/14 14:22, Michael S. Tsirkin wrote: > On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: >> This is a pc & q35 only machine opt. One use is to allow for more >> ram in a 32bit guest for example: >> >> -machine pc,max-ram-below-4g=3.75G >> >> If you add enough PCI devices then all mmio for them will not fit >> below 4G which may not be the layout the user wanted. This allows >> you to increase the below 4G address space that PCI devices can use >> (aka decrease ram below 4G) and therefore in more cases not have any >> mmio that is above 4G. >> >> For example using "-machine pc,max-ram-below-4g=2G" on the command >> line will limit the amount of ram that is below 4G to 2G. > I'm not sure I get it. > > All this only has effect if you have >4G RAM, right? Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. -machine pc,max-ram-below-4g=2G -m 3G Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > Presumably you then have a 64 bit guest so why does it > care about memory/MMIO being below 4G? It is not the guest that matters, it is all the PCI devices in use. There are ones (all old hardware) that only support 32bit addresses. When using these you may need more room. Also pci-passthru of real hardware that is 32bit only may require this. -Don Slutz > > >> Signed-off-by: Don Slutz <dslutz@verizon.com> >> --- >> v5: >> Re-work based on: >> >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 >> >> >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ >> hw/i386/pc_piix.c | 15 ++++++++++++--- >> hw/i386/pc_q35.c | 15 ++++++++++++--- >> include/hw/i386/pc.h | 3 +++ >> vl.c | 4 ++++ >> 5 files changed, 69 insertions(+), 6 deletions(-) >> >> diff --git a/hw/i386/pc.c b/hw/i386/pc.c >> index 7cdba10..bccb746 100644 >> --- a/hw/i386/pc.c >> +++ b/hw/i386/pc.c >> @@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, >> visit_type_int(v, &value, name, errp); >> } >> >> +static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, >> + void *opaque, const char *name, >> + Error **errp) >> +{ >> + PCMachineState *pcms = PC_MACHINE(obj); >> + uint64_t value = pcms->max_ram_below_4g; >> + >> + visit_type_size(v, &value, name, errp); >> +} >> + >> +static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, >> + void *opaque, const char *name, >> + Error **errp) >> +{ >> + PCMachineState *pcms = PC_MACHINE(obj); >> + Error *error = NULL; >> + uint64_t value; >> + >> + visit_type_size(v, &value, name, &error); >> + if (error) { >> + error_propagate(errp, error); >> + return; >> + } >> + if (value > (1ULL << 32)) { >> + error_set(&error, ERROR_CLASS_GENERIC_ERROR, >> + "Machine option 'max-ram-below-4g=%"PRIu64 >> + "' expects size less then or equal to 4G", value); >> + error_propagate(errp, error); >> + return; >> + } >> + >> + pcms->max_ram_below_4g = value; >> +} >> + >> static void pc_machine_initfn(Object *obj) >> { >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", >> pc_machine_get_hotplug_memory_region_size, >> NULL, NULL, NULL, NULL); >> + object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", >> + pc_machine_get_max_ram_below_4g, >> + pc_machine_set_max_ram_below_4g, >> + NULL, NULL, NULL); >> } >> >> static void pc_machine_class_init(ObjectClass *oc, void *data) >> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >> index 40f6eaf..25f4727 100644 >> --- a/hw/i386/pc_piix.c >> +++ b/hw/i386/pc_piix.c >> @@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, >> DeviceState *icc_bridge; >> FWCfgState *fw_cfg = NULL; >> PcGuestInfo *guest_info; >> + Object *mo = qdev_get_machine(); >> + PCMachineState *pcms = PC_MACHINE(mo); >> + ram_addr_t lowmem = 0xe0000000; >> + >> + if (pcms && pcms->max_ram_below_4g) { >> + lowmem = pcms->max_ram_below_4g; >> + } >> >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). >> * If it doesn't, we need to split it in chunks below and above 4G. >> @@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, >> * For old machine types, use whatever split we used historically to avoid >> * breaking migration. >> */ >> - if (machine->ram_size >= 0xe0000000) { >> - ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; >> + if (machine->ram_size >= lowmem) { >> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >> + lowmem = 0xc0000000; >> + } >> above_4g_mem_size = machine->ram_size - lowmem; >> below_4g_mem_size = lowmem; >> } else { >> @@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, >> } >> >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >> - object_property_add_child(qdev_get_machine(), "icc-bridge", >> + object_property_add_child(mo, "icc-bridge", >> OBJECT(icc_bridge), NULL); >> >> pc_cpus_init(machine->cpu_model, icc_bridge); >> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >> index e28ce40..155cdf1 100644 >> --- a/hw/i386/pc_q35.c >> +++ b/hw/i386/pc_q35.c >> @@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) >> PCIDevice *ahci; >> DeviceState *icc_bridge; >> PcGuestInfo *guest_info; >> + Object *mo = qdev_get_machine(); >> + PCMachineState *pcms = PC_MACHINE(mo); >> + ram_addr_t lowmem = 0xb0000000; >> + >> + if (pcms && pcms->max_ram_below_4g) { >> + lowmem = pcms->max_ram_below_4g; >> + } >> >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping >> @@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) >> * For old machine types, use whatever split we used historically to avoid >> * breaking migration. >> */ >> - if (machine->ram_size >= 0xb0000000) { >> - ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; >> + if (machine->ram_size >= lowmem) { >> + if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { >> + lowmem = 0x800000000; >> + } >> above_4g_mem_size = machine->ram_size - lowmem; >> below_4g_mem_size = lowmem; >> } else { >> @@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) >> } >> >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); >> - object_property_add_child(qdev_get_machine(), "icc-bridge", >> + object_property_add_child(mo, "icc-bridge", >> OBJECT(icc_bridge), NULL); >> >> pc_cpus_init(machine->cpu_model, icc_bridge); >> diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h >> index 19530bd..2d8b562 100644 >> --- a/include/hw/i386/pc.h >> +++ b/include/hw/i386/pc.h >> @@ -32,10 +32,13 @@ struct PCMachineState { >> MemoryRegion hotplug_memory; >> >> HotplugHandler *acpi_dev; >> + >> + uint64_t max_ram_below_4g; >> }; >> >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" >> +#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" >> >> /** >> * PCMachineClass: >> diff --git a/vl.c b/vl.c >> index 5e77a27..cffb9c5 100644 >> --- a/vl.c >> +++ b/vl.c >> @@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { >> .name = "kvm-type", >> .type = QEMU_OPT_STRING, >> .help = "Specifies the KVM virtualization mode (HV, PR)", >> + },{ >> + .name = PC_MACHINE_MAX_RAM_BELOW_4G, >> + .type = QEMU_OPT_SIZE, >> + .help = "maximum ram below the 4G boundary (32bit boundary)", >> }, >> { /* End of list */ } >> }, >> -- >> 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-17 18:44 ` Don Slutz @ 2014-06-17 19:43 ` Michael S. Tsirkin -1 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-17 19:43 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > On 06/17/14 14:22, Michael S. Tsirkin wrote: > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > >>This is a pc & q35 only machine opt. One use is to allow for more > >>ram in a 32bit guest for example: > >> > >>-machine pc,max-ram-below-4g=3.75G > >> > >>If you add enough PCI devices then all mmio for them will not fit > >>below 4G which may not be the layout the user wanted. This allows > >>you to increase the below 4G address space that PCI devices can use > >>(aka decrease ram below 4G) and therefore in more cases not have any > >>mmio that is above 4G. > >> > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > >>line will limit the amount of ram that is below 4G to 2G. > >I'm not sure I get it. > > > >All this only has effect if you have >4G RAM, right? > > Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. > > -machine pc,max-ram-below-4g=2G -m 3G > > Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > > >Presumably you then have a 64 bit guest so why does it > >care about memory/MMIO being below 4G? > > It is not the guest that matters, it is all the PCI devices in use. There are > ones (all old hardware) that only support 32bit addresses. Emulated devices? Let's just teach them to support 64 bit BARs. Looks like a nicer solution than asking user to make this decision. > When using > these you may need more room. > > Also pci-passthru of real hardware that is 32bit only may require this. > -Don Slutz Guest and host BARs are unrelated so it seems we could allow 64 bit BARs even when they are 32 bit on host. Though PCI Express spec requires 64 bit BARs since version 1.0, are there really many devices like this out there? Care giving examples? They won't well on physical systems either. > > > > > > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > >>--- > >>v5: > >> Re-work based on: > >> > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > >> > >> > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > >> include/hw/i386/pc.h | 3 +++ > >> vl.c | 4 ++++ > >> 5 files changed, 69 insertions(+), 6 deletions(-) > >> > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > >>index 7cdba10..bccb746 100644 > >>--- a/hw/i386/pc.c > >>+++ b/hw/i386/pc.c > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > >> visit_type_int(v, &value, name, errp); > >> } > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > >>+ void *opaque, const char *name, > >>+ Error **errp) > >>+{ > >>+ PCMachineState *pcms = PC_MACHINE(obj); > >>+ uint64_t value = pcms->max_ram_below_4g; > >>+ > >>+ visit_type_size(v, &value, name, errp); > >>+} > >>+ > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > >>+ void *opaque, const char *name, > >>+ Error **errp) > >>+{ > >>+ PCMachineState *pcms = PC_MACHINE(obj); > >>+ Error *error = NULL; > >>+ uint64_t value; > >>+ > >>+ visit_type_size(v, &value, name, &error); > >>+ if (error) { > >>+ error_propagate(errp, error); > >>+ return; > >>+ } > >>+ if (value > (1ULL << 32)) { > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > >>+ "' expects size less then or equal to 4G", value); > >>+ error_propagate(errp, error); > >>+ return; > >>+ } > >>+ > >>+ pcms->max_ram_below_4g = value; > >>+} > >>+ > >> static void pc_machine_initfn(Object *obj) > >> { > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > >> pc_machine_get_hotplug_memory_region_size, > >> NULL, NULL, NULL, NULL); > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > >>+ pc_machine_get_max_ram_below_4g, > >>+ pc_machine_set_max_ram_below_4g, > >>+ NULL, NULL, NULL); > >> } > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > >>index 40f6eaf..25f4727 100644 > >>--- a/hw/i386/pc_piix.c > >>+++ b/hw/i386/pc_piix.c > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > >> DeviceState *icc_bridge; > >> FWCfgState *fw_cfg = NULL; > >> PcGuestInfo *guest_info; > >>+ Object *mo = qdev_get_machine(); > >>+ PCMachineState *pcms = PC_MACHINE(mo); > >>+ ram_addr_t lowmem = 0xe0000000; > >>+ > >>+ if (pcms && pcms->max_ram_below_4g) { > >>+ lowmem = pcms->max_ram_below_4g; > >>+ } > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > >> * If it doesn't, we need to split it in chunks below and above 4G. > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > >> * For old machine types, use whatever split we used historically to avoid > >> * breaking migration. > >> */ > >>- if (machine->ram_size >= 0xe0000000) { > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > >>+ if (machine->ram_size >= lowmem) { > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > >>+ lowmem = 0xc0000000; > >>+ } > >> above_4g_mem_size = machine->ram_size - lowmem; > >> below_4g_mem_size = lowmem; > >> } else { > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > >> } > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > >>+ object_property_add_child(mo, "icc-bridge", > >> OBJECT(icc_bridge), NULL); > >> pc_cpus_init(machine->cpu_model, icc_bridge); > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > >>index e28ce40..155cdf1 100644 > >>--- a/hw/i386/pc_q35.c > >>+++ b/hw/i386/pc_q35.c > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > >> PCIDevice *ahci; > >> DeviceState *icc_bridge; > >> PcGuestInfo *guest_info; > >>+ Object *mo = qdev_get_machine(); > >>+ PCMachineState *pcms = PC_MACHINE(mo); > >>+ ram_addr_t lowmem = 0xb0000000; > >>+ > >>+ if (pcms && pcms->max_ram_below_4g) { > >>+ lowmem = pcms->max_ram_below_4g; > >>+ } > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > >> * For old machine types, use whatever split we used historically to avoid > >> * breaking migration. > >> */ > >>- if (machine->ram_size >= 0xb0000000) { > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > >>+ if (machine->ram_size >= lowmem) { > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > >>+ lowmem = 0x800000000; > >>+ } > >> above_4g_mem_size = machine->ram_size - lowmem; > >> below_4g_mem_size = lowmem; > >> } else { > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > >> } > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > >>+ object_property_add_child(mo, "icc-bridge", > >> OBJECT(icc_bridge), NULL); > >> pc_cpus_init(machine->cpu_model, icc_bridge); > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > >>index 19530bd..2d8b562 100644 > >>--- a/include/hw/i386/pc.h > >>+++ b/include/hw/i386/pc.h > >>@@ -32,10 +32,13 @@ struct PCMachineState { > >> MemoryRegion hotplug_memory; > >> HotplugHandler *acpi_dev; > >>+ > >>+ uint64_t max_ram_below_4g; > >> }; > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > >> /** > >> * PCMachineClass: > >>diff --git a/vl.c b/vl.c > >>index 5e77a27..cffb9c5 100644 > >>--- a/vl.c > >>+++ b/vl.c > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > >> .name = "kvm-type", > >> .type = QEMU_OPT_STRING, > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > >>+ },{ > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > >>+ .type = QEMU_OPT_SIZE, > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > >> }, > >> { /* End of list */ } > >> }, > >>-- > >>1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-17 19:43 ` Michael S. Tsirkin 0 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-17 19:43 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > On 06/17/14 14:22, Michael S. Tsirkin wrote: > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > >>This is a pc & q35 only machine opt. One use is to allow for more > >>ram in a 32bit guest for example: > >> > >>-machine pc,max-ram-below-4g=3.75G > >> > >>If you add enough PCI devices then all mmio for them will not fit > >>below 4G which may not be the layout the user wanted. This allows > >>you to increase the below 4G address space that PCI devices can use > >>(aka decrease ram below 4G) and therefore in more cases not have any > >>mmio that is above 4G. > >> > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > >>line will limit the amount of ram that is below 4G to 2G. > >I'm not sure I get it. > > > >All this only has effect if you have >4G RAM, right? > > Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. > > -machine pc,max-ram-below-4g=2G -m 3G > > Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > > >Presumably you then have a 64 bit guest so why does it > >care about memory/MMIO being below 4G? > > It is not the guest that matters, it is all the PCI devices in use. There are > ones (all old hardware) that only support 32bit addresses. Emulated devices? Let's just teach them to support 64 bit BARs. Looks like a nicer solution than asking user to make this decision. > When using > these you may need more room. > > Also pci-passthru of real hardware that is 32bit only may require this. > -Don Slutz Guest and host BARs are unrelated so it seems we could allow 64 bit BARs even when they are 32 bit on host. Though PCI Express spec requires 64 bit BARs since version 1.0, are there really many devices like this out there? Care giving examples? They won't well on physical systems either. > > > > > > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > >>--- > >>v5: > >> Re-work based on: > >> > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > >> > >> > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > >> include/hw/i386/pc.h | 3 +++ > >> vl.c | 4 ++++ > >> 5 files changed, 69 insertions(+), 6 deletions(-) > >> > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > >>index 7cdba10..bccb746 100644 > >>--- a/hw/i386/pc.c > >>+++ b/hw/i386/pc.c > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > >> visit_type_int(v, &value, name, errp); > >> } > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > >>+ void *opaque, const char *name, > >>+ Error **errp) > >>+{ > >>+ PCMachineState *pcms = PC_MACHINE(obj); > >>+ uint64_t value = pcms->max_ram_below_4g; > >>+ > >>+ visit_type_size(v, &value, name, errp); > >>+} > >>+ > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > >>+ void *opaque, const char *name, > >>+ Error **errp) > >>+{ > >>+ PCMachineState *pcms = PC_MACHINE(obj); > >>+ Error *error = NULL; > >>+ uint64_t value; > >>+ > >>+ visit_type_size(v, &value, name, &error); > >>+ if (error) { > >>+ error_propagate(errp, error); > >>+ return; > >>+ } > >>+ if (value > (1ULL << 32)) { > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > >>+ "' expects size less then or equal to 4G", value); > >>+ error_propagate(errp, error); > >>+ return; > >>+ } > >>+ > >>+ pcms->max_ram_below_4g = value; > >>+} > >>+ > >> static void pc_machine_initfn(Object *obj) > >> { > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > >> pc_machine_get_hotplug_memory_region_size, > >> NULL, NULL, NULL, NULL); > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > >>+ pc_machine_get_max_ram_below_4g, > >>+ pc_machine_set_max_ram_below_4g, > >>+ NULL, NULL, NULL); > >> } > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > >>index 40f6eaf..25f4727 100644 > >>--- a/hw/i386/pc_piix.c > >>+++ b/hw/i386/pc_piix.c > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > >> DeviceState *icc_bridge; > >> FWCfgState *fw_cfg = NULL; > >> PcGuestInfo *guest_info; > >>+ Object *mo = qdev_get_machine(); > >>+ PCMachineState *pcms = PC_MACHINE(mo); > >>+ ram_addr_t lowmem = 0xe0000000; > >>+ > >>+ if (pcms && pcms->max_ram_below_4g) { > >>+ lowmem = pcms->max_ram_below_4g; > >>+ } > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > >> * If it doesn't, we need to split it in chunks below and above 4G. > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > >> * For old machine types, use whatever split we used historically to avoid > >> * breaking migration. > >> */ > >>- if (machine->ram_size >= 0xe0000000) { > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > >>+ if (machine->ram_size >= lowmem) { > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > >>+ lowmem = 0xc0000000; > >>+ } > >> above_4g_mem_size = machine->ram_size - lowmem; > >> below_4g_mem_size = lowmem; > >> } else { > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > >> } > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > >>+ object_property_add_child(mo, "icc-bridge", > >> OBJECT(icc_bridge), NULL); > >> pc_cpus_init(machine->cpu_model, icc_bridge); > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > >>index e28ce40..155cdf1 100644 > >>--- a/hw/i386/pc_q35.c > >>+++ b/hw/i386/pc_q35.c > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > >> PCIDevice *ahci; > >> DeviceState *icc_bridge; > >> PcGuestInfo *guest_info; > >>+ Object *mo = qdev_get_machine(); > >>+ PCMachineState *pcms = PC_MACHINE(mo); > >>+ ram_addr_t lowmem = 0xb0000000; > >>+ > >>+ if (pcms && pcms->max_ram_below_4g) { > >>+ lowmem = pcms->max_ram_below_4g; > >>+ } > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > >> * For old machine types, use whatever split we used historically to avoid > >> * breaking migration. > >> */ > >>- if (machine->ram_size >= 0xb0000000) { > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > >>+ if (machine->ram_size >= lowmem) { > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > >>+ lowmem = 0x800000000; > >>+ } > >> above_4g_mem_size = machine->ram_size - lowmem; > >> below_4g_mem_size = lowmem; > >> } else { > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > >> } > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > >>+ object_property_add_child(mo, "icc-bridge", > >> OBJECT(icc_bridge), NULL); > >> pc_cpus_init(machine->cpu_model, icc_bridge); > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > >>index 19530bd..2d8b562 100644 > >>--- a/include/hw/i386/pc.h > >>+++ b/include/hw/i386/pc.h > >>@@ -32,10 +32,13 @@ struct PCMachineState { > >> MemoryRegion hotplug_memory; > >> HotplugHandler *acpi_dev; > >>+ > >>+ uint64_t max_ram_below_4g; > >> }; > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > >> /** > >> * PCMachineClass: > >>diff --git a/vl.c b/vl.c > >>index 5e77a27..cffb9c5 100644 > >>--- a/vl.c > >>+++ b/vl.c > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > >> .name = "kvm-type", > >> .type = QEMU_OPT_STRING, > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > >>+ },{ > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > >>+ .type = QEMU_OPT_SIZE, > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > >> }, > >> { /* End of list */ } > >> }, > >>-- > >>1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-17 19:43 ` Michael S. Tsirkin @ 2014-06-17 20:05 ` Michael S. Tsirkin -1 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-17 20:05 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: > On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > > On 06/17/14 14:22, Michael S. Tsirkin wrote: > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > >>This is a pc & q35 only machine opt. One use is to allow for more > > >>ram in a 32bit guest for example: > > >> > > >>-machine pc,max-ram-below-4g=3.75G > > >> > > >>If you add enough PCI devices then all mmio for them will not fit > > >>below 4G which may not be the layout the user wanted. This allows > > >>you to increase the below 4G address space that PCI devices can use > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > >>mmio that is above 4G. > > >> > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > >>line will limit the amount of ram that is below 4G to 2G. > > >I'm not sure I get it. > > > > > >All this only has effect if you have >4G RAM, right? > > > > Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. > > > > -machine pc,max-ram-below-4g=2G -m 3G > > > > Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > > > > >Presumably you then have a 64 bit guest so why does it > > >care about memory/MMIO being below 4G? > > > > It is not the guest that matters, it is all the PCI devices in use. There are > > ones (all old hardware) that only support 32bit addresses. > > Emulated devices? Let's just teach them to support 64 bit BARs. > Looks like a nicer solution than asking user to make > this decision. > > > When using > > these you may need more room. > > > > Also pci-passthru of real hardware that is 32bit only may require this. > > -Don Slutz > > Guest and host BARs are unrelated so it seems we could allow 64 bit BARs > even when they are 32 bit on host. > > Though PCI Express spec requires 64 bit BARs since version 1.0, > are there really many devices like this out there? > Care giving examples? > They won't well on physical systems either. Hmm if we are using a pci to pci bridge and bar is non prefetcheable then that limits us to 32 bit. So I'd like to hear a bit more about the usecase, but it's sounding kind of reasonable. Let's go with what I suggested in 20140617185426.GC15610@redhat.com then: - user sets an upper limit - we do min(qemu limit, user limit) probably also warn if user-supplied limit causes 1g alignment issues. > > > > > > > > > > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > > >>--- > > >>v5: > > >> Re-work based on: > > >> > > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > >> > > >> > > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > > >> include/hw/i386/pc.h | 3 +++ > > >> vl.c | 4 ++++ > > >> 5 files changed, 69 insertions(+), 6 deletions(-) > > >> > > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > > >>index 7cdba10..bccb746 100644 > > >>--- a/hw/i386/pc.c > > >>+++ b/hw/i386/pc.c > > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > > >> visit_type_int(v, &value, name, errp); > > >> } > > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > > >>+ void *opaque, const char *name, > > >>+ Error **errp) > > >>+{ > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > >>+ uint64_t value = pcms->max_ram_below_4g; > > >>+ > > >>+ visit_type_size(v, &value, name, errp); > > >>+} > > >>+ > > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > > >>+ void *opaque, const char *name, > > >>+ Error **errp) > > >>+{ > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > >>+ Error *error = NULL; > > >>+ uint64_t value; > > >>+ > > >>+ visit_type_size(v, &value, name, &error); > > >>+ if (error) { > > >>+ error_propagate(errp, error); > > >>+ return; > > >>+ } > > >>+ if (value > (1ULL << 32)) { > > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > > >>+ "' expects size less then or equal to 4G", value); > > >>+ error_propagate(errp, error); > > >>+ return; > > >>+ } > > >>+ > > >>+ pcms->max_ram_below_4g = value; > > >>+} > > >>+ > > >> static void pc_machine_initfn(Object *obj) > > >> { > > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > > >> pc_machine_get_hotplug_memory_region_size, > > >> NULL, NULL, NULL, NULL); > > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > > >>+ pc_machine_get_max_ram_below_4g, > > >>+ pc_machine_set_max_ram_below_4g, > > >>+ NULL, NULL, NULL); > > >> } > > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > > >>index 40f6eaf..25f4727 100644 > > >>--- a/hw/i386/pc_piix.c > > >>+++ b/hw/i386/pc_piix.c > > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > > >> DeviceState *icc_bridge; > > >> FWCfgState *fw_cfg = NULL; > > >> PcGuestInfo *guest_info; > > >>+ Object *mo = qdev_get_machine(); > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > >>+ ram_addr_t lowmem = 0xe0000000; > > >>+ > > >>+ if (pcms && pcms->max_ram_below_4g) { > > >>+ lowmem = pcms->max_ram_below_4g; > > >>+ } > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > > >> * If it doesn't, we need to split it in chunks below and above 4G. > > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > > >> * For old machine types, use whatever split we used historically to avoid > > >> * breaking migration. > > >> */ > > >>- if (machine->ram_size >= 0xe0000000) { > > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > > >>+ if (machine->ram_size >= lowmem) { > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > >>+ lowmem = 0xc0000000; > > >>+ } > > >> above_4g_mem_size = machine->ram_size - lowmem; > > >> below_4g_mem_size = lowmem; > > >> } else { > > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > > >> } > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > >>+ object_property_add_child(mo, "icc-bridge", > > >> OBJECT(icc_bridge), NULL); > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > > >>index e28ce40..155cdf1 100644 > > >>--- a/hw/i386/pc_q35.c > > >>+++ b/hw/i386/pc_q35.c > > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > > >> PCIDevice *ahci; > > >> DeviceState *icc_bridge; > > >> PcGuestInfo *guest_info; > > >>+ Object *mo = qdev_get_machine(); > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > >>+ ram_addr_t lowmem = 0xb0000000; > > >>+ > > >>+ if (pcms && pcms->max_ram_below_4g) { > > >>+ lowmem = pcms->max_ram_below_4g; > > >>+ } > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > > >> * For old machine types, use whatever split we used historically to avoid > > >> * breaking migration. > > >> */ > > >>- if (machine->ram_size >= 0xb0000000) { > > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > > >>+ if (machine->ram_size >= lowmem) { > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > >>+ lowmem = 0x800000000; > > >>+ } > > >> above_4g_mem_size = machine->ram_size - lowmem; > > >> below_4g_mem_size = lowmem; > > >> } else { > > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > > >> } > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > >>+ object_property_add_child(mo, "icc-bridge", > > >> OBJECT(icc_bridge), NULL); > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > > >>index 19530bd..2d8b562 100644 > > >>--- a/include/hw/i386/pc.h > > >>+++ b/include/hw/i386/pc.h > > >>@@ -32,10 +32,13 @@ struct PCMachineState { > > >> MemoryRegion hotplug_memory; > > >> HotplugHandler *acpi_dev; > > >>+ > > >>+ uint64_t max_ram_below_4g; > > >> }; > > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > >> /** > > >> * PCMachineClass: > > >>diff --git a/vl.c b/vl.c > > >>index 5e77a27..cffb9c5 100644 > > >>--- a/vl.c > > >>+++ b/vl.c > > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > > >> .name = "kvm-type", > > >> .type = QEMU_OPT_STRING, > > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > > >>+ },{ > > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > > >>+ .type = QEMU_OPT_SIZE, > > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > > >> }, > > >> { /* End of list */ } > > >> }, > > >>-- > > >>1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-17 20:05 ` Michael S. Tsirkin 0 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-17 20:05 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: > On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > > On 06/17/14 14:22, Michael S. Tsirkin wrote: > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > >>This is a pc & q35 only machine opt. One use is to allow for more > > >>ram in a 32bit guest for example: > > >> > > >>-machine pc,max-ram-below-4g=3.75G > > >> > > >>If you add enough PCI devices then all mmio for them will not fit > > >>below 4G which may not be the layout the user wanted. This allows > > >>you to increase the below 4G address space that PCI devices can use > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > >>mmio that is above 4G. > > >> > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > >>line will limit the amount of ram that is below 4G to 2G. > > >I'm not sure I get it. > > > > > >All this only has effect if you have >4G RAM, right? > > > > Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. > > > > -machine pc,max-ram-below-4g=2G -m 3G > > > > Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > > > > >Presumably you then have a 64 bit guest so why does it > > >care about memory/MMIO being below 4G? > > > > It is not the guest that matters, it is all the PCI devices in use. There are > > ones (all old hardware) that only support 32bit addresses. > > Emulated devices? Let's just teach them to support 64 bit BARs. > Looks like a nicer solution than asking user to make > this decision. > > > When using > > these you may need more room. > > > > Also pci-passthru of real hardware that is 32bit only may require this. > > -Don Slutz > > Guest and host BARs are unrelated so it seems we could allow 64 bit BARs > even when they are 32 bit on host. > > Though PCI Express spec requires 64 bit BARs since version 1.0, > are there really many devices like this out there? > Care giving examples? > They won't well on physical systems either. Hmm if we are using a pci to pci bridge and bar is non prefetcheable then that limits us to 32 bit. So I'd like to hear a bit more about the usecase, but it's sounding kind of reasonable. Let's go with what I suggested in 20140617185426.GC15610@redhat.com then: - user sets an upper limit - we do min(qemu limit, user limit) probably also warn if user-supplied limit causes 1g alignment issues. > > > > > > > > > > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > > >>--- > > >>v5: > > >> Re-work based on: > > >> > > >> https://github.com/imammedo/qemu/commits/memory-hotplug-v11 > > >> > > >> > > >> hw/i386/pc.c | 38 ++++++++++++++++++++++++++++++++++++++ > > >> hw/i386/pc_piix.c | 15 ++++++++++++--- > > >> hw/i386/pc_q35.c | 15 ++++++++++++--- > > >> include/hw/i386/pc.h | 3 +++ > > >> vl.c | 4 ++++ > > >> 5 files changed, 69 insertions(+), 6 deletions(-) > > >> > > >>diff --git a/hw/i386/pc.c b/hw/i386/pc.c > > >>index 7cdba10..bccb746 100644 > > >>--- a/hw/i386/pc.c > > >>+++ b/hw/i386/pc.c > > >>@@ -1644,11 +1644,49 @@ pc_machine_get_hotplug_memory_region_size(Object *obj, Visitor *v, void *opaque, > > >> visit_type_int(v, &value, name, errp); > > >> } > > >>+static void pc_machine_get_max_ram_below_4g(Object *obj, Visitor *v, > > >>+ void *opaque, const char *name, > > >>+ Error **errp) > > >>+{ > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > >>+ uint64_t value = pcms->max_ram_below_4g; > > >>+ > > >>+ visit_type_size(v, &value, name, errp); > > >>+} > > >>+ > > >>+static void pc_machine_set_max_ram_below_4g(Object *obj, Visitor *v, > > >>+ void *opaque, const char *name, > > >>+ Error **errp) > > >>+{ > > >>+ PCMachineState *pcms = PC_MACHINE(obj); > > >>+ Error *error = NULL; > > >>+ uint64_t value; > > >>+ > > >>+ visit_type_size(v, &value, name, &error); > > >>+ if (error) { > > >>+ error_propagate(errp, error); > > >>+ return; > > >>+ } > > >>+ if (value > (1ULL << 32)) { > > >>+ error_set(&error, ERROR_CLASS_GENERIC_ERROR, > > >>+ "Machine option 'max-ram-below-4g=%"PRIu64 > > >>+ "' expects size less then or equal to 4G", value); > > >>+ error_propagate(errp, error); > > >>+ return; > > >>+ } > > >>+ > > >>+ pcms->max_ram_below_4g = value; > > >>+} > > >>+ > > >> static void pc_machine_initfn(Object *obj) > > >> { > > >> object_property_add(obj, PC_MACHINE_MEMHP_REGION_SIZE, "int", > > >> pc_machine_get_hotplug_memory_region_size, > > >> NULL, NULL, NULL, NULL); > > >>+ object_property_add(obj, PC_MACHINE_MAX_RAM_BELOW_4G, "size", > > >>+ pc_machine_get_max_ram_below_4g, > > >>+ pc_machine_set_max_ram_below_4g, > > >>+ NULL, NULL, NULL); > > >> } > > >> static void pc_machine_class_init(ObjectClass *oc, void *data) > > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > > >>index 40f6eaf..25f4727 100644 > > >>--- a/hw/i386/pc_piix.c > > >>+++ b/hw/i386/pc_piix.c > > >>@@ -98,6 +98,13 @@ static void pc_init1(MachineState *machine, > > >> DeviceState *icc_bridge; > > >> FWCfgState *fw_cfg = NULL; > > >> PcGuestInfo *guest_info; > > >>+ Object *mo = qdev_get_machine(); > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > >>+ ram_addr_t lowmem = 0xe0000000; > > >>+ > > >>+ if (pcms && pcms->max_ram_below_4g) { > > >>+ lowmem = pcms->max_ram_below_4g; > > >>+ } > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory). > > >> * If it doesn't, we need to split it in chunks below and above 4G. > > >>@@ -106,8 +113,10 @@ static void pc_init1(MachineState *machine, > > >> * For old machine types, use whatever split we used historically to avoid > > >> * breaking migration. > > >> */ > > >>- if (machine->ram_size >= 0xe0000000) { > > >>- ram_addr_t lowmem = gigabyte_align ? 0xc0000000 : 0xe0000000; > > >>+ if (machine->ram_size >= lowmem) { > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > >>+ lowmem = 0xc0000000; > > >>+ } > > >> above_4g_mem_size = machine->ram_size - lowmem; > > >> below_4g_mem_size = lowmem; > > >> } else { > > >>@@ -122,7 +131,7 @@ static void pc_init1(MachineState *machine, > > >> } > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > >>+ object_property_add_child(mo, "icc-bridge", > > >> OBJECT(icc_bridge), NULL); > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > > >>index e28ce40..155cdf1 100644 > > >>--- a/hw/i386/pc_q35.c > > >>+++ b/hw/i386/pc_q35.c > > >>@@ -85,6 +85,13 @@ static void pc_q35_init(MachineState *machine) > > >> PCIDevice *ahci; > > >> DeviceState *icc_bridge; > > >> PcGuestInfo *guest_info; > > >>+ Object *mo = qdev_get_machine(); > > >>+ PCMachineState *pcms = PC_MACHINE(mo); > > >>+ ram_addr_t lowmem = 0xb0000000; > > >>+ > > >>+ if (pcms && pcms->max_ram_below_4g) { > > >>+ lowmem = pcms->max_ram_below_4g; > > >>+ } > > >> /* Check whether RAM fits below 4G (leaving 1/2 GByte for IO memory > > >> * and 256 Mbytes for PCI Express Enhanced Configuration Access Mapping > > >>@@ -95,8 +102,10 @@ static void pc_q35_init(MachineState *machine) > > >> * For old machine types, use whatever split we used historically to avoid > > >> * breaking migration. > > >> */ > > >>- if (machine->ram_size >= 0xb0000000) { > > >>- ram_addr_t lowmem = gigabyte_align ? 0x80000000 : 0xb0000000; > > >>+ if (machine->ram_size >= lowmem) { > > >>+ if (!(pcms && pcms->max_ram_below_4g) && gigabyte_align) { > > >>+ lowmem = 0x800000000; > > >>+ } > > >> above_4g_mem_size = machine->ram_size - lowmem; > > >> below_4g_mem_size = lowmem; > > >> } else { > > >>@@ -111,7 +120,7 @@ static void pc_q35_init(MachineState *machine) > > >> } > > >> icc_bridge = qdev_create(NULL, TYPE_ICC_BRIDGE); > > >>- object_property_add_child(qdev_get_machine(), "icc-bridge", > > >>+ object_property_add_child(mo, "icc-bridge", > > >> OBJECT(icc_bridge), NULL); > > >> pc_cpus_init(machine->cpu_model, icc_bridge); > > >>diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h > > >>index 19530bd..2d8b562 100644 > > >>--- a/include/hw/i386/pc.h > > >>+++ b/include/hw/i386/pc.h > > >>@@ -32,10 +32,13 @@ struct PCMachineState { > > >> MemoryRegion hotplug_memory; > > >> HotplugHandler *acpi_dev; > > >>+ > > >>+ uint64_t max_ram_below_4g; > > >> }; > > >> #define PC_MACHINE_ACPI_DEVICE_PROP "acpi-device" > > >> #define PC_MACHINE_MEMHP_REGION_SIZE "hotplug-memory-region-size" > > >>+#define PC_MACHINE_MAX_RAM_BELOW_4G "max-ram-below-4g" > > >> /** > > >> * PCMachineClass: > > >>diff --git a/vl.c b/vl.c > > >>index 5e77a27..cffb9c5 100644 > > >>--- a/vl.c > > >>+++ b/vl.c > > >>@@ -382,6 +382,10 @@ static QemuOptsList qemu_machine_opts = { > > >> .name = "kvm-type", > > >> .type = QEMU_OPT_STRING, > > >> .help = "Specifies the KVM virtualization mode (HV, PR)", > > >>+ },{ > > >>+ .name = PC_MACHINE_MAX_RAM_BELOW_4G, > > >>+ .type = QEMU_OPT_SIZE, > > >>+ .help = "maximum ram below the 4G boundary (32bit boundary)", > > >> }, > > >> { /* End of list */ } > > >> }, > > >>-- > > >>1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [Xen-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-17 19:43 ` Michael S. Tsirkin @ 2014-06-17 20:08 ` Konrad Rzeszutek Wilk -1 siblings, 0 replies; 53+ messages in thread From: Konrad Rzeszutek Wilk @ 2014-06-17 20:08 UTC (permalink / raw) To: Michael S. Tsirkin Cc: xen-devel, Stefano Stabellini, qemu-devel, Don Slutz, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: > On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > > On 06/17/14 14:22, Michael S. Tsirkin wrote: > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > >>This is a pc & q35 only machine opt. One use is to allow for more > > >>ram in a 32bit guest for example: > > >> > > >>-machine pc,max-ram-below-4g=3.75G > > >> > > >>If you add enough PCI devices then all mmio for them will not fit > > >>below 4G which may not be the layout the user wanted. This allows > > >>you to increase the below 4G address space that PCI devices can use > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > >>mmio that is above 4G. > > >> > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > >>line will limit the amount of ram that is below 4G to 2G. > > >I'm not sure I get it. > > > > > >All this only has effect if you have >4G RAM, right? > > > > Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. > > > > -machine pc,max-ram-below-4g=2G -m 3G > > > > Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > > > > >Presumably you then have a 64 bit guest so why does it > > >care about memory/MMIO being below 4G? > > > > It is not the guest that matters, it is all the PCI devices in use. There are > > ones (all old hardware) that only support 32bit addresses. > > Emulated devices? Let's just teach them to support 64 bit BARs. > Looks like a nicer solution than asking user to make > this decision. I presume real normal PCI devices. > > > When using > > these you may need more room. > > > > Also pci-passthru of real hardware that is 32bit only may require this. > > -Don Slutz > > Guest and host BARs are unrelated so it seems we could allow 64 bit BARs > even when they are 32 bit on host. That assumes that the devices are OK with having their BARs remmaped. That is not always the case and some of them might not like that. Also OSes might want to only use 32-bit BARs as that is what they had been written for. I presume since Don is working for a telecom that this might be some ancient networking hardware with super-fast BSD OS. > > Though PCI Express spec requires 64 bit BARs since version 1.0, > are there really many devices like this out there? > Care giving examples? I think he mentioned PCI devices, not PCIe. ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Xen-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-17 20:08 ` Konrad Rzeszutek Wilk 0 siblings, 0 replies; 53+ messages in thread From: Konrad Rzeszutek Wilk @ 2014-06-17 20:08 UTC (permalink / raw) To: Michael S. Tsirkin Cc: xen-devel, Stefano Stabellini, qemu-devel, Don Slutz, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: > On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > > On 06/17/14 14:22, Michael S. Tsirkin wrote: > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > >>This is a pc & q35 only machine opt. One use is to allow for more > > >>ram in a 32bit guest for example: > > >> > > >>-machine pc,max-ram-below-4g=3.75G > > >> > > >>If you add enough PCI devices then all mmio for them will not fit > > >>below 4G which may not be the layout the user wanted. This allows > > >>you to increase the below 4G address space that PCI devices can use > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > >>mmio that is above 4G. > > >> > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > >>line will limit the amount of ram that is below 4G to 2G. > > >I'm not sure I get it. > > > > > >All this only has effect if you have >4G RAM, right? > > > > Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. > > > > -machine pc,max-ram-below-4g=2G -m 3G > > > > Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > > > > >Presumably you then have a 64 bit guest so why does it > > >care about memory/MMIO being below 4G? > > > > It is not the guest that matters, it is all the PCI devices in use. There are > > ones (all old hardware) that only support 32bit addresses. > > Emulated devices? Let's just teach them to support 64 bit BARs. > Looks like a nicer solution than asking user to make > this decision. I presume real normal PCI devices. > > > When using > > these you may need more room. > > > > Also pci-passthru of real hardware that is 32bit only may require this. > > -Don Slutz > > Guest and host BARs are unrelated so it seems we could allow 64 bit BARs > even when they are 32 bit on host. That assumes that the devices are OK with having their BARs remmaped. That is not always the case and some of them might not like that. Also OSes might want to only use 32-bit BARs as that is what they had been written for. I presume since Don is working for a telecom that this might be some ancient networking hardware with super-fast BSD OS. > > Though PCI Express spec requires 64 bit BARs since version 1.0, > are there really many devices like this out there? > Care giving examples? I think he mentioned PCI devices, not PCIe. ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [Xen-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-17 20:08 ` Konrad Rzeszutek Wilk @ 2014-06-17 20:17 ` Michael S. Tsirkin -1 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-17 20:17 UTC (permalink / raw) To: Konrad Rzeszutek Wilk Cc: xen-devel, Stefano Stabellini, qemu-devel, Don Slutz, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 04:08:54PM -0400, Konrad Rzeszutek Wilk wrote: > On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: > > On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > > > On 06/17/14 14:22, Michael S. Tsirkin wrote: > > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > > >>This is a pc & q35 only machine opt. One use is to allow for more > > > >>ram in a 32bit guest for example: > > > >> > > > >>-machine pc,max-ram-below-4g=3.75G > > > >> > > > >>If you add enough PCI devices then all mmio for them will not fit > > > >>below 4G which may not be the layout the user wanted. This allows > > > >>you to increase the below 4G address space that PCI devices can use > > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > > >>mmio that is above 4G. > > > >> > > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > > >>line will limit the amount of ram that is below 4G to 2G. > > > >I'm not sure I get it. > > > > > > > >All this only has effect if you have >4G RAM, right? > > > > > > Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. > > > > > > -machine pc,max-ram-below-4g=2G -m 3G > > > > > > Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > > > > > > >Presumably you then have a 64 bit guest so why does it > > > >care about memory/MMIO being below 4G? > > > > > > It is not the guest that matters, it is all the PCI devices in use. There are > > > ones (all old hardware) that only support 32bit addresses. > > > > Emulated devices? Let's just teach them to support 64 bit BARs. > > Looks like a nicer solution than asking user to make > > this decision. > > I presume real normal PCI devices. > > > > > When using > > > these you may need more room. > > > > > > Also pci-passthru of real hardware that is 32bit only may require this. > > > -Don Slutz > > > > Guest and host BARs are unrelated so it seems we could allow 64 bit BARs > > even when they are 32 bit on host. > > That assumes that the devices are OK with having their BARs remmaped. > That is not always the case and some of them might not like that. > > Also OSes might want to only use 32-bit BARs as that is what they > had been written for. I presume since Don is working for a telecom > that this might be some ancient networking hardware with super-fast > BSD OS. > > > > Though PCI Express spec requires 64 bit BARs since version 1.0, > > are there really many devices like this out there? > > Care giving examples? > > I think he mentioned PCI devices, not PCIe. OK that's a small niche but it makes some sense. So let's focus on this case, it can be addressed cleanly: default: max-ram-below-4g=4g pc: low = MIN(low, max-ram-below-4g) no special handling for any corner cases. For bonus points detect and warn if value chosen causes alignment issues. -- MST ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Xen-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-17 20:17 ` Michael S. Tsirkin 0 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-17 20:17 UTC (permalink / raw) To: Konrad Rzeszutek Wilk Cc: xen-devel, Stefano Stabellini, qemu-devel, Don Slutz, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 04:08:54PM -0400, Konrad Rzeszutek Wilk wrote: > On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: > > On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > > > On 06/17/14 14:22, Michael S. Tsirkin wrote: > > > >On Fri, Jun 06, 2014 at 01:52:05PM -0400, Don Slutz wrote: > > > >>This is a pc & q35 only machine opt. One use is to allow for more > > > >>ram in a 32bit guest for example: > > > >> > > > >>-machine pc,max-ram-below-4g=3.75G > > > >> > > > >>If you add enough PCI devices then all mmio for them will not fit > > > >>below 4G which may not be the layout the user wanted. This allows > > > >>you to increase the below 4G address space that PCI devices can use > > > >>(aka decrease ram below 4G) and therefore in more cases not have any > > > >>mmio that is above 4G. > > > >> > > > >>For example using "-machine pc,max-ram-below-4g=2G" on the command > > > >>line will limit the amount of ram that is below 4G to 2G. > > > >I'm not sure I get it. > > > > > > > >All this only has effect if you have >4G RAM, right? > > > > > > Nope. When it takes effect includes RAM > max-ram-below-4g. I.E. > > > > > > -machine pc,max-ram-below-4g=2G -m 3G > > > > > > Will have 2G in 32bit space (below 4G) and 1G in 64bit space (above 4G). > > > > > > >Presumably you then have a 64 bit guest so why does it > > > >care about memory/MMIO being below 4G? > > > > > > It is not the guest that matters, it is all the PCI devices in use. There are > > > ones (all old hardware) that only support 32bit addresses. > > > > Emulated devices? Let's just teach them to support 64 bit BARs. > > Looks like a nicer solution than asking user to make > > this decision. > > I presume real normal PCI devices. > > > > > When using > > > these you may need more room. > > > > > > Also pci-passthru of real hardware that is 32bit only may require this. > > > -Don Slutz > > > > Guest and host BARs are unrelated so it seems we could allow 64 bit BARs > > even when they are 32 bit on host. > > That assumes that the devices are OK with having their BARs remmaped. > That is not always the case and some of them might not like that. > > Also OSes might want to only use 32-bit BARs as that is what they > had been written for. I presume since Don is working for a telecom > that this might be some ancient networking hardware with super-fast > BSD OS. > > > > Though PCI Express spec requires 64 bit BARs since version 1.0, > > are there really many devices like this out there? > > Care giving examples? > > I think he mentioned PCI devices, not PCIe. OK that's a small niche but it makes some sense. So let's focus on this case, it can be addressed cleanly: default: max-ram-below-4g=4g pc: low = MIN(low, max-ram-below-4g) no special handling for any corner cases. For bonus points detect and warn if value chosen causes alignment issues. -- MST ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [Xen-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-17 20:17 ` Michael S. Tsirkin @ 2014-06-18 13:28 ` Slutz, Donald Christopher -1 siblings, 0 replies; 53+ messages in thread From: Slutz, Donald Christopher @ 2014-06-18 13:28 UTC (permalink / raw) To: Michael S. Tsirkin Cc: xen-devel, Stefano Stabellini, Konrad Rzeszutek Wilk, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/17/14 16:17, Michael S. Tsirkin wrote: > On Tue, Jun 17, 2014 at 04:08:54PM -0400, Konrad Rzeszutek Wilk wrote: >> On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: [snip] >> I think he mentioned PCI devices, not PCIe. > OK that's a small niche but it makes some sense. > So let's focus on this case, it can be addressed > cleanly: > > default: max-ram-below-4g=4g > pc: > low = MIN(low, max-ram-below-4g) > > no special handling for any corner cases. > > For bonus points detect and warn if value chosen causes > alignment issues. > v7 of this is being tested. Expect to post today. -Don Slutz ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-18 13:28 ` Slutz, Donald Christopher 0 siblings, 0 replies; 53+ messages in thread From: Slutz, Donald Christopher @ 2014-06-18 13:28 UTC (permalink / raw) To: Michael S. Tsirkin Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/17/14 16:17, Michael S. Tsirkin wrote: > On Tue, Jun 17, 2014 at 04:08:54PM -0400, Konrad Rzeszutek Wilk wrote: >> On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: [snip] >> I think he mentioned PCI devices, not PCIe. > OK that's a small niche but it makes some sense. > So let's focus on this case, it can be addressed > cleanly: > > default: max-ram-below-4g=4g > pc: > low = MIN(low, max-ram-below-4g) > > no special handling for any corner cases. > > For bonus points detect and warn if value chosen causes > alignment issues. > v7 of this is being tested. Expect to post today. -Don Slutz ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [Xen-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g 2014-06-17 20:08 ` Konrad Rzeszutek Wilk @ 2014-06-17 20:35 ` Pasi Kärkkäinen -1 siblings, 0 replies; 53+ messages in thread From: Pasi Kärkkäinen @ 2014-06-17 20:35 UTC (permalink / raw) To: Konrad Rzeszutek Wilk Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Don Slutz, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 04:08:54PM -0400, Konrad Rzeszutek Wilk wrote: > On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: > > On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > > > > > > >Presumably you then have a 64 bit guest so why does it > > > >care about memory/MMIO being below 4G? > > > > > > It is not the guest that matters, it is all the PCI devices in use. There are > > > ones (all old hardware) that only support 32bit addresses. > > > > Emulated devices? Let's just teach them to support 64 bit BARs. > > Looks like a nicer solution than asking user to make > > this decision. > > I presume real normal PCI devices. > Yeah, I believe this thread is about enabling/fixing PCI passthru of (existing old legacy) physical PCI devices, so there's no way to "teach" them to support 64b BARs.. > > > > > When using > > > these you may need more room. > > > > > > Also pci-passthru of real hardware that is 32bit only may require this. > > > -Don Slutz > > -- Pasi ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Xen-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g @ 2014-06-17 20:35 ` Pasi Kärkkäinen 0 siblings, 0 replies; 53+ messages in thread From: Pasi Kärkkäinen @ 2014-06-17 20:35 UTC (permalink / raw) To: Konrad Rzeszutek Wilk Cc: xen-devel, Stefano Stabellini, Michael S. Tsirkin, qemu-devel, Don Slutz, Anthony Liguori, Igor Mammedov, Andreas Färber On Tue, Jun 17, 2014 at 04:08:54PM -0400, Konrad Rzeszutek Wilk wrote: > On Tue, Jun 17, 2014 at 10:43:29PM +0300, Michael S. Tsirkin wrote: > > On Tue, Jun 17, 2014 at 02:44:41PM -0400, Don Slutz wrote: > > > > > > >Presumably you then have a 64 bit guest so why does it > > > >care about memory/MMIO being below 4G? > > > > > > It is not the guest that matters, it is all the PCI devices in use. There are > > > ones (all old hardware) that only support 32bit addresses. > > > > Emulated devices? Let's just teach them to support 64 bit BARs. > > Looks like a nicer solution than asking user to make > > this decision. > > I presume real normal PCI devices. > Yeah, I believe this thread is about enabling/fixing PCI passthru of (existing old legacy) physical PCI devices, so there's no way to "teach" them to support 64b BARs.. > > > > > When using > > > these you may need more room. > > > > > > Also pci-passthru of real hardware that is 32bit only may require this. > > > -Don Slutz > > -- Pasi ^ permalink raw reply [flat|nested] 53+ messages in thread
* [Qemu-devel] [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init 2014-06-06 17:52 ` Don Slutz @ 2014-06-06 17:52 ` Don Slutz -1 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-06 17:52 UTC (permalink / raw) To: xen-devel, qemu-devel, Stefano Stabellini Cc: Igor Mammedov, Don Slutz, Andreas Färber, Anthony Liguori, Michael S. Tsirkin This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> Signed-off-by: Don Slutz <dslutz@verizon.com> --- v5: Added Acked-by: Stefano Stabellini Minor change of pmc to pcms. hw/i386/pc_piix.c | 1 + hw/i386/pc_q35.c | 1 + include/hw/xen/xen.h | 2 +- xen-hvm-stub.c | 2 +- xen-hvm.c | 36 ++++++++++++++++++++---------------- 5 files changed, 24 insertions(+), 18 deletions(-) diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c index 25f4727..27851c6 100644 --- a/hw/i386/pc_piix.c +++ b/hw/i386/pc_piix.c @@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, } if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, + !(pcms && pcms->max_ram_below_4g), &ram_memory) != 0) { fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); exit(1); diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c index 155cdf1..6436fce 100644 --- a/hw/i386/pc_q35.c +++ b/hw/i386/pc_q35.c @@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) } if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, + !(pcms && pcms->max_ram_below_4g), &ram_memory) != 0) { fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); exit(1); diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h index f71f2d8..6b94c14 100644 --- a/include/hw/xen/xen.h +++ b/include/hw/xen/xen.h @@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, - MemoryRegion **ram_memory); + bool is_default, MemoryRegion **ram_memory); void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, struct MemoryRegion *mr); void xen_modified_memory(ram_addr_t start, ram_addr_t length); diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c index 2d98696..d1bdb76 100644 --- a/xen-hvm-stub.c +++ b/xen-hvm-stub.c @@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) } int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, - MemoryRegion **ram_memory) + bool is_default, MemoryRegion **ram_memory) { return 0; } diff --git a/xen-hvm.c b/xen-hvm.c index a0b6b5d..8d27ee6 100644 --- a/xen-hvm.c +++ b/xen-hvm.c @@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) /* Memory Ops */ static void xen_ram_init(ram_addr_t *below_4g_mem_size, - ram_addr_t *above_4g_mem_size, + ram_addr_t *above_4g_mem_size, bool is_default, ram_addr_t ram_size, MemoryRegion **ram_memory_p) { MemoryRegion *sysmem = get_system_memory(); ram_addr_t block_len; - block_len = ram_size; - if (ram_size >= HVM_BELOW_4G_RAM_END) { - /* Xen does not allocate the memory continuously, and keep a hole at - * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH + if (is_default) { + if (ram_size >= HVM_BELOW_4G_RAM_END) { + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; + } else { + *above_4g_mem_size = 0; + *below_4g_mem_size = ram_size; + } + } + if (!*above_4g_mem_size) { + block_len = ram_size; + } else { + /* + * Xen does not allocate the memory continuously, and keep a hole of + * of the size computed above or passed in. */ - block_len += HVM_BELOW_4G_MMIO_LENGTH; + block_len = (1ULL << 32) + *above_4g_mem_size; } memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); *ram_memory_p = &ram_memory; vmstate_register_ram_global(&ram_memory); - if (ram_size >= HVM_BELOW_4G_RAM_END) { - *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; - *below_4g_mem_size = HVM_BELOW_4G_RAM_END; - } else { - *above_4g_mem_size = 0; - *below_4g_mem_size = ram_size; - } - memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", &ram_memory, 0, 0xa0000); memory_region_add_subregion(sysmem, 0, &ram_640k); @@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) } int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, - MemoryRegion **ram_memory) + bool is_default, MemoryRegion **ram_memory) { int i, rc; unsigned long ioreq_pfn; @@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, /* Init RAM management */ xen_map_cache_init(xen_phys_offset_to_gaddr, state); - xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); + xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, + ram_memory); qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); -- 1.8.4 ^ permalink raw reply related [flat|nested] 53+ messages in thread
* [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init @ 2014-06-06 17:52 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-06 17:52 UTC (permalink / raw) To: xen-devel, qemu-devel, Stefano Stabellini Cc: Igor Mammedov, Don Slutz, Andreas Färber, Anthony Liguori, Michael S. Tsirkin This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> Signed-off-by: Don Slutz <dslutz@verizon.com> --- v5: Added Acked-by: Stefano Stabellini Minor change of pmc to pcms. hw/i386/pc_piix.c | 1 + hw/i386/pc_q35.c | 1 + include/hw/xen/xen.h | 2 +- xen-hvm-stub.c | 2 +- xen-hvm.c | 36 ++++++++++++++++++++---------------- 5 files changed, 24 insertions(+), 18 deletions(-) diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c index 25f4727..27851c6 100644 --- a/hw/i386/pc_piix.c +++ b/hw/i386/pc_piix.c @@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, } if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, + !(pcms && pcms->max_ram_below_4g), &ram_memory) != 0) { fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); exit(1); diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c index 155cdf1..6436fce 100644 --- a/hw/i386/pc_q35.c +++ b/hw/i386/pc_q35.c @@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) } if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, + !(pcms && pcms->max_ram_below_4g), &ram_memory) != 0) { fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); exit(1); diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h index f71f2d8..6b94c14 100644 --- a/include/hw/xen/xen.h +++ b/include/hw/xen/xen.h @@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, - MemoryRegion **ram_memory); + bool is_default, MemoryRegion **ram_memory); void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, struct MemoryRegion *mr); void xen_modified_memory(ram_addr_t start, ram_addr_t length); diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c index 2d98696..d1bdb76 100644 --- a/xen-hvm-stub.c +++ b/xen-hvm-stub.c @@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) } int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, - MemoryRegion **ram_memory) + bool is_default, MemoryRegion **ram_memory) { return 0; } diff --git a/xen-hvm.c b/xen-hvm.c index a0b6b5d..8d27ee6 100644 --- a/xen-hvm.c +++ b/xen-hvm.c @@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) /* Memory Ops */ static void xen_ram_init(ram_addr_t *below_4g_mem_size, - ram_addr_t *above_4g_mem_size, + ram_addr_t *above_4g_mem_size, bool is_default, ram_addr_t ram_size, MemoryRegion **ram_memory_p) { MemoryRegion *sysmem = get_system_memory(); ram_addr_t block_len; - block_len = ram_size; - if (ram_size >= HVM_BELOW_4G_RAM_END) { - /* Xen does not allocate the memory continuously, and keep a hole at - * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH + if (is_default) { + if (ram_size >= HVM_BELOW_4G_RAM_END) { + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; + } else { + *above_4g_mem_size = 0; + *below_4g_mem_size = ram_size; + } + } + if (!*above_4g_mem_size) { + block_len = ram_size; + } else { + /* + * Xen does not allocate the memory continuously, and keep a hole of + * of the size computed above or passed in. */ - block_len += HVM_BELOW_4G_MMIO_LENGTH; + block_len = (1ULL << 32) + *above_4g_mem_size; } memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); *ram_memory_p = &ram_memory; vmstate_register_ram_global(&ram_memory); - if (ram_size >= HVM_BELOW_4G_RAM_END) { - *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; - *below_4g_mem_size = HVM_BELOW_4G_RAM_END; - } else { - *above_4g_mem_size = 0; - *below_4g_mem_size = ram_size; - } - memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", &ram_memory, 0, 0xa0000); memory_region_add_subregion(sysmem, 0, &ram_640k); @@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) } int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, - MemoryRegion **ram_memory) + bool is_default, MemoryRegion **ram_memory) { int i, rc; unsigned long ioreq_pfn; @@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, /* Init RAM management */ xen_map_cache_init(xen_phys_offset_to_gaddr, state); - xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); + xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, + ram_memory); qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); -- 1.8.4 ^ permalink raw reply related [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init 2014-06-06 17:52 ` Don Slutz @ 2014-06-08 15:24 ` Michael S. Tsirkin -1 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-08 15:24 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Fri, Jun 06, 2014 at 01:52:06PM -0400, Don Slutz wrote: > This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" > > Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> > Signed-off-by: Don Slutz <dslutz@verizon.com> > --- > v5: > Added Acked-by: Stefano Stabellini > Minor change of pmc to pcms. > > > hw/i386/pc_piix.c | 1 + > hw/i386/pc_q35.c | 1 + > include/hw/xen/xen.h | 2 +- > xen-hvm-stub.c | 2 +- > xen-hvm.c | 36 ++++++++++++++++++++---------------- > 5 files changed, 24 insertions(+), 18 deletions(-) > > diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > index 25f4727..27851c6 100644 > --- a/hw/i386/pc_piix.c > +++ b/hw/i386/pc_piix.c > @@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, > } > > if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > + !(pcms && pcms->max_ram_below_4g), > &ram_memory) != 0) { > fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > exit(1); > diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > index 155cdf1..6436fce 100644 > --- a/hw/i386/pc_q35.c > +++ b/hw/i386/pc_q35.c > @@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) > } > > if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > + !(pcms && pcms->max_ram_below_4g), > &ram_memory) != 0) { > fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > exit(1); > diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h > index f71f2d8..6b94c14 100644 > --- a/include/hw/xen/xen.h > +++ b/include/hw/xen/xen.h > @@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); > > #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory); > + bool is_default, MemoryRegion **ram_memory); > void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, > struct MemoryRegion *mr); > void xen_modified_memory(ram_addr_t start, ram_addr_t length); > diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c > index 2d98696..d1bdb76 100644 > --- a/xen-hvm-stub.c > +++ b/xen-hvm-stub.c > @@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) > } > > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory) > + bool is_default, MemoryRegion **ram_memory) > { > return 0; > } > diff --git a/xen-hvm.c b/xen-hvm.c > index a0b6b5d..8d27ee6 100644 > --- a/xen-hvm.c > +++ b/xen-hvm.c > @@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) > /* Memory Ops */ > > static void xen_ram_init(ram_addr_t *below_4g_mem_size, > - ram_addr_t *above_4g_mem_size, > + ram_addr_t *above_4g_mem_size, bool is_default, > ram_addr_t ram_size, MemoryRegion **ram_memory_p) > { > MemoryRegion *sysmem = get_system_memory(); > ram_addr_t block_len; > > - block_len = ram_size; > - if (ram_size >= HVM_BELOW_4G_RAM_END) { > - /* Xen does not allocate the memory continuously, and keep a hole at > - * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH > + if (is_default) { > + if (ram_size >= HVM_BELOW_4G_RAM_END) { > + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > + } else { > + *above_4g_mem_size = 0; > + *below_4g_mem_size = ram_size; > + } > + } > + if (!*above_4g_mem_size) { > + block_len = ram_size; > + } else { > + /* > + * Xen does not allocate the memory continuously, and keep a hole of > + * of the size computed above or passed in. > */ Not your fault but this is ambigious. I guess this means "does not allocate the memory continuously, it keeps a hole ..."? > - block_len += HVM_BELOW_4G_MMIO_LENGTH; > + block_len = (1ULL << 32) + *above_4g_mem_size; > } > memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); > *ram_memory_p = &ram_memory; > vmstate_register_ram_global(&ram_memory); > > - if (ram_size >= HVM_BELOW_4G_RAM_END) { > - *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > - *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > - } else { > - *above_4g_mem_size = 0; > - *below_4g_mem_size = ram_size; > - } > - > memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", > &ram_memory, 0, 0xa0000); > memory_region_add_subregion(sysmem, 0, &ram_640k); > @@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) > } > > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory) > + bool is_default, MemoryRegion **ram_memory) > { > int i, rc; > unsigned long ioreq_pfn; > @@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > > /* Init RAM management */ > xen_map_cache_init(xen_phys_offset_to_gaddr, state); > - xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); > + xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, > + ram_memory); > > qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); > > -- > 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init @ 2014-06-08 15:24 ` Michael S. Tsirkin 0 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-08 15:24 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Fri, Jun 06, 2014 at 01:52:06PM -0400, Don Slutz wrote: > This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" > > Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> > Signed-off-by: Don Slutz <dslutz@verizon.com> > --- > v5: > Added Acked-by: Stefano Stabellini > Minor change of pmc to pcms. > > > hw/i386/pc_piix.c | 1 + > hw/i386/pc_q35.c | 1 + > include/hw/xen/xen.h | 2 +- > xen-hvm-stub.c | 2 +- > xen-hvm.c | 36 ++++++++++++++++++++---------------- > 5 files changed, 24 insertions(+), 18 deletions(-) > > diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > index 25f4727..27851c6 100644 > --- a/hw/i386/pc_piix.c > +++ b/hw/i386/pc_piix.c > @@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, > } > > if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > + !(pcms && pcms->max_ram_below_4g), > &ram_memory) != 0) { > fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > exit(1); > diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > index 155cdf1..6436fce 100644 > --- a/hw/i386/pc_q35.c > +++ b/hw/i386/pc_q35.c > @@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) > } > > if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > + !(pcms && pcms->max_ram_below_4g), > &ram_memory) != 0) { > fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > exit(1); > diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h > index f71f2d8..6b94c14 100644 > --- a/include/hw/xen/xen.h > +++ b/include/hw/xen/xen.h > @@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); > > #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory); > + bool is_default, MemoryRegion **ram_memory); > void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, > struct MemoryRegion *mr); > void xen_modified_memory(ram_addr_t start, ram_addr_t length); > diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c > index 2d98696..d1bdb76 100644 > --- a/xen-hvm-stub.c > +++ b/xen-hvm-stub.c > @@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) > } > > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory) > + bool is_default, MemoryRegion **ram_memory) > { > return 0; > } > diff --git a/xen-hvm.c b/xen-hvm.c > index a0b6b5d..8d27ee6 100644 > --- a/xen-hvm.c > +++ b/xen-hvm.c > @@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) > /* Memory Ops */ > > static void xen_ram_init(ram_addr_t *below_4g_mem_size, > - ram_addr_t *above_4g_mem_size, > + ram_addr_t *above_4g_mem_size, bool is_default, > ram_addr_t ram_size, MemoryRegion **ram_memory_p) > { > MemoryRegion *sysmem = get_system_memory(); > ram_addr_t block_len; > > - block_len = ram_size; > - if (ram_size >= HVM_BELOW_4G_RAM_END) { > - /* Xen does not allocate the memory continuously, and keep a hole at > - * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH > + if (is_default) { > + if (ram_size >= HVM_BELOW_4G_RAM_END) { > + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > + } else { > + *above_4g_mem_size = 0; > + *below_4g_mem_size = ram_size; > + } > + } > + if (!*above_4g_mem_size) { > + block_len = ram_size; > + } else { > + /* > + * Xen does not allocate the memory continuously, and keep a hole of > + * of the size computed above or passed in. > */ Not your fault but this is ambigious. I guess this means "does not allocate the memory continuously, it keeps a hole ..."? > - block_len += HVM_BELOW_4G_MMIO_LENGTH; > + block_len = (1ULL << 32) + *above_4g_mem_size; > } > memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); > *ram_memory_p = &ram_memory; > vmstate_register_ram_global(&ram_memory); > > - if (ram_size >= HVM_BELOW_4G_RAM_END) { > - *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > - *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > - } else { > - *above_4g_mem_size = 0; > - *below_4g_mem_size = ram_size; > - } > - > memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", > &ram_memory, 0, 0xa0000); > memory_region_add_subregion(sysmem, 0, &ram_640k); > @@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) > } > > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory) > + bool is_default, MemoryRegion **ram_memory) > { > int i, rc; > unsigned long ioreq_pfn; > @@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > > /* Init RAM management */ > xen_map_cache_init(xen_phys_offset_to_gaddr, state); > - xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); > + xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, > + ram_memory); > > qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); > > -- > 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init 2014-06-08 15:24 ` Michael S. Tsirkin @ 2014-06-09 14:25 ` Don Slutz -1 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-09 14:25 UTC (permalink / raw) To: Michael S. Tsirkin, Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/08/14 11:24, Michael S. Tsirkin wrote: > On Fri, Jun 06, 2014 at 01:52:06PM -0400, Don Slutz wrote: >> This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" >> >> Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> >> Signed-off-by: Don Slutz <dslutz@verizon.com> >> --- >> v5: >> Added Acked-by: Stefano Stabellini >> Minor change of pmc to pcms. >> >> >> hw/i386/pc_piix.c | 1 + >> hw/i386/pc_q35.c | 1 + >> include/hw/xen/xen.h | 2 +- >> xen-hvm-stub.c | 2 +- >> xen-hvm.c | 36 ++++++++++++++++++++---------------- >> 5 files changed, 24 insertions(+), 18 deletions(-) >> >> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >> index 25f4727..27851c6 100644 >> --- a/hw/i386/pc_piix.c >> +++ b/hw/i386/pc_piix.c >> @@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, >> } >> >> if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, >> + !(pcms && pcms->max_ram_below_4g), >> &ram_memory) != 0) { >> fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); >> exit(1); >> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >> index 155cdf1..6436fce 100644 >> --- a/hw/i386/pc_q35.c >> +++ b/hw/i386/pc_q35.c >> @@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) >> } >> >> if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, >> + !(pcms && pcms->max_ram_below_4g), >> &ram_memory) != 0) { >> fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); >> exit(1); >> diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h >> index f71f2d8..6b94c14 100644 >> --- a/include/hw/xen/xen.h >> +++ b/include/hw/xen/xen.h >> @@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); >> >> #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, >> - MemoryRegion **ram_memory); >> + bool is_default, MemoryRegion **ram_memory); >> void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, >> struct MemoryRegion *mr); >> void xen_modified_memory(ram_addr_t start, ram_addr_t length); >> diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c >> index 2d98696..d1bdb76 100644 >> --- a/xen-hvm-stub.c >> +++ b/xen-hvm-stub.c >> @@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) >> } >> >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, >> - MemoryRegion **ram_memory) >> + bool is_default, MemoryRegion **ram_memory) >> { >> return 0; >> } >> diff --git a/xen-hvm.c b/xen-hvm.c >> index a0b6b5d..8d27ee6 100644 >> --- a/xen-hvm.c >> +++ b/xen-hvm.c >> @@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) >> /* Memory Ops */ >> >> static void xen_ram_init(ram_addr_t *below_4g_mem_size, >> - ram_addr_t *above_4g_mem_size, >> + ram_addr_t *above_4g_mem_size, bool is_default, >> ram_addr_t ram_size, MemoryRegion **ram_memory_p) >> { >> MemoryRegion *sysmem = get_system_memory(); >> ram_addr_t block_len; >> >> - block_len = ram_size; >> - if (ram_size >= HVM_BELOW_4G_RAM_END) { >> - /* Xen does not allocate the memory continuously, and keep a hole at >> - * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH >> + if (is_default) { >> + if (ram_size >= HVM_BELOW_4G_RAM_END) { >> + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; >> + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; >> + } else { >> + *above_4g_mem_size = 0; >> + *below_4g_mem_size = ram_size; >> + } >> + } >> + if (!*above_4g_mem_size) { >> + block_len = ram_size; >> + } else { >> + /* >> + * Xen does not allocate the memory continuously, and keep a hole of >> + * of the size computed above or passed in. >> */ > Not your fault but this is ambigious. > I guess this means "does not allocate the memory continuously, it keeps a > hole ..."? > How does (dropping the double of also): Xen does not allocate the memory continuously, it keeps a hole of the size computed above or passed in. -Don Slutz >> - block_len += HVM_BELOW_4G_MMIO_LENGTH; >> + block_len = (1ULL << 32) + *above_4g_mem_size; >> } >> memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); >> *ram_memory_p = &ram_memory; >> vmstate_register_ram_global(&ram_memory); >> >> - if (ram_size >= HVM_BELOW_4G_RAM_END) { >> - *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; >> - *below_4g_mem_size = HVM_BELOW_4G_RAM_END; >> - } else { >> - *above_4g_mem_size = 0; >> - *below_4g_mem_size = ram_size; >> - } >> - >> memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", >> &ram_memory, 0, 0xa0000); >> memory_region_add_subregion(sysmem, 0, &ram_640k); >> @@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) >> } >> >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, >> - MemoryRegion **ram_memory) >> + bool is_default, MemoryRegion **ram_memory) >> { >> int i, rc; >> unsigned long ioreq_pfn; >> @@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, >> >> /* Init RAM management */ >> xen_map_cache_init(xen_phys_offset_to_gaddr, state); >> - xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); >> + xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, >> + ram_memory); >> >> qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); >> >> -- >> 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init @ 2014-06-09 14:25 ` Don Slutz 0 siblings, 0 replies; 53+ messages in thread From: Don Slutz @ 2014-06-09 14:25 UTC (permalink / raw) To: Michael S. Tsirkin, Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On 06/08/14 11:24, Michael S. Tsirkin wrote: > On Fri, Jun 06, 2014 at 01:52:06PM -0400, Don Slutz wrote: >> This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" >> >> Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> >> Signed-off-by: Don Slutz <dslutz@verizon.com> >> --- >> v5: >> Added Acked-by: Stefano Stabellini >> Minor change of pmc to pcms. >> >> >> hw/i386/pc_piix.c | 1 + >> hw/i386/pc_q35.c | 1 + >> include/hw/xen/xen.h | 2 +- >> xen-hvm-stub.c | 2 +- >> xen-hvm.c | 36 ++++++++++++++++++++---------------- >> 5 files changed, 24 insertions(+), 18 deletions(-) >> >> diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c >> index 25f4727..27851c6 100644 >> --- a/hw/i386/pc_piix.c >> +++ b/hw/i386/pc_piix.c >> @@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, >> } >> >> if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, >> + !(pcms && pcms->max_ram_below_4g), >> &ram_memory) != 0) { >> fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); >> exit(1); >> diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c >> index 155cdf1..6436fce 100644 >> --- a/hw/i386/pc_q35.c >> +++ b/hw/i386/pc_q35.c >> @@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) >> } >> >> if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, >> + !(pcms && pcms->max_ram_below_4g), >> &ram_memory) != 0) { >> fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); >> exit(1); >> diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h >> index f71f2d8..6b94c14 100644 >> --- a/include/hw/xen/xen.h >> +++ b/include/hw/xen/xen.h >> @@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); >> >> #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, >> - MemoryRegion **ram_memory); >> + bool is_default, MemoryRegion **ram_memory); >> void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, >> struct MemoryRegion *mr); >> void xen_modified_memory(ram_addr_t start, ram_addr_t length); >> diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c >> index 2d98696..d1bdb76 100644 >> --- a/xen-hvm-stub.c >> +++ b/xen-hvm-stub.c >> @@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) >> } >> >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, >> - MemoryRegion **ram_memory) >> + bool is_default, MemoryRegion **ram_memory) >> { >> return 0; >> } >> diff --git a/xen-hvm.c b/xen-hvm.c >> index a0b6b5d..8d27ee6 100644 >> --- a/xen-hvm.c >> +++ b/xen-hvm.c >> @@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) >> /* Memory Ops */ >> >> static void xen_ram_init(ram_addr_t *below_4g_mem_size, >> - ram_addr_t *above_4g_mem_size, >> + ram_addr_t *above_4g_mem_size, bool is_default, >> ram_addr_t ram_size, MemoryRegion **ram_memory_p) >> { >> MemoryRegion *sysmem = get_system_memory(); >> ram_addr_t block_len; >> >> - block_len = ram_size; >> - if (ram_size >= HVM_BELOW_4G_RAM_END) { >> - /* Xen does not allocate the memory continuously, and keep a hole at >> - * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH >> + if (is_default) { >> + if (ram_size >= HVM_BELOW_4G_RAM_END) { >> + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; >> + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; >> + } else { >> + *above_4g_mem_size = 0; >> + *below_4g_mem_size = ram_size; >> + } >> + } >> + if (!*above_4g_mem_size) { >> + block_len = ram_size; >> + } else { >> + /* >> + * Xen does not allocate the memory continuously, and keep a hole of >> + * of the size computed above or passed in. >> */ > Not your fault but this is ambigious. > I guess this means "does not allocate the memory continuously, it keeps a > hole ..."? > How does (dropping the double of also): Xen does not allocate the memory continuously, it keeps a hole of the size computed above or passed in. -Don Slutz >> - block_len += HVM_BELOW_4G_MMIO_LENGTH; >> + block_len = (1ULL << 32) + *above_4g_mem_size; >> } >> memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); >> *ram_memory_p = &ram_memory; >> vmstate_register_ram_global(&ram_memory); >> >> - if (ram_size >= HVM_BELOW_4G_RAM_END) { >> - *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; >> - *below_4g_mem_size = HVM_BELOW_4G_RAM_END; >> - } else { >> - *above_4g_mem_size = 0; >> - *below_4g_mem_size = ram_size; >> - } >> - >> memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", >> &ram_memory, 0, 0xa0000); >> memory_region_add_subregion(sysmem, 0, &ram_640k); >> @@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) >> } >> >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, >> - MemoryRegion **ram_memory) >> + bool is_default, MemoryRegion **ram_memory) >> { >> int i, rc; >> unsigned long ioreq_pfn; >> @@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, >> >> /* Init RAM management */ >> xen_map_cache_init(xen_phys_offset_to_gaddr, state); >> - xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); >> + xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, >> + ram_memory); >> >> qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); >> >> -- >> 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init 2014-06-09 14:25 ` Don Slutz @ 2014-06-09 14:39 ` Michael S. Tsirkin -1 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-09 14:39 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Mon, Jun 09, 2014 at 10:25:36AM -0400, Don Slutz wrote: > On 06/08/14 11:24, Michael S. Tsirkin wrote: > >On Fri, Jun 06, 2014 at 01:52:06PM -0400, Don Slutz wrote: > >>This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" > >> > >>Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > >>--- > >>v5: > >> Added Acked-by: Stefano Stabellini > >> Minor change of pmc to pcms. > >> > >> > >> hw/i386/pc_piix.c | 1 + > >> hw/i386/pc_q35.c | 1 + > >> include/hw/xen/xen.h | 2 +- > >> xen-hvm-stub.c | 2 +- > >> xen-hvm.c | 36 ++++++++++++++++++++---------------- > >> 5 files changed, 24 insertions(+), 18 deletions(-) > >> > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > >>index 25f4727..27851c6 100644 > >>--- a/hw/i386/pc_piix.c > >>+++ b/hw/i386/pc_piix.c > >>@@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, > >> } > >> if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > >>+ !(pcms && pcms->max_ram_below_4g), > >> &ram_memory) != 0) { > >> fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > >> exit(1); > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > >>index 155cdf1..6436fce 100644 > >>--- a/hw/i386/pc_q35.c > >>+++ b/hw/i386/pc_q35.c > >>@@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) > >> } > >> if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > >>+ !(pcms && pcms->max_ram_below_4g), > >> &ram_memory) != 0) { > >> fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > >> exit(1); > >>diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h > >>index f71f2d8..6b94c14 100644 > >>--- a/include/hw/xen/xen.h > >>+++ b/include/hw/xen/xen.h > >>@@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); > >> #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) > >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > >>- MemoryRegion **ram_memory); > >>+ bool is_default, MemoryRegion **ram_memory); > >> void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, > >> struct MemoryRegion *mr); > >> void xen_modified_memory(ram_addr_t start, ram_addr_t length); > >>diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c > >>index 2d98696..d1bdb76 100644 > >>--- a/xen-hvm-stub.c > >>+++ b/xen-hvm-stub.c > >>@@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) > >> } > >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > >>- MemoryRegion **ram_memory) > >>+ bool is_default, MemoryRegion **ram_memory) > >> { > >> return 0; > >> } > >>diff --git a/xen-hvm.c b/xen-hvm.c > >>index a0b6b5d..8d27ee6 100644 > >>--- a/xen-hvm.c > >>+++ b/xen-hvm.c > >>@@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) > >> /* Memory Ops */ > >> static void xen_ram_init(ram_addr_t *below_4g_mem_size, > >>- ram_addr_t *above_4g_mem_size, > >>+ ram_addr_t *above_4g_mem_size, bool is_default, > >> ram_addr_t ram_size, MemoryRegion **ram_memory_p) > >> { > >> MemoryRegion *sysmem = get_system_memory(); > >> ram_addr_t block_len; > >>- block_len = ram_size; > >>- if (ram_size >= HVM_BELOW_4G_RAM_END) { > >>- /* Xen does not allocate the memory continuously, and keep a hole at > >>- * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH > >>+ if (is_default) { > >>+ if (ram_size >= HVM_BELOW_4G_RAM_END) { > >>+ *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > >>+ *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > >>+ } else { > >>+ *above_4g_mem_size = 0; > >>+ *below_4g_mem_size = ram_size; > >>+ } > >>+ } > >>+ if (!*above_4g_mem_size) { > >>+ block_len = ram_size; > >>+ } else { > >>+ /* > >>+ * Xen does not allocate the memory continuously, and keep a hole of > >>+ * of the size computed above or passed in. > >> */ > >Not your fault but this is ambigious. > >I guess this means "does not allocate the memory continuously, it keeps a > >hole ..."? > > > > How does (dropping the double of also): > > Xen does not allocate the memory continuously, it keeps a hole of the size computed above or passed in. > > > -Don Slutz > Sounds reasonable. > > >>- block_len += HVM_BELOW_4G_MMIO_LENGTH; > >>+ block_len = (1ULL << 32) + *above_4g_mem_size; > >> } > >> memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); > >> *ram_memory_p = &ram_memory; > >> vmstate_register_ram_global(&ram_memory); > >>- if (ram_size >= HVM_BELOW_4G_RAM_END) { > >>- *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > >>- *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > >>- } else { > >>- *above_4g_mem_size = 0; > >>- *below_4g_mem_size = ram_size; > >>- } > >>- > >> memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", > >> &ram_memory, 0, 0xa0000); > >> memory_region_add_subregion(sysmem, 0, &ram_640k); > >>@@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) > >> } > >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > >>- MemoryRegion **ram_memory) > >>+ bool is_default, MemoryRegion **ram_memory) > >> { > >> int i, rc; > >> unsigned long ioreq_pfn; > >>@@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > >> /* Init RAM management */ > >> xen_map_cache_init(xen_phys_offset_to_gaddr, state); > >>- xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); > >>+ xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, > >>+ ram_memory); > >> qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); > >>-- > >>1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init @ 2014-06-09 14:39 ` Michael S. Tsirkin 0 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-09 14:39 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Mon, Jun 09, 2014 at 10:25:36AM -0400, Don Slutz wrote: > On 06/08/14 11:24, Michael S. Tsirkin wrote: > >On Fri, Jun 06, 2014 at 01:52:06PM -0400, Don Slutz wrote: > >>This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" > >> > >>Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> > >>Signed-off-by: Don Slutz <dslutz@verizon.com> > >>--- > >>v5: > >> Added Acked-by: Stefano Stabellini > >> Minor change of pmc to pcms. > >> > >> > >> hw/i386/pc_piix.c | 1 + > >> hw/i386/pc_q35.c | 1 + > >> include/hw/xen/xen.h | 2 +- > >> xen-hvm-stub.c | 2 +- > >> xen-hvm.c | 36 ++++++++++++++++++++---------------- > >> 5 files changed, 24 insertions(+), 18 deletions(-) > >> > >>diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > >>index 25f4727..27851c6 100644 > >>--- a/hw/i386/pc_piix.c > >>+++ b/hw/i386/pc_piix.c > >>@@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, > >> } > >> if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > >>+ !(pcms && pcms->max_ram_below_4g), > >> &ram_memory) != 0) { > >> fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > >> exit(1); > >>diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > >>index 155cdf1..6436fce 100644 > >>--- a/hw/i386/pc_q35.c > >>+++ b/hw/i386/pc_q35.c > >>@@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) > >> } > >> if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > >>+ !(pcms && pcms->max_ram_below_4g), > >> &ram_memory) != 0) { > >> fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > >> exit(1); > >>diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h > >>index f71f2d8..6b94c14 100644 > >>--- a/include/hw/xen/xen.h > >>+++ b/include/hw/xen/xen.h > >>@@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); > >> #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) > >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > >>- MemoryRegion **ram_memory); > >>+ bool is_default, MemoryRegion **ram_memory); > >> void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, > >> struct MemoryRegion *mr); > >> void xen_modified_memory(ram_addr_t start, ram_addr_t length); > >>diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c > >>index 2d98696..d1bdb76 100644 > >>--- a/xen-hvm-stub.c > >>+++ b/xen-hvm-stub.c > >>@@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) > >> } > >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > >>- MemoryRegion **ram_memory) > >>+ bool is_default, MemoryRegion **ram_memory) > >> { > >> return 0; > >> } > >>diff --git a/xen-hvm.c b/xen-hvm.c > >>index a0b6b5d..8d27ee6 100644 > >>--- a/xen-hvm.c > >>+++ b/xen-hvm.c > >>@@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) > >> /* Memory Ops */ > >> static void xen_ram_init(ram_addr_t *below_4g_mem_size, > >>- ram_addr_t *above_4g_mem_size, > >>+ ram_addr_t *above_4g_mem_size, bool is_default, > >> ram_addr_t ram_size, MemoryRegion **ram_memory_p) > >> { > >> MemoryRegion *sysmem = get_system_memory(); > >> ram_addr_t block_len; > >>- block_len = ram_size; > >>- if (ram_size >= HVM_BELOW_4G_RAM_END) { > >>- /* Xen does not allocate the memory continuously, and keep a hole at > >>- * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH > >>+ if (is_default) { > >>+ if (ram_size >= HVM_BELOW_4G_RAM_END) { > >>+ *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > >>+ *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > >>+ } else { > >>+ *above_4g_mem_size = 0; > >>+ *below_4g_mem_size = ram_size; > >>+ } > >>+ } > >>+ if (!*above_4g_mem_size) { > >>+ block_len = ram_size; > >>+ } else { > >>+ /* > >>+ * Xen does not allocate the memory continuously, and keep a hole of > >>+ * of the size computed above or passed in. > >> */ > >Not your fault but this is ambigious. > >I guess this means "does not allocate the memory continuously, it keeps a > >hole ..."? > > > > How does (dropping the double of also): > > Xen does not allocate the memory continuously, it keeps a hole of the size computed above or passed in. > > > -Don Slutz > Sounds reasonable. > > >>- block_len += HVM_BELOW_4G_MMIO_LENGTH; > >>+ block_len = (1ULL << 32) + *above_4g_mem_size; > >> } > >> memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); > >> *ram_memory_p = &ram_memory; > >> vmstate_register_ram_global(&ram_memory); > >>- if (ram_size >= HVM_BELOW_4G_RAM_END) { > >>- *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > >>- *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > >>- } else { > >>- *above_4g_mem_size = 0; > >>- *below_4g_mem_size = ram_size; > >>- } > >>- > >> memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", > >> &ram_memory, 0, 0xa0000); > >> memory_region_add_subregion(sysmem, 0, &ram_640k); > >>@@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) > >> } > >> int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > >>- MemoryRegion **ram_memory) > >>+ bool is_default, MemoryRegion **ram_memory) > >> { > >> int i, rc; > >> unsigned long ioreq_pfn; > >>@@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > >> /* Init RAM management */ > >> xen_map_cache_init(xen_phys_offset_to_gaddr, state); > >>- xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); > >>+ xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, > >>+ ram_memory); > >> qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); > >>-- > >>1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [Qemu-devel] [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init 2014-06-06 17:52 ` Don Slutz @ 2014-06-08 15:42 ` Michael S. Tsirkin -1 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-08 15:42 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Fri, Jun 06, 2014 at 01:52:06PM -0400, Don Slutz wrote: > This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" > > Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> > Signed-off-by: Don Slutz <dslutz@verizon.com> > --- > v5: > Added Acked-by: Stefano Stabellini > Minor change of pmc to pcms. > > > hw/i386/pc_piix.c | 1 + > hw/i386/pc_q35.c | 1 + > include/hw/xen/xen.h | 2 +- > xen-hvm-stub.c | 2 +- > xen-hvm.c | 36 ++++++++++++++++++++---------------- > 5 files changed, 24 insertions(+), 18 deletions(-) > > diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > index 25f4727..27851c6 100644 > --- a/hw/i386/pc_piix.c > +++ b/hw/i386/pc_piix.c > @@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, > } > > if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > + !(pcms && pcms->max_ram_below_4g), > &ram_memory) != 0) { > fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > exit(1); > diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > index 155cdf1..6436fce 100644 > --- a/hw/i386/pc_q35.c > +++ b/hw/i386/pc_q35.c > @@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) > } > > if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > + !(pcms && pcms->max_ram_below_4g), > &ram_memory) != 0) { > fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > exit(1); > diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h > index f71f2d8..6b94c14 100644 > --- a/include/hw/xen/xen.h > +++ b/include/hw/xen/xen.h > @@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); > > #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory); > + bool is_default, MemoryRegion **ram_memory); > void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, > struct MemoryRegion *mr); > void xen_modified_memory(ram_addr_t start, ram_addr_t length); > diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c > index 2d98696..d1bdb76 100644 > --- a/xen-hvm-stub.c > +++ b/xen-hvm-stub.c > @@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) > } > > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory) > + bool is_default, MemoryRegion **ram_memory) > { > return 0; > } > diff --git a/xen-hvm.c b/xen-hvm.c > index a0b6b5d..8d27ee6 100644 > --- a/xen-hvm.c > +++ b/xen-hvm.c > @@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) > /* Memory Ops */ > > static void xen_ram_init(ram_addr_t *below_4g_mem_size, > - ram_addr_t *above_4g_mem_size, > + ram_addr_t *above_4g_mem_size, bool is_default, > ram_addr_t ram_size, MemoryRegion **ram_memory_p) > { > MemoryRegion *sysmem = get_system_memory(); > ram_addr_t block_len; > > - block_len = ram_size; > - if (ram_size >= HVM_BELOW_4G_RAM_END) { > - /* Xen does not allocate the memory continuously, and keep a hole at > - * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH > + if (is_default) { > + if (ram_size >= HVM_BELOW_4G_RAM_END) { > + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > + } else { > + *above_4g_mem_size = 0; > + *below_4g_mem_size = ram_size; > + } > + } > + if (!*above_4g_mem_size) { > + block_len = ram_size; > + } else { > + /* > + * Xen does not allocate the memory continuously, and keep a hole of > + * of the size computed above or passed in. of of -> typo > */ > - block_len += HVM_BELOW_4G_MMIO_LENGTH; > + block_len = (1ULL << 32) + *above_4g_mem_size; > } > memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); > *ram_memory_p = &ram_memory; > vmstate_register_ram_global(&ram_memory); > > - if (ram_size >= HVM_BELOW_4G_RAM_END) { > - *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > - *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > - } else { > - *above_4g_mem_size = 0; > - *below_4g_mem_size = ram_size; > - } > - > memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", > &ram_memory, 0, 0xa0000); > memory_region_add_subregion(sysmem, 0, &ram_640k); > @@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) > } > > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory) > + bool is_default, MemoryRegion **ram_memory) > { > int i, rc; > unsigned long ioreq_pfn; > @@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > > /* Init RAM management */ > xen_map_cache_init(xen_phys_offset_to_gaddr, state); > - xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); > + xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, > + ram_memory); > > qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); > > -- > 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
* Re: [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init @ 2014-06-08 15:42 ` Michael S. Tsirkin 0 siblings, 0 replies; 53+ messages in thread From: Michael S. Tsirkin @ 2014-06-08 15:42 UTC (permalink / raw) To: Don Slutz Cc: xen-devel, Stefano Stabellini, qemu-devel, Anthony Liguori, Igor Mammedov, Andreas Färber On Fri, Jun 06, 2014 at 01:52:06PM -0400, Don Slutz wrote: > This is the xen part of "pc & q35: Add new machine opt max-ram-below-4g" > > Acked-by: Stefano Stabellini <stefano.stabellini@eu.citrix.com> > Signed-off-by: Don Slutz <dslutz@verizon.com> > --- > v5: > Added Acked-by: Stefano Stabellini > Minor change of pmc to pcms. > > > hw/i386/pc_piix.c | 1 + > hw/i386/pc_q35.c | 1 + > include/hw/xen/xen.h | 2 +- > xen-hvm-stub.c | 2 +- > xen-hvm.c | 36 ++++++++++++++++++++---------------- > 5 files changed, 24 insertions(+), 18 deletions(-) > > diff --git a/hw/i386/pc_piix.c b/hw/i386/pc_piix.c > index 25f4727..27851c6 100644 > --- a/hw/i386/pc_piix.c > +++ b/hw/i386/pc_piix.c > @@ -125,6 +125,7 @@ static void pc_init1(MachineState *machine, > } > > if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > + !(pcms && pcms->max_ram_below_4g), > &ram_memory) != 0) { > fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > exit(1); > diff --git a/hw/i386/pc_q35.c b/hw/i386/pc_q35.c > index 155cdf1..6436fce 100644 > --- a/hw/i386/pc_q35.c > +++ b/hw/i386/pc_q35.c > @@ -114,6 +114,7 @@ static void pc_q35_init(MachineState *machine) > } > > if (xen_enabled() && xen_hvm_init(&below_4g_mem_size, &above_4g_mem_size, > + !(pcms && pcms->max_ram_below_4g), > &ram_memory) != 0) { > fprintf(stderr, "xen hardware virtual machine initialisation failed\n"); > exit(1); > diff --git a/include/hw/xen/xen.h b/include/hw/xen/xen.h > index f71f2d8..6b94c14 100644 > --- a/include/hw/xen/xen.h > +++ b/include/hw/xen/xen.h > @@ -41,7 +41,7 @@ void xenstore_store_pv_console_info(int i, struct CharDriverState *chr); > > #if defined(NEED_CPU_H) && !defined(CONFIG_USER_ONLY) > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory); > + bool is_default, MemoryRegion **ram_memory); > void xen_ram_alloc(ram_addr_t ram_addr, ram_addr_t size, > struct MemoryRegion *mr); > void xen_modified_memory(ram_addr_t start, ram_addr_t length); > diff --git a/xen-hvm-stub.c b/xen-hvm-stub.c > index 2d98696..d1bdb76 100644 > --- a/xen-hvm-stub.c > +++ b/xen-hvm-stub.c > @@ -52,7 +52,7 @@ void xen_modified_memory(ram_addr_t start, ram_addr_t length) > } > > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory) > + bool is_default, MemoryRegion **ram_memory) > { > return 0; > } > diff --git a/xen-hvm.c b/xen-hvm.c > index a0b6b5d..8d27ee6 100644 > --- a/xen-hvm.c > +++ b/xen-hvm.c > @@ -156,31 +156,34 @@ qemu_irq *xen_interrupt_controller_init(void) > /* Memory Ops */ > > static void xen_ram_init(ram_addr_t *below_4g_mem_size, > - ram_addr_t *above_4g_mem_size, > + ram_addr_t *above_4g_mem_size, bool is_default, > ram_addr_t ram_size, MemoryRegion **ram_memory_p) > { > MemoryRegion *sysmem = get_system_memory(); > ram_addr_t block_len; > > - block_len = ram_size; > - if (ram_size >= HVM_BELOW_4G_RAM_END) { > - /* Xen does not allocate the memory continuously, and keep a hole at > - * HVM_BELOW_4G_MMIO_START of HVM_BELOW_4G_MMIO_LENGTH > + if (is_default) { > + if (ram_size >= HVM_BELOW_4G_RAM_END) { > + *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > + *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > + } else { > + *above_4g_mem_size = 0; > + *below_4g_mem_size = ram_size; > + } > + } > + if (!*above_4g_mem_size) { > + block_len = ram_size; > + } else { > + /* > + * Xen does not allocate the memory continuously, and keep a hole of > + * of the size computed above or passed in. of of -> typo > */ > - block_len += HVM_BELOW_4G_MMIO_LENGTH; > + block_len = (1ULL << 32) + *above_4g_mem_size; > } > memory_region_init_ram(&ram_memory, NULL, "xen.ram", block_len); > *ram_memory_p = &ram_memory; > vmstate_register_ram_global(&ram_memory); > > - if (ram_size >= HVM_BELOW_4G_RAM_END) { > - *above_4g_mem_size = ram_size - HVM_BELOW_4G_RAM_END; > - *below_4g_mem_size = HVM_BELOW_4G_RAM_END; > - } else { > - *above_4g_mem_size = 0; > - *below_4g_mem_size = ram_size; > - } > - > memory_region_init_alias(&ram_640k, NULL, "xen.ram.640k", > &ram_memory, 0, 0xa0000); > memory_region_add_subregion(sysmem, 0, &ram_640k); > @@ -962,7 +965,7 @@ static void xen_wakeup_notifier(Notifier *notifier, void *data) > } > > int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > - MemoryRegion **ram_memory) > + bool is_default, MemoryRegion **ram_memory) > { > int i, rc; > unsigned long ioreq_pfn; > @@ -1040,7 +1043,8 @@ int xen_hvm_init(ram_addr_t *below_4g_mem_size, ram_addr_t *above_4g_mem_size, > > /* Init RAM management */ > xen_map_cache_init(xen_phys_offset_to_gaddr, state); > - xen_ram_init(below_4g_mem_size, above_4g_mem_size, ram_size, ram_memory); > + xen_ram_init(below_4g_mem_size, above_4g_mem_size, is_default, ram_size, > + ram_memory); > > qemu_add_vm_change_state_handler(xen_hvm_change_state_handler, state); > > -- > 1.8.4 ^ permalink raw reply [flat|nested] 53+ messages in thread
end of thread, other threads:[~2014-06-18 13:28 UTC | newest] Thread overview: 53+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2014-06-06 17:52 [Qemu-devel] [PATCH v5 0/3] Add max-ram-below-4g (was Add pci_hole_min_size machine option) Don Slutz 2014-06-06 17:52 ` Don Slutz 2014-06-06 17:52 ` [Qemu-devel] [PATCH v5 1/3] xen-hvm: Fix xen_hvm_init() to adjust pc memory layout Don Slutz 2014-06-06 17:52 ` Don Slutz 2014-06-06 17:52 ` [Qemu-devel] [PATCH v5 2/3] pc & q35: Add new machine opt max-ram-below-4g Don Slutz 2014-06-06 17:52 ` Don Slutz 2014-06-08 15:40 ` [Qemu-devel] " Michael S. Tsirkin 2014-06-08 15:40 ` Michael S. Tsirkin 2014-06-09 14:20 ` [Qemu-devel] " Don Slutz 2014-06-09 14:20 ` Don Slutz 2014-06-09 14:38 ` [Qemu-devel] " Michael S. Tsirkin 2014-06-09 14:38 ` Michael S. Tsirkin 2014-06-09 15:10 ` [Qemu-devel] " Marcel Apfelbaum 2014-06-09 15:37 ` Igor Mammedov 2014-06-09 15:37 ` Igor Mammedov 2014-06-09 17:33 ` [Qemu-devel] " Marcel Apfelbaum 2014-06-09 17:33 ` Marcel Apfelbaum 2014-06-09 20:03 ` [Qemu-devel] " Don Slutz 2014-06-09 20:03 ` Don Slutz 2014-06-09 19:13 ` [Qemu-devel] " Don Slutz 2014-06-09 19:13 ` Don Slutz 2014-06-10 7:36 ` [Qemu-devel] " Gerd Hoffmann 2014-06-10 7:36 ` Gerd Hoffmann 2014-06-17 17:51 ` [Qemu-devel] " Don Slutz 2014-06-17 17:51 ` Don Slutz 2014-06-18 9:52 ` [Qemu-devel] " Gerd Hoffmann 2014-06-18 9:52 ` Gerd Hoffmann 2014-06-17 18:22 ` [Qemu-devel] " Michael S. Tsirkin 2014-06-17 18:22 ` Michael S. Tsirkin 2014-06-17 18:44 ` [Qemu-devel] " Don Slutz 2014-06-17 18:44 ` Don Slutz 2014-06-17 19:43 ` [Qemu-devel] " Michael S. Tsirkin 2014-06-17 19:43 ` Michael S. Tsirkin 2014-06-17 20:05 ` [Qemu-devel] " Michael S. Tsirkin 2014-06-17 20:05 ` Michael S. Tsirkin 2014-06-17 20:08 ` [Qemu-devel] [Xen-devel] " Konrad Rzeszutek Wilk 2014-06-17 20:08 ` Konrad Rzeszutek Wilk 2014-06-17 20:17 ` [Qemu-devel] " Michael S. Tsirkin 2014-06-17 20:17 ` Michael S. Tsirkin 2014-06-18 13:28 ` [Qemu-devel] " Slutz, Donald Christopher 2014-06-18 13:28 ` Slutz, Donald Christopher 2014-06-17 20:35 ` [Qemu-devel] [Xen-devel] " Pasi Kärkkäinen 2014-06-17 20:35 ` Pasi Kärkkäinen 2014-06-06 17:52 ` [Qemu-devel] [PATCH v5 3/3] xen-hvm: Pass is_default to xen_hvm_init Don Slutz 2014-06-06 17:52 ` Don Slutz 2014-06-08 15:24 ` [Qemu-devel] " Michael S. Tsirkin 2014-06-08 15:24 ` Michael S. Tsirkin 2014-06-09 14:25 ` [Qemu-devel] " Don Slutz 2014-06-09 14:25 ` Don Slutz 2014-06-09 14:39 ` [Qemu-devel] " Michael S. Tsirkin 2014-06-09 14:39 ` Michael S. Tsirkin 2014-06-08 15:42 ` [Qemu-devel] " Michael S. Tsirkin 2014-06-08 15:42 ` Michael S. Tsirkin
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.