Re: rbd 0.48 storage support for kvm proxmox distribution available

[Alexandre DERUMIER <aderumier@odiso.com>]

Thanks for the infos.

I dind't have documented the ceph.conf feature,it's more a workaround for now for users which want to tune some values.

Indeed,I'm planning to add the cache size options to the proxmox storage.cfg.


Thanks

Alexandre


----- Mail original ----- 

De: "Wido den Hollander" <wido@widodh.nl> 
À: "Alexandre DERUMIER" <aderumier@odiso.com> 
Cc: ceph-devel@vger.kernel.org 
Envoyé: Mercredi 5 Septembre 2012 14:35:16 
Objet: Re: rbd 0.48 storage support for kvm proxmox distribution available 

On 09/05/2012 11:30 AM, Alexandre DERUMIER wrote: 
>>> Proxmox doesn't use libvirt, does it? 
> Yes, we don't use libvirt. 
> 
>>> Any plans to implement the RBD caching? 
> 
> It's already implemented (cache=writeback), patched qemu-kvm 1.1. (and qemu-kvm 1.2 is coming in the next days) 
> 
> Tunning of cache size can be done with a /etc/ceph.conf file 
> 

That is kind of dangerous imho and for a couple of reasons. 

For configuring the storage you have /etc/pve/storage.cfg where you can 
add the RBD pool, configure the monitors and cephx, but for caching you 
rely in librbd reading ceph.conf? 

That is hidden from the user, reading /etc/ceph/ceph.conf will go 
without your knowledge. I'd opt for passing down all the options to Qemu 
and being able to run without a ceph.conf 

I've ran into the same problems with libvirt and CloudStack. I couldn't 
figure out why libvirt was still able to connect to a specific cluster 
until I found out my ceph.conf was still in place. 

I also thought it is on the roadmap to not read /etc/ceph/ceph.conf by 
default with librbd/librados to take away these kind of issues. 

And you would also have this weird situation where the ceph.conf could 
have a couple of monitor entries and your "storage.cfg", how will that 
work out? 

I would try not to rely on the ceph.conf at all and have Proxmox pass 
all the configuration options down to Qemu. 

Wido 

> 
> 
> ----- Mail original ----- 
> 
> De: "Wido den Hollander" <wido@widodh.nl> 
> À: "Alexandre DERUMIER" <aderumier@odiso.com> 
> Cc: ceph-devel@vger.kernel.org 
> Envoyé: Mercredi 5 Septembre 2012 11:11:27 
> Objet: Re: rbd 0.48 storage support for kvm proxmox distribution available 
> 
> On 09/05/2012 06:31 AM, Alexandre DERUMIER wrote: 
>> Hi List, 
>> 
>> We have added rbd 0.48 support to the proxmox 2.1 kvm distribution 
>> http://www.proxmox.com/products/proxmox-ve 
>> 
>> 
>> Proxmox setup: 
>> 
>> edit the /etc/pve/storage.cfg and add the configuration (gui creation is not available yet) 
>> 
>> rbd: mycephcluster 
>> monhost 192.168.0.1:6789;192.168.0.2:6789;192.168.0.3:6789 
>> pool rbd 
>> username admin 
>> authsupported cephx;none 
>> content images 
>> 
> 
> Proxmox doesn't use libvirt, does it? 
> 
> Any plans to implement the RBD caching? 
> 
> Nice work though! 
> 
> Wido 
> 
>> 
>> then you need to copy the keyring file from ceph to proxmox 
>> 
>> scp cephserver1:/etc/ceph/client.admin.keyring /etc/pve/priv/ceph/mycephcluster.keyring 
>> 
>> 
>> 
>> For now, you can add/delete/resize rbd volumes from gui. 
>> Snapshots/cloning will be added soon (when layering will be available) 
>> 
>> 
>> Regards, 
>> 
>> Alexandre Derumier 
>> -- 
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in 
>> the body of a message to majordomo@vger.kernel.org 
>> More majordomo info at http://vger.kernel.org/majordomo-info.html 
>> 
> -- 
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in 
> the body of a message to majordomo@vger.kernel.org 
> More majordomo info at http://vger.kernel.org/majordomo-info.html 
> 
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html