RGW + erasure coding

RGW + erasure coding

[Somnath Roy]

Hi,
I am planning to setup RGW on top of Erasure coded pool. RGW stores all of its data in the .rgw.buckets pool and I am planning to configure this pool as erasure-coded. I think configuring all other rgw pools as replicated should be fine as they don't store lot of data.
Please let me know if I am missing anything, any comments/suggestion/performance tuning insight  on this will be very helpful.

Thanks & Regards
Somnath

________________________________

PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies).

Re: RGW + erasure coding

[Italo Santos]

[-- Attachment #1.1: Type: text/plain, Size: 1809 bytes --]

I use RGW with the .rgw.bucktes as EC pool and works fine as well, I’m able to reach ~300MB/s using a physical RGW server with 4 OSD nodes with SAS 10K drives w/out SSD journal.  

Also, I’ve tested create all other pools as EC pool too but RGW daemon doesn’t start, so I realised that the only pool should be EC was the data pool (.rgw.buckets)  

Regards.

Italo Santos
http://italosantos.com.br/


On Tuesday, May 5, 2015 at 22:35, Somnath Roy wrote:

> Hi,
> I am planning to setup RGW on top of Erasure coded pool. RGW stores all of its data in the .rgw.buckets pool and I am planning to configure this pool as erasure-coded. I think configuring all other rgw pools as replicated should be fine as they don't store lot of data.
> Please let me know if I am missing anything, any comments/suggestion/performance tuning insight on this will be very helpful.
>  
> Thanks & Regards
> Somnath
>  
> ________________________________
>  
> PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies).
>  
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com (mailto:ceph-users@lists.ceph.com)
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>  
>  



[-- Attachment #1.2: Type: text/html, Size: 2901 bytes --]

[-- Attachment #2: Type: text/plain, Size: 178 bytes --]

_______________________________________________
ceph-users mailing list
ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: RGW + erasure coding

[Somnath Roy]

[-- Attachment #1.1: Type: text/plain, Size: 2181 bytes --]

Thanks for the information Italo.
I think RGW should support all the pools on top of EC backend, not sure this is because of bucket-index sharding or not. You should probably raise a defect in the community.

Regards
Somnath

From: Italo Santos [mailto:okdokk@gmail.com]
Sent: Tuesday, May 05, 2015 6:49 PM
To: Somnath Roy
Cc: ceph-users@lists.ceph.com; ceph-devel
Subject: Re: [ceph-users] RGW + erasure coding

I use RGW with the .rgw.bucktes as EC pool and works fine as well, I’m able to reach ~300MB/s using a physical RGW server with 4 OSD nodes with SAS 10K drives w/out SSD journal.

Also, I’ve tested create all other pools as EC pool too but RGW daemon doesn’t start, so I realised that the only pool should be EC was the data pool (.rgw.buckets)

Regards.

Italo Santos
http://italosantos.com.br/


On Tuesday, May 5, 2015 at 22:35, Somnath Roy wrote:
Hi,
I am planning to setup RGW on top of Erasure coded pool. RGW stores all of its data in the .rgw.buckets pool and I am planning to configure this pool as erasure-coded. I think configuring all other rgw pools as replicated should be fine as they don't store lot of data.
Please let me know if I am missing anything, any comments/suggestion/performance tuning insight on this will be very helpful.

Thanks & Regards
Somnath

________________________________

PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies).

_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[-- Attachment #1.2: Type: text/html, Size: 7024 bytes --]

[-- Attachment #2: Type: text/plain, Size: 178 bytes --]

_______________________________________________
ceph-users mailing list
ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com