All of lore.kernel.org
 help / color / mirror / Atom feed
* Issue with radosgw in Ubuntu 13.10/emperor/fcgid
@ 2014-03-13 10:58 ghislain.chevalier
  2014-03-13 15:19 ` Yehuda Sadeh
  0 siblings, 1 reply; 5+ messages in thread
From: ghislain.chevalier @ 2014-03-13 10:58 UTC (permalink / raw)
  To: ceph-devel


Hi All,

I currently try to install a radosgw/emperor on a dedicated server under Ubuntu 13.10 
This server is an exception in the cluster which is in Emperor under Ubuntu 12.04 LTS 

The apache2 and radosgw installation seem to be correct; I created a S3 user with a swift subuser but I get an error 500 trying to use it.
I use fcgid module instead of fastcgi and so the configuration is quite different.
FYI : I installed a radosgw/dumpling/fastcgi on another platform and it works well !!

In radosgw log, I got no errors. 
In apache2 error log, I got 
[Thu Mar 13 11:38:15.584859 2014] [fcgid:warn] [pid 15279:tid 140016017676032] (104)Connection reset by peer: [client 10.194.182.60:43871] mod_fcgid: error reading data from FastCGI server
[Thu Mar 13 11:38:15.584953 2014] [core:error] [pid 15279:tid 140016017676032] [client 10.194.182.60:43871] End of script output before headers: radosgw.fcgi

I noticed that a radosgw script is launched at every http request…
I hope someone will find what is wrong in my configuration!!!

Here are my configuration files.

rgw.conf:
<VirtualHost *:88>
ServerName  r-cephrgw01
DocumentRoot /var/www
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) /radosgw.fcgi?page=$1&params=$2&%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
</IfModule>
<IfModule mod_fcgid.c>
<Directory /var/www>
Options +ExecCGI
AllowOverride All
SetHandler fcgid-script
FcgidWrapper "/usr/local/bin/radosgw -n client.radosgw.r-cephrgw01" .fcgi virtual
Order allow,deny
Allow from all
AuthBasicAuthoritative Off
</Directory>
</IfModule>
AllowEncodedSlashes On
ServerSignature Off
</VirtualHost>


ceph.conf:
[client.radosgw.r-cephrgw01]
host = r-cephrgw01
rgw_socket_path = /var/run/ceph/radosgw.sock
keyring = /etc/ceph/keyring.radosgw.r-cephrgw01
rgw_dns_name = r-cephrgw01
log_file = /var/log/ceph/radosgw.log
rgw_port = 88
rgw_print_continue = false
user = www-data

radosgw.fcgi:
#!/bin/sh
exec /usr/local/bin/radosgw -c /etc/ceph/ceph.conf -n client.radosgw.r-cephrgw01


User johndoe in radosgw:
radosgw-admin user info --uid=johndoe
{ "user_id": "johndoe",
  "display_name": "John Doe",
  "email": "john@example.com",
  "suspended": 0,
  "max_buckets": 1000,
  "auid": 0,
  "subusers": [
        { "id": "johndoe:swift",
          "permissions": "full-control"}],
  "keys": [
        { "user": "johndoe",
          "access_key": "s3johndoe",
          "secret_key": "s3secret"}],
  "swift_keys": [
        { "user": "johndoe:swift",
          "secret_key": "swsecret"}],
  "caps": [],
  "op_mask": "read, write, delete",
  "default_placement": "",
  "placement_tags": [],
  "bucket_quota": { "enabled": false,
      "max_size_kb": -1,
      "max_objects": -1}}


ceph auth list for radosgw client
client.radosgw.r-cephrgw01
        key: AQAvdwdTwMSvGxAAsctezTxARKVVq9sWsUmAPg==
        caps: [mon] allow rw
        caps: [osd] allow rwx

- - - - - - - - - - - - - - - - - 
Ghislain Chevalier
ORANGE/OLNC/OLPS/ASE/DAPI/CSE
Storage Service Architect
 +33299124432
ghislain.chevalier@orange.com 

_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.


^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: Issue with radosgw in Ubuntu 13.10/emperor/fcgid
  2014-03-13 10:58 Issue with radosgw in Ubuntu 13.10/emperor/fcgid ghislain.chevalier
@ 2014-03-13 15:19 ` Yehuda Sadeh
  2014-03-13 16:48   ` ghislain.chevalier
  0 siblings, 1 reply; 5+ messages in thread
From: Yehuda Sadeh @ 2014-03-13 15:19 UTC (permalink / raw)
  To: ghislain.chevalier; +Cc: ceph-devel

On Thu, Mar 13, 2014 at 3:58 AM,  <ghislain.chevalier@orange.com> wrote:
>
> Hi All,
>
> I currently try to install a radosgw/emperor on a dedicated server under Ubuntu 13.10
> This server is an exception in the cluster which is in Emperor under Ubuntu 12.04 LTS
>
> The apache2 and radosgw installation seem to be correct; I created a S3 user with a swift subuser but I get an error 500 trying to use it.
> I use fcgid module instead of fastcgi and so the configuration is quite different.
> FYI : I installed a radosgw/dumpling/fastcgi on another platform and it works well !!
>
> In radosgw log, I got no errors.
> In apache2 error log, I got
> [Thu Mar 13 11:38:15.584859 2014] [fcgid:warn] [pid 15279:tid 140016017676032] (104)Connection reset by peer: [client 10.194.182.60:43871] mod_fcgid: error reading data from FastCGI server
> [Thu Mar 13 11:38:15.584953 2014] [core:error] [pid 15279:tid 140016017676032] [client 10.194.182.60:43871] End of script output before headers: radosgw.fcgi
>
> I noticed that a radosgw script is launched at every http request...

Yeah, that  could be one of the issues with fcgid, not sure if there's
a way to tell it to just be static (as we do with mod_fastcgi), any
reason why you're using fcgid?

A 500 response usually means that apache was not able to communicate
with the radosgw backend. Not sure what the issue with your config, it
has been a while since I configured fcgid. Try bumping up the radosgw
logs (debug rgw = 20) to see if the requests do get there or not.


Yehuda

> I hope someone will find what is wrong in my configuration!!!
>
> Here are my configuration files.
>
> rgw.conf:
> <VirtualHost *:88>
> ServerName  r-cephrgw01
> DocumentRoot /var/www
> <IfModule mod_rewrite.c>
> RewriteEngine On
> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) /radosgw.fcgi?page=$1&params=$2&%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
> </IfModule>
> <IfModule mod_fcgid.c>
> <Directory /var/www>
> Options +ExecCGI
> AllowOverride All
> SetHandler fcgid-script
> FcgidWrapper "/usr/local/bin/radosgw -n client.radosgw.r-cephrgw01" .fcgi virtual
> Order allow,deny
> Allow from all
> AuthBasicAuthoritative Off
> </Directory>
> </IfModule>
> AllowEncodedSlashes On
> ServerSignature Off
> </VirtualHost>
>
>
> ceph.conf:
> [client.radosgw.r-cephrgw01]
> host = r-cephrgw01
> rgw_socket_path = /var/run/ceph/radosgw.sock
> keyring = /etc/ceph/keyring.radosgw.r-cephrgw01
> rgw_dns_name = r-cephrgw01
> log_file = /var/log/ceph/radosgw.log
> rgw_port = 88
> rgw_print_continue = false
> user = www-data
>
> radosgw.fcgi:
> #!/bin/sh
> exec /usr/local/bin/radosgw -c /etc/ceph/ceph.conf -n client.radosgw.r-cephrgw01
>
>
> User johndoe in radosgw:
> radosgw-admin user info --uid=johndoe
> { "user_id": "johndoe",
>   "display_name": "John Doe",
>   "email": "john@example.com",
>   "suspended": 0,
>   "max_buckets": 1000,
>   "auid": 0,
>   "subusers": [
>         { "id": "johndoe:swift",
>           "permissions": "full-control"}],
>   "keys": [
>         { "user": "johndoe",
>           "access_key": "s3johndoe",
>           "secret_key": "s3secret"}],
>   "swift_keys": [
>         { "user": "johndoe:swift",
>           "secret_key": "swsecret"}],
>   "caps": [],
>   "op_mask": "read, write, delete",
>   "default_placement": "",
>   "placement_tags": [],
>   "bucket_quota": { "enabled": false,
>       "max_size_kb": -1,
>       "max_objects": -1}}
>
>
> ceph auth list for radosgw client
> client.radosgw.r-cephrgw01
>         key: AQAvdwdTwMSvGxAAsctezTxARKVVq9sWsUmAPg==
>         caps: [mon] allow rw
>         caps: [osd] allow rwx
>
> - - - - - - - - - - - - - - - - -
> Ghislain Chevalier
> ORANGE/OLNC/OLPS/ASE/DAPI/CSE
> Storage Service Architect
>  +33299124432
> ghislain.chevalier@orange.com
>
> _________________________________________________________________________________________________________________________
>
> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or privileged information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
> Thank you.
>

^ permalink raw reply	[flat|nested] 5+ messages in thread

* RE: Issue with radosgw in Ubuntu 13.10/emperor/fcgid
  2014-03-13 15:19 ` Yehuda Sadeh
@ 2014-03-13 16:48   ` ghislain.chevalier
  2014-03-13 17:09     ` Yehuda Sadeh
  0 siblings, 1 reply; 5+ messages in thread
From: ghislain.chevalier @ 2014-03-13 16:48 UTC (permalink / raw)
  To: Yehuda Sadeh; +Cc: ceph-devel

Hi Yehuda,

and thx for answering quickly...

I suppose you want me to add --debug_ms 20 in the radosgw command.
Was it right?
Or is it an entry (not documented) in the ceph.conf: rgw_debug = 20?

I trapped some exchanges btw the rasdosgw server and all the osd servers but it's very verbose...

2014-03-13 17:02:38.625252 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x7f5f4c006230
2014-03-13 17:02:38.625257 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13efb00 10.194.182.58:6800/4728
2014-03-13 17:02:38.625264 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).discard_queue
2014-03-13 17:02:38.625273 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).unregister_pipe - not registered
2014-03-13 17:02:38.625282 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).join
2014-03-13 17:02:38.625299 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaped pipe 0x13efb00 10.194.182.58:6800/4728
2014-03-13 17:02:38.625308 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x13efb00
2014-03-13 17:02:38.625313 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13e44d0 10.194.182.43:6789/0
2014-03-13 17:02:38.625319 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).discard_queue
2014-03-13 17:02:38.625328 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).unregister_pipe - not registered
2014-03-13 17:02:38.625336 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).join

The reason I'm using fcgid is that fastcgi is not available in Ubuntu 13.10 (maybe I'm wrong!!)

What I didn't understand is 
why I got as many radosgw processes as launched http requests? socket issue?
why I got a script header error in the error.log meaning that the script is launched?

I set the log level to debug in apache and I got

[Thu Mar 13 17:15:56.071467 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of Require all granted: granted
[Thu Mar 13 17:15:56.071558 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of <RequireAny>: granted
[Thu Mar 13 17:15:56.072527 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: server r-cephrgw01:/usr/local/bin/radosgw(20415) started
[Thu Mar 13 17:15:56.090184 2014] [fcgid:warn] [pid 20351:tid 140472486065920] (104)Connection reset by peer: [client 10.194.182.60:44440] mod_fcgid: error reading data from FastCGI server
[Thu Mar 13 17:15:56.090247 2014] [core:error] [pid 20351:tid 140472486065920] [client 10.194.182.60:44440] End of script output before headers: radosgw.fcgi
[Thu Mar 13 17:16:02.078648 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: process /usr/local/bin/radosgw(20415) exit(communication error), terminated by calling exit(), return code: 0

Best Regards


-----Message d'origine-----
De : Yehuda Sadeh [mailto:yehuda@inktank.com] 
Envoyé : jeudi 13 mars 2014 16:19
À : CHEVALIER Ghislain IMT/OLPS
Cc : ceph-devel@vger.kernel.org
Objet : Re: [Ceph-devel] Issue with radosgw in Ubuntu 13.10/emperor/fcgid

On Thu, Mar 13, 2014 at 3:58 AM,  <ghislain.chevalier@orange.com> wrote:
>
> Hi All,
>
> I currently try to install a radosgw/emperor on a dedicated server under Ubuntu 13.10
> This server is an exception in the cluster which is in Emperor under Ubuntu 12.04 LTS
>
> The apache2 and radosgw installation seem to be correct; I created a S3 user with a swift subuser but I get an error 500 trying to use it.
> I use fcgid module instead of fastcgi and so the configuration is quite different.
> FYI : I installed a radosgw/dumpling/fastcgi on another platform and it works well !!
>
> In radosgw log, I got no errors.
> In apache2 error log, I got
> [Thu Mar 13 11:38:15.584859 2014] [fcgid:warn] [pid 15279:tid 140016017676032] (104)Connection reset by peer: [client 10.194.182.60:43871] mod_fcgid: error reading data from FastCGI server
> [Thu Mar 13 11:38:15.584953 2014] [core:error] [pid 15279:tid 140016017676032] [client 10.194.182.60:43871] End of script output before headers: radosgw.fcgi
>
> I noticed that a radosgw script is launched at every http request...

Yeah, that  could be one of the issues with fcgid, not sure if there's
a way to tell it to just be static (as we do with mod_fastcgi), any
reason why you're using fcgid?

A 500 response usually means that apache was not able to communicate
with the radosgw backend. Not sure what the issue with your config, it
has been a while since I configured fcgid. Try bumping up the radosgw
logs (debug rgw = 20) to see if the requests do get there or not.


Yehuda

> I hope someone will find what is wrong in my configuration!!!
>
> Here are my configuration files.
>
> rgw.conf:
> <VirtualHost *:88>
> ServerName  r-cephrgw01
> DocumentRoot /var/www
> <IfModule mod_rewrite.c>
> RewriteEngine On
> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) /radosgw.fcgi?page=$1&params=$2&%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
> </IfModule>
> <IfModule mod_fcgid.c>
> <Directory /var/www>
> Options +ExecCGI
> AllowOverride All
> SetHandler fcgid-script
> FcgidWrapper "/usr/local/bin/radosgw -n client.radosgw.r-cephrgw01" .fcgi virtual
> Order allow,deny
> Allow from all
> AuthBasicAuthoritative Off
> </Directory>
> </IfModule>
> AllowEncodedSlashes On
> ServerSignature Off
> </VirtualHost>
>
>
> ceph.conf:
> [client.radosgw.r-cephrgw01]
> host = r-cephrgw01
> rgw_socket_path = /var/run/ceph/radosgw.sock
> keyring = /etc/ceph/keyring.radosgw.r-cephrgw01
> rgw_dns_name = r-cephrgw01
> log_file = /var/log/ceph/radosgw.log
> rgw_port = 88
> rgw_print_continue = false
> user = www-data
>
> radosgw.fcgi:
> #!/bin/sh
> exec /usr/local/bin/radosgw -c /etc/ceph/ceph.conf -n client.radosgw.r-cephrgw01
>
>
> User johndoe in radosgw:
> radosgw-admin user info --uid=johndoe
> { "user_id": "johndoe",
>   "display_name": "John Doe",
>   "email": "john@example.com",
>   "suspended": 0,
>   "max_buckets": 1000,
>   "auid": 0,
>   "subusers": [
>         { "id": "johndoe:swift",
>           "permissions": "full-control"}],
>   "keys": [
>         { "user": "johndoe",
>           "access_key": "s3johndoe",
>           "secret_key": "s3secret"}],
>   "swift_keys": [
>         { "user": "johndoe:swift",
>           "secret_key": "swsecret"}],
>   "caps": [],
>   "op_mask": "read, write, delete",
>   "default_placement": "",
>   "placement_tags": [],
>   "bucket_quota": { "enabled": false,
>       "max_size_kb": -1,
>       "max_objects": -1}}
>
>
> ceph auth list for radosgw client
> client.radosgw.r-cephrgw01
>         key: AQAvdwdTwMSvGxAAsctezTxARKVVq9sWsUmAPg==
>         caps: [mon] allow rw
>         caps: [osd] allow rwx
>
> - - - - - - - - - - - - - - - - -
> Ghislain Chevalier
> ORANGE/OLNC/OLPS/ASE/DAPI/CSE
> Storage Service Architect
>  +33299124432
> ghislain.chevalier@orange.com
>
> _________________________________________________________________________________________________________________________
>
> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or privileged information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
> Thank you.
>

_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: Issue with radosgw in Ubuntu 13.10/emperor/fcgid
  2014-03-13 16:48   ` ghislain.chevalier
@ 2014-03-13 17:09     ` Yehuda Sadeh
  2014-03-14 10:39       ` ghislain.chevalier
  0 siblings, 1 reply; 5+ messages in thread
From: Yehuda Sadeh @ 2014-03-13 17:09 UTC (permalink / raw)
  To: ghislain.chevalier; +Cc: ceph-devel

On Thu, Mar 13, 2014 at 9:48 AM,  <ghislain.chevalier@orange.com> wrote:
> Hi Yehuda,
>
> and thx for answering quickly...
>
> I suppose you want me to add --debug_ms 20 in the radosgw command.
> Was it right?

Nope. Just --debug-rgw=20.

> Or is it an entry (not documented) in the ceph.conf: rgw_debug = 20?
>
> I trapped some exchanges btw the rasdosgw server and all the osd servers but it's very verbose...
>
> 2014-03-13 17:02:38.625252 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x7f5f4c006230
> 2014-03-13 17:02:38.625257 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13efb00 10.194.182.58:6800/4728
> 2014-03-13 17:02:38.625264 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).discard_queue
> 2014-03-13 17:02:38.625273 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).unregister_pipe - not registered
> 2014-03-13 17:02:38.625282 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).join
> 2014-03-13 17:02:38.625299 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaped pipe 0x13efb00 10.194.182.58:6800/4728
> 2014-03-13 17:02:38.625308 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x13efb00
> 2014-03-13 17:02:38.625313 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13e44d0 10.194.182.43:6789/0
> 2014-03-13 17:02:38.625319 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).discard_queue
> 2014-03-13 17:02:38.625328 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).unregister_pipe - not registered
> 2014-03-13 17:02:38.625336 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).join
>
> The reason I'm using fcgid is that fastcgi is not available in Ubuntu 13.10 (maybe I'm wrong!!)
>

I don't think that's correct.

> What I didn't understand is
> why I got as many radosgw processes as launched http requests? socket issue?

Probably because apache wasn't able to communicate with the radosgw
process so it just spawned another process.

> why I got a script header error in the error.log meaning that the script is launched?

Because it could not communicate with the radosgw backend.

>
> I set the log level to debug in apache and I got
>
> [Thu Mar 13 17:15:56.071467 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of Require all granted: granted
> [Thu Mar 13 17:15:56.071558 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of <RequireAny>: granted
> [Thu Mar 13 17:15:56.072527 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: server r-cephrgw01:/usr/local/bin/radosgw(20415) started
> [Thu Mar 13 17:15:56.090184 2014] [fcgid:warn] [pid 20351:tid 140472486065920] (104)Connection reset by peer: [client 10.194.182.60:44440] mod_fcgid: error reading data from FastCGI server
> [Thu Mar 13 17:15:56.090247 2014] [core:error] [pid 20351:tid 140472486065920] [client 10.194.182.60:44440] End of script output before headers: radosgw.fcgi
> [Thu Mar 13 17:16:02.078648 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: process /usr/local/bin/radosgw(20415) exit(communication error), terminated by calling exit(), return code: 0
>
> Best Regards
>
>
> -----Message d'origine-----
> De : Yehuda Sadeh [mailto:yehuda@inktank.com]
> Envoyé : jeudi 13 mars 2014 16:19
> À : CHEVALIER Ghislain IMT/OLPS
> Cc : ceph-devel@vger.kernel.org
> Objet : Re: [Ceph-devel] Issue with radosgw in Ubuntu 13.10/emperor/fcgid
>
> On Thu, Mar 13, 2014 at 3:58 AM,  <ghislain.chevalier@orange.com> wrote:
>>
>> Hi All,
>>
>> I currently try to install a radosgw/emperor on a dedicated server under Ubuntu 13.10
>> This server is an exception in the cluster which is in Emperor under Ubuntu 12.04 LTS
>>
>> The apache2 and radosgw installation seem to be correct; I created a S3 user with a swift subuser but I get an error 500 trying to use it.
>> I use fcgid module instead of fastcgi and so the configuration is quite different.
>> FYI : I installed a radosgw/dumpling/fastcgi on another platform and it works well !!
>>
>> In radosgw log, I got no errors.
>> In apache2 error log, I got
>> [Thu Mar 13 11:38:15.584859 2014] [fcgid:warn] [pid 15279:tid 140016017676032] (104)Connection reset by peer: [client 10.194.182.60:43871] mod_fcgid: error reading data from FastCGI server
>> [Thu Mar 13 11:38:15.584953 2014] [core:error] [pid 15279:tid 140016017676032] [client 10.194.182.60:43871] End of script output before headers: radosgw.fcgi
>>
>> I noticed that a radosgw script is launched at every http request...
>
> Yeah, that  could be one of the issues with fcgid, not sure if there's
> a way to tell it to just be static (as we do with mod_fastcgi), any
> reason why you're using fcgid?
>
> A 500 response usually means that apache was not able to communicate
> with the radosgw backend. Not sure what the issue with your config, it
> has been a while since I configured fcgid. Try bumping up the radosgw
> logs (debug rgw = 20) to see if the requests do get there or not.
>
>
> Yehuda
>
>> I hope someone will find what is wrong in my configuration!!!
>>
>> Here are my configuration files.
>>
>> rgw.conf:
>> <VirtualHost *:88>
>> ServerName  r-cephrgw01
>> DocumentRoot /var/www
>> <IfModule mod_rewrite.c>
>> RewriteEngine On
>> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) /radosgw.fcgi?page=$1&params=$2&%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>> </IfModule>
>> <IfModule mod_fcgid.c>
>> <Directory /var/www>
>> Options +ExecCGI
>> AllowOverride All
>> SetHandler fcgid-script
>> FcgidWrapper "/usr/local/bin/radosgw -n client.radosgw.r-cephrgw01" .fcgi virtual
>> Order allow,deny
>> Allow from all
>> AuthBasicAuthoritative Off
>> </Directory>
>> </IfModule>
>> AllowEncodedSlashes On
>> ServerSignature Off
>> </VirtualHost>
>>
>>
>> ceph.conf:
>> [client.radosgw.r-cephrgw01]
>> host = r-cephrgw01
>> rgw_socket_path = /var/run/ceph/radosgw.sock
>> keyring = /etc/ceph/keyring.radosgw.r-cephrgw01
>> rgw_dns_name = r-cephrgw01
>> log_file = /var/log/ceph/radosgw.log
>> rgw_port = 88
>> rgw_print_continue = false
>> user = www-data
>>
>> radosgw.fcgi:
>> #!/bin/sh
>> exec /usr/local/bin/radosgw -c /etc/ceph/ceph.conf -n client.radosgw.r-cephrgw01
>>
>>
>> User johndoe in radosgw:
>> radosgw-admin user info --uid=johndoe
>> { "user_id": "johndoe",
>>   "display_name": "John Doe",
>>   "email": "john@example.com",
>>   "suspended": 0,
>>   "max_buckets": 1000,
>>   "auid": 0,
>>   "subusers": [
>>         { "id": "johndoe:swift",
>>           "permissions": "full-control"}],
>>   "keys": [
>>         { "user": "johndoe",
>>           "access_key": "s3johndoe",
>>           "secret_key": "s3secret"}],
>>   "swift_keys": [
>>         { "user": "johndoe:swift",
>>           "secret_key": "swsecret"}],
>>   "caps": [],
>>   "op_mask": "read, write, delete",
>>   "default_placement": "",
>>   "placement_tags": [],
>>   "bucket_quota": { "enabled": false,
>>       "max_size_kb": -1,
>>       "max_objects": -1}}
>>
>>
>> ceph auth list for radosgw client
>> client.radosgw.r-cephrgw01
>>         key: AQAvdwdTwMSvGxAAsctezTxARKVVq9sWsUmAPg==
>>         caps: [mon] allow rw
>>         caps: [osd] allow rwx
>>
>> - - - - - - - - - - - - - - - - -
>> Ghislain Chevalier
>> ORANGE/OLNC/OLPS/ASE/DAPI/CSE
>> Storage Service Architect
>>  +33299124432
>> ghislain.chevalier@orange.com
>>
>> _________________________________________________________________________________________________________________________
>>
>> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
>> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
>> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
>> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>>
>> This message and its attachments may contain confidential or privileged information that may be protected by law;
>> they should not be distributed, used or copied without authorisation.
>> If you have received this email in error, please notify the sender and delete this message and its attachments.
>> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
>> Thank you.
>>
>
> _________________________________________________________________________________________________________________________
>
> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or privileged information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
> Thank you.
>
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 5+ messages in thread

* RE: Issue with radosgw in Ubuntu 13.10/emperor/fcgid
  2014-03-13 17:09     ` Yehuda Sadeh
@ 2014-03-14 10:39       ` ghislain.chevalier
  0 siblings, 0 replies; 5+ messages in thread
From: ghislain.chevalier @ 2014-03-14 10:39 UTC (permalink / raw)
  To: Yehuda Sadeh; +Cc: ceph-devel

Hi,

I set the --debug-rgw=20 parameter and it shows that the log is
2014-03-13 18:11:58.748840 7f24475d17c0  0 ceph version 0.72.2 (a913ded2ff138aefb8cb84d347d72164099cfd60), process radosgw, pid 20791
2014-03-13 18:11:58.765029 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:11:58.766251 7f24475d17c0 20 get_obj_state: rctx=0x146eb10 obj=.rgw.root:default.region state=0x14724a8 s->prefetch_data=0
2014-03-13 18:11:58.766305 7f24475d17c0 10 cache get: name=.rgw.root+default.region : miss
2014-03-13 18:11:58.769856 7f24475d17c0 10 cache put: name=.rgw.root+default.region
2014-03-13 18:11:58.769889 7f24475d17c0 10 adding .rgw.root+default.region to cache LRU end
2014-03-13 18:11:58.769904 7f24475d17c0 20 get_obj_state: s->obj_tag was set empty
2014-03-13 18:11:58.769923 7f24475d17c0 10 moving .rgw.root+default.region to cache LRU end
2014-03-13 18:11:58.769931 7f24475d17c0 10 cache get: name=.rgw.root+default.region : type miss (requested=1, cached=6)
2014-03-13 18:11:58.769946 7f24475d17c0 20 get_obj_state: rctx=0x146eb10 obj=.rgw.root:default.region state=0x1476698 s->prefetch_data=0
2014-03-13 18:11:58.769955 7f24475d17c0 10 moving .rgw.root+default.region to cache LRU end
2014-03-13 18:11:58.769957 7f24475d17c0 10 cache get: name=.rgw.root+default.region : hit
2014-03-13 18:11:58.769963 7f24475d17c0 20 get_obj_state: s->obj_tag was set empty
2014-03-13 18:11:58.769970 7f24475d17c0 20 get_obj_state: rctx=0x146eb10 obj=.rgw.root:default.region state=0x1476698 s->prefetch_data=0
2014-03-13 18:11:58.769973 7f24475d17c0 20 state for obj=.rgw.root:default.region is not atomic, not appending atomic test
2014-03-13 18:11:58.769976 7f24475d17c0 20 rados->read obj-ofs=0 read_ofs=0 read_len=524288
2014-03-13 18:11:58.771629 7f24475d17c0 20 rados->read r=0 bl.length=17
2014-03-13 18:11:58.771692 7f24475d17c0 10 cache put: name=.rgw.root+default.region
2014-03-13 18:11:58.771696 7f24475d17c0 10 moving .rgw.root+default.region to cache LRU end
2014-03-13 18:11:58.771741 7f24475d17c0 20 get_obj_state: rctx=0x146eb10 obj=.rgw.root:region_info.default state=0x1477158 s->prefetch_data=0
2014-03-13 18:11:58.771754 7f24475d17c0 10 cache get: name=.rgw.root+region_info.default : miss
2014-03-13 18:11:58.773429 7f24475d17c0 10 cache put: name=.rgw.root+region_info.default
2014-03-13 18:11:58.773451 7f24475d17c0 10 adding .rgw.root+region_info.default to cache LRU end
2014-03-13 18:11:58.773461 7f24475d17c0 20 get_obj_state: s->obj_tag was set empty
2014-03-13 18:11:58.773473 7f24475d17c0 10 moving .rgw.root+region_info.default to cache LRU end
2014-03-13 18:11:58.773476 7f24475d17c0 10 cache get: name=.rgw.root+region_info.default : type miss (requested=1, cached=6)
2014-03-13 18:11:58.773487 7f24475d17c0 20 get_obj_state: rctx=0x146eb10 obj=.rgw.root:region_info.default state=0x1477158 s->prefetch_data=0
2014-03-13 18:11:58.773494 7f24475d17c0 10 moving .rgw.root+region_info.default to cache LRU end
2014-03-13 18:11:58.773496 7f24475d17c0 10 cache get: name=.rgw.root+region_info.default : hit
2014-03-13 18:11:58.773502 7f24475d17c0 20 get_obj_state: s->obj_tag was set empty
2014-03-13 18:11:58.773505 7f24475d17c0 20 get_obj_state: rctx=0x146eb10 obj=.rgw.root:region_info.default state=0x1477158 s->prefetch_data=0
2014-03-13 18:11:58.773509 7f24475d17c0 20 state for obj=.rgw.root:region_info.default is not atomic, not appending atomic test
2014-03-13 18:11:58.773513 7f24475d17c0 20 rados->read obj-ofs=0 read_ofs=0 read_len=524288
2014-03-13 18:11:58.774936 7f24475d17c0 20 rados->read r=0 bl.length=145
2014-03-13 18:11:58.774993 7f24475d17c0 10 cache put: name=.rgw.root+region_info.default
2014-03-13 18:11:58.774997 7f24475d17c0 10 moving .rgw.root+region_info.default to cache LRU end
2014-03-13 18:11:58.775068 7f24475d17c0 20 get_obj_state: rctx=0x1477290 obj=.rgw.root:zone_info.default state=0x1479788 s->prefetch_data=0
2014-03-13 18:11:58.775081 7f24475d17c0 10 cache get: name=.rgw.root+zone_info.default : miss
2014-03-13 18:11:58.778538 7f24475d17c0 10 cache put: name=.rgw.root+zone_info.default
2014-03-13 18:11:58.778561 7f24475d17c0 10 adding .rgw.root+zone_info.default to cache LRU end
2014-03-13 18:11:58.778570 7f24475d17c0 20 get_obj_state: s->obj_tag was set empty
2014-03-13 18:11:58.778582 7f24475d17c0 10 moving .rgw.root+zone_info.default to cache LRU end
2014-03-13 18:11:58.778585 7f24475d17c0 10 cache get: name=.rgw.root+zone_info.default : type miss (requested=1, cached=6)
2014-03-13 18:11:58.778594 7f24475d17c0 20 get_obj_state: rctx=0x1477290 obj=.rgw.root:zone_info.default state=0x147b088 s->prefetch_data=0
2014-03-13 18:11:58.778602 7f24475d17c0 10 moving .rgw.root+zone_info.default to cache LRU end
2014-03-13 18:11:58.778604 7f24475d17c0 10 cache get: name=.rgw.root+zone_info.default : hit
2014-03-13 18:11:58.778610 7f24475d17c0 20 get_obj_state: s->obj_tag was set empty
2014-03-13 18:11:58.778624 7f24475d17c0 20 get_obj_state: rctx=0x1477290 obj=.rgw.root:zone_info.default state=0x147b088 s->prefetch_data=0
2014-03-13 18:11:58.778628 7f24475d17c0 20 state for obj=.rgw.root:zone_info.default is not atomic, not appending atomic test
2014-03-13 18:11:58.778631 7f24475d17c0 20 rados->read obj-ofs=0 read_ofs=0 read_len=524288
2014-03-13 18:11:58.780169 7f24475d17c0 20 rados->read r=0 bl.length=616
2014-03-13 18:11:58.780223 7f24475d17c0 10 cache put: name=.rgw.root+zone_info.default
2014-03-13 18:11:58.780228 7f24475d17c0 10 moving .rgw.root+zone_info.default to cache LRU end
2014-03-13 18:11:58.780274 7f24475d17c0  2 zone default is master
2014-03-13 18:11:58.780307 7f24475d17c0 20 get_obj_state: rctx=0x147c630 obj=.rgw.root:region_map state=0x147cc18 s->prefetch_data=0
2014-03-13 18:11:58.780319 7f24475d17c0 10 cache get: name=.rgw.root+region_map : miss
2014-03-13 18:11:58.781868 7f24475d17c0 10 cache put: name=.rgw.root+region_map
2014-03-13 18:11:58.781893 7f24475d17c0 10 adding .rgw.root+region_map to cache LRU end
2014-03-13 18:11:58.905504 7f2434ff2700  2 garbage collection: start
2014-03-13 18:11:58.909290 7f24475d17c0 10 allocated request req=0x148f620
2014-03-13 18:11:59.467781 7f2434ff2700  2 garbage collection: stop
2014-03-13 18:12:20.765198 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:12:42.765317 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:13:04.765448 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:13:26.765544 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:13:48.765675 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:14:10.765799 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:14:32.765916 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:14:54.766026 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:15:16.766115 7f2435ffb700  2 RGWDataChangesLog::ChangesRenewThread: start
2014-03-13 18:15:30.304899 7f23f7fff700  1 handle_sigterm
2014-03-13 18:15:30.304968 7f23f7fff700  1 handle_sigterm set alarm for 120
2014-03-13 18:15:30.304999 7f23f7fff700  1 handle_sigterm
2014-03-13 18:15:30.305111 7f24475d17c0  0 ERROR: FCGX_Accept_r returned -4
2014-03-13 18:15:30.312083 7f24475d17c0 -1 shutting down
2014-03-13 18:15:30.485996 7f24475d17c0  1 final shutdown

But there is nothing logged when I send a http request..
I agree that it's a communication issue btw apache/fcgi and the radosgw process

So I decided to remove apache2 from the server and to reinstall it with fastcgi.

AND IT WORKS for swift and s3 requests.

Thx a lot for your support...

-----Message d'origine-----
De : Yehuda Sadeh [mailto:yehuda@inktank.com] 
Envoyé : jeudi 13 mars 2014 18:09
À : CHEVALIER Ghislain IMT/OLPS
Cc : ceph-devel@vger.kernel.org
Objet : Re: [Ceph-devel] Issue with radosgw in Ubuntu 13.10/emperor/fcgid

On Thu, Mar 13, 2014 at 9:48 AM,  <ghislain.chevalier@orange.com> wrote:
> Hi Yehuda,
>
> and thx for answering quickly...
>
> I suppose you want me to add --debug_ms 20 in the radosgw command.
> Was it right?

Nope. Just --debug-rgw=20.

> Or is it an entry (not documented) in the ceph.conf: rgw_debug = 20?
>
> I trapped some exchanges btw the rasdosgw server and all the osd servers but it's very verbose...
>
> 2014-03-13 17:02:38.625252 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x7f5f4c006230
> 2014-03-13 17:02:38.625257 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13efb00 10.194.182.58:6800/4728
> 2014-03-13 17:02:38.625264 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).discard_queue
> 2014-03-13 17:02:38.625273 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).unregister_pipe - not registered
> 2014-03-13 17:02:38.625282 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.58:6800/4728 pipe(0x13efb00 sd=13 :36491 s=4 pgs=132 cs=1 l=1 c=0x13ef580).join
> 2014-03-13 17:02:38.625299 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaped pipe 0x13efb00 10.194.182.58:6800/4728
> 2014-03-13 17:02:38.625308 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper deleted pipe 0x13efb00
> 2014-03-13 17:02:38.625313 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 reaper reaping pipe 0x13e44d0 10.194.182.43:6789/0
> 2014-03-13 17:02:38.625319 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).discard_queue
> 2014-03-13 17:02:38.625328 7f5fa96177c0 10 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).unregister_pipe - not registered
> 2014-03-13 17:02:38.625336 7f5fa96177c0 20 -- 10.194.182.60:0/1019860 >> 10.194.182.43:6789/0 pipe(0x13e44d0 sd=9 :60694 s=4 pgs=165 cs=1 l=1 c=0x13e4730).join
>
> The reason I'm using fcgid is that fastcgi is not available in Ubuntu 13.10 (maybe I'm wrong!!)
>

I don't think that's correct.

> What I didn't understand is
> why I got as many radosgw processes as launched http requests? socket issue?

Probably because apache wasn't able to communicate with the radosgw
process so it just spawned another process.

> why I got a script header error in the error.log meaning that the script is launched?

Because it could not communicate with the radosgw backend.

>
> I set the log level to debug in apache and I got
>
> [Thu Mar 13 17:15:56.071467 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of Require all granted: granted
> [Thu Mar 13 17:15:56.071558 2014] [authz_core:debug] [pid 20351:tid 140472486065920] mod_authz_core.c(802): [client 10.194.182.60:44440] AH01626: authorization result of <RequireAny>: granted
> [Thu Mar 13 17:15:56.072527 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: server r-cephrgw01:/usr/local/bin/radosgw(20415) started
> [Thu Mar 13 17:15:56.090184 2014] [fcgid:warn] [pid 20351:tid 140472486065920] (104)Connection reset by peer: [client 10.194.182.60:44440] mod_fcgid: error reading data from FastCGI server
> [Thu Mar 13 17:15:56.090247 2014] [core:error] [pid 20351:tid 140472486065920] [client 10.194.182.60:44440] End of script output before headers: radosgw.fcgi
> [Thu Mar 13 17:16:02.078648 2014] [fcgid:info] [pid 20350:tid 140472580695936] mod_fcgid: process /usr/local/bin/radosgw(20415) exit(communication error), terminated by calling exit(), return code: 0
>
> Best Regards
>
>
> -----Message d'origine-----
> De : Yehuda Sadeh [mailto:yehuda@inktank.com]
> Envoyé : jeudi 13 mars 2014 16:19
> À : CHEVALIER Ghislain IMT/OLPS
> Cc : ceph-devel@vger.kernel.org
> Objet : Re: [Ceph-devel] Issue with radosgw in Ubuntu 13.10/emperor/fcgid
>
> On Thu, Mar 13, 2014 at 3:58 AM,  <ghislain.chevalier@orange.com> wrote:
>>
>> Hi All,
>>
>> I currently try to install a radosgw/emperor on a dedicated server under Ubuntu 13.10
>> This server is an exception in the cluster which is in Emperor under Ubuntu 12.04 LTS
>>
>> The apache2 and radosgw installation seem to be correct; I created a S3 user with a swift subuser but I get an error 500 trying to use it.
>> I use fcgid module instead of fastcgi and so the configuration is quite different.
>> FYI : I installed a radosgw/dumpling/fastcgi on another platform and it works well !!
>>
>> In radosgw log, I got no errors.
>> In apache2 error log, I got
>> [Thu Mar 13 11:38:15.584859 2014] [fcgid:warn] [pid 15279:tid 140016017676032] (104)Connection reset by peer: [client 10.194.182.60:43871] mod_fcgid: error reading data from FastCGI server
>> [Thu Mar 13 11:38:15.584953 2014] [core:error] [pid 15279:tid 140016017676032] [client 10.194.182.60:43871] End of script output before headers: radosgw.fcgi
>>
>> I noticed that a radosgw script is launched at every http request...
>
> Yeah, that  could be one of the issues with fcgid, not sure if there's
> a way to tell it to just be static (as we do with mod_fastcgi), any
> reason why you're using fcgid?
>
> A 500 response usually means that apache was not able to communicate
> with the radosgw backend. Not sure what the issue with your config, it
> has been a while since I configured fcgid. Try bumping up the radosgw
> logs (debug rgw = 20) to see if the requests do get there or not.
>
>
> Yehuda
>
>> I hope someone will find what is wrong in my configuration!!!
>>
>> Here are my configuration files.
>>
>> rgw.conf:
>> <VirtualHost *:88>
>> ServerName  r-cephrgw01
>> DocumentRoot /var/www
>> <IfModule mod_rewrite.c>
>> RewriteEngine On
>> RewriteRule ^/([a-zA-Z0-9-_.]*)([/]?.*) /radosgw.fcgi?page=$1&params=$2&%{QUERY_STRING} [E=HTTP_AUTHORIZATION:%{HTTP:Authorization},L]
>> </IfModule>
>> <IfModule mod_fcgid.c>
>> <Directory /var/www>
>> Options +ExecCGI
>> AllowOverride All
>> SetHandler fcgid-script
>> FcgidWrapper "/usr/local/bin/radosgw -n client.radosgw.r-cephrgw01" .fcgi virtual
>> Order allow,deny
>> Allow from all
>> AuthBasicAuthoritative Off
>> </Directory>
>> </IfModule>
>> AllowEncodedSlashes On
>> ServerSignature Off
>> </VirtualHost>
>>
>>
>> ceph.conf:
>> [client.radosgw.r-cephrgw01]
>> host = r-cephrgw01
>> rgw_socket_path = /var/run/ceph/radosgw.sock
>> keyring = /etc/ceph/keyring.radosgw.r-cephrgw01
>> rgw_dns_name = r-cephrgw01
>> log_file = /var/log/ceph/radosgw.log
>> rgw_port = 88
>> rgw_print_continue = false
>> user = www-data
>>
>> radosgw.fcgi:
>> #!/bin/sh
>> exec /usr/local/bin/radosgw -c /etc/ceph/ceph.conf -n client.radosgw.r-cephrgw01
>>
>>
>> User johndoe in radosgw:
>> radosgw-admin user info --uid=johndoe
>> { "user_id": "johndoe",
>>   "display_name": "John Doe",
>>   "email": "john@example.com",
>>   "suspended": 0,
>>   "max_buckets": 1000,
>>   "auid": 0,
>>   "subusers": [
>>         { "id": "johndoe:swift",
>>           "permissions": "full-control"}],
>>   "keys": [
>>         { "user": "johndoe",
>>           "access_key": "s3johndoe",
>>           "secret_key": "s3secret"}],
>>   "swift_keys": [
>>         { "user": "johndoe:swift",
>>           "secret_key": "swsecret"}],
>>   "caps": [],
>>   "op_mask": "read, write, delete",
>>   "default_placement": "",
>>   "placement_tags": [],
>>   "bucket_quota": { "enabled": false,
>>       "max_size_kb": -1,
>>       "max_objects": -1}}
>>
>>
>> ceph auth list for radosgw client
>> client.radosgw.r-cephrgw01
>>         key: AQAvdwdTwMSvGxAAsctezTxARKVVq9sWsUmAPg==
>>         caps: [mon] allow rw
>>         caps: [osd] allow rwx
>>
>> - - - - - - - - - - - - - - - - -
>> Ghislain Chevalier
>> ORANGE/OLNC/OLPS/ASE/DAPI/CSE
>> Storage Service Architect
>>  +33299124432
>> ghislain.chevalier@orange.com
>>
>> _________________________________________________________________________________________________________________________
>>
>> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
>> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
>> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
>> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>>
>> This message and its attachments may contain confidential or privileged information that may be protected by law;
>> they should not be distributed, used or copied without authorisation.
>> If you have received this email in error, please notify the sender and delete this message and its attachments.
>> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
>> Thank you.
>>
>
> _________________________________________________________________________________________________________________________
>
> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or privileged information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
> Thank you.
>

_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2014-03-14 10:39 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2014-03-13 10:58 Issue with radosgw in Ubuntu 13.10/emperor/fcgid ghislain.chevalier
2014-03-13 15:19 ` Yehuda Sadeh
2014-03-13 16:48   ` ghislain.chevalier
2014-03-13 17:09     ` Yehuda Sadeh
2014-03-14 10:39       ` ghislain.chevalier

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.