* [Ocfs2-devel] Adding new node to an online OCFS2 cluster
@ 2017-11-09 10:56 BASSAGET Cédric
2017-11-09 11:54 ` Joseph Qi
2017-11-09 12:36 ` Eric Ren
0 siblings, 2 replies; 5+ messages in thread
From: BASSAGET Cédric @ 2017-11-09 10:56 UTC (permalink / raw)
To: ocfs2-devel
Hello,
As I did not get help on users mailing list, I allow myself to post my
question here. Sorry if it's not the right place, but I can't find any
documentation.
I'm currently running an OCFS2 cluster on two hosts.
My ocfs2 partition is an iscsi disk mounted on both hosts debian1 and
debian2
I need to add a third host (debian3) to this cluster.
I've set up iscsi (& multipath), but now I'm looking for the correct way
to add the ocfs2 partition to my existing cluster.
root at debian1:~# cat /etc/ocfs2/cluster.conf
node:
ip_port = 7777
ip_address = 192.168.0.11
number = 0
name = debian1
cluster = ocfs2
node:
ip_port = 7777
ip_address = 192.168.0.12
number = 1
name = debian2
cluster = ocfs2
cluster:
node_count = 2
name = ocfs2
Same config on debian2.
I try to add the new node to the cluster, running this command on nodes
debian1 et debian2 :
root at debian1:~# o2cb_ctl -C -i -n debian3 -t node -a number=2 -a
ip_address=192.168.0.13 -a ip_port=7777 -a cluster=ocfs2
my new node is added to the config file, and node_count is incremented to 3.
then I do a "systemctl reload ocfs2" on debian1 and debian2.
I copy the cluster.conf file on debian3 and restart ocfs2 on it.
and in dmesg, I get :
[ 145.582469] o2net: Connected to node debian2 (num 1) at 192.168.0.12:7777
[ 145.582978] o2net: Connected to node debian1 (num 0) at 192.168.0.11:7777
[ 149.631921] o2dlm: Joining domain D2A1F74976E04C55B625CDC8DAC1D5E5
[ 149.631922] (
[ 149.631923] 0
[ 149.631924] 1
[ 149.631924] 2
[ 149.631925] ) 3 nodes
[ 149.634255] (mount.ocfs2,1627,0):ocfs2_find_slot:490 *ERROR: no free
slots available!*
[ 149.634784] (mount.ocfs2,1627,0):ocfs2_mount_volume:1859 ERROR: status =
-22
[ 153.738044] o2dlm: Leaving domain D2A1F74976E04C55B625CDC8DAC1D5E5
[ 153.738153] ocfs2: Unmounting device (254,0) on (node 2)
[ 153.738174] (mount.ocfs2,1627,0):ocfs2_fill_super:1218 ERROR: status =
-22
[ 155.657295] o2net: No longer connected to node debian1 (num 0) at
192.168.0.11:7777
[ 155.657387] o2net: No longer connected to node debian2 (num 1) at
192.168.0.12:7777
Can anyone tell me how I can add a slot, so my new node can work ?
Thanks for your help.
Regards,
C?dric
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-devel/attachments/20171109/720afa66/attachment.html
^ permalink raw reply [flat|nested] 5+ messages in thread
* [Ocfs2-devel] Adding new node to an online OCFS2 cluster
2017-11-09 10:56 [Ocfs2-devel] Adding new node to an online OCFS2 cluster BASSAGET Cédric
@ 2017-11-09 11:54 ` Joseph Qi
2017-11-09 13:04 ` BASSAGET Cédric
2017-11-09 12:36 ` Eric Ren
1 sibling, 1 reply; 5+ messages in thread
From: Joseph Qi @ 2017-11-09 11:54 UTC (permalink / raw)
To: ocfs2-devel
Hi C?dric,
I guess it is because your shared disk is formatted with only 2 slots.
You can check it using debugfs.ocfs2.
If it is, you may update slot count using tunefs.ocfs2 -N <num_of_slot>.
Hope it will help you.
Thanks,
Joseph
On 17/11/9 18:56, BASSAGET C?dric wrote:
> Hello,
> As I did not get help on users mailing list, I allow myself to post my
> question here. Sorry if it's not the right place, but I can't find any
> documentation.
>
> I'm currently running an OCFS2 cluster on two hosts.
> My ocfs2 partition is an iscsi disk mounted on both hosts debian1 and
> debian2
>
> I need to add a third host (debian3) to this cluster.
> I've set up iscsi (& multipath), but now I'm looking for the correct way
> to add the ocfs2 partition to my existing cluster.
>
> root at debian1:~# cat /etc/ocfs2/cluster.conf
> node:
> ip_port = 7777
> ip_address = 192.168.0.11
> number = 0
> name = debian1
> cluster = ocfs2
> node:
> ip_port = 7777
> ip_address = 192.168.0.12
> number = 1
> name = debian2
> cluster = ocfs2
> cluster:
> node_count = 2
> name = ocfs2
>
> Same config on debian2.
>
> I try to add the new node to the cluster, running this command on nodes
> debian1 et debian2 :
>
> root at debian1:~# o2cb_ctl -C -i -n debian3 -t node -a number=2 -a
> ip_address=192.168.0.13 -a ip_port=7777 -a cluster=ocfs2
>
> my new node is added to the config file, and node_count is incremented to 3.
>
> then I do a "systemctl reload ocfs2" on debian1 and debian2.
> I copy the cluster.conf file on debian3 and restart ocfs2 on it.
>
> and in dmesg, I get :
> [ 145.582469] o2net: Connected to node debian2 (num 1) at 192.168.0.12:7777
> [ 145.582978] o2net: Connected to node debian1 (num 0) at 192.168.0.11:7777
> [ 149.631921] o2dlm: Joining domain D2A1F74976E04C55B625CDC8DAC1D5E5
> [ 149.631922] (
> [ 149.631923] 0
> [ 149.631924] 1
> [ 149.631924] 2
> [ 149.631925] ) 3 nodes
> [ 149.634255] (mount.ocfs2,1627,0):ocfs2_find_slot:490 *ERROR: no free
> slots available!*
> [ 149.634784] (mount.ocfs2,1627,0):ocfs2_mount_volume:1859 ERROR: status =
> -22
> [ 153.738044] o2dlm: Leaving domain D2A1F74976E04C55B625CDC8DAC1D5E5
> [ 153.738153] ocfs2: Unmounting device (254,0) on (node 2)
> [ 153.738174] (mount.ocfs2,1627,0):ocfs2_fill_super:1218 ERROR: status =
> -22
> [ 155.657295] o2net: No longer connected to node debian1 (num 0) at
> 192.168.0.11:7777
> [ 155.657387] o2net: No longer connected to node debian2 (num 1) at
> 192.168.0.12:7777
>
>
> Can anyone tell me how I can add a slot, so my new node can work ?
>
> Thanks for your help.
> Regards,
> C?dric
>
>
>
> _______________________________________________
> Ocfs2-devel mailing list
> Ocfs2-devel at oss.oracle.com
> https://oss.oracle.com/mailman/listinfo/ocfs2-devel
>
^ permalink raw reply [flat|nested] 5+ messages in thread
* [Ocfs2-devel] Adding new node to an online OCFS2 cluster
2017-11-09 10:56 [Ocfs2-devel] Adding new node to an online OCFS2 cluster BASSAGET Cédric
2017-11-09 11:54 ` Joseph Qi
@ 2017-11-09 12:36 ` Eric Ren
1 sibling, 0 replies; 5+ messages in thread
From: Eric Ren @ 2017-11-09 12:36 UTC (permalink / raw)
To: ocfs2-devel
Hi,
On 11/09/2017 06:56 PM, BASSAGET C?dric wrote:
> Hello,
> As I did not get help on users mailing list, I allow myself to post my
> question here. Sorry if it's not the right place, but I can't find any
> documentation.
Not at all. Actually, other mail lists are under very low traffic now. I
think it's not bad to ask question on this devel list.
Eric
^ permalink raw reply [flat|nested] 5+ messages in thread
* [Ocfs2-devel] Adding new node to an online OCFS2 cluster
2017-11-09 11:54 ` Joseph Qi
@ 2017-11-09 13:04 ` BASSAGET Cédric
2017-11-10 2:31 ` alex chen
0 siblings, 1 reply; 5+ messages in thread
From: BASSAGET Cédric @ 2017-11-09 13:04 UTC (permalink / raw)
To: ocfs2-devel
Hi Joseph.
my shared disk is formatted with 2 slots :
root at debian2:~# debugfs.ocfs2 /dev/sdb -R stats | grep Slots
Max Node Slots: 2
I was hoping I can change it without unmounting my partition but it seems
not :
root at debian2:~# tunefs.ocfs2 -N 3 /dev/sdb
tunefs.ocfs2: Trylock failed while opening device "/dev/sdb"
C?dric
2017-11-09 12:54 GMT+01:00 Joseph Qi <jiangqi903@gmail.com>:
> Hi C?dric,
> I guess it is because your shared disk is formatted with only 2 slots.
> You can check it using debugfs.ocfs2.
> If it is, you may update slot count using tunefs.ocfs2 -N <num_of_slot>.
> Hope it will help you.
>
> Thanks,
> Joseph
>
> On 17/11/9 18:56, BASSAGET C?dric wrote:
> > Hello,
> > As I did not get help on users mailing list, I allow myself to post my
> > question here. Sorry if it's not the right place, but I can't find any
> > documentation.
> >
> > I'm currently running an OCFS2 cluster on two hosts.
> > My ocfs2 partition is an iscsi disk mounted on both hosts debian1 and
> > debian2
> >
> > I need to add a third host (debian3) to this cluster.
> > I've set up iscsi (& multipath), but now I'm looking for the correct way
> > to add the ocfs2 partition to my existing cluster.
> >
> > root at debian1:~# cat /etc/ocfs2/cluster.conf
> > node:
> > ip_port = 7777
> > ip_address = 192.168.0.11
> > number = 0
> > name = debian1
> > cluster = ocfs2
> > node:
> > ip_port = 7777
> > ip_address = 192.168.0.12
> > number = 1
> > name = debian2
> > cluster = ocfs2
> > cluster:
> > node_count = 2
> > name = ocfs2
> >
> > Same config on debian2.
> >
> > I try to add the new node to the cluster, running this command on nodes
> > debian1 et debian2 :
> >
> > root at debian1:~# o2cb_ctl -C -i -n debian3 -t node -a number=2 -a
> > ip_address=192.168.0.13 -a ip_port=7777 -a cluster=ocfs2
> >
> > my new node is added to the config file, and node_count is incremented
> to 3.
> >
> > then I do a "systemctl reload ocfs2" on debian1 and debian2.
> > I copy the cluster.conf file on debian3 and restart ocfs2 on it.
> >
> > and in dmesg, I get :
> > [ 145.582469] o2net: Connected to node debian2 (num 1) at
> 192.168.0.12:7777
> > [ 145.582978] o2net: Connected to node debian1 (num 0) at
> 192.168.0.11:7777
> > [ 149.631921] o2dlm: Joining domain D2A1F74976E04C55B625CDC8DAC1D5E5
> > [ 149.631922] (
> > [ 149.631923] 0
> > [ 149.631924] 1
> > [ 149.631924] 2
> > [ 149.631925] ) 3 nodes
> > [ 149.634255] (mount.ocfs2,1627,0):ocfs2_find_slot:490 *ERROR: no free
> > slots available!*
> > [ 149.634784] (mount.ocfs2,1627,0):ocfs2_mount_volume:1859 ERROR:
> status =
> > -22
> > [ 153.738044] o2dlm: Leaving domain D2A1F74976E04C55B625CDC8DAC1D5E5
> > [ 153.738153] ocfs2: Unmounting device (254,0) on (node 2)
> > [ 153.738174] (mount.ocfs2,1627,0):ocfs2_fill_super:1218 ERROR: status
> =
> > -22
> > [ 155.657295] o2net: No longer connected to node debian1 (num 0) at
> > 192.168.0.11:7777
> > [ 155.657387] o2net: No longer connected to node debian2 (num 1) at
> > 192.168.0.12:7777
> >
> >
> > Can anyone tell me how I can add a slot, so my new node can work ?
> >
> > Thanks for your help.
> > Regards,
> > C?dric
> >
> >
> >
> > _______________________________________________
> > Ocfs2-devel mailing list
> > Ocfs2-devel at oss.oracle.com
> > https://oss.oracle.com/mailman/listinfo/ocfs2-devel
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://oss.oracle.com/pipermail/ocfs2-devel/attachments/20171109/4cdf8254/attachment-0001.html
^ permalink raw reply [flat|nested] 5+ messages in thread
* [Ocfs2-devel] Adding new node to an online OCFS2 cluster
2017-11-09 13:04 ` BASSAGET Cédric
@ 2017-11-10 2:31 ` alex chen
0 siblings, 0 replies; 5+ messages in thread
From: alex chen @ 2017-11-10 2:31 UTC (permalink / raw)
To: ocfs2-devel
Hi C?dric,
Now we don't support change the slot number when the device is online.
you should umount the OCFS2 filesystem if you want to update the slot number.
Thanks,
Alex
On 2017/11/9 21:04, BASSAGET C?dric wrote:
> Hi Joseph.
> my shared disk is formatted with 2 slots :
> root at debian2:~# debugfs.ocfs2 /dev/sdb -R stats | grep Slots
> Max Node Slots: 2
>
> I was hoping I can change it without unmounting my partition but it seems not :
> root at debian2:~# tunefs.ocfs2 -N 3 /dev/sdb
> tunefs.ocfs2: Trylock failed while opening device "/dev/sdb"
>
> C?dric
>
>
> 2017-11-09 12:54 GMT+01:00 Joseph Qi <jiangqi903 at gmail.com <mailto:jiangqi903@gmail.com>>:
>
> Hi C?dric,
> I guess it is because your shared disk is formatted with only 2 slots.
> You can check it using debugfs.ocfs2.
> If it is, you may update slot count using tunefs.ocfs2 -N <num_of_slot>.
> Hope it will help you.
>
> Thanks,
> Joseph
>
> On 17/11/9 18:56, BASSAGET C?dric wrote:
> > Hello,
> > As I did not get help on users mailing list, I allow myself to post my
> > question here. Sorry if it's not the right place, but I can't find any
> > documentation.
> >
> > I'm currently running an OCFS2 cluster on two hosts.
> > My ocfs2 partition is an iscsi disk mounted on both hosts debian1 and
> > debian2
> >
> > I need to add a third host (debian3) to this cluster.
> > I've set up iscsi (& multipath), but now I'm looking for the correct way
> > to add the ocfs2 partition to my existing cluster.
> >
> > root at debian1:~# cat /etc/ocfs2/cluster.conf
> > node:
> > ip_port = 7777
> > ip_address = 192.168.0.11
> > number = 0
> > name = debian1
> > cluster = ocfs2
> > node:
> > ip_port = 7777
> > ip_address = 192.168.0.12
> > number = 1
> > name = debian2
> > cluster = ocfs2
> > cluster:
> > node_count = 2
> > name = ocfs2
> >
> > Same config on debian2.
> >
> > I try to add the new node to the cluster, running this command on nodes
> > debian1 et debian2 :
> >
> > root at debian1:~# o2cb_ctl -C -i -n debian3 -t node -a number=2 -a
> > ip_address=192.168.0.13 -a ip_port=7777 -a cluster=ocfs2
> >
> > my new node is added to the config file, and node_count is incremented to 3.
> >
> > then I do a "systemctl reload ocfs2" on debian1 and debian2.
> > I copy the cluster.conf file on debian3 and restart ocfs2 on it.
> >
> > and in dmesg, I get :
> > [ 145.582469] o2net: Connected to node debian2 (num 1) at 192.168.0.12:7777 <https://urldefense.proofpoint.com/v2/url?u=http-3A__192.168.0.12-3A7777&d=DwMFaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=C7gAd4uDxlAvTdc0vmU6X8CMk6L2iDY8-HD0qT6Fo7Y&m=2EscYgpUzamy6kXer3E9ni-s4QSmWNqUMBPuy0bdPUg&s=6GK0ClcSvN8cn-ZeNxir0kxLlGwKc83XFX77IRPtZcI&e=>
> > [ 145.582978] o2net: Connected to node debian1 (num 0) at 192.168.0.11:7777 <https://urldefense.proofpoint.com/v2/url?u=http-3A__192.168.0.11-3A7777&d=DwMFaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=C7gAd4uDxlAvTdc0vmU6X8CMk6L2iDY8-HD0qT6Fo7Y&m=2EscYgpUzamy6kXer3E9ni-s4QSmWNqUMBPuy0bdPUg&s=hM2TN0X94tyug5Xe3syHQDl6GCTBvQaetKLtWwdZq04&e=>
> > [ 149.631921] o2dlm: Joining domain D2A1F74976E04C55B625CDC8DAC1D5E5
> > [ 149.631922] (
> > [ 149.631923] 0
> > [ 149.631924] 1
> > [ 149.631924] 2
> > [ 149.631925] ) 3 nodes
> > [ 149.634255] (mount.ocfs2,1627,0):ocfs2_find_slot:490 *ERROR: no free
> > slots available!*
> > [ 149.634784] (mount.ocfs2,1627,0):ocfs2_mount_volume:1859 ERROR: status =
> > -22
> > [ 153.738044] o2dlm: Leaving domain D2A1F74976E04C55B625CDC8DAC1D5E5
> > [ 153.738153] ocfs2: Unmounting device (254,0) on (node 2)
> > [ 153.738174] (mount.ocfs2,1627,0):ocfs2_fill_super:1218 ERROR: status =
> > -22
> > [ 155.657295] o2net: No longer connected to node debian1 (num 0) at
> > 192.168.0.11:7777 <https://urldefense.proofpoint.com/v2/url?u=http-3A__192.168.0.11-3A7777&d=DwMFaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=C7gAd4uDxlAvTdc0vmU6X8CMk6L2iDY8-HD0qT6Fo7Y&m=2EscYgpUzamy6kXer3E9ni-s4QSmWNqUMBPuy0bdPUg&s=hM2TN0X94tyug5Xe3syHQDl6GCTBvQaetKLtWwdZq04&e=>
> > [ 155.657387] o2net: No longer connected to node debian2 (num 1) at
> > 192.168.0.12:7777 <https://urldefense.proofpoint.com/v2/url?u=http-3A__192.168.0.12-3A7777&d=DwMFaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=C7gAd4uDxlAvTdc0vmU6X8CMk6L2iDY8-HD0qT6Fo7Y&m=2EscYgpUzamy6kXer3E9ni-s4QSmWNqUMBPuy0bdPUg&s=6GK0ClcSvN8cn-ZeNxir0kxLlGwKc83XFX77IRPtZcI&e=>
> >
> >
> > Can anyone tell me how I can add a slot, so my new node can work ?
> >
> > Thanks for your help.
> > Regards,
> > C?dric
> >
> >
> >
> > _______________________________________________
> > Ocfs2-devel mailing list
> > Ocfs2-devel at oss.oracle.com <mailto:Ocfs2-devel@oss.oracle.com>
> > https://oss.oracle.com/mailman/listinfo/ocfs2-devel <https://oss.oracle.com/mailman/listinfo/ocfs2-devel>
> >
>
>
>
>
> _______________________________________________
> Ocfs2-devel mailing list
> Ocfs2-devel at oss.oracle.com
> https://oss.oracle.com/mailman/listinfo/ocfs2-devel
>
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2017-11-10 2:31 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-11-09 10:56 [Ocfs2-devel] Adding new node to an online OCFS2 cluster BASSAGET Cédric
2017-11-09 11:54 ` Joseph Qi
2017-11-09 13:04 ` BASSAGET Cédric
2017-11-10 2:31 ` alex chen
2017-11-09 12:36 ` Eric Ren
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.