[Pacemaker] gfs2

bunkertor bunkertor at tiscali.it
Mon Aug 9 12:43:56 EDT 2010

hi to all!
i have some problems with cluster and gfs2 mounting on iscsi devices.
i followed this guide 
"http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" with some 
changes depending on my envoironment; so the cluster should connect to 
iscsi portal, start dlm_controld(.pcmk) and gfs_controld(.pcmk) and 
mount gfs2 partitions on both nodes.
but when cluster tries to mount gfs2 partition on both nodes, i got an 
error in corosync.log, like this:

Aug 09 17:30:57 tromso lrmd: [7495]: info: RA output: 
(dlm:1:start:stderr) dlm_controld.pcmk: no process found
Aug 09 17:30:58 tromso lrmd: [7495]: info: RA output: 
(gfs2FS:0:start:stderr) error mounting /dev/sda on /mnt/fs-cl00: No such 
file or directory

in dmesg:
[14000.428842] GFS2: can't find protocol lock_dlm

but dlm_controld.pcmk is up and running
tromso:/etc/corosync # ps -eaf | grep pcmk
root      7699     1  0 17:30 ?        00:00:00 dlm_controld.pcmk -q 0
root      7704     1  0 17:30 ?        00:00:00 gfs_controld.pcmk -g 0

and mount point exists
tromso:/etc/corosync # ls -l /mnt/
total 4
drwxr-xr-x 2 root root 4096 Aug  9 11:41 fs-cl00

in gfs_controld it logs this error aswell:

Aug 09 17:36:01 gfs_controld mount_done: fscl not found
Aug 09 17:36:01 gfs_controld do_leave: fscl not found

iscsi, dlm and gfs2 control clones work fine.

when i try to mount partition manually i have this output: [where 
gfs2-cluster in clustername in corosync.conf and fscl is the name of 2 

tromso:/etc/corosync # mount -t gfs2 /dev/sda /mnt/fs-cl00 -o 
locktable=gfs2-cluster:fscl,lockproto=lock_dlm -vv
mount /dev/sda /mnt/fs-cl00
parse_opts: opts = "rw,locktable=gfs2-cluster:fscl,lockproto=lock_dlm"
   clear flag 1 for "rw", flags = 0
   add extra locktable=gfs2-cluster:fscl
   add extra lockproto=lock_dlm
parse_opts: flags = 0
parse_opts: extra = "locktable=gfs2-cluster:fscl,lockproto=lock_dlm"
parse_opts: hostdata = ""
parse_opts: lockproto = "lock_dlm"
parse_opts: locktable = "gfs2-cluster:fscl"
lock_dlm_join: hostdata: "hostdata=jid=0:id=382599105:first=1"
mount(2) failed error -1 errno 2
error mounting /dev/sda on /mnt/fs-cl00: No such file or directory


tromso:/etc/corosync # gfs2_tool sb /dev/sda table
current lock table name = "gfs2-cluster:fscl"
tromso:/etc/corosync # gfs2_tool sb /dev/sda proto
current lock protocol name = "lock_dlm"

i cannot see where i make mistakes, so i'm here to ask help =)

here my cluster configuration:
tromso:/etc/corosync # crm configure show
node oslo
node tromso
primitive Cluster-IP ocf:heartbeat:IPaddr2 \
         params ip="" cidr_netmask="32" \
         op monitor interval="30s"
primitive dlm ocf:pacemaker:controld \
         op monitor interval="120s"
primitive gfs-control ocf:pacemaker:controld \
         op monitor interval="120s"
primitive gfs2FS ocf:heartbeat:Filesystem \
         params device="/dev/sda" directory="/mnt/fs-cl00" fstype="gfs2"
primitive iscsi ocf:heartbeat:iscsi \
         params iscsiadm="/sbin/iscsiadm" 
clone dlm-clone dlm \
         meta interleave="true"
clone gfs-clone gfs-control \
         meta interleave="true"
clone gfs2FS-clone gfs2FS \
         meta interleave="true"
clone iscsi-clone iscsi \
         meta interleave="true"
colocation c_gfs2 inf: gfs2FS-clone ( gfs-clone dlm-clone ) iscsi-clone
order o_gfs2 inf: iscsi-clone ( dlm-clone gfs-clone ) gfs2FS-clone
property $id="cib-bootstrap-options" \
         dc-version="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" \
         cluster-infrastructure="openais" \
         expected-quorum-votes="2" \
         stonith-enabled="false" \
         no-quorum-policy="ignore" \

output of monitoring:
Last updated: Mon Aug  9 18:11:20 2010
Stack: openais
Current DC: oslo - partition with quorum
Version: 1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b
2 Nodes configured, 2 expected votes
5 Resources configured.

Online: [ oslo tromso ]

Cluster-IP      (ocf::heartbeat:IPaddr2):       Started oslo
  Clone Set: iscsi-clone
      Started: [ oslo tromso ]
  Clone Set: dlm-clone
      Started: [ oslo tromso ]
  Clone Set: gfs-clone
      Started: [ oslo tromso ]

Failed actions:
     gfs2FS:0_start_0 (node=oslo, call=14, rc=1, status=complete): 
unknown error
     gfs2FS:0_start_0 (node=tromso, call=12, rc=1, status=complete): 
unknown error

and versions of components (all sw manually installed)

tromso:/etc/corosync # dlm_controld.pcmk -V
dlm_controld 3.0.14 (built Aug  4 2010 23:13:16)
Copyright (C) Red Hat, Inc.  2004-2010  All rights reserved.
tromso:/etc/corosync # gfs_controld.pcmk -V
gfs_controld 3.0.14 (built Aug  4 2010 23:13:35)
Copyright (C) Red Hat, Inc.  2004-2010  All rights reserved.
tromso:/etc/corosync # corosync -v
Corosync Cluster Engine, version '1.2.7' SVN revision '3013'
Copyright (c) 2006-2009 Red Hat, Inc.

this is kernel...
Linux version 2.6.34-12-xen (geeko at buildhost) (gcc version 4.5.0 
20100604 [gcc-4_5-branch revision 160292] (SUSE Linux) ).

i'm not a guru and this installation is only for learning so be patient, 
and sorry for my poor english.
thank to all in advance and nice regards.

PS: i hope this is the right place to post my question, if not please 
let me know.

More information about the Pacemaker mailing list