<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 10pt;
font-family:Verdana
}
--></style>
</head>
<body class='hmmessage'>
I haven't been able to find any documentation outside of the man pages to help troubleshoot this, so I've come to the experts...<br><br>I'm attempting to setup the following:<br><br><font style="" face="Courier New">Services: NFS and Samba</font><font style="" face="Courier New"><br></font><font style="" face="Courier New"> -------------</font><font style="" face="Courier New">-----------<br></font><font style="" face="Courier New">Filesystems: /mnt/media | /mnt/datusr</font><font style="" face="Courier New"><br></font><font style="" face="Courier New"> ------------------------<br>Replicated LVMs: vgrData0 | vgrData1<br> ------------------------<br>Block Devices: drbd0 | drbd1<br> ------------------------<br>Underlying LVMs: vgData0 | vgData1<br> ------------------------<br>Disks: sdb1 | sdb2<br><br></font>I'm able to get all of this to work manually, without the heartbeat service running. My eventual intended configuration is:<br><br><font style="" face="Courier New">crm configure</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive drbd_data0 ocf:linbit:drbd params drbd_resource="data0" op monitor interval="15s"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive drbd_data1 ocf:linbit:drbd params drbd_resource="data1" op monitor interval="15s"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">ms ms_drbd_data0 drbd_data0 meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">ms ms_drbd_data1 drbd_data1 meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive lvm_data0 ocf:heartbeat:LVM params volgrpname="vgrData0" exclusive="yes" op monitor depth="0" timeout="30" interval="10"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive lvm_data1 ocf:heartbeat:LVM params volgrpname="vgrData1" exclusive="yes" op monitor depth="0" timeout="30" interval="10"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive fs_data0 ocf:heartbeat:Filesystem params device="/dev/vgrData0/lvrData0" directory="/mnt/media" fstype="ext4"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive fs_data1 ocf:heartbeat:Filesystem params device="/dev/vgrData1/lvrData1" directory="/mnt/datusr" fstype="ext4"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive ip_data ocf:heartbeat:IPaddr2 params ip="192.168.67.101" nic="eth0"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive svc_nfs lsb:nfs</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive svc_samba lsb:smb</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data00 inf: ms_drbd_data0:Master ms_drbd_data1:Master</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data01 inf: ms_drbd_data0:Master lvm_data0</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data02 inf: ms_drbd_data0:Master fs_data0</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data03 inf: ms_drbd_data0:Master lvm_data1</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data04 inf: ms_drbd_data0:Master fs_data1</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data05 inf: ms_drbd_data0:Master ip_data</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data06 inf: ms_drbd_data0:Master svc_nfs</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data07 inf: ms_drbd_data0:Master svc_samba</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data00 inf: ms_drbd_data0:promote ms_drbd_data1:promote</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data01 inf: ms_drbd_data0:promote lvm_data0:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data02 inf: lvm_data0:start fs_data0:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data03 inf: ms_drbd_data1:promote lvm_data1:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data04 inf: lvm_data1:start fs_data1:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data05 inf: fs_data0:start fs_data1:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data06 inf: fs_data1:start ip_data:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data07 inf: ip_data:start svc_nfs:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data08 inf: ip_data:start svc_samba:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">commit</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">bye</font><br><br>However, I've only been able to get the following so far to work:<br><br><font style="" face="Courier New">crm configure</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive drbd_data0 ocf:linbit:drbd params drbd_resource="data0" op monitor interval="15s"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive drbd_data1 ocf:linbit:drbd params drbd_resource="data1" op monitor interval="15s"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">ms ms_drbd_data0 drbd_data0 meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">ms ms_drbd_data1 drbd_data1 meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive lvm_data0 ocf:heartbeat:LVM params volgrpname="vgrData0" exclusive="yes" op monitor depth="0" timeout="30" interval="10"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">primitive fs_data0 ocf:heartbeat:Filesystem params device="/dev/vgrData0/lvrData0" directory="/mnt/media" fstype="ext4"</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data00 inf: ms_drbd_data0:Master ms_drbd_data1:Master</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data01 inf: ms_drbd_data0:Master lvm_data0</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">colocation col_data02 inf: ms_drbd_data0:Master fs_data0</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data00 inf: ms_drbd_data0:promote ms_drbd_data1:promote</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data01 inf: ms_drbd_data0:promote lvm_data0:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">order ord_data02 inf: lvm_data0:start fs_data0:start</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">commit</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">bye</font><br><br>And to get the above to work, I have to issue:<br><br><font style="" face="Courier New">crm resource failcount lvm_data0 delete node01</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">crm resource failcount lvm_data0 delete node02</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">crm resource failcount fs_data0 delete node01</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">crm resource failcount fs_data0 delete node02</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">crm resource cleanup lvm_data0</font><font style="" face="Courier New"><br></font><font style="" face="Courier New">crm resource cleanup fs_data0</font><br><br>Then everything starts just fine on it's own. After a reboot however, it pukes again. The only resources that start reliably are the drbd resources.<br><br>Looking through the logs (attached), it appears pacemaker may be attempting to verify the replicated LV (/dev/vgrData0/lvrData0) is down before starting the drbd resources. Since the replicated LVs are using the drbd devices as their backing block device, this first scan will fail, and I think this is were the failcounts for the replicated LV is hitting INFINITY before we've ever even tried to start the LV.<br><br>So assuming my analysis is correct, what ideas might you have to best address this issue? I believe I either need a way to prevent Pacemaker from attempting to find the replicated LV before the drbd resources are online, or I need a way to have Pacemaker automatically clear/cleanup the failcounts/status for the LV after the drbd resources come online.<br><br>Thoughts? Suggestions?<br><br>Thanks in advance.<br><br>DJ<br> <br /><hr />Hotmail: Powerful Free email with security by Microsoft. <a href='http://clk.atdmt.com/GBL/go/201469230/direct/01/' target='_new'>Get it now.</a></body>
</html>