<div dir="ltr"><div><span style="font-family:arial,sans-serif;font-size:13px">Apologies for double post. In my initial post, I forgot to set the subject properly.</span></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br>
</span></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div><span style="font-family:arial,sans-serif;font-size:13px">Hello List,</span><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">I am new here. I worked with Linux HA during 2006-2008, went in HPC direction, and came back to HA a month ago. Realized that a lot has changed. </div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">My setup:</div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">Two KVM machines vdb1 (192.168.122.11), vdb2 (192.168.122.12)</div>
<div style="font-family:arial,sans-serif;font-size:13px">ClusterIP: 192.168.122.10 </div><div style="font-family:arial,sans-serif;font-size:13px">Fedora 19 (64 bit). PCS, CoroSync, PaceMaker, DRBD</div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">Note: I use the names node1 and node2 for vdb1 and vdb2 for explanations.</div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">
I am trying to setup a test cluster, using <a href="http://clusterlabs.org/doc/en-US/Pacemaker/1.1-pcs/html/Clusters_from_Scratch/_configure_the_cluster_for_drbd.html" target="_blank">http://clusterlabs.org/doc/en-US/Pacemaker/1.1-pcs/html/Clusters_from_Scratch/_configure_the_cluster_for_drbd.html</a><br>
</div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px"><div>First, the status:</div><div><br></div><div>[root@vdb1 drbd.d]# pcs status</div><div>Cluster name: MySQLCluster</div>
<div>Last updated: Tue Nov 26 14:05:33 2013</div><div>Last change: Mon Nov 25 17:25:59 2013 via crm_resource on <a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a></div><div>Stack: corosync</div><div>Current DC: <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> (1) - partition with quorum</div>
<div>Version: 1.1.9-3.fc19-781a388</div><div>2 Nodes configured, unknown expected votes</div><div>2 Resources configured.</div><div><br></div><div>Online: [ <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> <a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a> ]</div>
<div><br></div><div>Full list of resources:</div><div><br></div><div> ClusterIP<span style="white-space:pre-wrap"> </span>(ocf::heartbeat:IPaddr2):<span style="white-space:pre-wrap"> </span>Started <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> </div>
<div> Apache<span style="white-space:pre-wrap"> </span>(ocf::heartbeat:apache):<span style="white-space:pre-wrap"> </span>Started <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> </div><div><br></div>
<div>[root@vdb1 drbd.d]#</div><div><br></div><div><div><br></div><div>My DRBD disks are: </div></div><div><br></div><div>[root@vdb1 drbd.d]# drbd-overview <br></div><div> 1:MySQLDisk/0 Connected Secondary/Secondary UpToDate/UpToDate C r----- </div>
<div> 2:ApacheDisk/0 Connected Secondary/Secondary UpToDate/UpToDate C r----- </div><div>[root@vdb1 drbd.d]# </div><div><br></div></div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">
Now, the guide suggests creating a small config file, define the new resources in that, and then push that in CIB. Extract from the guide:<br></div><div style="font-family:arial,sans-serif;font-size:13px"><pre style="white-space:pre-wrap;background-color:rgb(245,245,245);border-top-left-radius:11px;padding:0.5em 1em;line-height:1.29em;border-top-right-radius:11px;font-size:0.9em;border-bottom-right-radius:11px;font-family:'liberation mono','bitstream vera mono','dejavu mono',monospace;word-wrap:break-word;border:1px solid rgb(115,47,47);border-bottom-left-radius:11px">
<span style="color:rgb(176,48,96)"># pcs cluster cib drbd_cfg</span></pre></div><div style="font-family:arial,sans-serif;font-size:13px"><span style="color:rgb(176,48,96)"><pre style="white-space:pre-wrap;line-height:1.29em;font-family:'liberation mono','bitstream vera mono','dejavu mono',monospace;background-color:rgb(245,245,245);color:rgb(0,0,0);padding:0.5em 1em;word-wrap:break-word;font-size:0.9em;border:1px solid rgb(115,47,47);border-top-left-radius:11px;border-top-right-radius:11px;border-bottom-right-radius:11px;border-bottom-left-radius:11px">
# pcs -f drbd_cfg resource create WebData ocf:linbit:drbd \
drbd_resource=wwwdata op monitor interval=60s
# pcs -f drbd_cfg resource master WebDataClone WebData \
master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 \
notify=true</pre></span></div><div style="font-family:arial,sans-serif;font-size:13px"><span style="color:rgb(176,48,96)"><br></span></div><div style="font-family:arial,sans-serif;font-size:13px">I decided to execute the commands (manually), without using the config file method, as:</div>
<div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px"># pcs resource create p_ApacheDisk ocf:linbit:drbd \<br></div><div style="font-family:arial,sans-serif;font-size:13px">
> drbd_resource=ApacheDisk op monitor interval=60s</div><div style="font-family:arial,sans-serif;font-size:13px"><div><br></div><div># pcs resource master MasterApacheDisk p_ApacheDisk \</div><div>> master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 \</div>
<div>> notify=true</div></div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">(I changed the names of resources a bit)</div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">I get the following errors:<br></div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">
<div>[root@vdb2 ~]# pcs resource create p_ApacheDisk ocf:linbit:drbd \<br></div><div>> drbd_resource=ApacheDisk op monitor interval=60s</div><div><br></div><div><br></div><div>[root@vdb2 ~]# pcs status</div><div>
Cluster name: MySQLCluster</div><div>Last updated: Wed Nov 27 11:50:35 2013</div><div>Last change: Wed Nov 27 11:49:36 2013 via cibadmin on <a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a></div><div>
Stack: corosync</div><div>Current DC: <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> (1) - partition with quorum</div><div>Version: 1.1.9-3.fc19-781a388</div><div>2 Nodes configured, unknown expected votes</div>
<div>3 Resources configured.</div><div><br></div><div>Online: [ <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> <a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a> ]</div><div><br>
</div><div>Full list of resources:</div><div><br></div><div> ClusterIP<span style="white-space:pre-wrap"> </span>(ocf::heartbeat:IPaddr2):<span style="white-space:pre-wrap"> </span>Started <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> </div>
<div> Apache<span style="white-space:pre-wrap"> </span>(ocf::heartbeat:apache):<span style="white-space:pre-wrap"> </span>Started <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> </div><div> p_ApacheDisk<span style="white-space:pre-wrap"> </span>(ocf::linbit:drbd):<span style="white-space:pre-wrap"> </span>Stopped </div>
<div><br></div><div>Failed actions:</div><div> p_ApacheDisk_monitor_0 (node=<a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a>, call=27, rc=6, status=complete, last-rc-change=Wed Nov 27 11:49:36 2013</div>
<div>, queued=23ms, exec=0ms</div><div>): not configured</div><div> p_ApacheDisk_monitor_0 (node=<a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a>, call=15, rc=6, status=complete, last-rc-change=Wed Nov 27 11:49:36 2013</div>
<div>, queued=22ms, exec=1ms</div><div>): not configured</div><div><br></div><div><br></div><div>Got the following in /var/log/messages on DC (node 1):</div><div><br></div><div>Nov 27 11:49:36 vdb1 cib[538]: notice: cib:diff: Diff: --- 0.43.13</div>
<div>Nov 27 11:49:36 vdb1 cib[538]: notice: cib:diff: Diff: +++ 0.44.1 f4b87d9dee145747f86583cb5eb8276b</div><div>Nov 27 11:49:36 vdb1 stonith-ng[539]: notice: unpack_config: On loss of CCM Quorum: Ignore</div><div>Nov 27 11:49:36 vdb1 crmd[543]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]</div>
<div>Nov 27 11:49:36 vdb1 pengine[542]: notice: unpack_config: On loss of CCM Quorum: Ignore</div><div>Nov 27 11:49:36 vdb1 pengine[542]: notice: LogActions: Start p_ApacheDisk#011(<a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a>)</div>
<div>Nov 27 11:49:36 vdb1 pengine[542]: notice: process_pe_message: Calculated Transition 92: /var/lib/pacemaker/pengine/pe-input-74.bz2</div><div>Nov 27 11:49:36 vdb1 crmd[543]: notice: te_rsc_command: Initiating action 8: monitor p_ApacheDisk_monitor_0 on <a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a></div>
<div>Nov 27 11:49:36 vdb1 crmd[543]: notice: te_rsc_command: Initiating action 6: monitor p_ApacheDisk_monitor_0 on <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> (local)</div><div>Nov 27 11:49:36 vdb1 drbd(p_ApacheDisk)[9807]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found unset.</div>
<div>Nov 27 11:49:36 vdb1 crmd[543]: notice: process_lrm_event: LRM operation p_ApacheDisk_monitor_0 (call=27, rc=6, cib-update=124, confirmed=true) not configured</div><div>Nov 27 11:49:36 vdb1 crmd[543]: warning: status_from_rc: Action 8 (p_ApacheDisk_monitor_0) on <a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a> failed (target: 7 vs. rc: 6): Error</div>
<div>Nov 27 11:49:36 vdb1 crmd[543]: notice: te_rsc_command: Initiating action 7: probe_complete probe_complete on <a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a> - no waiting</div><div>Nov 27 11:49:36 vdb1 crmd[543]: warning: status_from_rc: Action 6 (p_ApacheDisk_monitor_0) on <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> failed (target: 7 vs. rc: 6): Error</div>
<div>Nov 27 11:49:36 vdb1 crmd[543]: notice: te_rsc_command: Initiating action 5: probe_complete probe_complete on <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> (local) - no waiting</div><div>Nov 27 11:49:36 vdb1 crmd[543]: notice: run_graph: Transition 92 (Complete=4, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-74.bz2): Stopped</div>
<div>Nov 27 11:49:36 vdb1 pengine[542]: notice: unpack_config: On loss of CCM Quorum: Ignore</div><div>Nov 27 11:49:36 vdb1 pengine[542]: error: unpack_rsc_op: Preventing p_ApacheDisk from re-starting anywhere in the cluster : operation monitor failed 'not configured' (rc=6)</div>
<div>Nov 27 11:49:36 vdb1 pengine[542]: error: unpack_rsc_op: Preventing p_ApacheDisk from re-starting anywhere in the cluster : operation monitor failed 'not configured' (rc=6)</div><div>Nov 27 11:49:36 vdb1 pengine[542]: notice: process_pe_message: Calculated Transition 93: /var/lib/pacemaker/pengine/pe-input-75.bz2</div>
<div>Nov 27 11:49:36 vdb1 crmd[543]: notice: run_graph: Transition 93 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-75.bz2): Complete</div><div>Nov 27 11:49:36 vdb1 crmd[543]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]</div>
<div><br></div><div><br></div><div>I then executed the second command and got this:<br></div><div><br></div><div>[root@vdb2 drbd.d]# pcs resource master MasterApacheDisk p_ApacheDisk \</div><div>> master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 \</div>
<div>> notify=true</div><div><br></div><div>[root@vdb2 drbd.d]# pcs status</div><div>Cluster name: MySQLCluster</div><div>Last updated: Wed Nov 27 11:52:54 2013</div><div>Last change: Wed Nov 27 11:52:39 2013 via cibadmin on <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a></div>
<div>Stack: corosync</div><div>Current DC: <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> (1) - partition with quorum</div><div>Version: 1.1.9-3.fc19-781a388</div><div>2 Nodes configured, unknown expected votes</div>
<div>4 Resources configured.</div><div><br></div><div>Online: [ <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> <a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a> ]</div><div><br>
</div><div>Full list of resources:</div><div><br></div><div> ClusterIP<span style="white-space:pre-wrap"> </span>(ocf::heartbeat:IPaddr2):<span style="white-space:pre-wrap"> </span>Started <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> </div>
<div> Apache<span style="white-space:pre-wrap"> </span>(ocf::heartbeat:apache):<span style="white-space:pre-wrap"> </span>Started <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> </div><div> Master/Slave Set: MasterApacheDisk [p_ApacheDisk]</div>
<div> Stopped: [ <a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a> <a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a> ]</div><div><br></div><div>Failed actions:</div><div> p_ApacheDisk_monitor_0 (node=<a href="http://vdb1.example.com/" target="_blank">vdb1.example.com</a>, call=27, rc=6, status=complete, last-rc-change=Wed Nov 27 11:49:36 2013</div>
<div>, queued=23ms, exec=0ms</div><div>): not configured</div><div> p_ApacheDisk_monitor_0 (node=<a href="http://vdb2.example.com/" target="_blank">vdb2.example.com</a>, call=15, rc=6, status=complete, last-rc-change=Wed Nov 27 11:49:36 2013</div>
<div>, queued=22ms, exec=1ms</div><div>): not configured</div><div><br></div><div>[root@vdb2 drbd.d]#</div><div><br></div><div><br></div><div>Got the following in log file on /var/log/messages:</div><div><br></div><div>Nov 27 11:52:39 vdb1 cib[538]: notice: cib:diff: Diff: --- 0.44.3</div>
<div>Nov 27 11:52:39 vdb1 cib[538]: notice: cib:diff: Diff: +++ 0.45.1 d62a8fd52495c636c2bc012ac156d3e2</div><div>Nov 27 11:52:39 vdb1 crmd[543]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]</div>
<div>Nov 27 11:52:39 vdb1 stonith-ng[539]: notice: unpack_config: On loss of CCM Quorum: Ignore</div><div>Nov 27 11:52:39 vdb1 pengine[542]: notice: unpack_config: On loss of CCM Quorum: Ignore</div><div>Nov 27 11:52:39 vdb1 pengine[542]: error: unpack_rsc_op: Preventing MasterApacheDisk from re-starting anywhere in the cluster : operation monitor failed 'not configured' (rc=6)</div>
<div>Nov 27 11:52:39 vdb1 pengine[542]: error: unpack_rsc_op: Preventing MasterApacheDisk from re-starting anywhere in the cluster : operation monitor failed 'not configured' (rc=6)</div><div>Nov 27 11:52:39 vdb1 pengine[542]: notice: process_pe_message: Calculated Transition 94: /var/lib/pacemaker/pengine/pe-input-76.bz2</div>
<div>Nov 27 11:52:39 vdb1 crmd[543]: notice: run_graph: Transition 94 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-76.bz2): Complete</div><div>Nov 27 11:52:39 vdb1 crmd[543]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]</div>
</div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">I have tried them they way it is specified in the guide and it works. (i.e. by using an intermediate config file). But my question is, why I cannot use the two commands individually? Are there any limitations in doing so? If someone can explain the above errors and the reasons behind them, I would really appreciate. Thank you for your time.</div>
<div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">Regards,</div><div style="font-family:arial,sans-serif;font-size:13px">K</div><div><br></div>-- <br>
<div dir="ltr"><a href="http://www.wbitt.com" target="_blank">http://www.wbitt.com</a> , <a href="http://techsnail.com" target="_blank">http://techsnail.com</a><br>Computer bugs are like shipwrecks. They are not found, unless they want to be found.</div>
</div>