Hi Florian,<div><br></div><div>Thank you for responding.<br><div><br></div><div>The config I provided in my initial posting is actually a cut down version of what we are actually running. There are really 11 activeMQ brokers (resources) running on the cluster, so the xml output from cibadmin is not going to match the initial config I provided. </div>
<div><br></div><div>It might help if I give you some more detail on our setup and the history of the testing I have done so far on this issue. We actually have a total of 7 two node clusters (1 integration cluster, 1 test cluster, 2 staging clusters, 2 live clusters and 1 stabe cluster) , all 7 use the same base crm config of 4 resources before any activeMQ resources are added. The problem of the master shutting down all it's resources when corosync is stopped on the slave exists on all 7 clusters. It also occurs with just the 4 base resources configured, so adding the activeMQ resources has no affect either way when it comes to this problem. The 4 base resources are:</div>
<div><br></div><div><div>primitive activemq_drbd ocf:linbit:drbd</div><div>primitive cluster_IP ocf:heartbeat:IPaddr2</div><div>primitive drbd_fs ocf:heartbeat:Filesystem</div><div>primitive ping_gateway ocf:pacemaker:ping</div>
</div><div><br></div><div>This is what the output of crm_mon looks like on all the clusters when no activeMQ resources have been added:</div><div><br></div><div><div><div>============</div><div>Last updated: Wed Oct 12 14:47:08 2011</div>
<div>Stack: openais</div><div>Current DC: mq009.back.stable.cwwtf.local - partition with quorum</div><div>Version: 1.0.11-1554a83db0d3c3e546cfd3aaff6af1184f79ee87</div><div>2 Nodes configured, 2 expected votes</div><div>4 Resources configured.</div>
<div>============</div><div><br></div><div>Online: [ mq009.back.stable.cwwtf.local mq010.back.stable.cwwtf.local ]</div><div><br></div><div> Clone Set: ping_gateway_clone</div><div> Started: [ mq009.back.stable.cwwtf.local mq010.back.stable.cwwtf.local ]</div>
<div> Master/Slave Set: ActiveMQ_Data</div><div> Masters: [ mq009.back.stable.cwwtf.local ]</div><div> Slaves: [ mq010.back.stable.cwwtf.local ]</div><div>drbd_fs (ocf::heartbeat:Filesystem): Started mq009.back.stable.cwwtf.local</div>
<div>cluster_IP<span class="Apple-tab-span" style="white-space:pre"> </span>(ocf::heartbeat:IPaddr2):<span class="Apple-tab-span" style="white-space:pre"> </span>Started mq009.back.stable.cwwtf.local</div></div></div><div>
<br></div><div>To make it easier for you to help me diagnose this issue I have removed all of the activeMQ broker resources from our "stable" cluster and have pasted both the crm config and the cibadmin xml output from the cluster below. Any help you can give me on this would be very much appreciated.</div>
<div><br></div><div><div>root@mq010:~# crm configure show</div><div>node mq009.back.stable.cwwtf.local \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>attributes standby="off"</div><div>
node mq010.back.stable.cwwtf.local \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>attributes standby="off"</div><div>primitive activemq_drbd ocf:linbit:drbd \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>params drbd_resource="r0" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>op monitor interval="15s" timeout="20s" \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>op start interval="0" timeout="240" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>op stop interval="0" timeout="100"</div><div>primitive cluster_IP ocf:heartbeat:IPaddr2 \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>params ip="172.23.42.55" nic="eth0" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>op monitor interval="30s" timeout="90" \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>op start interval="0" timeout="90" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>op stop interval="0" timeout="100"</div><div>primitive drbd_fs ocf:heartbeat:Filesystem \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>params device="/dev/drbd1" directory="/drbd" fstype="ext3" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>op monitor interval="15s" timeout="40s" \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>op start interval="0" timeout="60" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>op stop interval="0" timeout="60"</div><div>primitive ping_gateway ocf:pacemaker:ping \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>params name="ping_gateway" host_list="172.23.40.2" multiplier="100" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>op monitor interval="15s" timeout="20s" \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>op start interval="0" timeout="90" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>op stop interval="0" timeout="100"</div><div>ms ActiveMQ_Data activemq_drbd \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" target-role="Master"</div>
<div>clone ping_gateway_clone ping_gateway</div><div>location ActiveMQ_Data_on_connected_node_only ActiveMQ_Data \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>rule $id="ActiveMQ_Data_on_connected_node_only-rule" -inf: not_defined ping_gateway or ping_gateway lte 0</div>
<div>location ActiveMQ_Data_prefer_mq009 ActiveMQ_Data \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>rule $id="ActiveMQ_Data_prefer_mq009-rule" $role="Master" 500: #uname eq mq009.back.stable.cwwtf.local</div>
<div>colocation cluster_IP_with_ActiveMQ_Data inf: cluster_IP ActiveMQ_Data:Master</div><div>colocation drbd_fs_with_ActiveMQ_Data inf: drbd_fs ActiveMQ_Data:Master</div><div>order ActiveMQ_Data_after_ping_gateway_clone inf: ping_gateway_clone:start ActiveMQ_Data:promote</div>
<div>order cluster_IP_after_drbd_fs inf: drbd_fs:start cluster_IP:start</div><div>order drbd_fs_after_ActiveMQ_Data inf: ActiveMQ_Data:promote drbd_fs:start</div><div>property $id="cib-bootstrap-options" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>dc-version="1.0.11-1554a83db0d3c3e546cfd3aaff6af1184f79ee87" \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>cluster-infrastructure="openais" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>expected-quorum-votes="2" \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>no-quorum-policy="ignore" \</div><div>
<span class="Apple-tab-span" style="white-space:pre"> </span>stonith-enabled="false" \</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>last-lrm-refresh="1309359608"</div><div>rsc_defaults $id="rsc-options" \</div>
<div><span class="Apple-tab-span" style="white-space:pre"> </span>resource-stickiness="100"</div></div><div><br></div><div><br></div><div><br></div><div><div>root@mq010:~# cibadmin -Q</div><div><cib epoch="90" admin_epoch="0" validate-with="pacemaker-1.0" crm_feature_set="3.0.1" have-quorum="1" num_updates="35" cib-last-written="Tue Jul 5 12:23:25 2011" dc-uuid="mq009.back.stable.cwwtf.local"></div>
<div> <configuration></div><div> <crm_config></div><div> <cluster_property_set id="cib-bootstrap-options"></div><div> <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.0.11-1554a83db0d3c3e546cfd3aaff6af1184f79ee87"/></div>
<div> <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="openais"/></div><div> <nvpair id="cib-bootstrap-options-expected-quorum-votes" name="expected-quorum-votes" value="2"/></div>
<div> <nvpair id="cib-bootstrap-options-no-quorum-policy" name="no-quorum-policy" value="ignore"/></div><div> <nvpair id="cib-bootstrap-options-stonith-enabled" name="stonith-enabled" value="false"/></div>
<div> <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1309359608"/></div><div> </cluster_property_set></div><div> </crm_config></div>
<div> <nodes></div><div> <node id="mq009.back.stable.cwwtf.local" type="normal" uname="mq009.back.stable.cwwtf.local"></div><div> <instance_attributes id="nodes-mq009.back.stable.cwwtf.local"></div>
<div> <nvpair id="nodes-mq009.back.stable.cwwtf.local-standby" name="standby" value="off"/></div><div> </instance_attributes></div><div> </node></div><div>
<node id="mq010.back.stable.cwwtf.local" type="normal" uname="mq010.back.stable.cwwtf.local"></div><div> <instance_attributes id="nodes-mq010.back.stable.cwwtf.local"></div>
<div> <nvpair id="nodes-mq010.back.stable.cwwtf.local-standby" name="standby" value="off"/></div><div> </instance_attributes></div><div> </node></div><div>
</nodes></div><div> <resources></div><div> <clone id="ping_gateway_clone"></div><div> <primitive class="ocf" id="ping_gateway" provider="pacemaker" type="ping"></div>
<div> <instance_attributes id="ping_gateway-instance_attributes"></div><div> <nvpair id="ping_gateway-instance_attributes-name" name="name" value="ping_gateway"/></div>
<div> <nvpair id="ping_gateway-instance_attributes-host_list" name="host_list" value="172.23.40.2"/></div><div> <nvpair id="ping_gateway-instance_attributes-multiplier" name="multiplier" value="100"/></div>
<div> </instance_attributes></div><div> <operations></div><div> <op id="ping_gateway-monitor-15s" interval="15s" name="monitor" timeout="20s"/></div>
<div> <op id="ping_gateway-start-0" interval="0" name="start" timeout="90"/></div><div> <op id="ping_gateway-stop-0" interval="0" name="stop" timeout="100"/></div>
<div> </operations></div><div> </primitive></div><div> </clone></div><div> <master id="ActiveMQ_Data"></div><div> <meta_attributes id="ActiveMQ_Data-meta_attributes"></div>
<div> <nvpair id="ActiveMQ_Data-meta_attributes-master-max" name="master-max" value="1"/></div><div> <nvpair id="ActiveMQ_Data-meta_attributes-master-node-max" name="master-node-max" value="1"/></div>
<div> <nvpair id="ActiveMQ_Data-meta_attributes-clone-max" name="clone-max" value="2"/></div><div> <nvpair id="ActiveMQ_Data-meta_attributes-clone-node-max" name="clone-node-max" value="1"/></div>
<div> <nvpair id="ActiveMQ_Data-meta_attributes-notify" name="notify" value="true"/></div><div> <nvpair id="ActiveMQ_Data-meta_attributes-target-role" name="target-role" value="Master"/></div>
<div> </meta_attributes></div><div> <primitive class="ocf" id="activemq_drbd" provider="linbit" type="drbd"></div><div> <instance_attributes id="activemq_drbd-instance_attributes"></div>
<div> <nvpair id="activemq_drbd-instance_attributes-drbd_resource" name="drbd_resource" value="r0"/></div><div> </instance_attributes></div><div> <operations></div>
<div> <op id="activemq_drbd-monitor-15s" interval="15s" name="monitor" timeout="20s"/></div><div> <op id="activemq_drbd-start-0" interval="0" name="start" timeout="240"/></div>
<div> <op id="activemq_drbd-stop-0" interval="0" name="stop" timeout="100"/></div><div> </operations></div><div> </primitive></div><div>
</master></div><div> <primitive class="ocf" id="drbd_fs" provider="heartbeat" type="Filesystem"></div><div> <instance_attributes id="drbd_fs-instance_attributes"></div>
<div> <nvpair id="drbd_fs-instance_attributes-device" name="device" value="/dev/drbd1"/></div><div> <nvpair id="drbd_fs-instance_attributes-directory" name="directory" value="/drbd"/></div>
<div> <nvpair id="drbd_fs-instance_attributes-fstype" name="fstype" value="ext3"/></div><div> </instance_attributes></div><div> <operations></div><div>
<op id="drbd_fs-monitor-15s" interval="15s" name="monitor" timeout="40s"/></div><div> <op id="drbd_fs-start-0" interval="0" name="start" timeout="60"/></div>
<div> <op id="drbd_fs-stop-0" interval="0" name="stop" timeout="60"/></div><div> </operations></div><div> </primitive></div><div> <primitive class="ocf" id="cluster_IP" provider="heartbeat" type="IPaddr2"></div>
<div> <instance_attributes id="cluster_IP-instance_attributes"></div><div> <nvpair id="cluster_IP-instance_attributes-ip" name="ip" value="172.23.42.55"/></div>
<div> <nvpair id="cluster_IP-instance_attributes-nic" name="nic" value="eth0"/></div><div> </instance_attributes></div><div> <operations></div><div> <op id="cluster_IP-monitor-30s" interval="30s" name="monitor" timeout="90"/></div>
<div> <op id="cluster_IP-start-0" interval="0" name="start" timeout="90"/></div><div> <op id="cluster_IP-stop-0" interval="0" name="stop" timeout="100"/></div>
<div> </operations></div><div> </primitive></div><div> </resources></div><div> <constraints></div><div> <rsc_location id="ActiveMQ_Data_on_connected_node_only" rsc="ActiveMQ_Data"></div>
<div> <rule boolean-op="or" id="ActiveMQ_Data_on_connected_node_only-rule" score="-INFINITY"></div><div> <expression attribute="ping_gateway" id="ActiveMQ_Data_on_connected_node_only-expression" operation="not_defined"/></div>
<div> <expression attribute="ping_gateway" id="ActiveMQ_Data_on_connected_node_only-expression-0" operation="lte" value="0"/></div><div> </rule></div><div>
</rsc_location></div><div> <rsc_location id="ActiveMQ_Data_prefer_mq009" rsc="ActiveMQ_Data"></div><div> <rule id="ActiveMQ_Data_prefer_mq009-rule" role="Master" score="500"></div>
<div> <expression attribute="#uname" id="ActiveMQ_Data_prefer_mq009-expression" operation="eq" value="mq009.back.stable.cwwtf.local"/></div><div> </rule></div>
<div> </rsc_location></div><div> <rsc_colocation id="cluster_IP_with_ActiveMQ_Data" rsc="cluster_IP" score="INFINITY" with-rsc="ActiveMQ_Data" with-rsc-role="Master"/></div>
<div> <rsc_colocation id="drbd_fs_with_ActiveMQ_Data" rsc="drbd_fs" score="INFINITY" with-rsc="ActiveMQ_Data" with-rsc-role="Master"/></div><div> <rsc_order first="ping_gateway_clone" first-action="start" id="ActiveMQ_Data_after_ping_gateway_clone" score="INFINITY" then="ActiveMQ_Data" then-action="promote"/></div>
<div> <rsc_order first="drbd_fs" first-action="start" id="cluster_IP_after_drbd_fs" score="INFINITY" then="cluster_IP" then-action="start"/></div><div>
<rsc_order first="ActiveMQ_Data" first-action="promote" id="drbd_fs_after_ActiveMQ_Data" score="INFINITY" then="drbd_fs" then-action="start"/></div><div>
</constraints></div><div> <op_defaults/></div><div> <rsc_defaults></div><div> <meta_attributes id="rsc-options"></div><div> <nvpair id="rsc-options-resource-stickiness" name="resource-stickiness" value="100"/></div>
<div> </meta_attributes></div><div> </rsc_defaults></div><div> </configuration></div><div> <status></div><div> <node_state id="mq009.back.stable.cwwtf.local" uname="mq009.back.stable.cwwtf.local" ha="active" in_ccm="true" crmd="online" join="member" expected="member" crm-debug-origin="do_update_resource" shutdown="0"></div>
<div> <lrm id="mq009.back.stable.cwwtf.local"></div><div> <lrm_resources></div><div> <lrm_resource id="ping_gateway:0" type="ping" class="ocf" provider="pacemaker"></div>
<div> <lrm_rsc_op id="ping_gateway:0_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="4:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:7;4:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="2" rc-code="7" op-status="0" interval="0" last-run="1309874967" last-rc-change="1309874967" exec-time="20" queue-time="30" op-digest="4faa58043b927d02be6352d6d4b5d1b3"/></div>
<div> <lrm_rsc_op id="ping_gateway:0_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="13:1:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;13:1:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="6" rc-code="0" op-status="0" interval="0" last-run="1309874968" last-rc-change="1309874968" exec-time="4030" queue-time="20" op-digest="4faa58043b927d02be6352d6d4b5d1b3"/></div>
<div> <lrm_rsc_op id="ping_gateway:0_monitor_15000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="14:1:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;14:1:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="7" rc-code="0" op-status="0" interval="15000" last-rc-change="1309874972" exec-time="4020" queue-time="0" op-digest="43e591f50112aeb519555a036ffbf937"/></div>
<div> </lrm_resource></div><div> <lrm_resource id="activemq_drbd:0" type="drbd" class="ocf" provider="linbit"></div><div> <lrm_rsc_op id="activemq_drbd:0_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="5:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:7;5:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="3" rc-code="7" op-status="0" interval="0" last-run="1309874967" last-rc-change="1309874967" exec-time="70" queue-time="20" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> <lrm_rsc_op id="activemq_drbd:0_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="15:2:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;15:2:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="8" rc-code="0" op-status="0" interval="0" last-run="1309874978" last-rc-change="1309874978" exec-time="270" queue-time="20" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> <lrm_rsc_op id="activemq_drbd:0_post_notify_start_0" operation="notify" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="56:2:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;56:2:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="9" rc-code="0" op-status="0" interval="0" last-run="1309874979" last-rc-change="1309874979" exec-time="90" queue-time="50" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> <lrm_rsc_op id="activemq_drbd:0_pre_notify_promote_0" operation="notify" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="64:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;64:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="10" rc-code="0" op-status="0" interval="0" last-run="1309874980" last-rc-change="1309874980" exec-time="30" queue-time="30" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> <lrm_rsc_op id="activemq_drbd:0_promote_0" operation="promote" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="18:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;18:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="11" rc-code="0" op-status="0" interval="0" last-run="1309874981" last-rc-change="1309874981" exec-time="70" queue-time="20" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> <lrm_rsc_op id="activemq_drbd:0_post_notify_promote_0" operation="notify" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="65:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;65:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="12" rc-code="0" op-status="0" interval="0" last-run="1309874981" last-rc-change="1309874981" exec-time="70" queue-time="30" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> </lrm_resource></div><div> <lrm_resource id="drbd_fs" type="Filesystem" class="ocf" provider="heartbeat"></div><div> <lrm_rsc_op id="drbd_fs_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="6:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:7;6:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="4" rc-code="7" op-status="0" interval="0" last-run="1309874967" last-rc-change="1309874967" exec-time="40" queue-time="40" op-digest="fed478d3b644235e16ce536a4a455e20"/></div>
<div> <lrm_rsc_op id="drbd_fs_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="47:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;47:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="13" rc-code="0" op-status="0" interval="0" last-run="1309874982" last-rc-change="1309874982" exec-time="160" queue-time="20" op-digest="fed478d3b644235e16ce536a4a455e20"/></div>
<div> <lrm_rsc_op id="drbd_fs_monitor_15000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="48:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;48:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="14" rc-code="0" op-status="0" interval="15000" last-rc-change="1309874983" exec-time="40" queue-time="20" op-digest="b61254e5e6d321ff8ea886e90a81929d"/></div>
<div> </lrm_resource></div><div> <lrm_resource id="cluster_IP" type="IPaddr2" class="ocf" provider="heartbeat"></div><div> <lrm_rsc_op id="cluster_IP_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="7:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:7;7:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="5" rc-code="7" op-status="0" interval="0" last-run="1309874967" last-rc-change="1309874967" exec-time="30" queue-time="30" op-digest="e683599137b6cfe2a2737572c307b777"/></div>
<div> <lrm_rsc_op id="cluster_IP_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="49:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;49:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="15" rc-code="0" op-status="0" interval="0" last-run="1309874983" last-rc-change="1309874983" exec-time="110" queue-time="20" op-digest="e683599137b6cfe2a2737572c307b777"/></div>
<div> <lrm_rsc_op id="cluster_IP_monitor_30000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="50:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;50:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="16" rc-code="0" op-status="0" interval="30000" last-rc-change="1309874983" exec-time="30" queue-time="20" op-digest="4e48b7523fb8821dbd8b003784ca14e5"/></div>
<div> </lrm_resource></div><div> </lrm_resources></div><div> </lrm></div><div> <transient_attributes id="mq009.back.stable.cwwtf.local"></div><div> <instance_attributes id="status-mq009.back.stable.cwwtf.local"></div>
<div> <nvpair id="status-mq009.back.stable.cwwtf.local-probe_complete" name="probe_complete" value="true"/></div><div> <nvpair id="status-mq009.back.stable.cwwtf.local-ping_gateway" name="ping_gateway" value="100"/></div>
<div> <nvpair id="status-mq009.back.stable.cwwtf.local-master-activemq_drbd:0" name="master-activemq_drbd:0" value="10000"/></div><div> </instance_attributes></div>
<div> </transient_attributes></div><div> </node_state></div><div> <node_state id="mq010.back.stable.cwwtf.local" uname="mq010.back.stable.cwwtf.local" ha="active" in_ccm="true" crmd="online" join="member" expected="member" crm-debug-origin="do_update_resource" shutdown="0"></div>
<div> <lrm id="mq010.back.stable.cwwtf.local"></div><div> <lrm_resources></div><div> <lrm_resource id="ping_gateway:1" type="ping" class="ocf" provider="pacemaker"></div>
<div> <lrm_rsc_op id="ping_gateway:1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="9:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:7;9:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="2" rc-code="7" op-status="0" interval="0" last-run="1309874967" last-rc-change="1309874967" exec-time="20" queue-time="0" op-digest="4faa58043b927d02be6352d6d4b5d1b3"/></div>
<div> <lrm_rsc_op id="ping_gateway:1_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="15:1:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;15:1:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="6" rc-code="0" op-status="0" interval="0" last-run="1309874968" last-rc-change="1309874968" exec-time="4020" queue-time="0" op-digest="4faa58043b927d02be6352d6d4b5d1b3"/></div>
<div> <lrm_rsc_op id="ping_gateway:1_monitor_15000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="16:1:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;16:1:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="7" rc-code="0" op-status="0" interval="15000" last-rc-change="1309874972" exec-time="4020" queue-time="0" op-digest="43e591f50112aeb519555a036ffbf937"/></div>
<div> </lrm_resource></div><div> <lrm_resource id="activemq_drbd:0" type="drbd" class="ocf" provider="linbit"></div><div> <lrm_rsc_op id="activemq_drbd:0_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="10:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:7;10:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="3" rc-code="7" op-status="0" interval="0" last-run="1309874967" last-rc-change="1309874967" exec-time="40" queue-time="0" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> </lrm_resource></div><div> <lrm_resource id="drbd_fs" type="Filesystem" class="ocf" provider="heartbeat"></div><div> <lrm_rsc_op id="drbd_fs_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="11:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:7;11:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="4" rc-code="7" op-status="0" interval="0" last-run="1309874967" last-rc-change="1309874967" exec-time="40" queue-time="0" op-digest="fed478d3b644235e16ce536a4a455e20"/></div>
<div> </lrm_resource></div><div> <lrm_resource id="cluster_IP" type="IPaddr2" class="ocf" provider="heartbeat"></div><div> <lrm_rsc_op id="cluster_IP_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="12:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:7;12:1:7:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="5" rc-code="7" op-status="0" interval="0" last-run="1309874967" last-rc-change="1309874967" exec-time="40" queue-time="0" op-digest="e683599137b6cfe2a2737572c307b777"/></div>
<div> </lrm_resource></div><div> <lrm_resource id="activemq_drbd:1" type="drbd" class="ocf" provider="linbit"></div><div> <lrm_rsc_op id="activemq_drbd:1_start_0" operation="start" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="17:2:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;17:2:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="8" rc-code="0" op-status="0" interval="0" last-run="1309874978" last-rc-change="1309874978" exec-time="250" queue-time="0" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> <lrm_rsc_op id="activemq_drbd:1_post_notify_start_0" operation="notify" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="57:2:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;57:2:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="9" rc-code="0" op-status="0" interval="0" last-run="1309874979" last-rc-change="1309874979" exec-time="70" queue-time="0" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> <lrm_rsc_op id="activemq_drbd:1_pre_notify_promote_0" operation="notify" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="66:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;66:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="10" rc-code="0" op-status="0" interval="0" last-run="1309874980" last-rc-change="1309874980" exec-time="40" queue-time="0" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> <lrm_rsc_op id="activemq_drbd:1_post_notify_promote_0" operation="notify" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="67:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;67:3:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="11" rc-code="0" op-status="0" interval="0" last-run="1309874981" last-rc-change="1309874981" exec-time="40" queue-time="0" op-digest="c0e018b73fdf522b6cdd355e125af15e"/></div>
<div> <lrm_rsc_op id="activemq_drbd:1_monitor_15000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.0.1" transition-key="22:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" transition-magic="0:0;22:4:0:c6cb2823-95a3-4c61-802a-8af4d9fea224" call-id="12" rc-code="0" op-status="0" interval="15000" last-rc-change="1309874982" exec-time="50" queue-time="0" op-digest="db2fb3216fa7207fdc0b2bf31bbd09c1"/></div>
<div> </lrm_resource></div><div> </lrm_resources></div><div> </lrm></div><div> <transient_attributes id="mq010.back.stable.cwwtf.local"></div><div> <instance_attributes id="status-mq010.back.stable.cwwtf.local"></div>
<div> <nvpair id="status-mq010.back.stable.cwwtf.local-probe_complete" name="probe_complete" value="true"/></div><div> <nvpair id="status-mq010.back.stable.cwwtf.local-ping_gateway" name="ping_gateway" value="100"/></div>
<div> <nvpair id="status-mq010.back.stable.cwwtf.local-master-activemq_drbd:1" name="master-activemq_drbd:1" value="10000"/></div><div> </instance_attributes></div>
<div> </transient_attributes></div><div> </node_state></div><div> </status></div><div></cib></div></div><div><br></div><div><br></div><div><br></div><div><div class="gmail_quote">On Wed, Oct 12, 2011 at 1:11 PM, Florian Haas <span dir="ltr"><<a href="mailto:florian@hastexo.com">florian@hastexo.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">Tom,<br>
<div class="im"><br>
On 2011-10-12 14:02, Tom Pride wrote:<br>
> Hi Guys,<br>
><br>
> I was hoping that someone might be able to do a quick review of my<br>
> cluster config, shown below, to work out why when I shutdown corosync on<br>
> the master all the resources failover to the slave without a problem,<br>
> but if I shutdown corosync on the slave all of the resources on the<br>
> master stop as well, leaving me with both nodes broken. Obviously what<br>
> I want to happen is to be able to shutdown corosync on the slave and all<br>
> of the resources running on the master to remain untouched. I must have<br>
> something not quite right in the logic of my cluster config.<br>
<br>
</div>As your issue may not only be caused by a problem in your cluster<br>
configuration (which you have provided), but also by your cluster status<br>
(which you haven't), I'd ask that you create a CIB dump with "cibadmin<br>
-Q > /tmp/cib.xml", upload that to pastebin or whatever your favorite<br>
service is, and share the URL.<br>
<br>
Cheers,<br>
Florian<br>
<font color="#888888"><br>
--<br>
Need help with Pacemaker?<br>
<a href="http://www.hastexo.com/now" target="_blank">http://www.hastexo.com/now</a><br>
<br>
_______________________________________________<br>
Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
<a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
</font></blockquote></div><br></div></div>