No subject
Fri Oct 28 02:41:40 EDT 2011
restart operation for the above resources but the reason for the same is
not clear.
Following are some excerpts from the logs:
"*Feb 07 11:06:31 MCG1 pengine: [20534]: info: determine_online_status:
Node mcg2 is shutting down
Feb 07 11:06:31 MCG1 pengine: [20534]: info: determine_online_status: Node
mcg1 is online
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_print: Master/Slave
Set: ms_Rmgr
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
Rmgr:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_ac**tive: Resource
Rmgr:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active:
Resource**Rmgr:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
Rmgr:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: Masters: [
mcg1 ]
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: Slaves: [
mcg2 ]
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_print: Master/Slave
Set: ms_Tmgr
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
Tmgr:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
Tmgr:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
Tmgr:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
Tmgr:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: Masters: [
mcg1 ]
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: Slaves: [
mcg2 ]
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_print: Master/Slave
Set: ms_pimd
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
pimd:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
pimd:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
pimd:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
pimd:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: Masters: [
mcg1 ]
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: Slaves: [
mcg2 ]
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: native_print: ClusterIP
(ocf::mcg:MCG_VIPaddr_RA): Started mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_print: Clone Set:
EMS_CLONE*
*Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
EMS:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource EMS:0
active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource EMS:1
active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource EMS:1
active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: Started: [
mcg1 mcg2 ]
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: native_print: NDB_VIP
(ocf::heartbeat:IPaddr2): Started mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: native_print: NDB_MGMT
(ocf::mcg:NDB_MGM_RA): Started mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_print: Clone Set:
mysqld_clone
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: nati**ve_active: Resource
mysql:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
mysql:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
mysql:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
mysql:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: Started: [
mcg1 mcg2 ]
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_print: Clone Set:
ndbdclone
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
ndbd:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
ndbd:0 active on mcg1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
ndbd:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource
ndbd:1 active on mcg2
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: Started: [
mcg1 mcg2 ]
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource Rmgr:1: preferring current location (node=mcg2, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource Tmgr:1: preferring current location (node=mcg2, weight=100)*
Fe*b 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource pimd:1: preferring current location (node=mcg2, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource EMS:1: preferring current location (node=mcg2, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource mysql:1: preferring current location (node=mcg2, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource ndbd:1: preferring current location (node=mcg2, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource Rmgr:0: preferring current location (node=mcg1, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource Tmgr:0: preferring current location (node=mcg1, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource pimd:0: preferring current location (node=mcg1, weight=100)**
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource ClusterIP: preferring current location (node=mcg1, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource EMS:0: preferring current location (node=mcg1, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource NDB_VIP: preferring current location (node=mcg1, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource NDB_MGMT: preferring current location (node=mcg1, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource mysql:0: preferring current location (node=mcg1, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness:
Resource ndbd:0: preferring current location (node=mcg1, weight=100)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning
mcg1 to Rmgr:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: All nodes
for resource Rmgr:1 are unavailable, unclean or shutting down (mcg2: 0,
-1000000)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not
allocate a node for Rmgr:1
Feb 07 11:06:31 MCG1 pengine: [20534]: info: native_color: Resource Rmgr:1
cannot run anywhere
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_color: Allocated 1
ms_Rmgr instances of a possible 2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_color: Rmgr:0 master
score: 10
Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: Promoting Rmgr:0
(Master mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_color: Rmgr:1 master
score: 0
Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: ms_Rmgr:
Promoted 1 instances of a possible 1 to master
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning
mcg1 to Tmgr:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: All nodes
for resource Tmgr:1 are unavailable, unclean or shutting down (mcg2: 0,
-1000000)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not
allocate a node for Tmgr:1
Feb 07 11:06:31 MCG1 pengine: [20534]: info: native_color: Resource Tmgr:1
cannot run anywhere*
*Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_color: Allocated 1
ms_Tmgr instances of a possible 2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_color: Tmgr:0 master
score: 10
Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: Promoting Tmgr:0
(Master mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_color: Tmgr:1 master
score: 0
Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: ms_Tmgr:
Promoted 1 instances of a possible 1 to master
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning
mcg1 to pimd:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: All nodes
for resource pimd:1 are unavailable, unclean or shutting down (mcg2: 0,
-1000000)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not
allocate a node for pimd:1
Feb 07 11:06:31 MCG1 pengine: [20534]: info: native_color: Resource pimd:1
cannot run anywhere*
*Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_color: Allocated 1
ms_pimd instances of a possible 2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_color: pimd:0 master
score: 10
Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: Promoting pimd:0
(Master mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_color: pimd:1 master
score: 0
Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: ms_pimd:
Promoted 1 instances of a possible 1 to master
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning
mcg1 to ClusterIP
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning
mcg1 to EMS:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: All nodes
for resource EMS:1 are unavailable, unclean or shutting down (mcg2: 0,
-1000000)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not
allocate a node for EMS:1
Feb 07 11:06:31 MCG1 pengine: [20534]: info: native_color: Resource EMS:1
cannot run anywhere
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_color: Allocated 1
EMS_CLONE instances of a possible 2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning
mcg1 to NDB_VIP
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning
mcg1 to NDB_MGMT
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning
mcg1 to mysql:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: All nodes
for resource mysql:1 are unavailable, unclean or shutting down (mcg2: 0,
-1000000)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not
allocate a node for mysql:1
Feb 07 11:06:31 MCG1 pengine: [20534]: info: native_color: Resource mysql:1
cannot run anywhere
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_color: Allocated 1
mysqld_clone instances of a possible 2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning
mcg1 to ndbd:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: All nodes
for resource ndbd:1 are unavailable, unclean or shutting down (mcg2: 0,
-1000000)
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not
allocate a node for ndbd:1
Feb 07 11:06:31 MCG1 pengine: [20534]: info: native_color: Resource ndbd:1
cannot run anywhere
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_color: Allocated 1
ndbdclone instances of a possible 2
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_create_actions:
Creating actions for ms_Rmgr
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_create_actions:
Creating actions for ms_Tmgr
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_create_actions:
Creating actions for ms_pimd
Feb 07 11:06:31 MCG1 pengine: [20534]: info: stage6: Scheduling Node mcg2
for shutdown
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing
Rmgr:0 with Tmgr:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: find_compatible_child: Can't
pair Tmgr:1 with ms_Rmgr
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: No match
found for Tmgr:1 (0)
Feb 07 11:06:31 MCG1 pengine: [20534]: info: clone_rsc_order_lh: Inhibiting
Tmgr:1 from being active
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not
allocate a node for Tmgr:1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing
Tmgr:0 with Rmgr:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing
Tmgr:1 with Rmgr:1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing
Tmgr:0 with pimd:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: find_compatible_child: Can't
pair pimd:1 with ms_Tmgr
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: No match
found for pimd:1 (0)
Feb 07 11:06:31 MCG1 pengine: [20534]: info: clone_rsc_order_lh: Inhibiting
pimd:1 from being active
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not
allocate a node for pimd:1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing
pimd:0 with Tmgr:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing
pimd:1 with Tmgr:1
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing
Rmgr:0 with mysql:0
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing
Rmgr:1 with mysql:1
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Restart resource
Rmgr:0 (Master mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Stop resource
Rmgr:1 (mcg2)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Restart resource
Tmgr:0 (Master mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Stop resource
Tmgr:1 (mcg2)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Restart resource
pimd:0 (Master mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Stop resource
pimd:1 (mcg2)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Restart resource
ClusterIP (Started mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Leave resource
EMS:0 (Started mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Stop resource
EMS:1 (mcg2)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Leave resource
NDB_VIP (Started mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Leave resource
NDB_MGMT (Started mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Restart resource
mysql:0 (Started mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Stop resource
mysql:1 (mcg2)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Leave resource
ndbd:0 (Started mcg1)
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Stop resource
ndbd:1 (mcg2)
"
*Thanks in advance.
Regards
Neha Chatrath
--bcaec52c6a5f4d107e04b85d5729
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Hello,<br>I have a 2 node cluster with following configuration:<br><b style=
=3D"color:rgb(51,102,255)">*node $id=3D"9e53a111-0dca-496c-9461-a38f3e=
ec4d0e" mcg2 \<br> =A0 =A0 =A0 =A0attributes standby=3D"off"=
<br>node $id=3D"a90981f8-d993-4411-89f4-aff7156136d2" mcg1 \<br>
=A0 =A0 =A0 =A0attributes standby=3D"off"<br>primitive ClusterIP=
ocf:mcg:MCG_VIPaddr_RA \<br> =A0 =A0 =A0 =A0params ip=3D"192.168.115.=
50" cidr_netmask=3D"255.255.255.0" <br>nic=3D"bond1.115=
:1" \<br> =A0 =A0 =A0 =A0op monitor interval=3D"40" timeout=
=3D"20" \<br>
=A0 =A0 =A0 =A0meta target-role=3D"Started"<br>primitive EMS ocf=
:heartbeat:jboss \<br> =A0 =A0 =A0 =A0params jboss_home=3D"/opt/<a hre=
f=3D"http://jboss-5.1.0.GA">jboss-5.1.0.GA</a>" <br>java_home=3D"=
/opt/jdk1.6.0_29/" \<br>
=A0 =A0 =A0 =A0op start interval=3D"0" timeout=3D"240"=
\<br> =A0 =A0 =A0 =A0op stop interval=3D"0" timeout=3D"240&=
quot; \<br> =A0 =A0 =A0 =A0op monitor interval=3D"30s" timeout=3D=
"40s"<br>primitive NDB_MGMT ocf:mcg:NDB_MGM_RA \<br>
=A0 =A0 =A0 =A0op monitor interval=3D"120" timeout=3D"120&q=
uot;<br>primitive NDB_VIP ocf:heartbeat:IPaddr2 \<br> =A0 =A0 =A0 =A0params=
ip=3D"192.168.117.50" cidr_netmask=3D"255.255.255.255"=
<br>nic=3D"bond0.117:1" \</b><br>
=A0 =A0 =A0 <b style=3D"color:rgb(51,102,255)">=A0op monitor interval=3D&q=
uot;30" timeout=3D"10"<br>primitive Rmgr ocf:mcg:RM_RA \<br>=
=A0 =A0 =A0 =A0op monitor interval=3D"60" role=3D"Master&qu=
ot; timeout=3D"30" <br>
on-fail=3D"restart" \<br> =A0 =A0 =A0 =A0op monitor interval=3D&q=
uot;40" role=3D"Slave" timeout=3D"40" on-fail=3D&q=
uot;restart"<br>primitive Tmgr ocf:mcg:TM_RA \<br> =A0 =A0 =A0 =A0op m=
onitor interval=3D"60" role=3D"Master" timeout=3D"=
30" <br>
on-fail=3D"restart" \<br> =A0 =A0 =A0 =A0op monitor interval=3D&q=
uot;40" role=3D"Slave" timeout=3D"40" on-fail=3D&q=
uot;restart"<br>primitive mysql ocf:mcg:MYSQLD_RA \<br> =A0 =A0 =A0 =
=A0op monitor interval=3D"180" timeout=3D"200"<br>
primitive ndbd ocf:mcg:NDBD_RA \<br> =A0 =A0 =A0 =A0op monitor interval=3D&=
quot;120" timeout=3D"120"<br>primitive pimd ocf:mcg:PIMD_RA =
\<br> =A0 =A0 =A0 =A0op monitor interval=3D"60" role=3D"Mast=
er" timeout=3D"30" <br>
on-fail=3D"restart" \<br> =A0 =A0 =A0 =A0op monitor interval=3D&q=
uot;40" role=3D"Slave" timeout=3D"40" on-fail=3D&q=
uot;restart"<br>ms ms_Rmgr Rmgr \<br> =A0 =A0 =A0 =A0meta master-max=
=3D"1" master-max-node=3D"1" clone-max=3D"2" =
<br>
clone-node-max=3D"1" interleave=3D"true" notify=3D"=
;true"<br>ms ms_Tmgr Tmgr \<br> =A0 =A0 =A0 =A0meta master-max=3D"=
;1" master-max-node=3D"1" clone-max=3D"2" <br>clon=
e-node-max=3D"1" interleave=3D"true" notify=3D"tru=
e"<br>
ms ms_pimd pimd \<br> =A0 =A0 =A0 =A0meta master-max=3D"1" master=
-max-node=3D"1" clone-max=3D"2" <br>clone-node-max=3D&q=
uot;1" interleave=3D"true" notify=3D"true"<br>clon=
e EMS_CLONE EMS \<br>
=A0 =A0 =A0 =A0meta globally-unique=3D"false" clone-max=3D"=
2" clone-node-max=3D"1" <br>target-role=3D"Started"=
;<br>clone mysqld_clone mysql \<br> =A0 =A0 =A0 =A0meta globally-unique=3D&=
quot;false" clone-max=3D"2" clone-node-max=3D"1"<b=
r>
clone ndbdclone ndbd \<br> =A0 =A0 =A0 =A0meta globally-unique=3D"fals=
e" clone-max=3D"2" clone-node-max=3D"1" <br>target=
-role=3D"Started"<br>colocation ip_with_Pimd inf: ClusterIP ms_pi=
md:Master<br>
colocation ip_with_RM inf: ClusterIP ms_Rmgr:Master<br>colocation ip_with_T=
M inf: ClusterIP ms_Tmgr:Master<br>colocation ndb_vip-with-ndb_mgm inf: NDB=
_MGMT NDB_VIP<br>order RM-after-mysqld inf: mysqld_clone ms_Rmgr<br>order T=
M-after-RM inf: ms_Rmgr ms_Tmgr<br>
order ip-after-pimd inf: ms_pimd ClusterIP<br>order mysqld-after-ndbd inf: =
ndbdclone mysqld_clone<br>order pimd-after-TM inf: ms_Tmgr ms_pimd<br>prope=
rty $id=3D"cib-bootstrap-options" \<br> =A0 =A0 =A0 =A0dc-version=
=3D"1.0.11-55a5f5be61c367cbd676c2f0ec4f1c62b38223d7" \<br>
=A0 =A0 =A0 =A0cluster-infrastructure=3D"Heartbeat" \<br> =A0 =
=A0 =A0 =A0no-quorum-policy=3D"ignore" \<br> =A0 =A0 =A0 =A0stoni=
th-enabled=3D"false"<br>rsc_defaults $id=3D"rsc-options"=
; \<br> =A0 =A0 =A0 =A0migration_threshold=3D"3" \<br>
=A0 =A0 =A0 =A0resource-stickiness=3D"100"*<br><br></b><span sty=
le=3D"color:rgb(51,102,255)"><span style=3D"color:rgb(0,0,0)">With both nod=
es up and running, if heartbeat service is stopped on any of </span></span>=
<br>the nodes, following resources are restarted on the other node:<br>
mysqld_clone, ms_Rmgr, ms_Tmgr, ms_pimd, ClusterIP<br><br>From the Heartbea=
t debug logs, it seems policy engine is initiating a restart operation for =
the above resources but the reason for the same is not clear.<br><br>Follow=
ing are some excerpts from the logs:<br>
<br>"<b style=3D"color:rgb(51,102,255)">Feb 07 11:06:31 MCG1 pengine: =
[20534]: info: determine_online_status: Node mcg2 is shutting down<br>Feb 0=
7 11:06:31 MCG1 pengine: [20534]: info: determine_online_status: Node mcg1 =
is online<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_print: =A0Master/Slave=
Set: ms_Rmgr<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_activ=
e: Resource Rmgr:0 active on mcg1<br>Feb 07 11:06:31 MCG1 pengine: [20534]:=
debug: native_ac</b><b style=3D"color:rgb(51,102,255)">tive: Resource Rmgr=
:0 active on mcg1<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource</b><b=
style=3D"color:rgb(51,102,255)"> Rmgr:1 active on mcg2<br>Feb 07 11:06:31 =
MCG1 pengine: [20534]: debug: native_active: Resource Rmgr:1 active on mcg2=
<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: =A0 =A0 =A0Mast=
ers: [ mcg1 ]<br>Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print=
: =A0 =A0 =A0Slaves: [ mcg2 ]<br>Feb 07 11:06:31 MCG1 pengine: [20534]: not=
ice: clone_print: =A0Master/Slave Set: ms_Tmgr<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource Tmgr:=
0 active on mcg1<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_ac=
tive: Resource Tmgr:0 active on mcg1<br>Feb 07 11:06:31 MCG1 pengine: [2053=
4]: debug: native_active: Resource Tmgr:1 active on mcg2<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource Tmgr:=
1 active on mcg2<br>Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_pr=
int: =A0 =A0 =A0Masters: [ mcg1 ]<br>Feb 07 11:06:31 MCG1 pengine: [20534]:=
notice: short_print: =A0 =A0 =A0Slaves: [ mcg2 ]<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_print: =A0Master/Slave=
Set: ms_pimd<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_activ=
e: Resource pimd:0 active on mcg1<br>Feb 07 11:06:31 MCG1 pengine: [20534]:=
debug: native_active: Resource pimd:0 active on mcg1<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource pimd:=
1 active on mcg2<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_ac=
tive: Resource pimd:1 active on mcg2<br>Feb 07 11:06:31 MCG1 pengine: [2053=
4]: notice: short_print: =A0 =A0 =A0Masters: [ mcg1 ]<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: =A0 =A0 =A0Slav=
es: [ mcg2 ]<br>Feb 07 11:06:31 MCG1 pengine: [20534]: notice: native_print=
: ClusterIP =A0(ocf::mcg:MCG_VIPaddr_RA): =A0 =A0 =A0Started mcg1<br>Feb 07=
11:06:31 MCG1 pengine: [20534]: notice: clone_print: =A0Clone Set: EMS_CLO=
NE</b><br>
<b style=3D"color:rgb(51,102,255)">Feb 07 11:06:31 MCG1 pengine: [20534]: d=
ebug: native_active: Resource EMS:0 active on mcg1<br>Feb 07 11:06:31 MCG1 =
pengine: [20534]: debug: native_active: Resource EMS:0 active on mcg1<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource EMS:1=
active on mcg2<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_act=
ive: Resource EMS:1 active on mcg2<br>Feb 07 11:06:31 MCG1 pengine: [20534]=
: notice: short_print: =A0 =A0 =A0Started: [ mcg1 mcg2 ]<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: native_print: NDB_VIP =A0 =
=A0(ocf::heartbeat:IPaddr2): =A0 =A0 =A0 Started mcg1<br>Feb 07 11:06:31 MC=
G1 pengine: [20534]: notice: native_print: NDB_MGMT =A0 (ocf::mcg:NDB_MGM_R=
A): =A0Started mcg1<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_print: =A0Clone Set: m=
ysqld_clone<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: nati</b><b sty=
le=3D"color:rgb(51,102,255)">ve_active: Resource mysql:0 active on mcg1<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource mysql=
:0 active on mcg1<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_a=
ctive: Resource mysql:1 active on mcg2<br>Feb 07 11:06:31 MCG1 pengine: [20=
534]: debug: native_active: Resource mysql:1 active on mcg2<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: =A0 =A0 =A0Star=
ted: [ mcg1 mcg2 ]<br>Feb 07 11:06:31 MCG1 pengine: [20534]: notice: clone_=
print: =A0Clone Set: ndbdclone<br>Feb 07 11:06:31 MCG1 pengine: [20534]: de=
bug: native_active: Resource ndbd:0 active on mcg1<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_active: Resource ndbd:=
0 active on mcg1<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_ac=
tive: Resource ndbd:1 active on mcg2<br>Feb 07 11:06:31 MCG1 pengine: [2053=
4]: debug: native_active: Resource ndbd:1 active on mcg2<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: short_print: =A0 =A0 =A0Star=
ted: [ mcg1 mcg2 ]<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_=
apply_stickiness: Resource Rmgr:1: preferring current location (node=3Dmcg2=
, weight=3D100)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Reso=
urce Tmgr:1: preferring current location (node=3Dmcg2, weight=3D100)</b><br=
>Fe<b style=3D"color:rgb(51,102,255)">b 07 11:06:31 MCG1 pengine: [20534]: =
debug: common_apply_stickiness: Resource pimd:1: preferring current locatio=
n (node=3Dmcg2, weight=3D100)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Reso=
urce EMS:1: preferring current location (node=3Dmcg2, weight=3D100)<br>Feb =
07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Resource=
mysql:1: preferring current location (node=3Dmcg2, weight=3D100)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Reso=
urce ndbd:1: preferring current location (node=3Dmcg2, weight=3D100)<br>Feb=
07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Resourc=
e Rmgr:0: preferring current location (node=3Dmcg1, weight=3D100)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Reso=
urce Tmgr:0: preferring current location (node=3Dmcg1, weight=3D100)<br>Feb=
07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Resourc=
e pimd:0: preferring current location (node=3Dmcg1, weight=3D100)</b><b sty=
le=3D"color:rgb(51,102,255)"><br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Reso=
urce ClusterIP: preferring current location (node=3Dmcg1, weight=3D100)<br>=
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Reso=
urce EMS:0: preferring current location (node=3Dmcg1, weight=3D100)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Reso=
urce NDB_VIP: preferring current location (node=3Dmcg1, weight=3D100)<br>Fe=
b 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Resour=
ce NDB_MGMT: preferring current location (node=3Dmcg1, weight=3D100)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Reso=
urce mysql:0: preferring current location (node=3Dmcg1, weight=3D100)<br>Fe=
b 07 11:06:31 MCG1 pengine: [20534]: debug: common_apply_stickiness: Resour=
ce ndbd:0: preferring current location (node=3Dmcg1, weight=3D100)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning=
mcg1 to Rmgr:0<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_ass=
ign_node: All nodes for resource Rmgr:1 are unavailable, unclean or shuttin=
g down (mcg2: 0, -1000000)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not=
allocate a node for Rmgr:1<br>Feb 07 11:06:31 MCG1 pengine: [20534]: info:=
native_color: Resource Rmgr:1 cannot run anywhere<br>Feb 07 11:06:31 MCG1 =
pengine: [20534]: debug: clone_color: Allocated 1 ms_Rmgr instances of a po=
ssible 2<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_color: Rmgr:0 master s=
core: 10<br>Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: Prom=
oting Rmgr:0 (Master mcg1)<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug:=
master_color: Rmgr:1 master score: 0<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: ms_Rmgr: Promote=
d 1 instances of a possible 1 to master<br>Feb 07 11:06:31 MCG1 pengine: [2=
0534]: debug: native_assign_node: Assigning mcg1 to Tmgr:0<br>Feb 07 11:06:=
31 MCG1 pengine: [20534]: debug: native_assign_node: All nodes for resource=
Tmgr:1 are unavailable, unclean or shutting down (mcg2: 0, -1000000)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not=
allocate a node for Tmgr:1<br>Feb 07 11:06:31 MCG1 pengine: [20534]: info:=
native_color: Resource Tmgr:1 cannot run anywhere</b><br><b style=3D"color=
:rgb(51,102,255)">Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_color=
: Allocated 1 ms_Tmgr instances of a possible 2<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_color: Tmgr:0 master s=
core: 10<br>Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: Prom=
oting Tmgr:0 (Master mcg1)<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug:=
master_color: Tmgr:1 master score: 0<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: ms_Tmgr: Promote=
d 1 instances of a possible 1 to master<br>Feb 07 11:06:31 MCG1 pengine: [2=
0534]: debug: native_assign_node: Assigning mcg1 to pimd:0<br>Feb 07 11:06:=
31 MCG1 pengine: [20534]: debug: native_assign_node: All nodes for resource=
pimd:1 are unavailable, unclean or shutting down (mcg2: 0, -1000000)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not=
allocate a node for pimd:1<br>Feb 07 11:06:31 MCG1 pengine: [20534]: info:=
native_color: Resource pimd:1 cannot run anywhere</b><br><b style=3D"color=
:rgb(51,102,255)">Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_color=
: Allocated 1 ms_pimd instances of a possible 2<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_color: pimd:0 master s=
core: 10<br>Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: Prom=
oting pimd:0 (Master mcg1)<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug:=
master_color: pimd:1 master score: 0<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: info: master_color: ms_pimd: Promote=
d 1 instances of a possible 1 to master<br>Feb 07 11:06:31 MCG1 pengine: [2=
0534]: debug: native_assign_node: Assigning mcg1 to ClusterIP<br>Feb 07 11:=
06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning mcg1 to E=
MS:0<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: All nodes=
for resource EMS:1 are unavailable, unclean or shutting down (mcg2: 0, -10=
00000)<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node:=
Could not allocate a node for EMS:1<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: info: native_color: Resource EMS:1 c=
annot run anywhere<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_c=
olor: Allocated 1 EMS_CLONE instances of a possible 2<br>Feb 07 11:06:31 MC=
G1 pengine: [20534]: debug: native_assign_node: Assigning mcg1 to NDB_VIP<b=
r>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning=
mcg1 to NDB_MGMT<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_a=
ssign_node: Assigning mcg1 to mysql:0<br>Feb 07 11:06:31 MCG1 pengine: [205=
34]: debug: native_assign_node: All nodes for resource mysql:1 are unavaila=
ble, unclean or shutting down (mcg2: 0, -1000000)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not=
allocate a node for mysql:1<br>Feb 07 11:06:31 MCG1 pengine: [20534]: info=
: native_color: Resource mysql:1 cannot run anywhere<br>Feb 07 11:06:31 MCG=
1 pengine: [20534]: debug: clone_color: Allocated 1 mysqld_clone instances =
of a possible 2<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Assigning=
mcg1 to ndbd:0<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_ass=
ign_node: All nodes for resource ndbd:1 are unavailable, unclean or shuttin=
g down (mcg2: 0, -1000000)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not=
allocate a node for ndbd:1<br>Feb 07 11:06:31 MCG1 pengine: [20534]: info:=
native_color: Resource ndbd:1 cannot run anywhere<br>Feb 07 11:06:31 MCG1 =
pengine: [20534]: debug: clone_color: Allocated 1 ndbdclone instances of a =
possible 2<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: master_create_actions: Creati=
ng actions for ms_Rmgr<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: mas=
ter_create_actions: Creating actions for ms_Tmgr<br>Feb 07 11:06:31 MCG1 pe=
ngine: [20534]: debug: master_create_actions: Creating actions for ms_pimd<=
br>
Feb 07 11:06:31 MCG1 pengine: [20534]: info: stage6: Scheduling Node mcg2 f=
or shutdown<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_orde=
r_lh: Pairing Rmgr:0 with Tmgr:0<br>Feb 07 11:06:31 MCG1 pengine: [20534]: =
debug: find_compatible_child: Can't pair Tmgr:1 with ms_Rmgr<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: No match =
found for Tmgr:1 (0)<br>Feb 07 11:06:31 MCG1 pengine: [20534]: info: clone_=
rsc_order_lh: Inhibiting Tmgr:1 from being active<br>Feb 07 11:06:31 MCG1 p=
engine: [20534]: debug: native_assign_node: Could not allocate a node for T=
mgr:1<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing T=
mgr:0 with Rmgr:0<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rs=
c_order_lh: Pairing Tmgr:1 with Rmgr:1<br>Feb 07 11:06:31 MCG1 pengine: [20=
534]: debug: clone_rsc_order_lh: Pairing Tmgr:0 with pimd:0<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: find_compatible_child: Can=
9;t pair pimd:1 with ms_Tmgr<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debu=
g: clone_rsc_order_lh: No match found for pimd:1 (0)<br>Feb 07 11:06:31 MCG=
1 pengine: [20534]: info: clone_rsc_order_lh: Inhibiting pimd:1 from being =
active<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: native_assign_node: Could not=
allocate a node for pimd:1<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug=
: clone_rsc_order_lh: Pairing pimd:0 with Tmgr:0<br>Feb 07 11:06:31 MCG1 pe=
ngine: [20534]: debug: clone_rsc_order_lh: Pairing pimd:1 with Tmgr:1<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_rsc_order_lh: Pairing R=
mgr:0 with mysql:0<br>Feb 07 11:06:31 MCG1 pengine: [20534]: debug: clone_r=
sc_order_lh: Pairing Rmgr:1 with mysql:1<br>Feb 07 11:06:31 MCG1 pengine: [=
20534]: notice: LogActions: Restart resource Rmgr:0 =A0 =A0 =A0(Master mcg1=
)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Stop =A0 =A0reso=
urce Rmgr:1 =A0 =A0 =A0(mcg2)<br>Feb 07 11:06:31 MCG1 pengine: [20534]: not=
ice: LogActions: Restart resource Tmgr:0 =A0 =A0 =A0(Master mcg1)<br>Feb 07=
11:06:31 MCG1 pengine: [20534]: notice: LogActions: Stop =A0 =A0resource T=
mgr:1 =A0 =A0 =A0(mcg2)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Restart resource=
pimd:0 =A0 =A0 =A0(Master mcg1)<br>Feb 07 11:06:31 MCG1 pengine: [20534]: =
notice: LogActions: Stop =A0 =A0resource pimd:1 =A0 =A0 =A0(mcg2)<br>Feb 07=
11:06:31 MCG1 pengine: [20534]: notice: LogActions: Restart resource Clust=
erIP =A0 (Started mcg1)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Leave =A0 resour=
ce EMS:0 =A0 =A0 =A0 (Started mcg1)<br>Feb 07 11:06:31 MCG1 pengine: [20534=
]: notice: LogActions: Stop =A0 =A0resource EMS:1 =A0 =A0 =A0 (mcg2)<br>Feb=
07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Leave =A0 resource =
NDB_VIP =A0 =A0 (Started mcg1)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Leave =A0 resour=
ce NDB_MGMT =A0 =A0(Started mcg1)<br>Feb 07 11:06:31 MCG1 pengine: [20534]:=
notice: LogActions: Restart resource mysql:0 =A0 =A0 (Started mcg1)<br>Feb=
07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Stop =A0 =A0resourc=
e mysql:1 =A0 =A0 (mcg2)<br>
Feb 07 11:06:31 MCG1 pengine: [20534]: notice: LogActions: Leave =A0 resour=
ce ndbd:0 =A0 =A0 =A0(Started mcg1)<br>Feb 07 11:06:31 MCG1 pengine: [20534=
]: notice: LogActions: Stop =A0 =A0resource ndbd:1 =A0 =A0 =A0(mcg2)<br>&qu=
ot;<br></b>Thanks in advance.<br>
<br>Regards<br>Neha Chatrath <br>
--bcaec52c6a5f4d107e04b85d5729--
More information about the Pacemaker
mailing list