<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class="">Hello all,</div><div class=""><br class=""></div><div class="">I am trying to get a Corosync 2 cluster going on CentOS 6.7 but I am running in a bit of a problem with either Corosync or Pacemaker.</div><div class="">crm reports that all my nodes are offline and the stack is unknown (I am not sure if that is relevant).</div><div class=""><br class=""></div><div class="">I believe both nodes are actually present and seen in corosync, but they may not be considered as such by pacemaker.</div><div class="">I have messages in the logs saying that the processes cannot get the node name and default to uname -n: </div><div class=""><br class=""></div><div class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Defaulting to uname -n for the local corosync node name<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 is now known as <a href="http://hack1.example.com" class="">hack1.example.com</a></div><div class=""><br class=""></div><div class="">The uname -n is correct as far that is concerned.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Does this mean anything to anyone here? </div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">[Lots of details to follow]...</div><div class=""><br class=""></div><div class="">I compiled my own versions of Corosync, Pacemaker, crm and the resource-agents seemingly without problems.</div><div class=""><br class=""></div><div class="">Here is what I currently have installed:</div><div class=""><br class=""></div><div class=""><font face="Courier" class=""># corosync -v<br class="">Corosync Cluster Engine, version '2.3.5'<br class="">Copyright (c) 2006-2009 Red Hat, Inc.</font></div><div class=""><br class=""></div><div class=""><font face="Courier" class=""># pacemakerd -F<br class="">Pacemaker 1.1.13 (Build: 5b41ae1)<br class=""> Supporting v3.0.10: generated-manpages agent-manpages ascii-docs ncurses libqb-logging libqb-ipc lha-fencing upstart nagios corosync-native atomic-attrd libesmtp acls</font></div><div class=""><br class=""></div><div class=""># crm --version<br class="">crm 2.2.0-rc3</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Here is the output of crm status:</div><div class=""><br class=""></div><div class=""><font face="Courier" class=""># crm status<br class="">Last updated: Thu Dec 10 12:47:50 2015<span class="Apple-tab-span" style="white-space:pre"> </span>Last change: Thu Dec 10 12:02:33 2015 by root via cibadmin on <a href="http://hack1.example.com" class="">hack1.example.com</a><br class=""><b class="">Stack: unknown</b><br class="">Current DC: NONE<br class="">2 nodes and 0 resources configured<br class=""><br class=""><b class="">OFFLINE: [ <a href="http://hack1.example.com" class="">hack1.example.com</a> <a href="http://hack2.example.com" class="">hack2.example.com</a> ]</b><br class=""><br class="">Full list of resources:</font></div><div class=""><br class=""></div><div class="">{nothing to see here}</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><font face="Courier" class=""># corosync-cmapctl | grep members<br class="">runtime.totem.pg.mrp.srp.members.739513528.config_version (u64) = 0<br class=""><b class="">runtime.totem.pg.mrp.srp.members.739513528.ip (str) = r(0) ip(172.20.20.184)</b><br class="">runtime.totem.pg.mrp.srp.members.739513528.join_count (u32) = 1<br class="">runtime.totem.pg.mrp.srp.members.739513528.status (str) = joined<br class="">runtime.totem.pg.mrp.srp.members.739513590.config_version (u64) = 0<br class=""><b class="">runtime.totem.pg.mrp.srp.members.739513590.ip (str) = r(0) ip(172.20.20.246)</b><br class="">runtime.totem.pg.mrp.srp.members.739513590.join_count (u32) = 1<br class="">runtime.totem.pg.mrp.srp.members.739513590.status (str) = joined</font></div><div class=""><br class=""></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""># uname -n<br class=""><a href="http://hack1.example.com" class="">hack1.example.com</a></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""># corosync-cfgtool -s<br class="">Printing ring status.<br class="">Local node ID 739513528<br class="">RING ID 0<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>id<span class="Apple-tab-span" style="white-space:pre"> </span>= 172.20.20.184<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>status<span class="Apple-tab-span" style="white-space:pre"> </span>= ring 0 active with no faults</font></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><font face="Courier" class=""># uname -n<br class=""><a href="http://hack2.example.com" class="">hack2.example.com</a></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""># corosync-cfgtool -s<br class="">Printing ring status.<br class="">Local node ID 739513590<br class="">RING ID 0<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>id<span class="Apple-tab-span" style="white-space:pre"> </span>= 172.20.20.246<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>status<span class="Apple-tab-span" style="white-space:pre"> </span>= ring 0 active with no faults</font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Shouldn’t I see both nodes in the same ring?</div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">My corosync config is currently defined as:</div><div class=""><br class=""></div><div class=""><font face="Courier" class=""># egrep -v '#' /etc/corosync/corosync.conf<br class="">totem {<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>version: 2<br class=""><br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>crypto_cipher: none<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>crypto_hash: none<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>clear_node_high_bit: yes<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>cluster_name: hack_cluster<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>interface {<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>ringnumber: 0<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>bindnetaddr: 172.20.0.0<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>mcastaddr: 239.255.1.1<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>mcastport: 5405<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>ttl: 1<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>}<br class=""><br class="">}<br class=""><br class="">logging {<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>fileline: on<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>to_stderr: no<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>to_logfile: yes<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>logfile: /var/log/cluster/corosync.log<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>to_syslog: yes<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>debug: off<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>timestamp: on<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>logger_subsys {<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>subsys: QUORUM<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>debug: off<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span>}<br class="">}</font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""># cat /etc/corosync/service.d/pacemaker<br class="">service {<br class=""> name: pacemaker<br class=""> ver: 1<br class="">}</font></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">And here is my pacemaker configuration:</div><div class=""><br class=""></div><div class=""><font face="Courier" class=""># crm config show xml<br class=""><?xml version="1.0" ?><br class=""><cib num_updates="0" update-origin="<a href="http://hack1.example.com" class="">hack1.example.com</a>" crm_feature_set="3.0.10" validate-with="pacemaker-2.4" update-client="cibadmin" epoch="13" admin_epoch="0" update-user="root" cib-last-written="Thu Dec 10 13:35:06 2015"><br class=""> <configuration><br class=""> <crm_config><br class=""> <cluster_property_set id="cib-bootstrap-options"><br class=""> <nvpair name="stonith-enabled" value="false" id="cib-bootstrap-options-stonith-enabled"/><br class=""> <nvpair name="no-quorum-policy" value="ignore" id="cib-bootstrap-options-no-quorum-policy"/><br class=""> </cluster_property_set><br class=""> </crm_config><br class=""> <nodes><br class=""> <node uname="<a href="http://hack1.example.com" class="">hack1.example.com</a>" id="<a href="http://hack1.example.com" class="">hack1.example.com</a>"><br class=""> <instance_attributes id="<a href="http://hack1.example.com" class="">hack1.example.com</a>-instance_attributes"><br class=""> <nvpair name="standby" value="off" id="<a href="http://hack1.example.com" class="">hack1.example.com</a>-instance_attributes-standby"/><br class=""> </instance_attributes><br class=""> </node><br class=""> <node uname="<a href="http://hack2.example.com" class="">hack2.example.com</a>" id="<a href="http://hack2.example.com" class="">hack2.example.com</a>"><br class=""> <instance_attributes id="<a href="http://hack2.example.com" class="">hack2.example.com</a>-instance_attributes"><br class=""> <nvpair name="standby" value="off" id="<a href="http://hack2.example.com" class="">hack2.example.com</a>-instance_attributes-standby"/><br class=""> </instance_attributes><br class=""> </node><br class=""> </nodes><br class=""> <resources/><br class=""> <constraints/><br class=""> </configuration><br class=""></cib></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><br class=""></div><div class="">And finally some logs that might be relevant: </div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [MAIN ] main.c:1227 Corosync Cluster Engine ('2.3.5'): started and ready to provide service.<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync info [MAIN ] main.c:1228 Corosync built-in features: pie relro bindnow<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [TOTEM ] totemnet.c:248 Initializing transport (UDP/IP Multicast).<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [TOTEM ] totemcrypto.c:579 Initializing transmit/receive security (NSS) crypto: none hash: none<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [TOTEM ] totemudp.c:671 The network interface [172.20.20.184] is now up.<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [SERV ] service.c:174 Service engine loaded: corosync configuration map access [0]<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync info [QB ] ipc_setup.c:377 server name: cmap<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [SERV ] service.c:174 Service engine loaded: corosync configuration service [1]<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync info [QB ] ipc_setup.c:377 server name: cfg<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [SERV ] service.c:174 Service engine loaded: corosync cluster closed process group service v1.01 [2]<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync info [QB ] ipc_setup.c:377 server name: cpg<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [SERV ] service.c:174 Service engine loaded: corosync profile loading service [4]<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [SERV ] service.c:174 Service engine loaded: corosync cluster quorum service v0.1 [3]<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync info [QB ] ipc_setup.c:377 server name: quorum<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [TOTEM ] totemsrp.c:2095 A new membership (172.20.20.184:300) was formed. Members joined: 739513528<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [MAIN ] main.c:305 Completed service synchronization, ready to provide service.<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [TOTEM ] totemsrp.c:2095 A new membership (172.20.20.184:304) was formed. Members joined: 739513590<br class="">Dec 10 13:38:50 [2227] <a href="http://hack1.example.com" class="">hack1.example.com</a> corosync notice [MAIN ] main.c:305 Completed service synchronization, ready to provide service.<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: notice: mcp_read_config:<span class="Apple-tab-span" style="white-space:pre"> </span>Configured corosync to accept connections from group 500: OK (1)<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: notice: main:<span class="Apple-tab-span" style="white-space:pre"> </span>Starting Pacemaker 1.1.13 (Build: 5b41ae1): generated-manpages agent-manpages ascii-docs ncurses libqb-logging libqb-ipc lha-fencing upstart nagios corosync-native atomic-attrd libesmtp acls<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: main:<span class="Apple-tab-span" style="white-space:pre"> </span>Maximum core file size is: 18446744073709551615<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: qb_ipcs_us_publish:<span class="Apple-tab-span" style="white-space:pre"> </span>server name: pacemakerd<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513528<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry 212e3751-e79f-4a72-927b-6e0176a9b35c/0x1b68e50 for node (null)/739513528 (1 total)<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 has uuid 739513528<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>cluster_connect_cpg: Node (null)[739513528] - corosync-cpg is now online<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: error: cluster_connect_quorum:<span class="Apple-tab-span" style="white-space:pre"> </span>Corosync quorum is not configured<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Defaulting to uname -n for the local corosync node name<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 is now known as <a href="http://hack1.example.com" class="">hack1.example.com</a><br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Using uid=500 and group=500 for process cib<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Forked child 2231 for process cib<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Forked child 2232 for process stonith-ng<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Forked child 2233 for process lrmd<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Using uid=500 and group=500 for process attrd<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Forked child 2234 for process attrd<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Using uid=500 and group=500 for process pengine<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Forked child 2235 for process pengine<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Using uid=500 and group=500 for process crmd<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: start_child:<span class="Apple-tab-span" style="white-space:pre"> </span>Forked child 2236 for process crmd<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: main:<span class="Apple-tab-span" style="white-space:pre"> </span>Starting mainloop<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 joined group pacemakerd (counter=0.0)<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 still member of group pacemakerd (peer=<a href="http://hack1.example.com" class="">hack1.example.com</a>, counter=0.0)<br class="">Dec 10 13:38:52 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: crm_log_init:<span class="Apple-tab-span" style="white-space:pre"> </span>Changed active directory to /var/lib/heartbeat/cores/hacluster<br class="">Dec 10 13:38:52 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: warning: crm_is_writable:<span class="Apple-tab-span" style="white-space:pre"> </span>/var/lib/pacemaker/cib should be owned and r/w by group haclient<br class="">Dec 10 13:38:52 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: get_cluster_type:<span class="Apple-tab-span" style="white-space:pre"> </span>Verifying cluster type: 'corosync'<br class="">Dec 10 13:38:52 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: get_cluster_type:<span class="Apple-tab-span" style="white-space:pre"> </span>Assuming an active 'corosync' cluster<br class="">Dec 10 13:38:52 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: retrieveCib:<span class="Apple-tab-span" style="white-space:pre"> </span>Reading cluster configuration file /var/lib/pacemaker/cib/cib.xml (digest: /var/lib/pacemaker/cib/cib.xml.sig)<br class="">Dec 10 13:38:52 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: validate_with_relaxng:<span class="Apple-tab-span" style="white-space:pre"> </span>Creating RNG parser context<br class="">Dec 10 13:38:52 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: crm_log_init:<span class="Apple-tab-span" style="white-space:pre"> </span>Changed active directory to /var/lib/heartbeat/cores/hacluster<br class="">Dec 10 13:38:52 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: main:<span class="Apple-tab-span" style="white-space:pre"> </span>Starting up<br class="">Dec 10 13:38:52 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: get_cluster_type:<span class="Apple-tab-span" style="white-space:pre"> </span>Verifying cluster type: 'corosync'<br class="">Dec 10 13:38:52 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: get_cluster_type:<span class="Apple-tab-span" style="white-space:pre"> </span>Assuming an active 'corosync' cluster<br class="">Dec 10 13:38:52 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: notice: crm_cluster_connect:<span class="Apple-tab-span" style="white-space:pre"> </span>Connecting to cluster infrastructure: corosync<br class="">Dec 10 13:38:52 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: crm_log_init:<span class="Apple-tab-span" style="white-space:pre"> </span>Changed active directory to /var/lib/heartbeat/cores/hacluster<br class="">Dec 10 13:38:52 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: notice: main:<span class="Apple-tab-span" style="white-space:pre"> </span>CRM Git Version: 1.1.13 (5b41ae1)<br class="">Dec 10 13:38:52 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: crm_log_init:<span class="Apple-tab-span" style="white-space:pre"> </span>Changed active directory to /var/lib/heartbeat/cores/root<br class="">Dec 10 13:38:52 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: get_cluster_type:<span class="Apple-tab-span" style="white-space:pre"> </span>Verifying cluster type: 'corosync'<br class="">Dec 10 13:38:52 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: get_cluster_type:<span class="Apple-tab-span" style="white-space:pre"> </span>Assuming an active 'corosync' cluster<br class="">Dec 10 13:38:52 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: notice: crm_cluster_connect:<span class="Apple-tab-span" style="white-space:pre"> </span>Connecting to cluster infrastructure: corosync<br class="">Dec 10 13:38:52 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: warning: crm_is_writable:<span class="Apple-tab-span" style="white-space:pre"> </span>/var/lib/pacemaker/pengine should be owned and r/w by group haclient<br class="">Dec 10 13:38:52 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: warning: crm_is_writable:<span class="Apple-tab-span" style="white-space:pre"> </span>/var/lib/pacemaker/cib should be owned and r/w by group haclient<br class="">Dec 10 13:38:52 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: do_log:<span class="Apple-tab-span" style="white-space:pre"> </span>FSA: Input I_STARTUP from crmd_init() received in state S_STARTING<br class="">Dec 10 13:38:52 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: get_cluster_type:<span class="Apple-tab-span" style="white-space:pre"> </span>Verifying cluster type: 'corosync'<br class="">Dec 10 13:38:52 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: get_cluster_type:<span class="Apple-tab-span" style="white-space:pre"> </span>Assuming an active 'corosync' cluster<br class="">Dec 10 13:38:52 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: startCib:<span class="Apple-tab-span" style="white-space:pre"> </span>CIB Initialization completed successfully<br class="">Dec 10 13:38:52 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: notice: crm_cluster_connect:<span class="Apple-tab-span" style="white-space:pre"> </span>Connecting to cluster infrastructure: corosync<br class="">Dec 10 13:38:52 [2235] <a href="http://hack1.example.com" class="">hack1.example.com</a> pengine: info: crm_log_init:<span class="Apple-tab-span" style="white-space:pre"> </span>Changed active directory to /var/lib/heartbeat/cores/hacluster<br class="">Dec 10 13:38:52 [2235] <a href="http://hack1.example.com" class="">hack1.example.com</a> pengine: warning: crm_is_writable:<span class="Apple-tab-span" style="white-space:pre"> </span>/var/lib/pacemaker/pengine should be owned and r/w by group haclient<br class="">Dec 10 13:38:52 [2235] <a href="http://hack1.example.com" class="">hack1.example.com</a> pengine: info: qb_ipcs_us_publish:<span class="Apple-tab-span" style="white-space:pre"> </span>server name: pengine<br class="">Dec 10 13:38:52 [2235] <a href="http://hack1.example.com" class="">hack1.example.com</a> pengine: info: main:<span class="Apple-tab-span" style="white-space:pre"> </span>Starting pengine<br class="">Dec 10 13:38:52 [2233] <a href="http://hack1.example.com" class="">hack1.example.com</a> lrmd: info: crm_log_init:<span class="Apple-tab-span" style="white-space:pre"> </span>Changed active directory to /var/lib/heartbeat/cores/root<br class="">Dec 10 13:38:52 [2233] <a href="http://hack1.example.com" class="">hack1.example.com</a> lrmd: info: qb_ipcs_us_publish:<span class="Apple-tab-span" style="white-space:pre"> </span>server name: lrmd<br class="">Dec 10 13:38:52 [2233] <a href="http://hack1.example.com" class="">hack1.example.com</a> lrmd: info: main:<span class="Apple-tab-span" style="white-space:pre"> </span>Starting<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513590<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513590<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry f34a4388-23fc-4f86-8932-43c814eb5ad7/0x1b6a920 for node (null)/739513590 (2 total)<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 has uuid 739513590<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 still member of group pacemakerd (peer=(null), counter=0.1)<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>pcmk_cpg_membership: Node (null)[739513590] - corosync-cpg is now online<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 is now known as <a href="http://hack2.example.com" class="">hack2.example.com</a><br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: mcp_cpg_deliver:<span class="Apple-tab-span" style="white-space:pre"> </span>Ignoring process list sent by peer for local node<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: mcp_cpg_deliver:<span class="Apple-tab-span" style="white-space:pre"> </span>Ignoring process list sent by peer for local node<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: mcp_cpg_deliver:<span class="Apple-tab-span" style="white-space:pre"> </span>Ignoring process list sent by peer for local node<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: mcp_cpg_deliver:<span class="Apple-tab-span" style="white-space:pre"> </span>Ignoring process list sent by peer for local node<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: mcp_cpg_deliver:<span class="Apple-tab-span" style="white-space:pre"> </span>Ignoring process list sent by peer for local node<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: mcp_cpg_deliver:<span class="Apple-tab-span" style="white-space:pre"> </span>Ignoring process list sent by peer for local node<br class="">Dec 10 13:38:52 [2230] <a href="http://hack1.example.com" class="">hack1.example.com</a> pacemakerd: info: mcp_cpg_deliver:<span class="Apple-tab-span" style="white-space:pre"> </span>Ignoring process list sent by peer for local node<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513528<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry 5fbd08d1-fdbf-4f8c-85d0-bbbed1240969/0x180eb70 for node (null)/739513528 (1 total)<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 has uuid 739513528<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>cluster_connect_cpg: Node (null)[739513528] - corosync-cpg is now online<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: notice: crm_update_peer_state_iter:<span class="Apple-tab-span" style="white-space:pre"> </span>crm_update_peer_proc: Node (null)[739513528] - state is now member (was (null))<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: init_cs_connection_once:<span class="Apple-tab-span" style="white-space:pre"> </span>Connection to 'corosync': established<br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513528<br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry c2d2ccef-c87c-4b3c-8004-659f09113048/0x11fa8e0 for node (null)/739513528 (1 total)<br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 has uuid 739513528<br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>cluster_connect_cpg: Node (null)[739513528] - corosync-cpg is now online<br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: notice: crm_update_peer_state_iter:<span class="Apple-tab-span" style="white-space:pre"> </span>crm_update_peer_proc: Node (null)[739513528] - state is now member (was (null))<br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: init_cs_connection_once:<span class="Apple-tab-span" style="white-space:pre"> </span>Connection to 'corosync': established<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Defaulting to uname -n for the local corosync node name<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 is now known as <a href="http://hack1.example.com" class="">hack1.example.com</a><br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Defaulting to uname -n for the local corosync node name<br class="">Dec 10 13:38:53 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 is now known as <a href="http://hack1.example.com" class="">hack1.example.com</a><br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513528<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry 97e43f18-db5c-4496-b8fc-bd7b4a6ea711/0x1deba80 for node (null)/739513528 (1 total)<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 has uuid 739513528<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>cluster_connect_cpg: Node (null)[739513528] - corosync-cpg is now online<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: notice: crm_update_peer_state_iter:<span class="Apple-tab-span" style="white-space:pre"> </span>crm_update_peer_proc: Node (null)[739513528] - state is now member (was (null))<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: init_cs_connection_once:<span class="Apple-tab-span" style="white-space:pre"> </span>Connection to 'corosync': established<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: main:<span class="Apple-tab-span" style="white-space:pre"> </span>Cluster connection active<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: qb_ipcs_us_publish:<span class="Apple-tab-span" style="white-space:pre"> </span>server name: attrd<br class="">Dec 10 13:38:53 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: main:<span class="Apple-tab-span" style="white-space:pre"> </span>Accepting attribute updates<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Defaulting to uname -n for the local corosync node name<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 is now known as <a href="http://hack1.example.com" class="">hack1.example.com</a><br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: qb_ipcs_us_publish:<span class="Apple-tab-span" style="white-space:pre"> </span>server name: cib_ro<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: qb_ipcs_us_publish:<span class="Apple-tab-span" style="white-space:pre"> </span>server name: cib_rw<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: qb_ipcs_us_publish:<span class="Apple-tab-span" style="white-space:pre"> </span>server name: cib_shm<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: cib_init:<span class="Apple-tab-span" style="white-space:pre"> </span>Starting cib mainloop<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: cib_file_backup:<span class="Apple-tab-span" style="white-space:pre"> </span>Archived previous version as /var/lib/pacemaker/cib/cib-26.raw<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: cib_file_write_with_digest:<span class="Apple-tab-span" style="white-space:pre"> </span>Wrote version 0.13.0 of the CIB to disk (digest: d37e6c1873e854e52dd9b2caaa5e4beb)<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: cib_file_write_with_digest:<span class="Apple-tab-span" style="white-space:pre"> </span>Reading cluster configuration file /var/lib/pacemaker/cib/cib.dqtKlA (digest: /var/lib/pacemaker/cib/cib.BkV3eX)<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 joined group cib (counter=0.0)<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 still member of group cib (peer=<a href="http://hack1.example.com" class="">hack1.example.com</a>, counter=0.0)<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513590<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513590<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry 87459e91-7cff-4781-9c9a-5f78385e4b7c/0x1dec1d0 for node (null)/739513590 (2 total)<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 has uuid 739513590<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 still member of group cib (peer=(null), counter=0.1)<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>pcmk_cpg_membership: Node (null)[739513590] - corosync-cpg is now online<br class="">Dec 10 13:38:53 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: notice: crm_update_peer_state_iter:<span class="Apple-tab-span" style="white-space:pre"> </span>crm_update_peer_proc: Node (null)[739513590] - state is now member (was (null))<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: do_cib_control:<span class="Apple-tab-span" style="white-space:pre"> </span>CIB connection established<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: notice: crm_cluster_connect:<span class="Apple-tab-span" style="white-space:pre"> </span>Connecting to cluster infrastructure: corosync<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513528<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry 09d2eabe-fe50-4b40-b614-4f550dcbc677/0x156d0c0 for node (null)/739513528 (1 total)<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 has uuid 739513528<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>cluster_connect_cpg: Node (null)[739513528] - corosync-cpg is now online<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: init_cs_connection_once:<span class="Apple-tab-span" style="white-space:pre"> </span>Connection to 'corosync': established<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Defaulting to uname -n for the local corosync node name<br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 is now known as <a href="http://hack1.example.com" class="">hack1.example.com</a><br class="">Dec 10 13:38:53 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: peer_update_callback:<span class="Apple-tab-span" style="white-space:pre"> </span><a href="http://hack1.example.com" class="">hack1.example.com</a> is now in unknown state<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: error: cluster_connect_quorum:<span class="Apple-tab-span" style="white-space:pre"> </span>Corosync quorum is not configured<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: attrd_cib_connect:<span class="Apple-tab-span" style="white-space:pre"> </span>Connected to the CIB after 2 attempts<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: main:<span class="Apple-tab-span" style="white-space:pre"> </span>CIB connection active<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 joined group attrd (counter=0.0)<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 still member of group attrd (peer=<a href="http://hack1.example.com" class="">hack1.example.com</a>, counter=0.0)<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: notice: setup_cib:<span class="Apple-tab-span" style="white-space:pre"> </span>Watching for stonith topology changes<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: qb_ipcs_us_publish:<span class="Apple-tab-span" style="white-space:pre"> </span>server name: stonith-ng<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: main:<span class="Apple-tab-span" style="white-space:pre"> </span>Starting stonith-ng mainloop<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 joined group stonith-ng (counter=0.0)<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 still member of group stonith-ng (peer=<a href="http://hack1.example.com" class="">hack1.example.com</a>, counter=0.0)<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: do_ha_control:<span class="Apple-tab-span" style="white-space:pre"> </span>Connected to the cluster<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: lrmd_ipc_connect:<span class="Apple-tab-span" style="white-space:pre"> </span>Connecting to lrmd<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513590<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513590<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry 1edc2c5f-1438-4f5c-b5aa-e95861c4205e/0x1814190 for node (null)/739513590 (2 total)<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 has uuid 739513590<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 still member of group attrd (peer=(null), counter=0.1)<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>pcmk_cpg_membership: Node (null)[739513590] - corosync-cpg is now online<br class="">Dec 10 13:38:54 [2234] <a href="http://hack1.example.com" class="">hack1.example.com</a> attrd: notice: crm_update_peer_state_iter:<span class="Apple-tab-span" style="white-space:pre"> </span>crm_update_peer_proc: Node (null)[739513590] - state is now member (was (null))<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513590<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513590<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry 81f08c2d-6517-4b38-8fdc-51a4ada76af2/0x11fc5c0 for node (null)/739513590 (2 total)<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 has uuid 739513590<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 still member of group stonith-ng (peer=(null), counter=0.1)<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>pcmk_cpg_membership: Node (null)[739513590] - corosync-cpg is now online<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: notice: crm_update_peer_state_iter:<span class="Apple-tab-span" style="white-space:pre"> </span>crm_update_peer_proc: Node (null)[739513590] - state is now member (was (null))<br class="">Dec 10 13:38:54 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: cib_process_request:<span class="Apple-tab-span" style="white-space:pre"> </span>Forwarding cib_modify operation for section nodes to master (origin=local/crmd/3)<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: do_lrm_control:<span class="Apple-tab-span" style="white-space:pre"> </span>LRM connection established<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: do_started:<span class="Apple-tab-span" style="white-space:pre"> </span>Delaying start, no membership data (0000000000100000)<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 joined group crmd (counter=0.0)<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513528 still member of group crmd (peer=<a href="http://hack1.example.com" class="">hack1.example.com</a>, counter=0.0)<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Defaulting to uname -n for the local corosync node name<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: init_cib_cache_cb:<span class="Apple-tab-span" style="white-space:pre"> </span>Updating device list from the cib: init<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: cib_devices_update:<span class="Apple-tab-span" style="white-space:pre"> </span>Updating devices to version 0.13.0<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: notice: unpack_config:<span class="Apple-tab-span" style="white-space:pre"> </span>On loss of CCM Quorum: Ignore<br class="">Dec 10 13:38:54 [2232] <a href="http://hack1.example.com" class="">hack1.example.com</a> stonith-ng: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 is now known as <a href="http://hack2.example.com" class="">hack2.example.com</a><br class="">Dec 10 13:38:54 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513528<br class="">Dec 10 13:38:54 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Defaulting to uname -n for the local corosync node name<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: corosync_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Unable to get node name for nodeid 739513590<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: notice: get_node_name:<span class="Apple-tab-span" style="white-space:pre"> </span>Could not obtain a node name for corosync nodeid 739513590<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Created entry b34ca282-9c15-47de-8c98-cb59d1d8bed4/0x16b5130 for node (null)/739513590 (2 total)<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: crm_get_peer:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 has uuid 739513590<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: pcmk_cpg_membership:<span class="Apple-tab-span" style="white-space:pre"> </span>Node 739513590 still member of group crmd (peer=(null), counter=0.1)<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: crm_update_peer_proc:<span class="Apple-tab-span" style="white-space:pre"> </span>pcmk_cpg_membership: Node (null)[739513590] - corosync-cpg is now online<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: notice: crmd_enable_notifications:<span class="Apple-tab-span" style="white-space:pre"> </span>Notifications disabled<br class="">Dec 10 13:38:54 [2236] <a href="http://hack1.example.com" class="">hack1.example.com</a> crmd: info: do_started:<span class="Apple-tab-span" style="white-space:pre"> </span>Delaying start, no membership data (0000000000100000)<br class="">Dec 10 13:38:54 [2231] <a href="http://hack1.example.com" class="">hack1.example.com</a> cib: info: cib_process_request:<span class="Apple-tab-span" style="white-space:pre"> </span>Completed cib_modify operation for section nodes: OK (rc=0, origin=<a href="http://hack1.example.com/crmd/3" class="">hack1.example.com/crmd/3</a>, version=0.13.0)</font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class=""><font face="Courier" class=""><br class=""></font></div><div class="">Any help would be much appreciated.</div><div class=""><br class=""></div>Best regards,<br class=""><div apple-content-edited="true" class="">
<div style="color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; " class=""><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; " class="">--</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; " class="">Louis Munro<br class=""><br class=""></div></div>
</div>
<br class=""></body></html>