Sep 01 09:16:51 corosync [MAIN ] Corosync Cluster Engine ('trunk'): started and ready to provide service. Sep 01 09:16:51 corosync [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'. Sep 01 09:16:51 corosync [corosy] Warning: the to_file config paramater has been obsoleted. See corosync.conf man page to_logfile directive. Sep 01 09:16:51 corosync [TOTEM ] Token Timeout (1000 ms) retransmit timeout (238 ms) Sep 01 09:16:51 corosync [TOTEM ] token hold (180 ms) retransmits before loss (4 retrans) Sep 01 09:16:51 corosync [TOTEM ] join (60 ms) send_join (0 ms) consensus (800 ms) merge (200 ms) Sep 01 09:16:51 corosync [TOTEM ] downcheck (1000 ms) fail to recv const (50 msgs) Sep 01 09:16:51 corosync [TOTEM ] seqno unchanged const (30 rotations) Maximum network MTU 1500 Sep 01 09:16:51 corosync [TOTEM ] window size per rotation (50 messages) maximum messages per rotation (20 messages) Sep 01 09:16:51 corosync [TOTEM ] send threads (0 threads) Sep 01 09:16:51 corosync [TOTEM ] RRP token expired timeout (238 ms) Sep 01 09:16:51 corosync [TOTEM ] RRP token problem counter (2000 ms) Sep 01 09:16:51 corosync [TOTEM ] RRP threshold (10 problem count) Sep 01 09:16:51 corosync [TOTEM ] RRP mode set to none. Sep 01 09:16:51 corosync [TOTEM ] heartbeat_failures_allowed (0) Sep 01 09:16:51 corosync [TOTEM ] max_network_delay (50 ms) Sep 01 09:16:51 corosync [TOTEM ] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0 Sep 01 09:16:51 corosync [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0). Sep 01 09:16:51 corosync [TOTEM ] Receive multicast socket recv buffer size (288000 bytes). Sep 01 09:16:51 corosync [TOTEM ] Transmit multicast socket send buffer size (262142 bytes). Sep 01 09:16:51 corosync [TOTEM ] The network interface [198.38.17.40] is now up. Sep 01 09:16:51 corosync [TOTEM ] Created or loaded sequence id 752.198.38.17.40 for this ring. Sep 01 09:16:51 corosync [TOTEM ] entering GATHER state from 15. Sep 01 09:16:51 corosync [pcmk ] info: process_ais_conf: Reading configure Sep 01 09:16:51 corosync [pcmk ] info: config_find_init: Local handle: 2013064636357672961 for logging Sep 01 09:16:51 corosync [pcmk ] info: config_find_next: Processing additional logging options... Sep 01 09:16:51 corosync [pcmk ] info: get_config_opt: Found 'on' for option: debug Sep 01 09:16:51 corosync [pcmk ] info: get_config_opt: Found 'yes' for option: to_file Sep 01 09:16:51 corosync [pcmk ] info: get_config_opt: Found 'yes' for option: to_syslog Sep 01 09:16:51 corosync [pcmk ] info: get_config_opt: Found '/var/log/corosync.log' for option: logfile Sep 01 09:16:51 corosync [pcmk ] info: get_config_opt: Defaulting to 'daemon' for option: syslog_facility Sep 01 09:16:51 corosync [pcmk ] info: config_find_init: Local handle: 4730966301143465986 for service Sep 01 09:16:51 corosync [pcmk ] info: config_find_next: Processing additional service options... Sep 01 09:16:51 corosync [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_logd Sep 01 09:16:51 corosync [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_mgmtd Sep 01 09:16:51 corosync [pcmk ] info: pcmk_plugin_init: CRM: Initialized Sep 01 09:16:51 corosync [pcmk ] Logging: Initialized pcmk_plugin_init Sep 01 09:16:51 corosync [pcmk ] info: pcmk_plugin_init: Service: 9 Sep 01 09:16:51 corosync [pcmk ] info: pcmk_plugin_init: Local node id: 672212678 Sep 01 09:16:51 corosync [pcmk ] info: pcmk_plugin_init: Local hostname: royal Sep 01 09:16:51 corosync [pcmk ] info: update_member: Creating entry for node 672212678 born on 0 Sep 01 09:16:51 corosync [pcmk ] info: update_member: 0x128c1e0 Node 672212678 now known as royal (was: (null)) Sep 01 09:16:51 corosync [pcmk ] info: update_member: Node royal now has 1 quorum votes (was 0) Sep 01 09:16:51 corosync [pcmk ] info: update_member: Node 672212678/royal is now: member Sep 01 09:16:51 royal stonithd: [11723]: notice: /usr/lib64/heartbeat/stonithd is already running. Sep 01 09:16:51 royal cib: [11724]: info: G_main_add_TriggerHandler: Added signal manual handler Sep 01 09:16:51 royal cib: [11724]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Sep 01 09:16:51 royal lrmd: [11725]: info: G_main_add_SignalHandler: Added signal handler for signal 15 Sep 01 09:16:51 royal cib: [11724]: info: retrieveCib: Reading cluster configuration from: /var/lib/lib/heartbeat/crm/cib.xml (digest: /var/lib/lib/heartbeat/crm/cib.xml.sig) Sep 01 09:16:51 royal lrmd: [11725]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Sep 01 09:16:51 royal lrmd: [11725]: info: G_main_add_SignalHandler: Added signal handler for signal 10 Sep 01 09:16:51 royal lrmd: [11725]: info: G_main_add_SignalHandler: Added signal handler for signal 12 Sep 01 09:16:51 royal lrmd: [11725]: info: Started. Sep 01 09:16:51 royal attrd: [11726]: info: main: Starting up Sep 01 09:16:51 royal attrd: [11726]: info: crm_cluster_connect: Connecting to OpenAIS Sep 01 09:16:51 royal attrd: [11726]: info: init_ais_connection: Creating connection to our AIS plugin Sep 01 09:16:51 royal attrd: [11726]: info: init_ais_connection: Connection to our AIS plugin (9) failed: Try again (6) Sep 01 09:16:51 corosync [pcmk ] info: spawn_child: Forked child 11723 for process stonithd Sep 01 09:16:51 corosync [pcmk ] info: spawn_child: Forked child 11724 for process cib Sep 01 09:16:51 corosync [pcmk ] info: spawn_child: Forked child 11725 for process lrmd Sep 01 09:16:51 corosync [pcmk ] info: spawn_child: Forked child 11726 for process attrd Sep 01 09:16:51 corosync [pcmk ] info: spawn_child: Forked child 11727 for process pengine Sep 01 09:16:51 corosync [pcmk ] ERROR: pcmk_wait_dispatch: Child process stonithd exited (pid=11723, rc=100) Sep 01 09:16:51 corosync [pcmk ] notice: pcmk_wait_dispatch: Child process stonithd no longer wishes to be respawned Sep 01 09:16:51 corosync [pcmk ] info: spawn_child: Forked child 11728 for process crmd Sep 01 09:16:51 corosync [pcmk ] info: pcmk_startup: CRM: Initialized Sep 01 09:16:51 corosync [SERV ] Service initialized 'Pacemaker Cluster Manager' Sep 01 09:16:51 corosync [pcmk ] debug: send_cluster_id: Local update: id=672212678, born=0, seq=0 Sep 01 09:16:51 corosync [pcmk ] info: update_member: Node royal now has process list: 00000000000000000000000000011312 (70418) Sep 01 09:16:51 royal pengine: [11727]: info: main: Starting pengine Sep 01 09:16:51 corosync [SERV ] Service initialized 'corosync extended virtual synchrony service' Sep 01 09:16:51 corosync [SERV ] Service initialized 'corosync configuration service' Sep 01 09:16:51 corosync [SERV ] Service initialized 'corosync cluster closed process group service v1.01' Sep 01 09:16:51 royal crmd: [11728]: info: main: CRM Hg Version: 462f1569a43740667daf7b0f6b521742e9eb8fa7 Sep 01 09:16:51 corosync [SERV ] Service initialized 'corosync cluster config database access v1.01' Sep 01 09:16:51 royal crmd: [11728]: info: crmd_init: Starting crmd Sep 01 09:16:51 royal crmd: [11728]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Sep 01 09:16:51 royal cib: [11724]: info: startCib: CIB Initialization completed successfully Sep 01 09:16:51 royal cib: [11724]: info: crm_cluster_connect: Connecting to OpenAIS Sep 01 09:16:51 royal cib: [11724]: info: init_ais_connection: Creating connection to our AIS plugin Sep 01 09:16:51 royal cib: [11724]: info: init_ais_connection: Connection to our AIS plugin (9) failed: Try again (6) Sep 01 09:16:51 corosync [SERV ] Service initialized 'corosync profile loading service' Sep 01 09:16:51 corosync [MAIN ] Compatibility mode set to whitetank. Using V1 and V2 of the synchronization engine. Sep 01 09:16:51 corosync [TOTEM ] Creating commit token because I am the rep. Sep 01 09:16:51 corosync [TOTEM ] Saving state aru 0 high seq received 0 Sep 01 09:16:51 corosync [TOTEM ] Storing new sequence id for ring 2f4 Sep 01 09:16:51 corosync [TOTEM ] entering COMMIT state. Sep 01 09:16:51 corosync [TOTEM ] got commit token Sep 01 09:16:51 corosync [TOTEM ] entering RECOVERY state. Sep 01 09:16:51 corosync [TOTEM ] position [0] member 198.38.17.40: Sep 01 09:16:51 corosync [TOTEM ] previous ring seq 752 rep 198.38.17.40 Sep 01 09:16:51 corosync [TOTEM ] aru 0 high delivered 0 received flag 1 Sep 01 09:16:51 corosync [TOTEM ] Did not need to originate any messages in recovery. Sep 01 09:16:51 corosync [TOTEM ] got commit token Sep 01 09:16:51 corosync [TOTEM ] Sending initial ORF token Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 0, aru 0 Sep 01 09:16:51 corosync [TOTEM ] install seq 0 aru 0 high seq received 0 Sep 01 09:16:51 corosync [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 1, aru 0 Sep 01 09:16:51 corosync [TOTEM ] install seq 0 aru 0 high seq received 0 Sep 01 09:16:51 corosync [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 2, aru 0 Sep 01 09:16:51 corosync [TOTEM ] install seq 0 aru 0 high seq received 0 Sep 01 09:16:51 corosync [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 3, aru 0 Sep 01 09:16:51 corosync [TOTEM ] install seq 0 aru 0 high seq received 0 Sep 01 09:16:51 corosync [TOTEM ] retrans flag count 4 token aru 0 install seq 0 aru 0 0 Sep 01 09:16:51 corosync [TOTEM ] recovery to regular 1-0 Sep 01 09:16:51 corosync [TOTEM ] Delivering to app 1 to 0 Sep 01 09:16:51 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 756: memb=0, new=0, lost=0 Sep 01 09:16:51 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 756: memb=1, new=1, lost=0 Sep 01 09:16:51 corosync [pcmk ] info: pcmk_peer_update: NEW: royal 672212678 Sep 01 09:16:51 corosync [pcmk ] debug: pcmk_peer_update: Node 672212678 has address r(0) ip(198.38.17.40) Sep 01 09:16:51 corosync [pcmk ] info: pcmk_peer_update: MEMB: royal 672212678 Sep 01 09:16:51 corosync [pcmk ] debug: send_cluster_id: Local update: id=672212678, born=0, seq=756 Sep 01 09:16:51 corosync [SYNC ] This node is within the primary component and will provide service. Sep 01 09:16:51 corosync [TOTEM ] entering OPERATIONAL state. Sep 01 09:16:51 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed. Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] Delivering 0 to 2 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 1 to pending delivery queue Sep 01 09:16:51 corosync [pcmk ] debug: pcmk_cluster_id_callback: Node update: royal (1.0.5) Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 2 to pending delivery queue Sep 01 09:16:51 corosync [pcmk ] debug: pcmk_cluster_id_callback: Node update: royal (1.0.5) Sep 01 09:16:51 corosync [SYNC ] confchg entries 1 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (dummy CLM service) Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] Delivering 2 to 3 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 3 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 2 Sep 01 09:16:51 corosync [TOTEM ] Delivering 3 to 4 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 4 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 1 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (dummy CLM service) Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (dummy AMF service) Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 3 Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 4 Sep 01 09:16:51 corosync [TOTEM ] Delivering 4 to 5 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 5 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 1 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (dummy AMF service) Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (dummy CKPT service) Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 5 Sep 01 09:16:51 corosync [TOTEM ] Delivering 5 to 6 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 6 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 1 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (dummy CKPT service) Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (dummy EVT service) Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] Delivering 6 to 7 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 7 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 6 Sep 01 09:16:51 corosync [TOTEM ] Delivering 7 to 8 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 8 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 7 Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 8 Sep 01 09:16:51 corosync [TOTEM ] Delivering 8 to 9 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 9 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 1 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (dummy EVT service) Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (corosync cluster closed process group service v1.01) Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 9 Sep 01 09:16:51 corosync [TOTEM ] Delivering 9 to a Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq a to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 1 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (corosync cluster closed process group service v1.01) Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] Delivering a to b Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq b to pending delivery queue Sep 01 09:16:51 corosync [MAIN ] Completed service synchronization, ready to provide service. Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including a Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including b Sep 01 09:16:51 corosync [TOTEM ] entering GATHER state from 11. Sep 01 09:16:51 corosync [TOTEM ] Creating commit token because I am the rep. Sep 01 09:16:51 corosync [TOTEM ] Saving state aru b high seq received b Sep 01 09:16:51 corosync [TOTEM ] Storing new sequence id for ring 2fc Sep 01 09:16:51 corosync [TOTEM ] entering COMMIT state. Sep 01 09:16:51 corosync [TOTEM ] got commit token Sep 01 09:16:51 corosync [TOTEM ] entering RECOVERY state. Sep 01 09:16:51 corosync [TOTEM ] position [0] member 198.38.17.40: Sep 01 09:16:51 corosync [TOTEM ] previous ring seq 756 rep 198.38.17.40 Sep 01 09:16:51 corosync [TOTEM ] aru b high delivered b received flag 1 Sep 01 09:16:51 corosync [TOTEM ] position [1] member 198.38.17.62: Sep 01 09:16:51 corosync [TOTEM ] previous ring seq 760 rep 198.38.17.62 Sep 01 09:16:51 corosync [TOTEM ] aru 10 high delivered 10 received flag 1 Sep 01 09:16:51 corosync [TOTEM ] Did not need to originate any messages in recovery. Sep 01 09:16:51 corosync [TOTEM ] got commit token Sep 01 09:16:51 corosync [TOTEM ] Sending initial ORF token Sep 01 09:16:51 corosync [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 0, aru 0 Sep 01 09:16:51 corosync [TOTEM ] install seq 0 aru 0 high seq received 0 Sep 01 09:16:51 corosync [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 1, aru 0 Sep 01 09:16:51 corosync [TOTEM ] install seq 0 aru 0 high seq received 0 Sep 01 09:16:51 corosync [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 2, aru 0 Sep 01 09:16:51 corosync [TOTEM ] install seq 0 aru 0 high seq received 0 Sep 01 09:16:51 corosync [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 3, aru 0 Sep 01 09:16:51 corosync [TOTEM ] install seq 0 aru 0 high seq received 0 Sep 01 09:16:51 corosync [TOTEM ] retrans flag count 4 token aru 0 install seq 0 aru 0 0 Sep 01 09:16:51 corosync [TOTEM ] recovery to regular 1-0 Sep 01 09:16:51 corosync [TOTEM ] Delivering to app c to b Sep 01 09:16:51 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 764: memb=1, new=0, lost=0 Sep 01 09:16:51 corosync [pcmk ] info: pcmk_peer_update: memb: royal 672212678 Sep 01 09:16:51 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 764: memb=2, new=1, lost=0 Sep 01 09:16:51 corosync [pcmk ] info: update_member: Creating entry for node 1041311430 born on 764 Sep 01 09:16:51 corosync [pcmk ] info: update_member: Node 1041311430/unknown is now: member Sep 01 09:16:51 corosync [pcmk ] info: pcmk_peer_update: NEW: .pending. 1041311430 Sep 01 09:16:51 corosync [pcmk ] debug: pcmk_peer_update: Node 1041311430 has address r(0) ip(198.38.17.62) Sep 01 09:16:51 corosync [pcmk ] info: pcmk_peer_update: MEMB: royal 672212678 Sep 01 09:16:51 corosync [pcmk ] info: pcmk_peer_update: MEMB: .pending. 1041311430 Sep 01 09:16:51 corosync [pcmk ] debug: pcmk_peer_update: 1 nodes changed Sep 01 09:16:51 corosync [pcmk ] info: send_member_notification: Sending membership update 764 to 0 children Sep 01 09:16:51 corosync [pcmk ] debug: send_cluster_id: Local update: id=672212678, born=764, seq=764 Sep 01 09:16:51 corosync [pcmk ] info: update_member: 0x128c1e0 Node 672212678 ((null)) born on: 764 Sep 01 09:16:51 corosync [SYNC ] This node is within the primary component and will provide service. Sep 01 09:16:51 corosync [TOTEM ] entering OPERATIONAL state. Sep 01 09:16:51 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed. Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 1 Sep 01 09:16:51 corosync [TOTEM ] Delivering 0 to 1 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 1 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 1041311430 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 0. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 1. Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] Delivering 1 to 2 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 2 to pending delivery queue Sep 01 09:16:51 corosync [pcmk ] debug: pcmk_cluster_id_callback: Node update: royal (1.0.5) Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (dummy CLM service) Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 2 Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 1 Sep 01 09:16:51 corosync [TOTEM ] Delivering 2 to 3 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 3 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 3 Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 4 Sep 01 09:16:51 corosync [TOTEM ] Delivering 3 to 4 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 4 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 2 Sep 01 09:16:51 corosync [TOTEM ] Delivering 4 to 5 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 5 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 0. Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 5 Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 6 Sep 01 09:16:51 corosync [TOTEM ] Delivering 5 to 6 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 6 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 1041311430 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (dummy CLM service) Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (dummy AMF service) Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 4 Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 6 Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 7 Sep 01 09:16:51 corosync [TOTEM ] Delivering 6 to 7 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 7 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 1041311430 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 0. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 1. Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] Delivering 7 to 8 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 8 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (dummy AMF service) Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (dummy CKPT service) Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 8 Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 7 Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 9 Sep 01 09:16:51 corosync [TOTEM ] Delivering 8 to 9 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 9 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 8 Sep 01 09:16:51 corosync [TOTEM ] Delivering 9 to a Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq a to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 0. Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq a Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 9 Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including a Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq b Sep 01 09:16:51 corosync [TOTEM ] Delivering a to b Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq b to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 1041311430 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (dummy CKPT service) Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (dummy EVT service) Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq c Sep 01 09:16:51 corosync [TOTEM ] Delivering b to c Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq c to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including b Sep 01 09:16:51 corosync [TOTEM ] Delivering c to d Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq d to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq d Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq e Sep 01 09:16:51 corosync [TOTEM ] Delivering d to e Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq e to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including c Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including e Sep 01 09:16:51 corosync [TOTEM ] Delivering e to f Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq f to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq f Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 10 Sep 01 09:16:51 corosync [TOTEM ] Delivering f to 10 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 10 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 10 Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 11 Sep 01 09:16:51 corosync [TOTEM ] Delivering 10 to 11 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 11 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 1041311430 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 0. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 1. Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] Delivering 11 to 12 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 12 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (dummy EVT service) Sep 01 09:16:51 corosync [SYNC ] Synchronization actions starting for (corosync cluster closed process group service v1.01) Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 12 Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 11 Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 13 Sep 01 09:16:51 corosync [TOTEM ] Delivering 12 to 13 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 13 to pending delivery queue Sep 01 09:16:51 corosync [CPG ] got joinlist message from node 3e1126c6 Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 12 Sep 01 09:16:51 corosync [TOTEM ] Delivering 13 to 14 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 14 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 672212678 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 0. Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 14 Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 15 Sep 01 09:16:51 corosync [TOTEM ] Delivering 14 to 15 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 15 to pending delivery queue Sep 01 09:16:51 corosync [SYNC ] confchg entries 2 Sep 01 09:16:51 corosync [SYNC ] Barrier Start Received From 1041311430 Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 672212678 = 1. Sep 01 09:16:51 corosync [SYNC ] Barrier completion status for nodeid 1041311430 = 1. Sep 01 09:16:51 corosync [SYNC ] Synchronization barrier completed Sep 01 09:16:51 corosync [SYNC ] Committing synchronization for (corosync cluster closed process group service v1.01) Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 13 Sep 01 09:16:51 corosync [TOTEM ] Delivering 15 to 16 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 16 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 16 Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 15 Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 17 Sep 01 09:16:51 corosync [TOTEM ] Delivering 16 to 17 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 17 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 18 Sep 01 09:16:51 corosync [TOTEM ] Delivering 17 to 18 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 18 to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 16 Sep 01 09:16:51 corosync [SYNCV2] Committing synchronization for External Service (id = 5) Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] Delivering 18 to 19 Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 19 to pending delivery queue Sep 01 09:16:51 corosync [SYNCV2] Committing synchronization for External Service (id = 6) Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 19 Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 18 Sep 01 09:16:51 corosync [TOTEM ] Delivering 19 to 1a Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 1a to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 1a Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 1b Sep 01 09:16:51 corosync [TOTEM ] Delivering 1a to 1b Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 1b to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 19 Sep 01 09:16:51 corosync [SYNCV2] Committing synchronization for External Service (id = 17) Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 1c Sep 01 09:16:51 corosync [TOTEM ] Delivering 1b to 1c Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 1c to pending delivery queue Sep 01 09:16:51 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 1b Sep 01 09:16:51 corosync [TOTEM ] Delivering 1c to 1d Sep 01 09:16:51 corosync [TOTEM ] Delivering MCAST message with seq 1d to pending delivery queue Sep 01 09:16:51 corosync [MAIN ] Completed service synchronization, ready to provide service. Sep 01 09:16:51 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 1d Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 1c Sep 01 09:16:51 corosync [TOTEM ] releasing messages up to and including 1d Sep 01 09:16:52 royal attrd: [11726]: info: init_ais_connection: Creating connection to our AIS plugin Sep 01 09:16:52 royal attrd: [11726]: info: init_ais_connection: AIS connection established Sep 01 09:16:52 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x1292cd0 for attrd/11726 Sep 01 09:16:52 corosync [pcmk ] debug: process_ais_message: Msg[0] (dest=local:ais, from=royal:attrd.11726, remote=true, size=6): 11726 Sep 01 09:16:52 royal attrd: [11726]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Sep 01 09:16:52 royal attrd: [11726]: info: crm_new_peer: Node royal now has id: 672212678 Sep 01 09:16:52 royal attrd: [11726]: info: crm_new_peer: Node 672212678 is now known as royal Sep 01 09:16:52 royal attrd: [11726]: info: main: Cluster connection active Sep 01 09:16:52 royal attrd: [11726]: info: main: Accepting attribute updates Sep 01 09:16:52 royal attrd: [11726]: info: main: Starting mainloop... Sep 01 09:16:52 royal crmd: [11728]: info: do_cib_control: Could not connect to the CIB service: connection failed Sep 01 09:16:52 royal crmd: [11728]: WARN: do_cib_control: Couldn't complete CIB registration 1 times... pause and retry Sep 01 09:16:52 royal crmd: [11728]: info: crmd_init: Starting crmd's mainloop Sep 01 09:16:52 royal cib: [11724]: info: init_ais_connection: Creating connection to our AIS plugin Sep 01 09:16:52 royal cib: [11724]: info: init_ais_connection: AIS connection established Sep 01 09:16:52 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x1294660 for cib/11724 Sep 01 09:16:52 corosync [pcmk ] info: pcmk_ipc: Sending membership update 764 to cib Sep 01 09:16:52 corosync [pcmk ] debug: process_ais_message: Msg[0] (dest=local:ais, from=royal:cib.11724, remote=true, size=6): 11724 Sep 01 09:16:52 royal cib: [11724]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Sep 01 09:16:52 royal cib: [11724]: info: crm_new_peer: Node royal now has id: 672212678 Sep 01 09:16:52 royal cib: [11724]: info: crm_new_peer: Node 672212678 is now known as royal Sep 01 09:16:52 royal cib: [11724]: info: cib_init: Starting cib mainloop Sep 01 09:16:52 royal cib: [11724]: info: ais_dispatch: Membership 764: quorum still lost Sep 01 09:16:52 royal cib: [11724]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=764 seen=764 proc=00000000000000000000000000011312 (new) Sep 01 09:16:52 royal cib: [11724]: info: crm_new_peer: Node now has id: 1041311430 Sep 01 09:16:52 royal cib: [11724]: info: crm_update_peer: Node (null): id=1041311430 state=member (new) addr=r(0) ip(198.38.17.62) votes=0 born=0 seen=764 proc=00000000000000000000000000000000 Sep 01 09:16:52 royal cib: [11731]: info: write_cib_contents: Archived previous version as /var/lib/lib/heartbeat/crm/cib-1.raw Sep 01 09:16:52 royal cib: [11731]: info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: b4fc66cefa301d6b206a2efe7cd25a64) Sep 01 09:16:52 royal cib: [11731]: info: retrieveCib: Reading cluster configuration from: /var/lib/lib/heartbeat/crm/cib.WJ0hgH (digest: /var/lib/lib/heartbeat/crm/cib.SnxbCC) Sep 01 09:16:52 royal cib: [11724]: info: Managed write_cib_contents process 11731 exited with return code 0. Sep 01 09:16:53 royal attrd: [11726]: info: cib_connect: Connected to the CIB after 1 signon attempts Sep 01 09:16:53 royal attrd: [11726]: info: cib_connect: Sending full refresh Sep 01 09:16:54 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:16:54 royal crmd: [11728]: info: do_cib_control: CIB connection established Sep 01 09:16:54 royal crmd: [11728]: info: crm_cluster_connect: Connecting to OpenAIS Sep 01 09:16:54 royal crmd: [11728]: info: init_ais_connection: Creating connection to our AIS plugin Sep 01 09:16:54 royal crmd: [11728]: info: init_ais_connection: AIS connection established Sep 01 09:16:54 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x1294e70 for crmd/11728 Sep 01 09:16:54 royal crmd: [11728]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Sep 01 09:16:54 corosync [pcmk ] info: pcmk_ipc: Sending membership update 764 to crmd Sep 01 09:16:54 corosync [pcmk ] debug: process_ais_message: Msg[0] (dest=local:ais, from=royal:crmd.11728, remote=true, size=6): 11728 Sep 01 09:16:54 royal crmd: [11728]: info: crm_new_peer: Node royal now has id: 672212678 Sep 01 09:16:54 royal crmd: [11728]: info: crm_new_peer: Node 672212678 is now known as royal Sep 01 09:16:54 royal crmd: [11728]: info: do_ha_control: Connected to the cluster Sep 01 09:16:54 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:16:54 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 1 (30 max) times Sep 01 09:16:54 royal crmd: [11728]: info: config_query_callback: Checking for expired actions every 900000ms Sep 01 09:16:54 corosync [pcmk ] info: update_expected_votes: Expected quorum votes 1024 -> 2 Sep 01 09:16:54 royal crmd: [11728]: info: ais_dispatch: Membership 764: quorum still lost Sep 01 09:16:54 royal crmd: [11728]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=764 seen=764 proc=00000000000000000000000000011312 (new) Sep 01 09:16:54 royal crmd: [11728]: info: crm_new_peer: Node now has id: 1041311430 Sep 01 09:16:54 royal crmd: [11728]: info: crm_update_peer: Node (null): id=1041311430 state=member (new) addr=r(0) ip(198.38.17.62) votes=0 born=0 seen=764 proc=00000000000000000000000000000000 Sep 01 09:16:54 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:16:54 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 2 (30 max) times Sep 01 09:16:54 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:16:54 corosync [TOTEM ] Delivering 1d to 1e Sep 01 09:16:54 royal crmd: [11728]: notice: ais_dispatch: Membership 764: quorum aquired Sep 01 09:16:54 corosync [TOTEM ] Delivering MCAST message with seq 1e to pending delivery queue Sep 01 09:16:54 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 1e Sep 01 09:16:54 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:16:54 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 3 (30 max) times Sep 01 09:16:54 corosync [TOTEM ] releasing messages up to and including 1e Sep 01 09:16:56 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:16:56 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:16:56 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 4 (30 max) times Sep 01 09:16:58 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:16:58 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:16:58 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 5 (30 max) times Sep 01 09:17:00 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:00 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:00 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 6 (30 max) times Sep 01 09:17:02 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:02 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:02 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 7 (30 max) times Sep 01 09:17:04 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:04 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:04 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 8 (30 max) times Sep 01 09:17:06 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:06 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:06 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 9 (30 max) times Sep 01 09:17:08 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:08 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:08 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 10 (30 max) times Sep 01 09:17:10 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:10 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:10 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 11 (30 max) times Sep 01 09:17:12 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:12 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:12 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 12 (30 max) times Sep 01 09:17:14 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:14 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:14 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 13 (30 max) times Sep 01 09:17:16 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:16 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:16 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 14 (30 max) times Sep 01 09:17:18 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:18 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:18 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 15 (30 max) times Sep 01 09:17:20 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:20 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:20 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 16 (30 max) times Sep 01 09:17:22 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:22 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:22 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 17 (30 max) times Sep 01 09:17:24 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:24 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:24 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 18 (30 max) times Sep 01 09:17:25 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:17:25 corosync [TOTEM ] Delivering 1e to 1f Sep 01 09:17:25 corosync [TOTEM ] Delivering MCAST message with seq 1f to pending delivery queue Sep 01 09:17:25 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 1f Sep 01 09:17:25 corosync [TOTEM ] releasing messages up to and including 1f Sep 01 09:17:26 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:26 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:26 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 19 (30 max) times Sep 01 09:17:28 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:28 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:28 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 20 (30 max) times Sep 01 09:17:30 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:30 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:30 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 21 (30 max) times Sep 01 09:17:32 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:32 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:32 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 22 (30 max) times Sep 01 09:17:34 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:34 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:34 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 23 (30 max) times Sep 01 09:17:36 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:36 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:36 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 24 (30 max) times Sep 01 09:17:38 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:38 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:38 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 25 (30 max) times Sep 01 09:17:40 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:40 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:40 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 26 (30 max) times Sep 01 09:17:42 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:42 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:42 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 27 (30 max) times Sep 01 09:17:44 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:44 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:44 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 28 (30 max) times Sep 01 09:17:46 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:46 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:46 royal crmd: [11728]: WARN: do_lrm_control: Failed to sign on to the LRM 29 (30 max) times Sep 01 09:17:48 royal crmd: [11728]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:48 royal crmd: [11728]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:48 royal crmd: [11728]: ERROR: do_lrm_control: Failed to sign on to the LRM 30 (max) times Sep 01 09:17:48 royal crmd: [11728]: ERROR: do_log: FSA: Input I_ERROR from do_lrm_control() received in state S_STARTING Sep 01 09:17:48 royal crmd: [11728]: info: do_state_transition: State transition S_STARTING -> S_RECOVERY [ input=I_ERROR cause=C_FSA_INTERNAL origin=do_lrm_control ] Sep 01 09:17:48 royal crmd: [11728]: ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported Sep 01 09:17:48 royal crmd: [11728]: ERROR: do_started: Start cancelled... S_RECOVERY Sep 01 09:17:48 royal crmd: [11728]: ERROR: do_log: FSA: Input I_TERMINATE from do_recover() received in state S_RECOVERY Sep 01 09:17:48 royal crmd: [11728]: info: do_state_transition: State transition S_RECOVERY -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_recover ] Sep 01 09:17:48 royal crmd: [11728]: info: do_ha_control: Disconnected from OpenAIS Sep 01 09:17:48 royal crmd: [11728]: info: do_cib_control: Disconnecting CIB Sep 01 09:17:48 royal crmd: [11728]: info: crmd_cib_connection_destroy: Connection to the CIB terminated... Sep 01 09:17:48 royal cib: [11724]: WARN: send_ipc_message: IPC Channel to 11728 is not connected Sep 01 09:17:48 royal crmd: [11728]: info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd Sep 01 09:17:48 royal crmd: [11728]: ERROR: do_exit: Could not recover from internal error Sep 01 09:17:48 royal cib: [11724]: WARN: send_via_callback_channel: Delivery of reply to client 11728/0ef7c525-6ed4-4d2c-809b-54f3724b6774 failed Sep 01 09:17:48 royal crmd: [11728]: info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=do_stop ] Sep 01 09:17:48 royal cib: [11724]: WARN: do_local_notify: A-Sync reply to crmd failed: reply failed Sep 01 09:17:48 royal crmd: [11728]: info: do_exit: [crmd] stopped (2) Sep 01 09:17:48 corosync [pcmk ] ERROR: pcmk_wait_dispatch: Child process crmd exited (pid=11728, rc=2) Sep 01 09:17:48 corosync [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: crmd Sep 01 09:17:48 corosync [pcmk ] info: spawn_child: Forked child 11746 for process crmd Sep 01 09:17:48 royal crmd: [11746]: info: main: CRM Hg Version: 462f1569a43740667daf7b0f6b521742e9eb8fa7 Sep 01 09:17:48 royal crmd: [11746]: info: crmd_init: Starting crmd Sep 01 09:17:48 royal crmd: [11746]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Sep 01 09:17:48 royal crmd: [11746]: info: do_cib_control: CIB connection established Sep 01 09:17:48 royal crmd: [11746]: info: crm_cluster_connect: Connecting to OpenAIS Sep 01 09:17:48 royal crmd: [11746]: info: init_ais_connection: Creating connection to our AIS plugin Sep 01 09:17:48 royal crmd: [11746]: info: init_ais_connection: AIS connection established Sep 01 09:17:48 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x1294e70 for crmd/11746 Sep 01 09:17:48 corosync [pcmk ] info: pcmk_ipc: Sending membership update 764 to crmd Sep 01 09:17:48 corosync [pcmk ] debug: process_ais_message: Msg[0] (dest=local:ais, from=royal:crmd.11746, remote=true, size=6): 11746 Sep 01 09:17:48 royal crmd: [11746]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Sep 01 09:17:48 royal crmd: [11746]: info: crm_new_peer: Node royal now has id: 672212678 Sep 01 09:17:48 royal crmd: [11746]: info: crm_new_peer: Node 672212678 is now known as royal Sep 01 09:17:48 royal crmd: [11746]: info: do_ha_control: Connected to the cluster Sep 01 09:17:48 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:48 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 1 (30 max) times Sep 01 09:17:48 royal crmd: [11746]: info: crmd_init: Starting crmd's mainloop Sep 01 09:17:48 royal crmd: [11746]: info: config_query_callback: Checking for expired actions every 900000ms Sep 01 09:17:48 royal crmd: [11746]: notice: ais_dispatch: Membership 764: quorum aquired Sep 01 09:17:48 royal crmd: [11746]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=764 seen=764 proc=00000000000000000000000000011312 (new) Sep 01 09:17:48 royal crmd: [11746]: info: crm_new_peer: Node now has id: 1041311430 Sep 01 09:17:48 royal crmd: [11746]: info: crm_update_peer: Node (null): id=1041311430 state=member (new) addr=r(0) ip(198.38.17.62) votes=0 born=0 seen=764 proc=00000000000000000000000000000000 Sep 01 09:17:48 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:48 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 2 (30 max) times Sep 01 09:17:48 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:17:48 corosync [TOTEM ] Delivering 1f to 20 Sep 01 09:17:48 corosync [TOTEM ] Delivering MCAST message with seq 20 to pending delivery queue Sep 01 09:17:48 royal crmd: [11746]: info: ais_dispatch: Membership 764: quorum retained Sep 01 09:17:48 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 20 Sep 01 09:17:48 corosync [TOTEM ] releasing messages up to and including 20 Sep 01 09:17:48 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:48 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 3 (30 max) times Sep 01 09:17:50 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:50 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:50 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 4 (30 max) times Sep 01 09:17:52 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:52 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:52 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 5 (30 max) times Sep 01 09:17:54 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:54 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:54 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 6 (30 max) times Sep 01 09:17:56 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:56 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:56 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 7 (30 max) times Sep 01 09:17:58 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:17:58 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:17:58 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 8 (30 max) times Sep 01 09:18:00 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:00 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:00 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 9 (30 max) times Sep 01 09:18:02 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:02 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:02 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 10 (30 max) times Sep 01 09:18:04 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:04 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:04 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 11 (30 max) times Sep 01 09:18:06 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:06 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:06 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 12 (30 max) times Sep 01 09:18:08 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:08 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:08 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 13 (30 max) times Sep 01 09:18:10 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:10 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:10 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 14 (30 max) times Sep 01 09:18:12 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:12 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:12 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 15 (30 max) times Sep 01 09:18:14 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:14 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:14 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 16 (30 max) times Sep 01 09:18:16 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:16 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:16 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 17 (30 max) times Sep 01 09:18:18 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:18 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:18 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 18 (30 max) times Sep 01 09:18:20 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:20 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:20 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 19 (30 max) times Sep 01 09:18:22 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:22 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:22 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 20 (30 max) times Sep 01 09:18:24 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:24 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:24 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 21 (30 max) times Sep 01 09:18:26 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:26 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:26 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 22 (30 max) times Sep 01 09:18:28 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:28 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:28 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 23 (30 max) times Sep 01 09:18:29 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:18:29 corosync [TOTEM ] Delivering 20 to 21 Sep 01 09:18:29 corosync [TOTEM ] Delivering MCAST message with seq 21 to pending delivery queue Sep 01 09:18:29 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 21 Sep 01 09:18:29 corosync [TOTEM ] releasing messages up to and including 21 Sep 01 09:18:30 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:30 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:30 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 24 (30 max) times Sep 01 09:18:32 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:32 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:32 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 25 (30 max) times Sep 01 09:18:34 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:34 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:34 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 26 (30 max) times Sep 01 09:18:36 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:36 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:36 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 27 (30 max) times Sep 01 09:18:38 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:38 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:38 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 28 (30 max) times Sep 01 09:18:40 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:40 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:40 royal crmd: [11746]: WARN: do_lrm_control: Failed to sign on to the LRM 29 (30 max) times Sep 01 09:18:42 royal crmd: [11746]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:42 royal crmd: [11746]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:42 royal crmd: [11746]: ERROR: do_lrm_control: Failed to sign on to the LRM 30 (max) times Sep 01 09:18:42 royal crmd: [11746]: ERROR: do_log: FSA: Input I_ERROR from do_lrm_control() received in state S_STARTING Sep 01 09:18:42 royal crmd: [11746]: info: do_state_transition: State transition S_STARTING -> S_RECOVERY [ input=I_ERROR cause=C_FSA_INTERNAL origin=do_lrm_control ] Sep 01 09:18:42 royal crmd: [11746]: ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported Sep 01 09:18:42 royal crmd: [11746]: ERROR: do_started: Start cancelled... S_RECOVERY Sep 01 09:18:42 royal crmd: [11746]: ERROR: do_log: FSA: Input I_TERMINATE from do_recover() received in state S_RECOVERY Sep 01 09:18:42 royal crmd: [11746]: info: do_state_transition: State transition S_RECOVERY -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_recover ] Sep 01 09:18:42 royal crmd: [11746]: info: do_ha_control: Disconnected from OpenAIS Sep 01 09:18:42 royal crmd: [11746]: info: do_cib_control: Disconnecting CIB Sep 01 09:18:42 royal crmd: [11746]: info: crmd_cib_connection_destroy: Connection to the CIB terminated... Sep 01 09:18:42 royal crmd: [11746]: info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd Sep 01 09:18:42 royal crmd: [11746]: ERROR: do_exit: Could not recover from internal error Sep 01 09:18:42 royal crmd: [11746]: info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=do_stop ] Sep 01 09:18:42 royal crmd: [11746]: info: do_exit: [crmd] stopped (2) Sep 01 09:18:42 corosync [pcmk ] info: pcmk_ipc_exit: Client crmd (conn=0x1294e70, async-conn=0x1294e70) left Sep 01 09:18:42 corosync [pcmk ] ERROR: pcmk_wait_dispatch: Child process crmd exited (pid=11746, rc=2) Sep 01 09:18:42 corosync [pcmk ] notice: pcmk_wait_dispatch: Respawning failed child process: crmd Sep 01 09:18:42 corosync [pcmk ] info: spawn_child: Forked child 11749 for process crmd Sep 01 09:18:42 royal crmd: [11749]: info: main: CRM Hg Version: 462f1569a43740667daf7b0f6b521742e9eb8fa7 Sep 01 09:18:42 royal crmd: [11749]: info: crmd_init: Starting crmd Sep 01 09:18:42 royal crmd: [11749]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Sep 01 09:18:42 royal crmd: [11749]: info: do_cib_control: CIB connection established Sep 01 09:18:42 royal crmd: [11749]: info: crm_cluster_connect: Connecting to OpenAIS Sep 01 09:18:42 royal crmd: [11749]: info: init_ais_connection: Creating connection to our AIS plugin Sep 01 09:18:42 royal crmd: [11749]: info: init_ais_connection: AIS connection established Sep 01 09:18:42 corosync [pcmk ] info: pcmk_ipc: Recorded connection 0x1294e70 for crmd/11749 Sep 01 09:18:42 corosync [pcmk ] info: pcmk_ipc: Sending membership update 764 to crmd Sep 01 09:18:42 corosync [pcmk ] debug: process_ais_message: Msg[0] (dest=local:ais, from=royal:crmd.11749, remote=true, size=6): 11749 Sep 01 09:18:42 royal crmd: [11749]: info: get_ais_nodeid: Server details: id=672212678 uname=royal Sep 01 09:18:42 royal crmd: [11749]: info: crm_new_peer: Node royal now has id: 672212678 Sep 01 09:18:42 royal crmd: [11749]: info: crm_new_peer: Node 672212678 is now known as royal Sep 01 09:18:42 royal crmd: [11749]: info: do_ha_control: Connected to the cluster Sep 01 09:18:42 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:42 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 1 (30 max) times Sep 01 09:18:42 royal crmd: [11749]: info: crmd_init: Starting crmd's mainloop Sep 01 09:18:42 royal crmd: [11749]: info: config_query_callback: Checking for expired actions every 900000ms Sep 01 09:18:42 royal crmd: [11749]: notice: ais_dispatch: Membership 764: quorum aquired Sep 01 09:18:42 royal crmd: [11749]: info: crm_update_peer: Node royal: id=672212678 state=member (new) addr=r(0) ip(198.38.17.40) (new) votes=1 (new) born=764 seen=764 proc=00000000000000000000000000011312 (new) Sep 01 09:18:42 royal crmd: [11749]: info: crm_new_peer: Node now has id: 1041311430 Sep 01 09:18:42 royal crmd: [11749]: info: crm_update_peer: Node (null): id=1041311430 state=member (new) addr=r(0) ip(198.38.17.62) votes=0 born=0 seen=764 proc=00000000000000000000000000000000 Sep 01 09:18:42 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:42 corosync [TOTEM ] mcasted message added to pending queue Sep 01 09:18:42 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 2 (30 max) times Sep 01 09:18:42 corosync [TOTEM ] Delivering 21 to 22 Sep 01 09:18:42 corosync [TOTEM ] Delivering MCAST message with seq 22 to pending delivery queue Sep 01 09:18:42 corosync [TOTEM ] Received ringid(198.38.17.40:764) seq 22 Sep 01 09:18:42 royal crmd: [11749]: info: ais_dispatch: Membership 764: quorum retained Sep 01 09:18:42 corosync [TOTEM ] releasing messages up to and including 22 Sep 01 09:18:42 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:42 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 3 (30 max) times Sep 01 09:18:44 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:44 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:44 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 4 (30 max) times Sep 01 09:18:46 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:46 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:46 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 5 (30 max) times Sep 01 09:18:48 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:48 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:48 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 6 (30 max) times Sep 01 09:18:50 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:50 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:50 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 7 (30 max) times Sep 01 09:18:52 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:52 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:52 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 8 (30 max) times Sep 01 09:18:54 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:54 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:54 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 9 (30 max) times Sep 01 09:18:56 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:56 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:56 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 10 (30 max) times Sep 01 09:18:58 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:18:58 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:18:58 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 11 (30 max) times Sep 01 09:19:00 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:00 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:00 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 12 (30 max) times Sep 01 09:19:02 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:02 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:02 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 13 (30 max) times Sep 01 09:19:04 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:04 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:04 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 14 (30 max) times Sep 01 09:19:06 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:06 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:06 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 15 (30 max) times Sep 01 09:19:08 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:08 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:08 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 16 (30 max) times Sep 01 09:19:10 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:10 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:10 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 17 (30 max) times Sep 01 09:19:12 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:12 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:12 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 18 (30 max) times Sep 01 09:19:14 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:14 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:14 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 19 (30 max) times Sep 01 09:19:16 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:16 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:16 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 20 (30 max) times Sep 01 09:19:18 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:18 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:18 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 21 (30 max) times Sep 01 09:19:20 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:20 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:20 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 22 (30 max) times Sep 01 09:19:22 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:22 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:22 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 23 (30 max) times Sep 01 09:19:24 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:24 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:24 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 24 (30 max) times Sep 01 09:19:26 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:26 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:26 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 25 (30 max) times Sep 01 09:19:28 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:28 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:28 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 26 (30 max) times Sep 01 09:19:30 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:30 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:30 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 27 (30 max) times Sep 01 09:19:32 royal crmd: [11749]: info: crm_timer_popped: Wait Timer (I_NULL) just popped! Sep 01 09:19:32 royal crmd: [11749]: WARN: lrm_signon: can not initiate connection Sep 01 09:19:32 royal crmd: [11749]: WARN: do_lrm_control: Failed to sign on to the LRM 28 (30 max) times Sep 01 09:19:34 corosync [SERV ] Unloading all corosync components Sep 01 09:19:34 corosync [SERV ] Unloading corosync component: corosync_evs v0 Sep 01 09:19:34 corosync [SERV ] Unloading corosync component: corosync_cfg v0 Sep 01 09:19:34 corosync [SERV ] Unloading corosync component: corosync_cpg v0 Sep 01 09:19:34 corosync [SERV ] Unloading corosync component: corosync_confdb v0 Sep 01 09:19:34 corosync [SERV ] Unloading corosync component: corosync_pload v0 Sep 01 09:19:34 corosync [SERV ] Unloading corosync component: pacemaker v0 Sep 01 09:19:34 corosync [pcmk ] notice: pcmk_shutdown: Begining shutdown Sep 01 09:19:34 corosync [pcmk ] debug: stop_child: Stopping CRM child "crmd" Sep 01 09:19:34 corosync [pcmk ] notice: stop_child: Sent -15 to crmd: [11749] Sep 01 09:19:35 corosync [pcmk ] notice: pcmk_shutdown: crmd (pid=11749) confirmed dead Sep 01 09:19:35 corosync [pcmk ] debug: stop_child: Stopping CRM child "pengine" Sep 01 09:19:35 corosync [pcmk ] notice: stop_child: Sent -15 to pengine: [11727] Sep 01 09:19:35 corosync [pcmk ] notice: pcmk_shutdown: pengine (pid=11727) confirmed dead Sep 01 09:19:35 royal lrmd: [11725]: info: lrmd is shutting down Sep 01 09:19:35 corosync [pcmk ] debug: stop_child: Stopping CRM child "attrd" Sep 01 09:19:35 corosync [pcmk ] notice: stop_child: Sent -15 to attrd: [11726] Sep 01 09:19:35 corosync [pcmk ] notice: pcmk_shutdown: attrd (pid=11726) confirmed dead Sep 01 09:19:35 corosync [pcmk ] debug: stop_child: Stopping CRM child "lrmd" Sep 01 09:19:35 corosync [pcmk ] notice: stop_child: Sent -15 to lrmd: [11725] Sep 01 09:19:36 corosync [pcmk ] notice: pcmk_shutdown: lrmd (pid=11725) confirmed dead Sep 01 09:19:36 corosync [pcmk ] debug: stop_child: Stopping CRM child "cib" Sep 01 09:19:36 corosync [pcmk ] notice: stop_child: Sent -15 to cib: [11724] Sep 01 09:19:36 corosync [pcmk ] notice: pcmk_shutdown: cib (pid=11724) confirmed dead Sep 01 09:19:36 corosync [pcmk ] debug: stop_child: Stopping CRM child "stonithd" Sep 01 09:19:36 corosync [pcmk ] notice: pcmk_shutdown: stonithd (pid=0) confirmed dead Sep 01 09:19:36 corosync [pcmk ] debug: send_cluster_id: Local update: id=672212678, born=764, seq=764 Sep 01 09:19:36 corosync [pcmk ] info: update_member: Node royal now has process list: 00000000000000000000000000000002 (2) Sep 01 09:19:36 corosync [pcmk ] notice: pcmk_shutdown: Shutdown complete Sep 01 09:19:36 corosync [TOTEM ] sending join/leave message Sep 01 09:19:36 corosync [MAIN ] Corosync Cluster Engine exiting with status -1 at main.c:171.