Jan 28 14:03:08 srv01 corosync[31871]: [MAIN ] main.c:1236 Corosync Cluster Engine ('1.2.0'): started and ready to provide service. Jan 28 14:03:08 srv01 corosync[31871]: [MAIN ] main.c:1237 Corosync built-in features: nss Jan 28 14:03:08 srv01 corosync[31871]: [MAIN ] main.c:1312 Successfully read main configuration file '/etc/corosync/corosync.conf'. Jan 28 14:03:08 srv01 corosync[31871]: [TOTEM ] totemnet.c:204 Initializing transport (UDP/IP). Jan 28 14:03:08 srv01 corosync[31871]: [TOTEM ] totemudp.c:321 Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0). Jan 28 14:03:08 srv01 corosync[31871]: [TOTEM ] totemnet.c:204 Initializing transport (UDP/IP). Jan 28 14:03:08 srv01 corosync[31871]: [TOTEM ] totemudp.c:321 Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0). Jan 28 14:03:08 srv01 corosync[31871]: [MAIN ] main.c:1457 Compatibility mode set to whitetank. Using V1 and V2 of the synchronization engine. Jan 28 14:03:08 srv01 corosync[31871]: [TOTEM ] totemudp.c:1357 The network interface [192.168.50.210] is now up. Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] plugin.c:321 info: process_ais_conf: Reading configure Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:546 info: config_find_init: Local handle: 7739444317642555394 for logging Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:572 info: config_find_next: Processing additional logging options... Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:598 info: get_config_opt: Found 'on' for option: debug Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:612 info: get_config_opt: Defaulting to 'off' for option: to_file Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:598 info: get_config_opt: Found 'local1' for option: syslog_facility Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:546 info: config_find_init: Local handle: 5650605097994944515 for service Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:572 info: config_find_next: Processing additional service options... Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:612 info: get_config_opt: Defaulting to 'pcmk' for option: clustername Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:612 info: get_config_opt: Defaulting to 'no' for option: use_logd Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] utils.c:612 info: get_config_opt: Defaulting to 'no' for option: use_mgmtd Jan 28 14:03:08 srv01 lrmd: [31879]: info: G_main_add_SignalHandler: Added signal handler for signal 15 Jan 28 14:03:08 srv01 stonithd: [31877]: info: G_main_add_SignalHandler: Added signal handler for signal 10 Jan 28 14:03:08 srv01 crmd: [31882]: info: Invoked: /usr/lib/heartbeat/crmd Jan 28 14:03:08 srv01 attrd: [31880]: info: Invoked: /usr/lib/heartbeat/attrd Jan 28 14:03:08 srv01 pengine: [31881]: info: Invoked: /usr/lib/heartbeat/pengine Jan 28 14:03:08 srv01 cib: [31878]: info: Invoked: /usr/lib/heartbeat/cib Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] plugin.c:517 info: pcmk_startup: CRM: Initialized Jan 28 14:03:08 srv01 lrmd: [31879]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Jan 28 14:03:08 srv01 stonithd: [31877]: info: G_main_add_SignalHandler: Added signal handler for signal 12 Jan 28 14:03:08 srv01 crmd: [31882]: info: main: CRM Hg Version: 9287969750e1f2aaac96d7e500cfeedc72347fe6 Jan 28 14:03:08 srv01 attrd: [31880]: info: main: Starting up Jan 28 14:03:08 srv01 cib: [31878]: info: G_main_add_TriggerHandler: Added signal manual handler Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] plugin.c:518 Logging: Initialized pcmk_startup Jan 28 14:03:08 srv01 stonithd: [31877]: info: Stack hogger failed 0xffffffff Jan 28 14:03:08 srv01 crmd: [31882]: info: crmd_init: Starting crmd Jan 28 14:03:08 srv01 attrd: [31880]: info: crm_cluster_connect: Connecting to OpenAIS Jan 28 14:03:08 srv01 cib: [31878]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Jan 28 14:03:08 srv01 corosync[31871]: [pcmk ] plugin.c:536 info: pcmk_startup: Maximum core file size is: 4294967295 Jan 28 14:03:08 srv01 lrmd: [31879]: info: G_main_add_SignalHandler: Added signal handler for signal 10 Jan 28 14:03:08 srv01 attrd: [31880]: info: init_ais_connection: Creating connection to our AIS plugin Jan 28 14:03:09 srv01 cib: [31878]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] plugin.c:557 info: pcmk_startup: Service: 9 Jan 28 14:03:09 srv01 lrmd: [31879]: info: G_main_add_SignalHandler: Added signal handler for signal 12 Jan 28 14:03:09 srv01 attrd: [31880]: info: init_ais_connection: AIS connection established Jan 28 14:03:09 srv01 stonithd: [31877]: info: crm_cluster_connect: Connecting to OpenAIS Jan 28 14:03:09 srv01 cib: [31878]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] plugin.c:558 info: pcmk_startup: Local hostname: srv01 Jan 28 14:03:09 srv01 attrd: [31880]: info: get_ais_nodeid: Server details: id=1379051712 uname=srv01 cname=pcmk Jan 28 14:03:09 srv01 stonithd: [31877]: info: init_ais_connection: Creating connection to our AIS plugin Jan 28 14:03:09 srv01 pengine: [31881]: info: main: Starting pengine Jan 28 14:03:09 srv01 cib: [31878]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup... Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] plugin.c:475 info: pcmk_update_nodeid: Local node id: 1379051712 Jan 28 14:03:09 srv01 lrmd: [31879]: info: Started. Jan 28 14:03:09 srv01 stonithd: [31877]: info: init_ais_connection: AIS connection established Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:233 info: update_member: Creating entry for node 1379051712 born on 0 Jan 28 14:03:09 srv01 attrd: [31880]: info: crm_new_peer: Node srv01 now has id: 1379051712 Jan 28 14:03:09 srv01 stonithd: [31877]: info: get_ais_nodeid: Server details: id=1379051712 uname=srv01 cname=pcmk Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:260 info: update_member: 0x93ce190 Node 1379051712 now known as srv01 (was: (null)) Jan 28 14:03:09 srv01 crmd: [31882]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Jan 28 14:03:09 srv01 attrd: [31880]: info: crm_new_peer: Node 1379051712 is now known as srv01 Jan 28 14:03:09 srv01 cib: [31878]: WARN: readCibXmlFile: Continuing with an empty configuration. Jan 28 14:03:09 srv01 stonithd: [31877]: info: crm_new_peer: Node srv01 now has id: 1379051712 Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:276 info: update_member: Node srv01 now has 1 quorum votes (was 0) Jan 28 14:03:09 srv01 attrd: [31880]: info: main: Cluster connection active Jan 28 14:03:09 srv01 stonithd: [31877]: info: crm_new_peer: Node 1379051712 is now known as srv01 Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:286 info: update_member: Node 1379051712/srv01 is now: member Jan 28 14:03:09 srv01 attrd: [31880]: info: main: Accepting attribute updates Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:142 info: spawn_child: Forked child 31877 for process stonithd Jan 28 14:03:09 srv01 attrd: [31880]: info: main: Starting mainloop... Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:142 info: spawn_child: Forked child 31878 for process cib Jan 28 14:03:09 srv01 stonithd: [31877]: notice: /usr/lib/heartbeat/stonithd start up successfully. Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:142 info: spawn_child: Forked child 31879 for process lrmd Jan 28 14:03:09 srv01 stonithd: [31877]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:142 info: spawn_child: Forked child 31880 for process attrd Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:142 info: spawn_child: Forked child 31881 for process pengine Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] utils.c:142 info: spawn_child: Forked child 31882 for process crmd Jan 28 14:03:09 srv01 corosync[31871]: [SERV ] service.c:252 Service engine loaded: Pacemaker Cluster Manager 1.0.7 Jan 28 14:03:09 srv01 corosync[31871]: [SERV ] service.c:252 Service engine loaded: corosync extended virtual synchrony service Jan 28 14:03:09 srv01 corosync[31871]: [SERV ] service.c:252 Service engine loaded: corosync configuration service Jan 28 14:03:09 srv01 cib: [31878]: info: startCib: CIB Initialization completed successfully Jan 28 14:03:09 srv01 corosync[31871]: [SERV ] service.c:252 Service engine loaded: corosync cluster closed process group service v1.01 Jan 28 14:03:09 srv01 cib: [31878]: info: crm_cluster_connect: Connecting to OpenAIS Jan 28 14:03:09 srv01 corosync[31871]: [SERV ] service.c:252 Service engine loaded: corosync cluster config database access v1.01 Jan 28 14:03:09 srv01 cib: [31878]: info: init_ais_connection: Creating connection to our AIS plugin Jan 28 14:03:09 srv01 corosync[31871]: [SERV ] service.c:252 Service engine loaded: corosync profile loading service Jan 28 14:03:09 srv01 cib: [31878]: info: init_ais_connection: AIS connection established Jan 28 14:03:09 srv01 corosync[31871]: [SERV ] service.c:252 Service engine loaded: corosync cluster quorum service v0.1 Jan 28 14:03:09 srv01 cib: [31878]: info: get_ais_nodeid: Server details: id=1379051712 uname=srv01 cname=pcmk Jan 28 14:03:09 srv01 cib: [31878]: info: crm_new_peer: Node srv01 now has id: 1379051712 Jan 28 14:03:09 srv01 corosync[31871]: [TOTEM ] totemudp.c:1357 The network interface [192.168.60.210] is now up. Jan 28 14:03:09 srv01 cib: [31878]: info: crm_new_peer: Node 1379051712 is now known as srv01 Jan 28 14:03:09 srv01 cib: [31878]: info: cib_init: Starting cib mainloop Jan 28 14:03:09 srv01 cib: [31878]: info: ais_dispatch: Membership 0: quorum still lost Jan 28 14:03:09 srv01 cib: [31878]: info: crm_update_peer: Node srv01: id=1379051712 state=member (new) addr=(null) votes=1 (new) born=0 seen=0 proc=00000000000000000000000000000000 Jan 28 14:03:09 srv01 cib: [31886]: info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 6a194e28f72d826d14dcf2114b12d65a) Jan 28 14:03:09 srv01 cib: [31886]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.WT92vg (digest: /var/lib/heartbeat/crm/cib.xwoffd) Jan 28 14:03:09 srv01 cib: [31878]: info: Managed write_cib_contents process 31886 exited with return code 0. Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] plugin.c:943 info: pcmk_ipc: Recorded connection 0x93d3190 for attrd/31880 Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] plugin.c:943 info: pcmk_ipc: Recorded connection 0x93d3708 for stonithd/31877 Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] plugin.c:943 info: pcmk_ipc: Recorded connection 0x93d5088 for cib/31878 Jan 28 14:03:09 srv01 corosync[31871]: [pcmk ] plugin.c:952 info: pcmk_ipc: Sending membership update 0 to cib Jan 28 14:03:10 srv01 crmd: [31882]: info: do_cib_control: CIB connection established Jan 28 14:03:10 srv01 crmd: [31882]: info: crm_cluster_connect: Connecting to OpenAIS Jan 28 14:03:10 srv01 crmd: [31882]: info: init_ais_connection: Creating connection to our AIS plugin Jan 28 14:03:10 srv01 crmd: [31882]: info: init_ais_connection: AIS connection established Jan 28 14:03:10 srv01 corosync[31871]: [pcmk ] plugin.c:943 info: pcmk_ipc: Recorded connection 0x93d57c8 for crmd/31882 Jan 28 14:03:10 srv01 corosync[31871]: [pcmk ] plugin.c:952 info: pcmk_ipc: Sending membership update 0 to crmd Jan 28 14:03:10 srv01 crmd: [31882]: info: get_ais_nodeid: Server details: id=1379051712 uname=srv01 cname=pcmk Jan 28 14:03:10 srv01 crmd: [31882]: info: crm_new_peer: Node srv01 now has id: 1379051712 Jan 28 14:03:10 srv01 crmd: [31882]: info: crm_new_peer: Node 1379051712 is now known as srv01 Jan 28 14:03:10 srv01 crmd: [31882]: info: do_ha_control: Connected to the cluster Jan 28 14:03:10 srv01 crmd: [31882]: info: do_started: Delaying start, CCM (0000000000100000) not connected Jan 28 14:03:10 srv01 crmd: [31882]: info: crmd_init: Starting crmd's mainloop Jan 28 14:03:10 srv01 crmd: [31882]: info: ais_dispatch: Membership 0: quorum still lost Jan 28 14:03:10 srv01 crmd: [31882]: info: crm_update_peer: Node srv01: id=1379051712 state=member (new) addr=(null) votes=1 (new) born=0 seen=0 proc=00000000000000000000000000000000 Jan 28 14:03:10 srv01 crmd: [31882]: info: do_started: Delaying start, Config not read (0000000000000040) Jan 28 14:03:10 srv01 crmd: [31882]: info: config_query_callback: Checking for expired actions every 900000ms Jan 28 14:03:10 srv01 corosync[31871]: [pcmk ] plugin.c:309 info: update_expected_votes: Expected quorum votes 1024 -> 2 Jan 28 14:03:10 srv01 crmd: [31882]: info: do_started: The local CRM is operational Jan 28 14:03:10 srv01 crmd: [31882]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ] Jan 28 14:03:11 srv01 crmd: [31882]: info: ais_dispatch: Membership 0: quorum still lost Jan 28 14:03:14 srv01 attrd: [31880]: info: cib_connect: Connected to the CIB after 1 signon attempts Jan 28 14:03:14 srv01 attrd: [31880]: info: cib_connect: Sending full refresh Jan 28 14:03:14 srv01 corosync[31871]: [TOTEM ] totemrrp.c:1070 Incrementing problem counter for seqid 1 iface 192.168.60.210 to [1 of 10] Jan 28 14:03:14 srv01 corosync[31871]: [pcmk ] plugin.c:662 notice: pcmk_peer_update: Transitional membership event on ring 3692: memb=0, new=0, lost=0 Jan 28 14:03:14 srv01 corosync[31871]: [pcmk ] plugin.c:662 notice: pcmk_peer_update: Stable membership event on ring 3692: memb=1, new=1, lost=0 Jan 28 14:03:14 srv01 corosync[31871]: [pcmk ] plugin.c:690 info: pcmk_peer_update: NEW: srv01 1379051712 Jan 28 14:03:14 srv01 corosync[31871]: [pcmk ] plugin.c:708 info: pcmk_peer_update: MEMB: srv01 1379051712 Jan 28 14:03:14 srv01 corosync[31871]: [pcmk ] utils.c:269 info: update_member: Node srv01 now has process list: 00000000000000000000000000013312 (78610) Jan 28 14:03:14 srv01 corosync[31871]: [TOTEM ] totemsrp.c:1789 A processor joined or left the membership and a new membership was formed. Jan 28 14:03:14 srv01 corosync[31871]: [MAIN ] main.c:249 Completed service synchronization, ready to provide service. Jan 28 14:03:44 srv01 corosync[31871]: [TOTEM ] totemrrp.c:1038 ring 1 active with no faults Jan 28 14:04:11 srv01 crmd: [31882]: info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! Jan 28 14:04:11 srv01 crmd: [31882]: WARN: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING Jan 28 14:04:11 srv01 crmd: [31882]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] Jan 28 14:04:11 srv01 crmd: [31882]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] Jan 28 14:04:11 srv01 crmd: [31882]: info: do_te_control: Registering TE UUID: 308220b3-1398-45c3-82d5-6d4d6ac3f42a Jan 28 14:04:11 srv01 crmd: [31882]: WARN: cib_client_add_notify_callback: Callback already present Jan 28 14:04:11 srv01 crmd: [31882]: info: set_graph_functions: Setting custom graph functions Jan 28 14:04:11 srv01 crmd: [31882]: info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses Jan 28 14:04:11 srv01 crmd: [31882]: info: do_dc_takeover: Taking over DC status for this partition Jan 28 14:04:11 srv01 cib: [31878]: info: cib_process_readwrite: We are now in R/W mode Jan 28 14:04:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/6, version=0.0.0): ok (rc=0) Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: - Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/7, version=0.1.1): ok (rc=0) Jan 28 14:04:11 srv01 cib: [31919]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-0.raw Jan 28 14:04:11 srv01 cib: [31919]: info: write_cib_contents: Wrote version 0.1.0 of the CIB to disk (digest: a373defe49a484a3c80dca2659221c50) Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: - Jan 28 14:04:11 srv01 cib: [31919]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.pXNCsM (digest: /var/lib/heartbeat/crm/cib.l3xo8e) Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/10, version=0.2.1): ok (rc=0) Jan 28 14:04:11 srv01 cib: [31878]: info: Managed write_cib_contents process 31919 exited with return code 0. Jan 28 14:04:11 srv01 cib: [31920]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-1.raw Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: - Jan 28 14:04:11 srv01 cib: [31920]: info: write_cib_contents: Wrote version 0.2.0 of the CIB to disk (digest: 0c426f96793008a488dee3ff159f9c76) Jan 28 14:04:11 srv01 crmd: [31882]: info: join_make_offer: Peer process on srv01 is not active (yet?): 00000000 1 Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31920]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.8uDgOM (digest: /var/lib/heartbeat/crm/cib.1PZFPf) Jan 28 14:04:11 srv01 crmd: [31882]: info: do_dc_join_offer_all: join-1: Waiting on 0 outstanding join acks Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 crmd: [31882]: info: ais_dispatch: Membership 3692: quorum still lost Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/13, version=0.3.1): ok (rc=0) Jan 28 14:04:11 srv01 cib: [31878]: info: Managed write_cib_contents process 31920 exited with return code 0. Jan 28 14:04:11 srv01 cib: [31921]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-2.raw Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: - Jan 28 14:04:11 srv01 cib: [31921]: info: write_cib_contents: Wrote version 0.3.0 of the CIB to disk (digest: b6f92f47d512b9b6069eae8de11a0051) Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31921]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.51GCcN (digest: /var/lib/heartbeat/crm/cib.xBloCg) Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 crmd: [31882]: info: config_query_callback: Checking for expired actions every 900000ms Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 crmd: [31882]: info: ais_dispatch: Membership 3692: quorum still lost Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: log_data_element: cib:diff: + Jan 28 14:04:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/17, version=0.4.1): ok (rc=0) Jan 28 14:04:11 srv01 cib: [31878]: info: Managed write_cib_contents process 31921 exited with return code 0. Jan 28 14:04:11 srv01 crmd: [31882]: info: te_connect_stonith: Attempting connection to fencing daemon... Jan 28 14:04:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/19, version=0.4.1): ok (rc=0) Jan 28 14:04:11 srv01 cib: [31922]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-3.raw Jan 28 14:04:11 srv01 cib: [31922]: info: write_cib_contents: Wrote version 0.4.0 of the CIB to disk (digest: 8da7609228594ac108641116df49f030) Jan 28 14:04:11 srv01 cib: [31922]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.Wt1oDN (digest: /var/lib/heartbeat/crm/cib.192Wth) Jan 28 14:04:11 srv01 cib: [31878]: info: Managed write_cib_contents process 31922 exited with return code 0. Jan 28 14:04:12 srv01 crmd: [31882]: info: te_connect_stonith: Connected Jan 28 14:07:11 srv01 crmd: [31882]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped! Jan 28 14:07:11 srv01 crmd: [31882]: info: crm_timer_popped: Welcomed: 0, Integrated: 0 Jan 28 14:07:11 srv01 crmd: [31882]: info: do_state_transition: State transition S_INTEGRATION -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=crm_timer_popped ] Jan 28 14:07:11 srv01 crmd: [31882]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] Jan 28 14:07:11 srv01 crmd: [31882]: info: do_dc_takeover: Taking over DC status for this partition Jan 28 14:07:11 srv01 cib: [31878]: info: cib_process_readwrite: We are now in R/O mode Jan 28 14:07:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_slave_all for section 'all' (origin=local/crmd/20, version=0.4.1): ok (rc=0) Jan 28 14:07:11 srv01 cib: [31878]: info: cib_process_readwrite: We are now in R/W mode Jan 28 14:07:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/21, version=0.4.1): ok (rc=0) Jan 28 14:07:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/22, version=0.4.1): ok (rc=0) Jan 28 14:07:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/24, version=0.4.1): ok (rc=0) Jan 28 14:07:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/26, version=0.4.1): ok (rc=0) Jan 28 14:07:11 srv01 crmd: [31882]: info: join_make_offer: Making join offers based on membership 3692 Jan 28 14:07:11 srv01 crmd: [31882]: info: join_make_offer: Peer process on srv01 is not active (yet?): 00000000 1 Jan 28 14:07:11 srv01 crmd: [31882]: info: do_dc_join_offer_all: join-2: Waiting on 0 outstanding join acks Jan 28 14:07:11 srv01 crmd: [31882]: info: ais_dispatch: Membership 3692: quorum still lost Jan 28 14:07:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/29, version=0.4.1): ok (rc=0) Jan 28 14:07:11 srv01 crmd: [31882]: info: config_query_callback: Checking for expired actions every 900000ms Jan 28 14:07:11 srv01 crmd: [31882]: info: ais_dispatch: Membership 3692: quorum still lost Jan 28 14:07:11 srv01 cib: [31878]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/31, version=0.4.1): ok (rc=0)