Mar 30 14:24:33 bl460g6a heartbeat: [30676]: WARN: Logging daemon is disabled --enabling logging daemon is recommended
Mar 30 14:24:33 bl460g6a heartbeat: [30676]: info: **************************
Mar 30 14:24:33 bl460g6a heartbeat: [30676]: info: Configuration validated. Starting heartbeat 3.0.5
Mar 30 14:24:33 bl460g6a heartbeat: [30677]: info: heartbeat: version 3.0.5
Mar 30 14:24:34 bl460g6a heartbeat: [30677]: info: Heartbeat generation: 1329101317
Mar 30 14:24:34 bl460g6a heartbeat: [30677]: info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth1
Mar 30 14:24:34 bl460g6a heartbeat: [30677]: info: glib: UDP Broadcast heartbeat closed on port 694 interface eth1 - Status: 1
Mar 30 14:24:34 bl460g6a heartbeat: [30677]: notice: Using watchdog device: /dev/watchdog
Mar 30 14:24:34 bl460g6a heartbeat: [30677]: info: Local status now set to: 'up'
Mar 30 14:24:34 bl460g6a heartbeat: [30677]: info: Link bl460g6a:eth1 up.
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Link bl460g6b:eth1 up.
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Status update for node bl460g6b: status up
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: debug: get_delnodelist: delnodelist= 
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Comm_now_up(): updating status to active
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Local status now set to: 'active'
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Starting child client "/usr/lib64/heartbeat/ccm" (495,489)
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Starting child client "/usr/lib64/heartbeat/cib" (495,489)
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Starting child client "/usr/lib64/heartbeat/lrmd -r" (0,0)
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Starting child client "/usr/lib64/heartbeat/stonithd" (0,0)
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Starting child client "/usr/lib64/heartbeat/attrd" (495,489)
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: Starting child client "/usr/lib64/heartbeat/crmd" (495,489)
Mar 30 14:24:38 bl460g6a heartbeat: [30686]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 495  gid 489 (pid 30686)
Mar 30 14:24:38 bl460g6a heartbeat: [30687]: info: Starting "/usr/lib64/heartbeat/cib" as uid 495  gid 489 (pid 30687)
Mar 30 14:24:38 bl460g6a heartbeat: [30688]: info: Starting "/usr/lib64/heartbeat/lrmd -r" as uid 0  gid 0 (pid 30688)
Mar 30 14:24:38 bl460g6a heartbeat: [30689]: info: Starting "/usr/lib64/heartbeat/stonithd" as uid 0  gid 0 (pid 30689)
Mar 30 14:24:38 bl460g6a heartbeat: [30690]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 495  gid 489 (pid 30690)
Mar 30 14:24:38 bl460g6a heartbeat: [30691]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 495  gid 489 (pid 30691)
Mar 30 14:24:38 bl460g6a crmd: [30691]: info: Invoked: /usr/lib64/heartbeat/crmd 
Mar 30 14:24:38 bl460g6a crmd: [30691]: info: main: CRM Hg Version: unknown
Mar 30 14:24:38 bl460g6a attrd: [30690]: info: Invoked: /usr/lib64/heartbeat/attrd 
Mar 30 14:24:38 bl460g6a crmd: [30691]: info: crmd_init: Starting crmd
Mar 30 14:24:38 bl460g6a attrd: [30690]: info: main: Starting up
Mar 30 14:24:38 bl460g6a cib: [30687]: info: Invoked: /usr/lib64/heartbeat/cib 
Mar 30 14:24:38 bl460g6a cib: [30687]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Mar 30 14:24:38 bl460g6a cib: [30687]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Mar 30 14:24:38 bl460g6a cib: [30687]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Mar 30 14:24:38 bl460g6a cib: [30687]: WARN: readCibXmlFile: Continuing with an empty configuration.
Mar 30 14:24:38 bl460g6a cib: [30687]: info: startCib: CIB Initialization completed successfully
Mar 30 14:24:38 bl460g6a ccm: [30686]: info: Hostname: bl460g6a
Mar 30 14:24:38 bl460g6a cib: [30687]: info: register_heartbeat_conn: Hostname: bl460g6a
Mar 30 14:24:38 bl460g6a cib: [30687]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Mar 30 14:24:38 bl460g6a cib: [30687]: info: crm_cluster_connect: Connecting to Heartbeat
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: the send queue length from heartbeat to client ccm is set to 1024
Mar 30 14:24:38 bl460g6a cib: [30687]: info: ccm_connect: Registering with CCM...
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: the send queue length from heartbeat to client cib is set to 1024
Mar 30 14:24:38 bl460g6a cib: [30687]: WARN: ccm_connect: CCM Activation failed
Mar 30 14:24:38 bl460g6a cib: [30687]: WARN: ccm_connect: CCM Connection failed 1 times (30 max)
Mar 30 14:24:38 bl460g6a attrd: [30690]: info: register_heartbeat_conn: Hostname: bl460g6a
Mar 30 14:24:38 bl460g6a attrd: [30690]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Mar 30 14:24:38 bl460g6a attrd: [30690]: info: crm_cluster_connect: Connecting to Heartbeat
Mar 30 14:24:38 bl460g6a attrd: [30690]: info: main: Cluster connection active
Mar 30 14:24:38 bl460g6a attrd: [30690]: info: main: Accepting attribute updates
Mar 30 14:24:38 bl460g6a attrd: [30690]: info: main: Starting mainloop...
Mar 30 14:24:38 bl460g6a lrmd: [30688]: info: enabling coredumps
Mar 30 14:24:38 bl460g6a lrmd: [30688]: info: Started.
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: the send queue length from heartbeat to client attrd is set to 1024
Mar 30 14:24:38 bl460g6a stonithd: [30689]: info: register_heartbeat_conn: Hostname: bl460g6a
Mar 30 14:24:38 bl460g6a stonithd: [30689]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Mar 30 14:24:38 bl460g6a stonithd: [30689]: info: crm_cluster_connect: Connecting to Heartbeat
Mar 30 14:24:38 bl460g6a heartbeat: [30677]: info: the send queue length from heartbeat to client stonithd is set to 1024
Mar 30 14:24:38 bl460g6a stonithd: [30689]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
Mar 30 14:24:39 bl460g6a heartbeat: [30677]: info: Status update for node bl460g6b: status active
Mar 30 14:24:39 bl460g6a crmd: [30691]: info: do_cib_control: Could not connect to the CIB service: connection failed
Mar 30 14:24:39 bl460g6a crmd: [30691]: WARN: do_cib_control: Couldn't complete CIB registration 1 times... pause and retry
Mar 30 14:24:39 bl460g6a crmd: [30691]: info: crmd_init: Starting crmd's mainloop
Mar 30 14:24:41 bl460g6a crmd: [30691]: info: crm_timer_popped: Wait Timer (I_NULL) just popped!
Mar 30 14:24:41 bl460g6a cib: [30687]: info: ccm_connect: Registering with CCM...
Mar 30 14:24:41 bl460g6a cib: [30687]: info: cib_init: Requesting the list of configured nodes
Mar 30 14:24:42 bl460g6a cib: [30687]: info: cib_init: Starting cib mainloop
Mar 30 14:24:42 bl460g6a cib: [30687]: info: cib_client_status_callback: Status update: Client bl460g6a/cib now has status [join]
Mar 30 14:24:42 bl460g6a cib: [30687]: info: crm_new_peer: Node 0 is now known as bl460g6a
Mar 30 14:24:42 bl460g6a cib: [30687]: info: crm_update_peer_proc: bl460g6a.cib is now online
Mar 30 14:24:42 bl460g6a cib: [30687]: info: cib_client_status_callback: Status update: Client bl460g6b/cib now has status [join]
Mar 30 14:24:42 bl460g6a cib: [30687]: info: crm_new_peer: Node 0 is now known as bl460g6b
Mar 30 14:24:42 bl460g6a cib: [30687]: info: crm_update_peer_proc: bl460g6b.cib is now online
Mar 30 14:24:42 bl460g6a cib: [30687]: info: cib_client_status_callback: Status update: Client bl460g6a/cib now has status [online]
Mar 30 14:24:42 bl460g6a crmd: [30691]: info: do_cib_control: CIB connection established
Mar 30 14:24:42 bl460g6a cib: [30694]: info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: b8476e23665d5ac2188672087daa65a5)
Mar 30 14:24:42 bl460g6a cib: [30694]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.OT06q2 (digest: /var/lib/heartbeat/crm/cib.rd9Ly4)
Mar 30 14:24:43 bl460g6a cib: [30687]: info: cib_client_status_callback: Status update: Client bl460g6b/cib now has status [online]
Mar 30 14:24:43 bl460g6a heartbeat: [30677]: WARN: 1 lost packet(s) for [bl460g6b] [17:19]
Mar 30 14:24:43 bl460g6a cib: [30687]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Mar 30 14:24:43 bl460g6a cib: [30687]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Mar 30 14:24:43 bl460g6a cib: [30687]: info: cib_ccm_msg_callback: Processing CCM event=NEW MEMBERSHIP (id=2)
Mar 30 14:24:43 bl460g6a cib: [30687]: info: crm_get_peer: Node bl460g6b now has id: 1
Mar 30 14:24:43 bl460g6a cib: [30687]: info: crm_update_peer: Node bl460g6b: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000100
Mar 30 14:24:43 bl460g6a cib: [30687]: info: crm_update_peer_proc: bl460g6b.ais is now online
Mar 30 14:24:43 bl460g6a cib: [30687]: info: crm_update_peer_proc: bl460g6b.crmd is now online
Mar 30 14:24:43 bl460g6a cib: [30687]: info: crm_update_peer: Node bl460g6a: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000100
Mar 30 14:24:43 bl460g6a cib: [30687]: info: crm_update_peer_proc: bl460g6a.ais is now online
Mar 30 14:24:43 bl460g6a cib: [30687]: info: crm_update_peer_proc: bl460g6a.crmd is now online
Mar 30 14:24:43 bl460g6a heartbeat: [30677]: info: No pkts missing from bl460g6b!
Mar 30 14:24:43 bl460g6a crmd: [30691]: info: register_heartbeat_conn: Hostname: bl460g6a
Mar 30 14:24:43 bl460g6a crmd: [30691]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Mar 30 14:24:43 bl460g6a crmd: [30691]: info: crm_cluster_connect: Connecting to Heartbeat
Mar 30 14:24:43 bl460g6a heartbeat: [30677]: info: the send queue length from heartbeat to client crmd is set to 1024
Mar 30 14:24:43 bl460g6a crmd: [30691]: info: do_ha_control: Connected to the cluster
Mar 30 14:24:43 bl460g6a crmd: [30691]: info: do_ccm_control: CCM connection established... waiting for first callback
Mar 30 14:24:43 bl460g6a crmd: [30691]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Mar 30 14:24:43 bl460g6a crmd: [30691]: notice: crmd_client_status_callback: Status update: Client bl460g6a/crmd now has status [online] (DC=false)
Mar 30 14:24:43 bl460g6a crmd: [30691]: info: crm_new_peer: Node 0 is now known as bl460g6a
Mar 30 14:24:43 bl460g6a crmd: [30691]: info: crm_update_peer_proc: bl460g6a.crmd is now online
Mar 30 14:24:43 bl460g6a crmd: [30691]: info: crmd_client_status_callback: Not the DC
Mar 30 14:24:43 bl460g6a crmd: [30691]: notice: crmd_client_status_callback: Status update: Client bl460g6b/crmd now has status [online] (DC=false)
Mar 30 14:24:43 bl460g6a attrd: [30690]: info: cib_connect: Connected to the CIB after 1 signon attempts
Mar 30 14:24:43 bl460g6a attrd: [30690]: info: cib_connect: Sending full refresh
Mar 30 14:24:44 bl460g6a crmd: [30691]: info: crm_new_peer: Node 0 is now known as bl460g6b
Mar 30 14:24:44 bl460g6a crmd: [30691]: info: crm_update_peer_proc: bl460g6b.crmd is now online
Mar 30 14:24:44 bl460g6a crmd: [30691]: info: crmd_client_status_callback: Not the DC
Mar 30 14:24:44 bl460g6a crmd: [30691]: notice: crmd_client_status_callback: Status update: Client bl460g6a/crmd now has status [online] (DC=false)
Mar 30 14:24:44 bl460g6a heartbeat: [30677]: WARN: 1 lost packet(s) for [bl460g6b] [22:24]
Mar 30 14:24:44 bl460g6a heartbeat: [30677]: info: No pkts missing from bl460g6b!
Mar 30 14:24:44 bl460g6a crmd: [30691]: info: crmd_client_status_callback: Not the DC
Mar 30 14:24:44 bl460g6a crmd: [30691]: notice: crmd_client_status_callback: Status update: Client bl460g6b/crmd now has status [online] (DC=false)
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: crmd_client_status_callback: Not the DC
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: config_query_callback: Checking for expired actions every 900000ms
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: ccm_event_detail: 	CURRENT: bl460g6b [nodeid=1, born=1]
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: ccm_event_detail: 	CURRENT: bl460g6a [nodeid=0, born=2]
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: ccm_event_detail: 	NEW:     bl460g6b [nodeid=1, born=1]
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: ccm_event_detail: 	NEW:     bl460g6a [nodeid=0, born=2]
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: crm_get_peer: Node bl460g6b now has id: 1
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: crm_update_peer: Node bl460g6b: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000200
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: crm_update_peer_proc: bl460g6b.ais is now online
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: crm_update_peer: Node bl460g6a: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000200
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: crm_update_peer_proc: bl460g6a.ais is now online
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: do_started: The local CRM is operational
Mar 30 14:24:45 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Mar 30 14:25:06 bl460g6a crmd: [30691]: info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped!
Mar 30 14:25:06 bl460g6a crmd: [30691]: WARN: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING
Mar 30 14:25:06 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
Mar 30 14:25:07 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_ELECTION -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Mar 30 14:25:07 bl460g6a crmd: [30691]: info: do_dc_release: DC role released
Mar 30 14:25:07 bl460g6a crmd: [30691]: info: do_te_control: Transitioner is now inactive
Mar 30 14:25:12 bl460g6a crmd: [30691]: info: update_dc: Set DC to bl460g6b (3.0.1)
Mar 30 14:25:12 bl460g6a cib: [30706]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-0.raw
Mar 30 14:25:12 bl460g6a cib: [30706]: info: write_cib_contents: Wrote version 0.3.0 of the CIB to disk (digest: 255d26c501f2f0f3538b05186082e476)
Mar 30 14:25:12 bl460g6a cib: [30706]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.du1ufv (digest: /var/lib/heartbeat/crm/cib.nbZByS)
Mar 30 14:25:14 bl460g6a crmd: [30691]: info: update_attrd: Connecting to attrd...
Mar 30 14:25:14 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Mar 30 14:25:14 bl460g6a attrd: [30690]: info: find_hash_entry: Creating hash entry for terminate
Mar 30 14:25:14 bl460g6a attrd: [30690]: info: find_hash_entry: Creating hash entry for shutdown
Mar 30 14:25:14 bl460g6a attrd: [30690]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Mar 30 14:25:14 bl460g6a cib: [30707]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-1.raw
Mar 30 14:25:14 bl460g6a cib: [30707]: info: write_cib_contents: Wrote version 0.5.0 of the CIB to disk (digest: c46d513db54e72a84cfb0faf30035473)
Mar 30 14:25:14 bl460g6a cib: [30707]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.FgBgGX (digest: /var/lib/heartbeat/crm/cib.Btl88o)
Mar 30 14:25:15 bl460g6a crmd: [30691]: info: erase_xpath_callback: Deletion of "//node_state[@uname='bl460g6a']/transient_attributes": ok (rc=0)
Mar 30 14:25:16 bl460g6a attrd: [30690]: info: attrd_ha_callback: flush message from bl460g6b
Mar 30 14:25:16 bl460g6a attrd: [30690]: info: find_hash_entry: Creating hash entry for probe_complete
Mar 30 14:25:16 bl460g6a attrd: [30690]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Mar 30 14:25:16 bl460g6a attrd: [30690]: info: attrd_perform_update: Sent update 5: probe_complete=true
Mar 30 14:25:16 bl460g6a cib: [30708]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-2.raw
Mar 30 14:25:16 bl460g6a cib: [30708]: info: write_cib_contents: Wrote version 0.6.0 of the CIB to disk (digest: 4126714f01fd7c127216d3463018a501)
Mar 30 14:25:16 bl460g6a cib: [30708]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.n1edA2 (digest: /var/lib/heartbeat/crm/cib.3HnCyz)
Mar 30 14:26:36 bl460g6a attrd: [30690]: info: attrd_ha_callback: flush message from bl460g6b
Mar 30 14:26:36 bl460g6a cib: [30776]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-3.raw
Mar 30 14:26:36 bl460g6a cib: [30776]: info: write_cib_contents: Wrote version 0.9.0 of the CIB to disk (digest: bfa9898c99f4cf56b6f04ff09f6eed9a)
Mar 30 14:26:36 bl460g6a cib: [30776]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.UTT4dF (digest: /var/lib/heartbeat/crm/cib.wP27rL)
Mar 30 14:26:37 bl460g6a crmd: [30691]: info: update_dc: Unset DC bl460g6b
Mar 30 14:26:37 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Mar 30 14:26:42 bl460g6a crmd: [30691]: info: update_dc: Set DC to bl460g6b (3.0.1)
Mar 30 14:26:44 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Mar 30 14:26:44 bl460g6a attrd: [30690]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Mar 30 14:26:44 bl460g6a attrd: [30690]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Mar 30 14:26:46 bl460g6a attrd: [30690]: info: attrd_ha_callback: flush message from bl460g6b
Mar 30 14:26:48 bl460g6a crmd: [30691]: info: do_lrm_rsc_op: Performing key=4:1:7:fef04010-696e-441b-b502-bf6d39f8c631 op=dummy01_monitor_0 )
Mar 30 14:26:48 bl460g6a lrmd: [30688]: info: rsc:dummy01:2: probe
Mar 30 14:26:48 bl460g6a crmd: [30691]: info: process_lrm_event: LRM operation dummy01_monitor_0 (call=2, rc=7, cib-update=12, confirmed=true) not running
Mar 30 14:26:49 bl460g6a crmd: [30691]: info: do_lrm_rsc_op: Performing key=7:1:0:fef04010-696e-441b-b502-bf6d39f8c631 op=dummy01_start_0 )
Mar 30 14:26:49 bl460g6a lrmd: [30688]: info: rsc:dummy01:3: start
Mar 30 14:26:49 bl460g6a crmd: [30691]: info: process_lrm_event: LRM operation dummy01_start_0 (call=3, rc=0, cib-update=13, confirmed=true) ok
Mar 30 14:26:50 bl460g6a crmd: [30691]: info: do_lrm_rsc_op: Performing key=8:1:0:fef04010-696e-441b-b502-bf6d39f8c631 op=dummy01_monitor_10000 )
Mar 30 14:26:50 bl460g6a lrmd: [30688]: info: rsc:dummy01:4: monitor
Mar 30 14:26:50 bl460g6a crmd: [30691]: info: process_lrm_event: LRM operation dummy01_monitor_10000 (call=4, rc=0, cib-update=14, confirmed=false) ok
Mar 30 14:32:19 bl460g6a attrd: [30690]: info: attrd_ha_callback: flush message from bl460g6b
Mar 30 14:32:19 bl460g6a cib: [31188]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-4.raw
Mar 30 14:32:19 bl460g6a cib: [31188]: info: write_cib_contents: Wrote version 0.11.0 of the CIB to disk (digest: 26d374dd76ae8264a5353863c3715a86)
Mar 30 14:32:19 bl460g6a cib: [31188]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.WM35ya (digest: /var/lib/heartbeat/crm/cib.dAGALz)
Mar 30 14:32:20 bl460g6a crmd: [30691]: info: update_dc: Unset DC bl460g6b
Mar 30 14:32:20 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Mar 30 14:32:26 bl460g6a crmd: [30691]: info: update_dc: Set DC to bl460g6b (3.0.1)
Mar 30 14:32:28 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Mar 30 14:32:28 bl460g6a attrd: [30690]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Mar 30 14:32:28 bl460g6a attrd: [30690]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Mar 30 14:32:30 bl460g6a attrd: [30690]: info: attrd_ha_callback: flush message from bl460g6b
Mar 30 14:32:32 bl460g6a crmd: [30691]: info: do_lrm_rsc_op: Performing key=5:2:7:fef04010-696e-441b-b502-bf6d39f8c631 op=dummy02_monitor_0 )
Mar 30 14:32:32 bl460g6a lrmd: [30688]: info: rsc:dummy02:5: probe
Mar 30 14:32:32 bl460g6a crmd: [30691]: info: process_lrm_event: LRM operation dummy02_monitor_0 (call=5, rc=7, cib-update=18, confirmed=true) not running
Mar 30 14:32:40 bl460g6a heartbeat: [30677]: WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 1010 ms (> 50 ms) (GSource: 0x20b2d30)
Mar 30 14:32:41 bl460g6a heartbeat: [30677]: WARN: G_CH_check_int: working on write child took 1010 ms (> 100 ms)
Mar 30 14:32:43 bl460g6a lrmd: [30688]: WARN: G_CH_check_int: working on IPC channel took 1000 ms (> 100 ms)
Mar 30 14:32:56 bl460g6a ccm: [30686]: WARN: G_CH_check_int: working on IPC channel took 1000 ms (> 100 ms)
Mar 30 14:33:13 bl460g6a crmd: [30691]: WARN: G_CH_check_int: working on IPC channel took 500 ms (> 100 ms)
Mar 30 14:33:33 bl460g6a lrmd: [30688]: WARN: G_CH_check_int: working on IPC channel took 590 ms (> 100 ms)
Mar 30 14:33:37 bl460g6a ccm: [30686]: WARN: G_CH_check_int: working on IPC channel took 830 ms (> 100 ms)
Mar 30 14:33:44 bl460g6a cib: [31276]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-5.raw
Mar 30 14:33:46 bl460g6a cib: [31276]: info: write_cib_contents: Wrote version 0.12.0 of the CIB to disk (digest: 0885939b445513728c925bf748e70975)
Mar 30 14:33:46 bl460g6a cib: [31276]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.nwjZX0 (digest: /var/lib/heartbeat/crm/cib.5Gnerd)
Mar 30 14:33:58 bl460g6a ccm: [30686]: WARN: G_CH_prepare_int: working on IPC channel took 1010 ms (> 100 ms)
Mar 30 14:34:29 bl460g6a lrmd: [30688]: WARN: G_CH_prepare_int: working on IPC channel took 1010 ms (> 100 ms)
Mar 30 14:34:30 bl460g6a heartbeat: [30677]: WARN: G_CH_check_int: working on read child took 1010 ms (> 100 ms)
Mar 30 14:34:30 bl460g6a ccm: [30686]: WARN: G_CH_prepare_int: working on IPC channel took 1010 ms (> 100 ms)
Mar 30 14:34:37 bl460g6a ccm: [30686]: WARN: G_CH_check_int: working on IPC channel took 1010 ms (> 100 ms)
Mar 30 14:34:42 bl460g6a cib: [30687]: info: cib_stats: Processed 107 operations (186.00us average, 0% utilization) in the last 10min
Mar 30 14:35:02 bl460g6a cib: [30687]: WARN: G_CH_check_int: working on Heartbeat API channel took 390 ms (> 100 ms)
Mar 30 14:35:04 bl460g6a heartbeat: [30677]: WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 320 ms (> 50 ms) (GSource: 0x20b2d30)
Mar 30 14:35:05 bl460g6a attrd: [30690]: info: attrd_ha_callback: flush message from bl460g6b
Mar 30 14:35:05 bl460g6a cib: [31361]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-6.raw
Mar 30 14:35:07 bl460g6a cib: [31361]: info: write_cib_contents: Wrote version 0.14.0 of the CIB to disk (digest: 4d05cb08436324a4653b58464b160833)
Mar 30 14:35:07 bl460g6a cib: [31361]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.NlIcco (digest: /var/lib/heartbeat/crm/cib.ipHy7b)
Mar 30 14:35:08 bl460g6a crmd: [30691]: info: update_dc: Unset DC bl460g6b
Mar 30 14:35:08 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Mar 30 14:35:15 bl460g6a crmd: [30691]: info: update_dc: Set DC to bl460g6b (3.0.1)
Mar 30 14:35:19 bl460g6a crmd: [30691]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Mar 30 14:35:19 bl460g6a attrd: [30690]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Mar 30 14:35:19 bl460g6a attrd: [30690]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Mar 30 14:35:23 bl460g6a attrd: [30690]: info: attrd_ha_callback: flush message from bl460g6b
Mar 30 14:35:24 bl460g6a heartbeat: [30677]: WARN: G_CH_check_int: working on write child took 1010 ms (> 100 ms)
Mar 30 14:35:25 bl460g6a ccm: [30686]: WARN: G_CH_check_int: working on IPC channel took 1000 ms (> 100 ms)
Mar 30 14:35:45 bl460g6a heartbeat: [30677]: WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 1000 ms (> 50 ms) (GSource: 0x20b2d30)
Mar 30 14:35:53 bl460g6a heartbeat: [30677]: WARN: G_CH_check_int: working on write child took 1010 ms (> 100 ms)
