Aug 15 17:55:19 bl460g1n13 heartbeat: [6708]: WARN: heartbeat: udp port 695 reserved for service "ieee-mms-ssl".
Aug 15 17:55:19 bl460g1n13 heartbeat: [6708]: WARN: Logging daemon is disabled --enabling logging daemon is recommended
Aug 15 17:55:19 bl460g1n13 heartbeat: [6708]: info: **************************
Aug 15 17:55:19 bl460g1n13 heartbeat: [6708]: info: Configuration validated. Starting heartbeat 3.0.5
Aug 15 17:55:19 bl460g1n13 heartbeat: [6709]: info: heartbeat: version 3.0.5
Aug 15 17:55:19 bl460g1n13 heartbeat: [6709]: info: Heartbeat generation: 1308643556
Aug 15 17:55:19 bl460g1n13 heartbeat: [6709]: info: glib: UDP Broadcast heartbeat started on port 695 (695) interface eth2
Aug 15 17:55:19 bl460g1n13 heartbeat: [6709]: info: glib: UDP Broadcast heartbeat closed on port 695 interface eth2 - Status: 1
Aug 15 17:55:19 bl460g1n13 heartbeat: [6709]: notice: Using watchdog device: /dev/watchdog
Aug 15 17:55:19 bl460g1n13 heartbeat: [6709]: info: Local status now set to: 'up'
Aug 15 17:55:20 bl460g1n13 heartbeat: [6709]: info: Link bl460g1n13:eth2 up.
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Link bl460g1n14:eth2 up.
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Status update for node bl460g1n14: status up
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: debug: get_delnodelist: delnodelist= 
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Comm_now_up(): updating status to active
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Local status now set to: 'active'
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Starting child client "/usr/lib64/heartbeat/ccm" (101,157)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Starting child client "/usr/lib64/heartbeat/cib" (101,157)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Starting child client "/usr/lib64/heartbeat/lrmd -r" (0,0)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Starting child client "/usr/lib64/heartbeat/stonithd" (0,0)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Starting child client "/usr/lib64/heartbeat/attrd" (101,157)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Starting child client "/usr/lib64/heartbeat/crmd" (101,157)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6709]: info: Status update for node bl460g1n14: status active
Aug 15 17:55:21 bl460g1n13 heartbeat: [6724]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 101  gid 157 (pid 6724)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6719]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 101  gid 157 (pid 6719)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6723]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 101  gid 157 (pid 6723)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6722]: info: Starting "/usr/lib64/heartbeat/stonithd" as uid 0  gid 0 (pid 6722)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6721]: info: Starting "/usr/lib64/heartbeat/lrmd -r" as uid 0  gid 0 (pid 6721)
Aug 15 17:55:21 bl460g1n13 heartbeat: [6720]: info: Starting "/usr/lib64/heartbeat/cib" as uid 101  gid 157 (pid 6720)
Aug 15 17:55:21 bl460g1n13 crmd: [6724]: info: Invoked: /usr/lib64/heartbeat/crmd 
Aug 15 17:55:21 bl460g1n13 attrd: [6723]: info: Invoked: /usr/lib64/heartbeat/attrd 
Aug 15 17:55:21 bl460g1n13 ccm: [6719]: info: Hostname: bl460g1n13
Aug 15 17:55:21 bl460g1n13 lrmd: [6721]: info: enabling coredumps
Aug 15 17:55:21 bl460g1n13 cib: [6720]: info: Invoked: /usr/lib64/heartbeat/cib 
Aug 15 17:55:21 bl460g1n13 crmd: [6724]: info: main: CRM Hg Version: db98485d06ed stable-1.0 tip 
Aug 15 17:55:21 bl460g1n13 attrd: [6723]: info: main: Starting up
Aug 15 17:55:21 bl460g1n13 lrmd: [6721]: info: Started.
Aug 15 17:55:21 bl460g1n13 cib: [6720]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Aug 15 17:55:22 bl460g1n13 crmd: [6724]: info: crmd_init: Starting crmd
Aug 15 17:55:22 bl460g1n13 stonithd: [6722]: info: register_heartbeat_conn: Hostname: bl460g1n13
Aug 15 17:55:22 bl460g1n13 cib: [6720]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Aug 15 17:55:22 bl460g1n13 heartbeat: [6709]: info: the send queue length from heartbeat to client ccm is set to 1024
Aug 15 17:55:22 bl460g1n13 stonithd: [6722]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Aug 15 17:55:22 bl460g1n13 cib: [6720]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Aug 15 17:55:22 bl460g1n13 heartbeat: [6709]: WARN: G_CH_dispatch_int: Dispatch function for API client took too long to execute: 110 ms (> 100 ms) (GSource: 0xa84ac40)
Aug 15 17:55:22 bl460g1n13 stonithd: [6722]: info: crm_cluster_connect: Connecting to Heartbeat
Aug 15 17:55:22 bl460g1n13 cib: [6720]: WARN: readCibXmlFile: Continuing with an empty configuration.
Aug 15 17:55:22 bl460g1n13 attrd: [6723]: info: register_heartbeat_conn: Hostname: bl460g1n13
Aug 15 17:55:22 bl460g1n13 cib: [6720]: info: startCib: CIB Initialization completed successfully
Aug 15 17:55:22 bl460g1n13 attrd: [6723]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Aug 15 17:55:22 bl460g1n13 heartbeat: [6709]: info: the send queue length from heartbeat to client stonithd is set to 1024
Aug 15 17:55:22 bl460g1n13 attrd: [6723]: info: crm_cluster_connect: Connecting to Heartbeat
Aug 15 17:55:22 bl460g1n13 stonithd: [6722]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
Aug 15 17:55:22 bl460g1n13 attrd: [6723]: info: main: Cluster connection active
Aug 15 17:55:22 bl460g1n13 attrd: [6723]: info: main: Accepting attribute updates
Aug 15 17:55:22 bl460g1n13 attrd: [6723]: info: main: Starting mainloop...
Aug 15 17:55:22 bl460g1n13 heartbeat: [6709]: WARN: 1 lost packet(s) for [bl460g1n14] [28:30]
Aug 15 17:55:22 bl460g1n13 heartbeat: [6709]: info: No pkts missing from bl460g1n14!
Aug 15 17:55:22 bl460g1n13 heartbeat: [6709]: info: the send queue length from heartbeat to client attrd is set to 1024
Aug 15 17:55:22 bl460g1n13 cib: [6720]: info: register_heartbeat_conn: Hostname: bl460g1n13
Aug 15 17:55:22 bl460g1n13 cib: [6720]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Aug 15 17:55:22 bl460g1n13 cib: [6720]: info: crm_cluster_connect: Connecting to Heartbeat
Aug 15 17:55:23 bl460g1n13 cib: [6720]: info: ccm_connect: Registering with CCM...
Aug 15 17:55:23 bl460g1n13 cib: [6720]: WARN: ccm_connect: CCM Activation failed
Aug 15 17:55:23 bl460g1n13 cib: [6720]: WARN: ccm_connect: CCM Connection failed 1 times (30 max)
Aug 15 17:55:23 bl460g1n13 crmd: [6724]: info: do_cib_control: Could not connect to the CIB service: connection failed
Aug 15 17:55:23 bl460g1n13 crmd: [6724]: WARN: do_cib_control: Couldn't complete CIB registration 1 times... pause and retry
Aug 15 17:55:23 bl460g1n13 crmd: [6724]: info: crmd_init: Starting crmd's mainloop
Aug 15 17:55:23 bl460g1n13 heartbeat: [6709]: info: the send queue length from heartbeat to client cib is set to 1024
Aug 15 17:55:24 bl460g1n13 heartbeat: [6709]: WARN: 1 lost packet(s) for [bl460g1n14] [31:33]
Aug 15 17:55:24 bl460g1n13 heartbeat: [6709]: info: No pkts missing from bl460g1n14!
Aug 15 17:55:25 bl460g1n13 crmd: [6724]: info: crm_timer_popped: Wait Timer (I_NULL) just popped!
Aug 15 17:55:26 bl460g1n13 cib: [6720]: info: ccm_connect: Registering with CCM...
Aug 15 17:55:26 bl460g1n13 cib: [6720]: info: cib_init: Requesting the list of configured nodes
Aug 15 17:55:26 bl460g1n13 crmd: [6724]: info: do_cib_control: Could not connect to the CIB service: connection failed
Aug 15 17:55:26 bl460g1n13 crmd: [6724]: WARN: do_cib_control: Couldn't complete CIB registration 2 times... pause and retry
Aug 15 17:55:26 bl460g1n13 cib: [6720]: info: cib_init: Starting cib mainloop
Aug 15 17:55:26 bl460g1n13 cib: [6720]: info: cib_client_status_callback: Status update: Client bl460g1n13/cib now has status [join]
Aug 15 17:55:26 bl460g1n13 cib: [6720]: info: crm_new_peer: Node 0 is now known as bl460g1n13
Aug 15 17:55:26 bl460g1n13 cib: [6720]: info: crm_update_peer_proc: bl460g1n13.cib is now online
Aug 15 17:55:26 bl460g1n13 cib: [6727]: info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 4fe0e1181868cbe5951e517ff43b8766)
Aug 15 17:55:26 bl460g1n13 cib: [6727]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.89XoQ8 (digest: /var/lib/heartbeat/crm/cib.CGqmkA)
Aug 15 17:55:26 bl460g1n13 cib: [6720]: info: cib_client_status_callback: Status update: Client bl460g1n13/cib now has status [online]
Aug 15 17:55:27 bl460g1n13 cib: [6720]: info: cib_client_status_callback: Status update: Client bl460g1n14/cib now has status [online]
Aug 15 17:55:27 bl460g1n13 cib: [6720]: info: crm_new_peer: Node 0 is now known as bl460g1n14
Aug 15 17:55:27 bl460g1n13 cib: [6720]: info: crm_update_peer_proc: bl460g1n14.cib is now online
Aug 15 17:55:27 bl460g1n13 attrd: [6723]: info: cib_connect: Connected to the CIB after 1 signon attempts
Aug 15 17:55:27 bl460g1n13 attrd: [6723]: info: cib_connect: Sending full refresh
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: crm_timer_popped: Wait Timer (I_NULL) just popped!
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: do_cib_control: CIB connection established
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: register_heartbeat_conn: Hostname: bl460g1n13
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: crm_cluster_connect: Connecting to Heartbeat
Aug 15 17:55:28 bl460g1n13 heartbeat: [6709]: info: the send queue length from heartbeat to client crmd is set to 1024
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: cib_ccm_msg_callback: Processing CCM event=NEW MEMBERSHIP (id=2)
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: crm_get_peer: Node bl460g1n14 now has id: 1
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: crm_update_peer: Node bl460g1n14: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000100
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: crm_update_peer_proc: bl460g1n14.ais is now online
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: crm_update_peer_proc: bl460g1n14.crmd is now online
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: crm_update_peer: Node bl460g1n13: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000100
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: crm_update_peer_proc: bl460g1n13.ais is now online
Aug 15 17:55:28 bl460g1n13 cib: [6720]: info: crm_update_peer_proc: bl460g1n13.crmd is now online
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: do_ha_control: Connected to the cluster
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: do_ccm_control: CCM connection established... waiting for first callback
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: config_query_callback: Checking for expired actions every 900000ms
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: notice: crmd_client_status_callback: Status update: Client bl460g1n13/crmd now has status [online] (DC=false)
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: crm_new_peer: Node 0 is now known as bl460g1n13
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: crm_update_peer_proc: bl460g1n13.crmd is now online
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: crmd_client_status_callback: Not the DC
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: notice: crmd_client_status_callback: Status update: Client bl460g1n13/crmd now has status [online] (DC=false)
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: info: crmd_client_status_callback: Not the DC
Aug 15 17:55:28 bl460g1n13 crmd: [6724]: notice: crmd_client_status_callback: Status update: Client bl460g1n14/crmd now has status [online] (DC=false)
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: crm_new_peer: Node 0 is now known as bl460g1n14
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: crm_update_peer_proc: bl460g1n14.crmd is now online
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: crmd_client_status_callback: Not the DC
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: ccm_event_detail: 	CURRENT: bl460g1n14 [nodeid=1, born=1]
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: ccm_event_detail: 	CURRENT: bl460g1n13 [nodeid=0, born=2]
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: ccm_event_detail: 	NEW:     bl460g1n14 [nodeid=1, born=1]
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: ccm_event_detail: 	NEW:     bl460g1n13 [nodeid=0, born=2]
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: crm_get_peer: Node bl460g1n14 now has id: 1
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: crm_update_peer: Node bl460g1n14: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000200
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: crm_update_peer_proc: bl460g1n14.ais is now online
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: crm_update_peer: Node bl460g1n13: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000200
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: crm_update_peer_proc: bl460g1n13.ais is now online
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: do_started: The local CRM is operational
Aug 15 17:55:29 bl460g1n13 crmd: [6724]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Aug 15 17:56:34 bl460g1n13 crmd: [6724]: info: update_dc: Set DC to bl460g1n14 (3.0.1)
Aug 15 17:56:34 bl460g1n13 crmd: [6724]: info: config_query_callback: Checking for expired actions every 900000ms
Aug 15 17:56:34 bl460g1n13 cib: [6728]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-0.raw
Aug 15 17:56:34 bl460g1n13 cib: [6728]: info: write_cib_contents: Wrote version 0.2.0 of the CIB to disk (digest: b48b6eef7be16430bfafaca8faca927c)
Aug 15 17:56:34 bl460g1n13 cib: [6728]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.fEcTc9 (digest: /var/lib/heartbeat/crm/cib.ofsscA)
Aug 15 17:56:34 bl460g1n13 crmd: [6724]: info: config_query_callback: Checking for expired actions every 900000ms
Aug 15 17:56:34 bl460g1n13 cib: [6731]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-1.raw
Aug 15 17:56:34 bl460g1n13 cib: [6731]: info: write_cib_contents: Wrote version 0.3.0 of the CIB to disk (digest: 7948948033e5ad94d662d1a7b8fb2be0)
Aug 15 17:56:35 bl460g1n13 cib: [6731]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.uUA3NG (digest: /var/lib/heartbeat/crm/cib.Ub9a78)
Aug 15 17:56:36 bl460g1n13 crmd: [6724]: info: update_attrd: Connecting to attrd...
Aug 15 17:56:36 bl460g1n13 crmd: [6724]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Aug 15 17:56:36 bl460g1n13 attrd: [6723]: info: find_hash_entry: Creating hash entry for terminate
Aug 15 17:56:36 bl460g1n13 attrd: [6723]: info: find_hash_entry: Creating hash entry for shutdown
Aug 15 17:56:36 bl460g1n13 attrd: [6723]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Aug 15 17:56:36 bl460g1n13 attrd: [6723]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
Aug 15 17:56:36 bl460g1n13 attrd: [6723]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
Aug 15 17:56:36 bl460g1n13 cib: [6732]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-2.raw
Aug 15 17:56:36 bl460g1n13 cib: [6732]: info: write_cib_contents: Wrote version 0.5.0 of the CIB to disk (digest: 51b3ea33532a01a7f4c4ad3a6e3b3f3b)
Aug 15 17:56:36 bl460g1n13 cib: [6732]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.1FnOCd (digest: /var/lib/heartbeat/crm/cib.spje7J)
Aug 15 17:56:36 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n13
Aug 15 17:56:36 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n13
Aug 15 17:56:37 bl460g1n13 crmd: [6724]: info: erase_xpath_callback: Deletion of "//node_state[@uname='bl460g1n13']/transient_attributes": ok (rc=0)
Aug 15 17:56:39 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n14
Aug 15 17:56:39 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n14
Aug 15 17:56:39 bl460g1n13 cib: [6734]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-3.raw
Aug 15 17:56:39 bl460g1n13 cib: [6734]: info: write_cib_contents: Wrote version 0.6.0 of the CIB to disk (digest: 3f5493afa2b91143682020cbf07491ce)
Aug 15 17:56:39 bl460g1n13 cib: [6734]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.oum95j (digest: /var/lib/heartbeat/crm/cib.EIXKHY)
Aug 15 17:56:40 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n14
Aug 15 17:56:40 bl460g1n13 attrd: [6723]: info: find_hash_entry: Creating hash entry for probe_complete
Aug 15 17:56:40 bl460g1n13 attrd: [6723]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Aug 15 17:56:40 bl460g1n13 attrd: [6723]: info: attrd_perform_update: Sent update 11: probe_complete=true
Aug 15 17:58:58 bl460g1n13 lrmd: [6721]: debug: stonithRA plugin: provider attribute is not needed and will be ignored.
Aug 15 17:59:01 bl460g1n13 crmd: [6724]: info: update_dc: Unset DC bl460g1n14
Aug 15 17:59:01 bl460g1n13 crmd: [6724]: info: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Aug 15 17:59:01 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n14
Aug 15 17:59:01 bl460g1n13 last message repeated 2 times
Aug 15 17:59:01 bl460g1n13 crmd: [6724]: info: config_query_callback: Checking for expired actions every 900000ms
Aug 15 17:59:01 bl460g1n13 cib: [6789]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-4.raw
Aug 15 17:59:02 bl460g1n13 cib: [6789]: info: write_cib_contents: Wrote version 0.7.0 of the CIB to disk (digest: 51d9307367302a715522e9aa6d746214)
Aug 15 17:59:02 bl460g1n13 cib: [6789]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.AFcc2f (digest: /var/lib/heartbeat/crm/cib.DkDxCb)
Aug 15 17:59:06 bl460g1n13 crmd: [6724]: info: update_dc: Set DC to bl460g1n14 (3.0.1)
Aug 15 17:59:07 bl460g1n13 crmd: [6724]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Aug 15 17:59:07 bl460g1n13 attrd: [6723]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Aug 15 17:59:07 bl460g1n13 attrd: [6723]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Aug 15 17:59:07 bl460g1n13 attrd: [6723]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
Aug 15 17:59:07 bl460g1n13 attrd: [6723]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
Aug 15 17:59:07 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n13
Aug 15 17:59:07 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n13
Aug 15 17:59:08 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n14
Aug 15 17:59:08 bl460g1n13 last message repeated 2 times
Aug 15 17:59:10 bl460g1n13 lrmd: [6721]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Aug 15 17:59:10 bl460g1n13 crmd: [6724]: info: do_lrm_rsc_op: Performing key=4:2:7:59d18364-507d-4eb4-8360-4147f3325077 op=stonith1_monitor_0 )
Aug 15 17:59:10 bl460g1n13 lrmd: [6721]: info: rsc:stonith1 probe[2] (pid 6794)
Aug 15 17:59:10 bl460g1n13 lrmd: [6721]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Aug 15 17:59:10 bl460g1n13 crmd: [6724]: info: do_lrm_rsc_op: Performing key=5:2:7:59d18364-507d-4eb4-8360-4147f3325077 op=stonith2_monitor_0 )
Aug 15 17:59:10 bl460g1n13 lrmd: [6721]: info: rsc:stonith2 probe[3] (pid 6796)
Aug 15 17:59:10 bl460g1n13 lrmd: [6721]: info: operation monitor[2] on stonith1 for client 6724: pid 6794 exited with return code 7
Aug 15 17:59:10 bl460g1n13 crmd: [6724]: info: process_lrm_event: LRM operation stonith1_monitor_0 (call=2, rc=7, cib-update=14, confirmed=true) not running
Aug 15 17:59:10 bl460g1n13 lrmd: [6721]: info: operation monitor[3] on stonith2 for client 6724: pid 6796 exited with return code 7
Aug 15 17:59:10 bl460g1n13 crmd: [6724]: info: process_lrm_event: LRM operation stonith2_monitor_0 (call=3, rc=7, cib-update=15, confirmed=true) not running
Aug 15 17:59:12 bl460g1n13 crmd: [6724]: info: do_lrm_rsc_op: Performing key=11:2:0:59d18364-507d-4eb4-8360-4147f3325077 op=stonith2_start_0 )
Aug 15 17:59:12 bl460g1n13 lrmd: [6721]: info: rsc:stonith2 start[4] (pid 6798)
Aug 15 17:59:12 bl460g1n13 lrmd: [6798]: info: Try to start STONITH resource <rsc_id=stonith2> : Device=external/ipmi
Aug 15 17:59:12 bl460g1n13 stonithd: [6722]: info: ----- current path /sbin:/usr/sbin:/bin:/usr/bin
Aug 15 17:59:12 bl460g1n13 stonithd: [6722]: info: ----- new path /usr/share/cluster-glue:/sbin:/usr/sbin:/bin:/usr/bin
Aug 15 17:59:12 bl460g1n13 stonithd: [6802]: info: ----- current path /usr/share/cluster-glue:/sbin:/usr/sbin:/bin:/usr/bin
Aug 15 17:59:53 bl460g1n13 external/ipmi[6803]: ERROR: PATH=/usr/share/cluster-glue:/sbin:/usr/sbin:/bin:/usr/bin
Aug 15 17:59:53 bl460g1n13 external/ipmi[6803]: ERROR: USER=
Aug 15 17:59:53 bl460g1n13 external/ipmi[6803]: ERROR: error executing ipmitool: Error: Unable to establish IPMI v2 / RMCP+ session
 Unable to get Chassis Power Status
Aug 15 17:59:53 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n14
Aug 15 17:59:53 bl460g1n13 attrd: [6723]: info: find_hash_entry: Creating hash entry for fail-count-stonith1
Aug 15 17:59:53 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: flush message from bl460g1n14
Aug 15 17:59:53 bl460g1n13 attrd: [6723]: info: find_hash_entry: Creating hash entry for last-failure-stonith1
Aug 15 17:59:54 bl460g1n13 stonithd: [6802]: WARN: external_status: 'ipmi status' failed with rc 1
Aug 15 17:59:54 bl460g1n13 stonithd: [6722]: WARN: start stonith2 failed, because its hostlist is empty
Aug 15 17:59:54 bl460g1n13 lrmd: [6721]: info: operation start[4] on stonith2 for client 6724: pid 6798 exited with return code 1
Aug 15 17:59:54 bl460g1n13 lrmd: [6721]: debug: stonithRA plugin: provider attribute is not needed and will be ignored.
Aug 15 17:59:54 bl460g1n13 crmd: [6724]: info: process_lrm_event: LRM operation stonith2_start_0 (call=4, rc=1, cib-update=16, confirmed=true) unknown error
Aug 15 17:59:56 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: Update relayed from bl460g1n14
Aug 15 17:59:56 bl460g1n13 attrd: [6723]: info: find_hash_entry: Creating hash entry for fail-count-stonith2
Aug 15 17:59:56 bl460g1n13 attrd: [6723]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-stonith2 (INFINITY)
Aug 15 17:59:56 bl460g1n13 attrd: [6723]: info: attrd_perform_update: Sent update 30: fail-count-stonith2=INFINITY
Aug 15 17:59:56 bl460g1n13 attrd: [6723]: info: attrd_ha_callback: Update relayed from bl460g1n14
Aug 15 17:59:56 bl460g1n13 attrd: [6723]: info: find_hash_entry: Creating hash entry for last-failure-stonith2
Aug 15 17:59:56 bl460g1n13 attrd: [6723]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-stonith2 (1313398796)
Aug 15 17:59:56 bl460g1n13 attrd: [6723]: info: attrd_perform_update: Sent update 33: last-failure-stonith2=1313398796
Aug 15 17:59:59 bl460g1n13 crmd: [6724]: info: do_lrm_rsc_op: Performing key=2:3:0:59d18364-507d-4eb4-8360-4147f3325077 op=stonith2_stop_0 )
Aug 15 17:59:59 bl460g1n13 lrmd: [6721]: info: rsc:stonith2 stop[5] (pid 6848)
Aug 15 17:59:59 bl460g1n13 lrmd: [6848]: info: Try to stop STONITH resource <rsc_id=stonith2> : Device=external/ipmi
Aug 15 17:59:59 bl460g1n13 stonithd: [6722]: notice: try to stop a resource stonith2 who is not in started resource queue.
Aug 15 17:59:59 bl460g1n13 lrmd: [6721]: info: operation stop[5] on stonith2 for client 6724: pid 6848 exited with return code 0
Aug 15 17:59:59 bl460g1n13 crmd: [6724]: info: process_lrm_event: LRM operation stonith2_stop_0 (call=5, rc=0, cib-update=17, confirmed=true) ok
Aug 15 18:01:23 bl460g1n13 root: Mark:HB_REPORT:1313398881
