Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(udpport,694)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(keepalive,2)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(warntime,7)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(deadtime,10)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(initdead,24)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(bcast,eth1)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(node,bl460g6a)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(node,bl460g6b)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(watchdog,/dev/watchdog)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: uid=hacluster, gid=<null>
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: uid=hacluster, gid=<null>
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: uid=<null>, gid=haclient
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: uid=root, gid=<null>
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: uid=<null>, gid=haclient
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: Beginning authentication parsing
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: 16 max authentication methods
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: Keyfile opened
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: Keyfile perms OK
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: 16 max authentication methods
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: Found authentication method [sha1]
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: info: AUTH: i=1: key = 0xf34630, auth=0x7ff3004dfdb0, authname=sha1
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: Outbound signing method is 1
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: Authentication parsing complete [1]
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(cluster,linux-ha)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(hopfudge,1)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(baud,19200)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(auto_failback,legacy)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(hbgenmethod,file)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(realtime,true)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(msgfmt,classic)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(conn_logd_time,60)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(log_badpack,true)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(syslogmsgfmt,true)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(coredumps,true)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(autojoin,none)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(uuidfrom,file)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(compression,zlib)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(compression_threshold,2)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(traditional_compression,no)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(max_rexmit_delay,250)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: Setting max_rexmit_delay to 250 ms
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(record_config_changes,on)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(record_pengine_inputs,on)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(enable_config_writes,on)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: add_option(memreserve,6500)
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: WARN: Logging daemon is disabled --enabling logging daemon is recommended
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: info: **************************
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: info: Configuration validated. Starting heartbeat 3.0.5
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: debug: HA configuration OK.  Heartbeat starting.
Mar  2 14:43:20 bl460g6a heartbeat: [15529]: info: Heartbeat Hg Version: node: 7e3a82377fa8c88b4d9ee47e29020d4531f4629a
Mar  2 14:43:20 bl460g6a heartbeat: [15530]: info: heartbeat: version 3.0.5
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: info: Heartbeat generation: 1329101151
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: uuid is:11111111-1111-1111-1111-111111111111
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: FIFO process pid: 15535
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: opening bcast eth1 (UDP/IP broadcast)
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: glib: SO_BINDTODEVICE(r) set for device eth1
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth1
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: write process pid: 15536
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: read child process pid: 15537
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: info: glib: UDP Broadcast heartbeat closed on port 694 interface eth1 - Status: 1
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: make_io_childpair: CREATED childpair wchan socket 9
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: make_io_childpair: CREATED childpair rchan socket 11
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: notice: Using watchdog device: /dev/watchdog
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: Set watchdog timer to 11 seconds.
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: Limiting CPU: 42 CPU seconds every 60000 milliseconds
Mar  2 14:43:30 bl460g6a heartbeat: [15535]: debug: pid 15535 locked in memory.
Mar  2 14:43:30 bl460g6a heartbeat: [15535]: debug: Limiting CPU: 6 CPU seconds every 60000 milliseconds
Mar  2 14:43:30 bl460g6a heartbeat: [15536]: debug: pid 15536 locked in memory.
Mar  2 14:43:30 bl460g6a heartbeat: [15536]: debug: Limiting CPU: 24 CPU seconds every 60000 milliseconds
Mar  2 14:43:30 bl460g6a heartbeat: [15537]: debug: pid 15537 locked in memory.
Mar  2 14:43:30 bl460g6a heartbeat: [15537]: debug: Limiting CPU: 6 CPU seconds every 60000 milliseconds
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: pid 15530 locked in memory.
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: Waiting for child processes to start
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: info: Local status now set to: 'up'
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: All your child process are belong to us
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: Starting local status message @ 2000 ms intervals
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: debug: Forking temp process write_hostcachedata
Mar  2 14:43:30 bl460g6a heartbeat: [15530]: info: Link bl460g6a:eth1 up.
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Link bl460g6b:eth1 up.
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Get a reqnodes message from bl460g6b
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: get_delnodelist: delnodelist= 
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: sending reqnodes msg to node bl460g6b
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Managed write_hostcachedata process 15538 exited with return code 0.
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Forking temp process write_hostcachedata
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Status update for node bl460g6b: status up
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Status seqno: 12 msgtime: 1330667011
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Status update for node bl460g6b: status active
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Status seqno: 13 msgtime: 1330667011
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Get a repnodes msg from bl460g6b
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: nodelist received:bl460g6a bl460g6b 
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Comm_now_up(): updating status to active
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Local status now set to: 'active'
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Starting child client "/usr/lib64/heartbeat/ccm" (495,489)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Starting child client "/usr/lib64/heartbeat/cib" (495,489)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Starting child client "/usr/lib64/heartbeat/lrmd -r" (0,0)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Starting child client "/usr/lib64/heartbeat/stonithd" (0,0)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Starting child client "/usr/lib64/heartbeat/attrd" (495,489)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Starting child client "/usr/lib64/heartbeat/crmd" (495,489)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: WARN: 1 lost packet(s) for [bl460g6b] [30:32]
Mar  2 14:43:31 bl460g6a heartbeat: [15540]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 495  gid 489 (pid 15540)
Mar  2 14:43:31 bl460g6a heartbeat: [15543]: info: Starting "/usr/lib64/heartbeat/stonithd" as uid 0  gid 0 (pid 15543)
Mar  2 14:43:31 bl460g6a heartbeat: [15545]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 495  gid 489 (pid 15545)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: No pkts missing from bl460g6b!
Mar  2 14:43:31 bl460g6a heartbeat: [15541]: info: Starting "/usr/lib64/heartbeat/cib" as uid 495  gid 489 (pid 15541)
Mar  2 14:43:31 bl460g6a heartbeat: [15544]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 495  gid 489 (pid 15544)
Mar  2 14:43:31 bl460g6a heartbeat: [15542]: info: Starting "/usr/lib64/heartbeat/lrmd -r" as uid 0  gid 0 (pid 15542)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Forking temp process write_delcachedata
Mar  2 14:43:31 bl460g6a ccm: [15540]: debug: Signing in with Heartbeat
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: APIregistration_dispatch() {
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: process_registerevent() {
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: client->gsource = 0xf3e9b0
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: }/*process_registerevent*/;
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: }/*APIregistration_dispatch*/;
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Checking client authorization for client ccm (495:489)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6a
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6b
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Signing on API client 15540 (ccm)
Mar  2 14:43:31 bl460g6a attrd: [15544]: info: Invoked: /usr/lib64/heartbeat/attrd 
Mar  2 14:43:31 bl460g6a attrd: [15544]: info: crm_log_init_worker: Changed active directory to /var/lib/heartbeat/cores/hacluster
Mar  2 14:43:31 bl460g6a attrd: [15544]: info: main: Starting up
Mar  2 14:43:31 bl460g6a attrd: [15544]: debug: find_corosync_variant: Could not initialize Cluster Configuration Database API instance error 6
Mar  2 14:43:31 bl460g6a attrd: [15544]: info: get_cluster_type: Assuming a 'heartbeat' based cluster
Mar  2 14:43:31 bl460g6a attrd: [15544]: notice: crm_cluster_connect: Connecting to cluster infrastructure: heartbeat
Mar  2 14:43:31 bl460g6a attrd: [15544]: debug: register_heartbeat_conn: Signing in with Heartbeat
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: APIregistration_dispatch() {
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: process_registerevent() {
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: client->gsource = 0xf41ea0
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: }/*process_registerevent*/;
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: }/*APIregistration_dispatch*/;
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Checking client authorization for client attrd (495:489)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6a
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6b
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Signing on API client 15544 (attrd)
Mar  2 14:43:31 bl460g6a ccm: [15540]: info: Hostname: bl460g6a
Mar  2 14:43:31 bl460g6a cib: [15541]: info: crm_log_init_worker: Changed active directory to /var/lib/heartbeat/cores/hacluster
Mar  2 14:43:31 bl460g6a cib: [15541]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Mar  2 14:43:31 bl460g6a cib: [15541]: WARN: retrieveCib: Cluster configuration not found: /var/lib/heartbeat/crm/cib.xml
Mar  2 14:43:31 bl460g6a cib: [15541]: WARN: readCibXmlFile: Primary configuration corrupt or unusable, trying backup...
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: get_last_sequence: Series file /var/lib/heartbeat/crm/cib.last does not exist
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: Backup file /var/lib/heartbeat/crm/cib-99.raw not found
Mar  2 14:43:31 bl460g6a cib: [15541]: WARN: readCibXmlFile: Continuing with an empty configuration.
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: info: Invoked: /usr/lib64/heartbeat/stonithd 
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: [on-disk] <cib epoch="0" num_updates="0" admin_epoch="0" validate-with="pacemaker-1.2" >
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: [on-disk]   <configuration >
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: [on-disk]     <crm_config />
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: [on-disk]     <nodes />
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: [on-disk]     <resources />
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: [on-disk]     <constraints />
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: [on-disk]   </configuration>
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: [on-disk]   <status />
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: readCibXmlFile: [on-disk] </cib>
Mar  2 14:43:31 bl460g6a cib: [15541]: info: validate_with_relaxng: Creating RNG parser context
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: info: crm_log_init_worker: Changed active directory to /var/lib/heartbeat/cores/root
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: find_corosync_variant: Could not initialize Cluster Configuration Database API instance error 6
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: info: get_cluster_type: Assuming a 'heartbeat' based cluster
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: notice: crm_cluster_connect: Connecting to cluster infrastructure: heartbeat
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: register_heartbeat_conn: Signing in with Heartbeat
Mar  2 14:43:31 bl460g6a crmd: [15545]: info: Invoked: /usr/lib64/heartbeat/crmd 
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: the send queue length from heartbeat to client ccm is set to 1024
Mar  2 14:43:31 bl460g6a attrd: [15544]: ERROR: get_node_uuid: Unsupported cluster type
Mar  2 14:43:31 bl460g6a attrd: [15544]: info: register_heartbeat_conn: Hostname: bl460g6a
Mar  2 14:43:31 bl460g6a attrd: [15544]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Mar  2 14:43:31 bl460g6a crmd: [15545]: info: crm_log_init_worker: Changed active directory to /var/lib/heartbeat/cores/hacluster
Mar  2 14:43:31 bl460g6a attrd: [15544]: info: main: Cluster connection active
Mar  2 14:43:31 bl460g6a crmd: [15545]: notice: main: CRM Hg Version: b7534bd
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: the send queue length from heartbeat to client attrd is set to 1024
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: APIregistration_dispatch() {
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: process_registerevent() {
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: client->gsource = 0xf444a0
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: }/*process_registerevent*/;
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: crmd_init: Starting crmd
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: }/*APIregistration_dispatch*/;
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_STARTUP: [ state=S_STARTING cause=C_STARTUP origin=crmd_init ]
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_LOG   
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: do_log: FSA: Input I_STARTUP from crmd_init() received in state S_STARTING
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Checking client authorization for client stonith-ng (0:0)
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_STARTUP
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: do_startup: Registering Signal Handlers
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: do_startup: Creating CIB and LRM objects
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_CIB_START
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6a
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6b
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Signing on API client 15543 (stonith-ng)
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_rw
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to command channel failed
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_callback
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to callback channel failed
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to CIB failed: connection failed
Mar  2 14:43:31 bl460g6a crmd: [15545]: debug: cib_native_signoff: Signing out of the CIB Service
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: activateCibXml: Triggering CIB write for start op
Mar  2 14:43:31 bl460g6a cib: [15541]: info: startCib: CIB Initialization completed successfully
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: find_corosync_variant: Could not initialize Cluster Configuration Database API instance error 6
Mar  2 14:43:31 bl460g6a cib: [15541]: info: get_cluster_type: Assuming a 'heartbeat' based cluster
Mar  2 14:43:31 bl460g6a cib: [15541]: notice: crm_cluster_connect: Connecting to cluster infrastructure: heartbeat
Mar  2 14:43:31 bl460g6a cib: [15541]: debug: register_heartbeat_conn: Signing in with Heartbeat
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: ERROR: get_node_uuid: Unsupported cluster type
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: APIregistration_dispatch() {
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: process_registerevent() {
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: info: register_heartbeat_conn: Hostname: bl460g6a
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: client->gsource = 0xf423f0
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: }/*process_registerevent*/;
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: }/*APIregistration_dispatch*/;
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: the send queue length from heartbeat to client stonith-ng is set to 1024
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Checking client authorization for client cib (495:489)
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6a
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_rw
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6b
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Signing on API client 15541 (cib)
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to command channel failed
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_callback
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to callback channel failed
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to CIB failed: connection failed
Mar  2 14:43:31 bl460g6a stonith-ng: [15543]: debug: cib_native_signoff: Signing out of the CIB Service
Mar  2 14:43:31 bl460g6a lrmd: [15542]: info: enabling coredumps
Mar  2 14:43:31 bl460g6a lrmd: [15542]: debug: main: run the loop...
Mar  2 14:43:31 bl460g6a lrmd: [15542]: info: Started.
Mar  2 14:43:31 bl460g6a attrd: [15544]: info: main: Accepting attribute updates
Mar  2 14:43:31 bl460g6a attrd: [15544]: notice: main: Starting mainloop...
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: Managed write_hostcachedata process 15539 exited with return code 0.
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: debug: Forking temp process write_hostcachedata
Mar  2 14:43:31 bl460g6a cib: [15541]: ERROR: get_node_uuid: Unsupported cluster type
Mar  2 14:43:31 bl460g6a cib: [15541]: info: register_heartbeat_conn: Hostname: bl460g6a
Mar  2 14:43:31 bl460g6a cib: [15541]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Mar  2 14:43:31 bl460g6a cib: [15541]: info: ccm_connect: Registering with CCM...
Mar  2 14:43:31 bl460g6a cib: [15541]: WARN: ccm_connect: CCM Activation failed
Mar  2 14:43:31 bl460g6a cib: [15541]: WARN: ccm_connect: CCM Connection failed 1 times (30 max)
Mar  2 14:43:31 bl460g6a heartbeat: [15530]: info: the send queue length from heartbeat to client cib is set to 1024
Mar  2 14:43:32 bl460g6a heartbeat: [15530]: info: Managed write_delcachedata process 15546 exited with return code 0.
Mar  2 14:43:32 bl460g6a heartbeat: [15530]: info: Managed write_hostcachedata process 15547 exited with return code 0.
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:33 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_rw
Mar  2 14:43:33 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_rw
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to command channel failed
Mar  2 14:43:33 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to command channel failed
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:33 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_callback
Mar  2 14:43:33 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_callback
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to callback channel failed
Mar  2 14:43:33 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to callback channel failed
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to CIB failed: connection failed
Mar  2 14:43:33 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to CIB failed: connection failed
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: cib_native_signoff: Signing out of the CIB Service
Mar  2 14:43:33 bl460g6a stonith-ng: [15543]: debug: cib_native_signoff: Signing out of the CIB Service
Mar  2 14:43:33 bl460g6a crmd: [15545]: info: do_cib_control: Could not connect to the CIB service: connection failed
Mar  2 14:43:33 bl460g6a crmd: [15545]: WARN: do_cib_control: Couldn't complete CIB registration 1 times... pause and retry
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: crm_timer_start: Started Wait Timer (I_NULL:2000ms), src=5
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: register_fsa_input_adv: Stalling the FSA pending further input: cause=C_FSA_INTERNAL
Mar  2 14:43:33 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Exiting the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Mar  2 14:43:33 bl460g6a ccm: [15540]: debug: node state CCM_STATE_NONE -> CCM_STATE_NONE
Mar  2 14:43:33 bl460g6a ccm: [15540]: debug: node state CCM_STATE_NONE -> CCM_STATE_NONE
Mar  2 14:43:34 bl460g6a ccm: [15540]: debug: recv msg hbapi-clstat from bl460g6a, status:join
Mar  2 14:43:34 bl460g6a heartbeat: [15530]: WARN: 1 lost packet(s) for [bl460g6b] [35:37]
Mar  2 14:43:34 bl460g6a heartbeat: [15530]: info: No pkts missing from bl460g6b!
Mar  2 14:43:35 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:35 bl460g6a crmd: [15545]: info: crm_timer_popped: Wait Timer (I_NULL) just popped (2000ms)
Mar  2 14:43:35 bl460g6a ccm: [15540]: debug: recv msg CCM_TYPE_PROTOVERSION from bl460g6b, status:[null ptr]
Mar  2 14:43:35 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_rw
Mar  2 14:43:35 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_CIB_START
Mar  2 14:43:35 bl460g6a ccm: [15540]: debug: send msg CCM_TYPE_PROTOVERSION to cluster, status:[null]
Mar  2 14:43:35 bl460g6a cib: [15541]: info: ccm_connect: Registering with CCM...
Mar  2 14:43:35 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to command channel failed
Mar  2 14:43:35 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:35 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:35 bl460g6a ccm: [15540]: debug: node state CCM_STATE_NONE -> CCM_STATE_VERSION_REQUEST
Mar  2 14:43:35 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_rw
Mar  2 14:43:35 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_callback
Mar  2 14:43:35 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to command channel failed
Mar  2 14:43:35 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to callback channel failed
Mar  2 14:43:35 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:35 bl460g6a cib: [15541]: debug: ccm_connect: CCM Activation passed... all set to go!
Mar  2 14:43:35 bl460g6a cib: [15541]: info: cib_init: Requesting the list of configured nodes
Mar  2 14:43:35 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_callback
Mar  2 14:43:35 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to CIB failed: connection failed
Mar  2 14:43:35 bl460g6a stonith-ng: [15543]: debug: cib_native_signoff: Signing out of the CIB Service
Mar  2 14:43:35 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to callback channel failed
Mar  2 14:43:35 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to CIB failed: connection failed
Mar  2 14:43:35 bl460g6a crmd: [15545]: debug: cib_native_signoff: Signing out of the CIB Service
Mar  2 14:43:35 bl460g6a ccm: [15540]: debug: recv msg CCM_TYPE_PROTOVERSION from bl460g6a, status:[null ptr]
Mar  2 14:43:35 bl460g6a cib: [15541]: debug: Delaying cstatus request for 75 ms
Mar  2 14:43:36 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:36 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_rw
Mar  2 14:43:36 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to command channel failed
Mar  2 14:43:36 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:36 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to CIB failed: connection failed
Mar  2 14:43:36 bl460g6a crmd: [15545]: debug: cib_native_signoff: Signing out of the CIB Service
Mar  2 14:43:36 bl460g6a crmd: [15545]: info: do_cib_control: Could not connect to the CIB service: connection failed
Mar  2 14:43:36 bl460g6a crmd: [15545]: WARN: do_cib_control: Couldn't complete CIB registration 2 times... pause and retry
Mar  2 14:43:36 bl460g6a crmd: [15545]: debug: crm_timer_start: Started Wait Timer (I_NULL:2000ms), src=6
Mar  2 14:43:36 bl460g6a cib: [15541]: info: cib_init: Starting cib mainloop
Mar  2 14:43:36 bl460g6a crmd: [15545]: debug: register_fsa_input_adv: Stalling the FSA pending further input: cause=C_FSA_INTERNAL
Mar  2 14:43:36 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Exiting the FSA: queue=0, fsa_actions=0x180021000000006, stalled=true
Mar  2 14:43:36 bl460g6a cib: [15541]: info: cib_client_status_callback: Status update: Client bl460g6a/cib now has status [join]
Mar  2 14:43:36 bl460g6a ccm: [15540]: debug: recv msg CCM_TYPE_PROTOVERSION_RESP from bl460g6b, status:[null ptr]
Mar  2 14:43:36 bl460g6a cib: [15541]: debug: crm_new_peer: Creating entry for node bl460g6a/0
Mar  2 14:43:36 bl460g6a ccm: [15540]: debug: send msg CCM_TYPE_ALIVE to cluster, status:[null]
Mar  2 14:43:36 bl460g6a cib: [15541]: info: crm_new_peer: Node 0 is now known as bl460g6a
Mar  2 14:43:36 bl460g6a cib: [15541]: info: crm_update_peer_proc: bl460g6a.cib is now online
Mar  2 14:43:36 bl460g6a ccm: [15540]: debug: node state CCM_STATE_VERSION_REQUEST -> CCM_STATE_NEW_NODE_WAIT_FOR_MEM_LIST
Mar  2 14:43:36 bl460g6a cib: [15541]: debug: Forking temp process write_cib_contents
Mar  2 14:43:36 bl460g6a heartbeat: [15530]: WARN: Gmain_timeout_dispatch: Dispatch function for hb_pop_deadtime was delayed 1000 ms (> 500 ms) before being called (GSource: 0xf395a0)
Mar  2 14:43:36 bl460g6a heartbeat: [15530]: info: Gmain_timeout_dispatch: started at 453757044 should have started at 453756944
Mar  2 14:43:36 bl460g6a ccm: [15540]: debug: recv msg CCM_TYPE_ALIVE from bl460g6a, status:[null ptr]
Mar  2 14:43:36 bl460g6a cib: [15541]: info: cib_client_status_callback: Status update: Client bl460g6a/cib now has status [online]
Mar  2 14:43:36 bl460g6a cib: [15541]: info: Managed write_cib_contents process 15548 exited with return code 0.
Mar  2 14:43:37 bl460g6a attrd: [15544]: debug: cib_connect: CIB signon attempt 1
Mar  2 14:43:37 bl460g6a attrd: [15544]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: recv msg CCM_TYPE_MEM_LIST from bl460g6b, status:[null ptr]
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: node state CCM_STATE_NEW_NODE_WAIT_FOR_MEM_LIST -> CCM_STATE_JOINED
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: dump current membership 0x7f0e5fd29010
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: 	leader=bl460g6b
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: 	transition=2
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: 	status=CCM_STATE_JOINED
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: 	has_quorum=1
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: 	nodename=bl460g6a bornon=2
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: 	nodename=bl460g6b bornon=1
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: quorum is 1
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: delivering new membership to 1 clients: 
Mar  2 14:43:37 bl460g6a ccm: [15540]: debug: client: pid =15541
Mar  2 14:43:37 bl460g6a cib: [15541]: info: cib_client_status_callback: Status update: Client bl460g6b/cib now has status [online]
Mar  2 14:43:38 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:38 bl460g6a crmd: [15545]: info: crm_timer_popped: Wait Timer (I_NULL) just popped (2000ms)
Mar  2 14:43:38 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_CIB_START
Mar  2 14:43:38 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Mar  2 14:43:38 bl460g6a cib: [15541]: ERROR: get_node_uuid: Unsupported cluster type
Mar  2 14:43:38 bl460g6a cib: [15541]: debug: crm_new_peer: Creating entry for node bl460g6b/0
Mar  2 14:43:38 bl460g6a cib: [15541]: info: crm_new_peer: Node 0 is now known as bl460g6b
Mar  2 14:43:38 bl460g6a cib: [15541]: info: crm_update_peer_proc: bl460g6b.cib is now online
Mar  2 14:43:38 bl460g6a cib: [15541]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Mar  2 14:43:38 bl460g6a cib: [15541]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Mar  2 14:43:38 bl460g6a cib: [15541]: info: cib_ccm_msg_callback: Processing CCM event=NEW MEMBERSHIP (id=2)
Mar  2 14:43:38 bl460g6a cib: [15541]: info: crm_get_peer: Node bl460g6b now has id: 1
Mar  2 14:43:38 bl460g6a cib: [15541]: info: crm_update_peer: Node bl460g6b: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000100
Mar  2 14:43:38 bl460g6a cib: [15541]: info: crm_update_peer_proc: bl460g6b.ais is now online
Mar  2 14:43:38 bl460g6a cib: [15541]: info: crm_update_peer_proc: bl460g6b.crmd is now online
Mar  2 14:43:38 bl460g6a cib: [15541]: info: crm_update_peer: Node bl460g6a: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000100
Mar  2 14:43:38 bl460g6a cib: [15541]: info: crm_update_peer_proc: bl460g6a.ais is now online
Mar  2 14:43:38 bl460g6a cib: [15541]: info: crm_update_peer_proc: bl460g6a.crmd is now online
Mar  2 14:43:38 bl460g6a stonith-ng: [15543]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:38 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:38 bl460g6a attrd: [15544]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Mar  2 14:43:38 bl460g6a stonith-ng: [15543]: debug: cib_native_signon_raw: Connection to CIB successful
Mar  2 14:43:38 bl460g6a crmd: [15545]: debug: cib_native_signon_raw: Connection to CIB successful
Mar  2 14:43:38 bl460g6a stonith-ng: [15543]: notice: setup_cib: Watching for stonith topology changes
Mar  2 14:43:38 bl460g6a attrd: [15544]: debug: cib_native_signon_raw: Connection to CIB successful
Mar  2 14:43:38 bl460g6a attrd: [15544]: info: cib_connect: Connected to the CIB after 1 signon attempts
Mar  2 14:43:38 bl460g6a crmd: [15545]: info: do_cib_control: CIB connection established
Mar  2 14:43:38 bl460g6a attrd: [15544]: info: cib_connect: Sending full refresh
Mar  2 14:43:38 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_HA_CONNECT
Mar  2 14:43:38 bl460g6a stonith-ng: [15543]: info: main: Starting stonith-ng mainloop
Mar  2 14:43:38 bl460g6a crmd: [15545]: debug: find_corosync_variant: Could not initialize Cluster Configuration Database API instance error 6
Mar  2 14:43:38 bl460g6a crmd: [15545]: info: get_cluster_type: Assuming a 'heartbeat' based cluster
Mar  2 14:43:38 bl460g6a crmd: [15545]: notice: crm_cluster_connect: Connecting to cluster infrastructure: heartbeat
Mar  2 14:43:38 bl460g6a cib: [15541]: debug: cib_common_callback_worker: Setting cib_diff_notify callbacks for 15543 (d33d0de1-dd9b-4542-81aa-f60605a1c66e): on
Mar  2 14:43:38 bl460g6a crmd: [15545]: debug: register_heartbeat_conn: Signing in with Heartbeat
Mar  2 14:43:38 bl460g6a cib: [15541]: debug: cib_common_callback_worker: Setting cib_refresh_notify callbacks for 15545 (170d462c-d6cf-401f-927e-290514c2126e): on
Mar  2 14:43:38 bl460g6a cib: [15541]: debug: cib_common_callback_worker: Setting cib_diff_notify callbacks for 15545 (170d462c-d6cf-401f-927e-290514c2126e): on
Mar  2 14:43:38 bl460g6a heartbeat: [15530]: debug: APIregistration_dispatch() {
Mar  2 14:43:38 bl460g6a heartbeat: [15530]: debug: process_registerevent() {
Mar  2 14:43:38 bl460g6a heartbeat: [15530]: debug: client->gsource = 0xf3e0d0
Mar  2 14:43:38 bl460g6a heartbeat: [15530]: debug: }/*process_registerevent*/;
Mar  2 14:43:38 bl460g6a cib: [15541]: debug: cib_common_callback_worker: Setting cib_refresh_notify callbacks for 15544 (eb900e3e-057e-47ac-9596-3c68c1d6f683): on
Mar  2 14:43:38 bl460g6a heartbeat: [15530]: debug: }/*APIregistration_dispatch*/;
Mar  2 14:43:38 bl460g6a heartbeat: [15530]: debug: Checking client authorization for client crmd (495:489)
Mar  2 14:43:38 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6a
Mar  2 14:43:38 bl460g6a heartbeat: [15530]: debug: create_seq_snapshot_table:no missing packets found for node bl460g6b
Mar  2 14:43:38 bl460g6a heartbeat: [15530]: debug: Signing on API client 15545 (crmd)
Mar  2 14:43:39 bl460g6a crmd: [15545]: ERROR: get_node_uuid: Unsupported cluster type
Mar  2 14:43:39 bl460g6a crmd: [15545]: info: register_heartbeat_conn: Hostname: bl460g6a
Mar  2 14:43:39 bl460g6a crmd: [15545]: info: register_heartbeat_conn: UUID: 11111111-1111-1111-1111-111111111111
Mar  2 14:43:40 bl460g6a attrd: [15544]: WARN: G_CH_check_int: working on Heartbeat API channel took 1010 ms (> 100 ms)
Mar  2 14:43:40 bl460g6a heartbeat: [15530]: info: the send queue length from heartbeat to client crmd is set to 1024
Mar  2 14:43:40 bl460g6a crmd: [15545]: debug: Delaying cstatus request for 69 ms
Mar  2 14:43:41 bl460g6a crmd: [15545]: info: do_ha_control: Connected to the cluster
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_READCONFIG
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_LRM_CONNECT
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: do_lrm_control: Connecting to the LRM
Mar  2 14:43:41 bl460g6a lrmd: [15542]: debug: on_msg_register:client crmd [15545] registered
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: do_lrm_control: LRM connection established
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_CCM_CONNECT
Mar  2 14:43:41 bl460g6a crmd: [15545]: info: do_ccm_control: CCM connection established... waiting for first callback
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_STARTED
Mar  2 14:43:41 bl460g6a crmd: [15545]: info: do_started: Delaying start, no membership data (0000000000100000)
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: register_fsa_input_adv: Stalling the FSA pending further input: cause=C_FSA_INTERNAL
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Exiting the FSA: queue=0, fsa_actions=0x2, stalled=true
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: config_query_callback: Call 3 : Parsing CIB options
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: config_query_callback: Shutdown escalation occurs after: 1200000ms
Mar  2 14:43:41 bl460g6a crmd: [15545]: debug: config_query_callback: Checking for expired actions every 900000ms
Mar  2 14:43:41 bl460g6a crmd: [15545]: notice: crmd_client_status_callback: Status update: Client bl460g6a/crmd now has status [online] (DC=false)
Mar  2 14:43:42 bl460g6a crmd: [15545]: ERROR: get_node_uuid: Unsupported cluster type
Mar  2 14:43:42 bl460g6a crmd: [15545]: debug: crm_new_peer: Creating entry for node bl460g6a/0
Mar  2 14:43:42 bl460g6a crmd: [15545]: info: crm_new_peer: Node 0 is now known as bl460g6a
Mar  2 14:43:42 bl460g6a crmd: [15545]: info: ais_status_callback: status: bl460g6a is now unknown
Mar  2 14:43:42 bl460g6a crmd: [15545]: info: crm_update_peer_proc: bl460g6a.crmd is now online
Mar  2 14:43:42 bl460g6a crmd: [15545]: notice: crmd_peer_update: Status update: Client bl460g6a/crmd now has status [online] (DC=<null>)
Mar  2 14:43:42 bl460g6a crmd: [15545]: notice: crmd_client_status_callback: Status update: Client bl460g6a/crmd now has status [online] (DC=false)
Mar  2 14:43:43 bl460g6a crmd: [15545]: ERROR: get_node_uuid: Unsupported cluster type
Mar  2 14:43:43 bl460g6a crmd: [15545]: notice: crmd_client_status_callback: Status update: Client bl460g6b/crmd now has status [online] (DC=false)
Mar  2 14:43:44 bl460g6a crmd: [15545]: ERROR: get_node_uuid: Unsupported cluster type
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: crm_new_peer: Creating entry for node bl460g6b/0
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: crm_new_peer: Node 0 is now known as bl460g6b
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: ais_status_callback: status: bl460g6b is now unknown
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: crm_update_peer_proc: bl460g6b.crmd is now online
Mar  2 14:43:44 bl460g6a crmd: [15545]: notice: crmd_peer_update: Status update: Client bl460g6b/crmd now has status [online] (DC=<null>)
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_STARTED
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: do_started: Delaying start, no membership data (0000000000100000)
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: register_fsa_input_adv: Stalling the FSA pending further input: cause=C_FSA_INTERNAL
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Exiting the FSA: queue=0, fsa_actions=0x2, stalled=true
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: ccm_event_detail: 	CURRENT: bl460g6b [nodeid=1, born=1]
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: ccm_event_detail: 	CURRENT: bl460g6a [nodeid=0, born=2]
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: ccm_event_detail: 	NEW:     bl460g6b [nodeid=1, born=1]
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: ccm_event_detail: 	NEW:     bl460g6a [nodeid=0, born=2]
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: crm_get_peer: Node bl460g6b now has id: 1
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: ais_status_callback: status: bl460g6b is now member (was unknown)
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: crm_update_peer: Node bl460g6b: id=1 state=member (new) addr=(null) votes=-1 born=1 seen=2 proc=00000000000000000000000000000200
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: crm_update_peer_proc: bl460g6b.ais is now online
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: ais_status_callback: status: bl460g6a is now member (was unknown)
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: crm_update_peer: Node bl460g6a: id=0 state=member (new) addr=(null) votes=-1 born=2 seen=2 proc=00000000000000000000000000000200
Mar  2 14:43:44 bl460g6a crmd: [15545]: info: crm_update_peer_proc: bl460g6a.ais is now online
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: post_cache_update: Updated cache after membership event 2.
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: post_cache_update: post_cache_update added action A_ELECTION_CHECK to the FSA
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_STARTED
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_started: Init server comms
Mar  2 14:43:44 bl460g6a crmd: [15545]: notice: do_started: The local CRM is operational
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_ELECTION_CHECK
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_election_check: Ignore election check: we not in an election
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_PENDING: [ state=S_STARTING cause=C_FSA_INTERNAL origin=do_started ]
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_LOG   
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_log: FSA: Input I_PENDING from do_started() received in state S_STARTING
Mar  2 14:43:44 bl460g6a crmd: [15545]: notice: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_INTEGRATE_TIMER_STOP
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_FINALIZE_TIMER_STOP
Mar  2 14:43:44 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_CL_JOIN_QUERY
Mar  2 14:43:45 bl460g6a crmd: [15545]: debug: do_cl_join_query: Querying for a DC
Mar  2 14:43:45 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_START
Mar  2 14:43:45 bl460g6a crmd: [15545]: debug: crm_timer_start: Started Election Trigger (I_DC_TIMEOUT:20000ms), src=15
Mar  2 14:43:45 bl460g6a crmd: [15545]: debug: te_connect_stonith: Attempting connection to fencing daemon...
Mar  2 14:43:46 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/st_command
Mar  2 14:43:46 bl460g6a crmd: [15545]: debug: get_stonith_token: Obtained registration token: 6fcf328a-594e-48d3-99cb-d32c73036e54
Mar  2 14:43:46 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/st_callback
Mar  2 14:43:46 bl460g6a crmd: [15545]: debug: get_stonith_token: Obtained registration token: 0906603e-c17e-4ce3-8b05-7ac54385c777
Mar  2 14:43:46 bl460g6a crmd: [15545]: debug: stonith_api_signon: Connection to STONITH successful
Mar  2 14:43:46 bl460g6a stonith-ng: [15543]: debug: stonith_command: Processing register from crmd (               0)
Mar  2 14:43:46 bl460g6a stonith-ng: [15543]: debug: stonith_command: Processing st_notify from 15545 (               0)
Mar  2 14:43:46 bl460g6a stonith-ng: [15543]: debug: stonith_command: Setting st_notify_disconnect callbacks for 15545 (0906603e-c17e-4ce3-8b05-7ac54385c777): ON
Mar  2 14:43:46 bl460g6a stonith-ng: [15543]: debug: stonith_command: Processing st_notify from 15545 (               0)
Mar  2 14:43:46 bl460g6a stonith-ng: [15543]: debug: stonith_command: Setting st_fence callbacks for 15545 (0906603e-c17e-4ce3-8b05-7ac54385c777): ON
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_ELECTION_COUNT
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: do_election_count_vote: Created voted hash
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: crm_uptime: Current CPU usage is: 0s, 4999us
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: crm_compare_age: Loose: 4999 vs 7998 (usec)
Mar  2 14:43:56 bl460g6a crmd: [15545]: info: do_election_count_vote: Election 2 (owner: 22222222-2222-2222-2222-222222222222) lost: vote from bl460g6b (Uptime)
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_ELECTION_CHECK
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: do_election_check: Ignore election check: we not in an election
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_PENDING: [ state=S_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_LOG   
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: do_log: FSA: Input I_PENDING from do_election_count_vote() received in state S_PENDING
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_STOP
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_START
Mar  2 14:43:56 bl460g6a crmd: [15545]: debug: crm_timer_start: Started Election Trigger (I_DC_TIMEOUT:20000ms), src=17
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: handle_request: Raising I_JOIN_OFFER: join-1
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_JOIN_OFFER: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_STOP
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_CL_JOIN_REQUEST
Mar  2 14:44:02 bl460g6a crmd: [15545]: info: update_dc: Set DC to bl460g6b (3.0.6)
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: do_cl_join_offer_respond: do_cl_join_offer_respond added action A_DC_TIMER_STOP to the FSA
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_STOP
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:02 bl460g6a cib: [15541]: debug: activateCibXml: Triggering CIB write for cib_apply_diff op
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:02 bl460g6a cib: [15541]: debug: activateCibXml: Triggering CIB write for cib_apply_diff op
Mar  2 14:44:02 bl460g6a cib: [15541]: debug: Forking temp process write_cib_contents
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: join_query_callback: Respond to join offer join-1
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: join_query_callback: Acknowledging bl460g6b as our DC
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: config_query_callback: Call 7 : Parsing CIB options
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: config_query_callback: Shutdown escalation occurs after: 1200000ms
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: config_query_callback: Checking for expired actions every 900000ms
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: config_query_callback: Call 8 : Parsing CIB options
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: config_query_callback: Shutdown escalation occurs after: 1200000ms
Mar  2 14:44:02 bl460g6a crmd: [15545]: debug: config_query_callback: Checking for expired actions every 900000ms
Mar  2 14:44:03 bl460g6a cib: [15541]: debug: activateCibXml: Triggering CIB write for cib_replace op
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: handle_request: Raising I_JOIN_RESULT: join-1
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_JOIN_RESULT: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_CL_JOIN_RESULT
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: do_cl_join_finalize_respond: Confirming join join-1: join_ack_nack
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: do_cl_join_finalize_respond: join-1: Join complete.  Sending local LRM status to bl460g6b
Mar  2 14:44:04 bl460g6a cib: [15541]: debug: activateCibXml: Triggering CIB write for cib_apply_diff op
Mar  2 14:44:04 bl460g6a crmd: [15545]: info: update_attrd: Connecting to attrd...
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/attrd
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: attrd_update_delegate: Sent update: terminate=(null) for bl460g6a
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: attrd_update_delegate: Sent update: shutdown=(null) for bl460g6a
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: attrd_update_delegate: Sent update: (null)=(null) for localhost
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_NOT_DC: [ state=S_PENDING cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_LOG   
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: do_log: FSA: Input I_NOT_DC from do_cl_join_finalize_respond() received in state S_PENDING
Mar  2 14:44:04 bl460g6a crmd: [15545]: notice: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_STOP
Mar  2 14:44:04 bl460g6a attrd: [15544]: debug: attrd_local_callback: update message from crmd: terminate=<null>
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_INTEGRATE_TIMER_STOP
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_FINALIZE_TIMER_STOP
Mar  2 14:44:04 bl460g6a attrd: [15544]: info: find_hash_entry: Creating hash entry for terminate
Mar  2 14:44:04 bl460g6a attrd: [15544]: debug: attrd_local_callback: Supplied: (null), Current: (null), Stored: (null)
Mar  2 14:44:04 bl460g6a attrd: [15544]: debug: attrd_local_callback: update message from crmd: shutdown=<null>
Mar  2 14:44:04 bl460g6a attrd: [15544]: info: find_hash_entry: Creating hash entry for shutdown
Mar  2 14:44:04 bl460g6a attrd: [15544]: debug: attrd_local_callback: Supplied: (null), Current: (null), Stored: (null)
Mar  2 14:44:04 bl460g6a attrd: [15544]: notice: attrd_local_callback: Sending full refresh (origin=crmd)
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:04 bl460g6a cib: [15541]: debug: activateCibXml: Triggering CIB write for cib_apply_diff op
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:04 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:04 bl460g6a cib: [15541]: info: Managed write_cib_contents process 15557 exited with return code 0.
Mar  2 14:44:04 bl460g6a cib: [15541]: debug: Forking temp process write_cib_contents
Mar  2 14:44:05 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:05 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:05 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:05 bl460g6a crmd: [15545]: debug: erase_xpath_callback: Deletion of "//node_state[@uname='bl460g6a']/transient_attributes": ok (rc=0)
Mar  2 14:44:05 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:05 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:05 bl460g6a cib: [15541]: info: Managed write_cib_contents process 15558 exited with return code 0.
Mar  2 14:44:06 bl460g6a attrd: [15544]: info: attrd_ha_callback: flush message from bl460g6b
Mar  2 14:44:06 bl460g6a attrd: [15544]: info: find_hash_entry: Creating hash entry for probe_complete
Mar  2 14:44:06 bl460g6a crmd: [15545]: debug: attrd_update_delegate: Sent update: probe_complete=true for localhost
Mar  2 14:44:06 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:06 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:06 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:06 bl460g6a cib: [15541]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='11111111-1111-1111-1111-111111111111']//transient_attributes//nvpair[@name='probe_complete'] does not exist
Mar  2 14:44:06 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:06 bl460g6a attrd: [15544]: debug: attrd_cib_callback: Update -22 for probe_complete=(null) passed
Mar  2 14:44:06 bl460g6a attrd: [15544]: debug: attrd_local_callback: update message from crmd: probe_complete=true
Mar  2 14:44:06 bl460g6a attrd: [15544]: debug: attrd_local_callback: Supplied: true, Current: (null), Stored: (null)
Mar  2 14:44:06 bl460g6a attrd: [15544]: debug: attrd_local_callback: New value of probe_complete is true
Mar  2 14:44:06 bl460g6a attrd: [15544]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Mar  2 14:44:06 bl460g6a cib: [15541]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='11111111-1111-1111-1111-111111111111']//transient_attributes//nvpair[@name='probe_complete'] does not exist
Mar  2 14:44:06 bl460g6a cib: [15541]: debug: cib_process_xpath: Processing cib_query op for /cib (/cib)
Mar  2 14:44:06 bl460g6a attrd: [15544]: notice: attrd_perform_update: Sent update 5: probe_complete=true
Mar  2 14:44:09 bl460g6a attrd: [15544]: debug: attrd_cib_callback: Update 5 for probe_complete=true passed
Mar  2 14:44:09 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:09 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:44:22 bl460g6a ccm: [15540]: WARN: G_CH_check_int: working on IPC channel took 1010 ms (> 100 ms)
Mar  2 14:44:30 bl460g6a ccm: [15540]: WARN: G_CH_check_int: working on IPC channel took 1010 ms (> 100 ms)
Mar  2 14:44:30 bl460g6a heartbeat: [15530]: WARN: Gmain_timeout_dispatch: Dispatch function for cpu limit was delayed 550 ms (> 50 ms) before being called (GSource: 0xf38cf0)
Mar  2 14:44:30 bl460g6a heartbeat: [15530]: info: Gmain_timeout_dispatch: started at 453762498 should have started at 453762443
Mar  2 14:44:43 bl460g6a lrmd: [15542]: WARN: G_CH_check_int: working on IPC channel took 1010 ms (> 100 ms)
Mar  2 14:45:10 bl460g6a ccm: [15540]: WARN: G_CH_check_int: working on IPC channel took 800 ms (> 100 ms)
Mar  2 14:45:31 bl460g6a heartbeat: [15530]: WARN: Gmain_timeout_dispatch: Dispatch function for cpu limit was delayed 590 ms (> 50 ms) before being called (GSource: 0xf38cf0)
Mar  2 14:45:31 bl460g6a heartbeat: [15530]: info: Gmain_timeout_dispatch: started at 453768557 should have started at 453768498
Mar  2 14:45:45 bl460g6a lrmd: [15542]: debug: on_msg_register:client lrmadmin [15601] registered
Mar  2 14:45:45 bl460g6a lrmd: [15542]: debug: on_receive_cmd: the IPC to client [pid:15601] disconnected.
Mar  2 14:45:45 bl460g6a lrmd: [15542]: debug: unregister_client: client lrmadmin [pid:15601] is unregistered
Mar  2 14:45:45 bl460g6a lrmd: [15542]: debug: on_msg_register:client lrmadmin [15602] registered
Mar  2 14:45:45 bl460g6a lrmd: [15542]: debug: on_receive_cmd: the IPC to client [pid:15602] disconnected.
Mar  2 14:45:45 bl460g6a lrmd: [15542]: debug: unregister_client: client lrmadmin [pid:15602] is unregistered
Mar  2 14:45:45 bl460g6a lrmd: [15542]: debug: on_msg_register:client lrmadmin [15607] registered
Mar  2 14:45:45 bl460g6a lrmd: [15542]: debug: on_receive_cmd: the IPC to client [pid:15607] disconnected.
Mar  2 14:45:45 bl460g6a lrmd: [15542]: debug: unregister_client: client lrmadmin [pid:15607] is unregistered
Mar  2 14:45:47 bl460g6a attrd: [15544]: info: attrd_ha_callback: flush message from bl460g6b
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_ELECTION_COUNT
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: crm_uptime: Current CPU usage is: 0s, 14997us
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: crm_compare_age: Loose: 14997 vs 30995 (usec)
Mar  2 14:45:47 bl460g6a crmd: [15545]: info: do_election_count_vote: Election 3 (owner: 22222222-2222-2222-2222-222222222222) lost: vote from bl460g6b (Uptime)
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: update_dc: Unset DC. Was bl460g6b
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_ELECTION_CHECK
Mar  2 14:45:47 bl460g6a cib: [15541]: info: apply_xml_diff: Digest mis-match: expected f93b498fd2daa7b2c4fdf471fa69c70a, calculated f411925f004998d8e6526c38ed49f6ea
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: do_election_check: Ignore election check: we not in an election
Mar  2 14:45:47 bl460g6a cib: [15541]: notice: cib_process_diff: Diff 0.4.13 -> 0.5.1 not applied to 0.4.13: Failed application of an update diff
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_PENDING: [ state=S_NOT_DC cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_LOG   
Mar  2 14:45:47 bl460g6a cib: [15541]: info: cib_server_process_diff: Requesting re-sync from peer
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: do_log: FSA: Input I_PENDING from do_election_count_vote() received in state S_NOT_DC
Mar  2 14:45:47 bl460g6a crmd: [15545]: notice: do_state_transition: State transition S_NOT_DC -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_STOP
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_INTEGRATE_TIMER_STOP
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_FINALIZE_TIMER_STOP
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_START
Mar  2 14:45:47 bl460g6a crmd: [15545]: debug: crm_timer_start: Started Election Trigger (I_DC_TIMEOUT:20000ms), src=23
Mar  2 14:45:47 bl460g6a cib: [15541]: notice: cib_server_process_diff: Not applying diff 0.5.1 -> 0.5.2 (sync in progress)
Mar  2 14:45:47 bl460g6a cib: [15541]: notice: cib_server_process_diff: Not applying diff 0.5.2 -> 0.5.3 (sync in progress)
Mar  2 14:45:47 bl460g6a cib: [15541]: notice: cib_server_process_diff: Not applying diff 0.5.3 -> 0.5.4 (sync in progress)
Mar  2 14:45:47 bl460g6a cib: [15541]: debug: cib_process_xpath: Processing cib_query op for //cib/status//node_state[@id='11111111-1111-1111-1111-111111111111']//transient_attributes//nvpair[@name='probe_complete'] (/cib/status/node_state[2]/transient_attributes/instance_attributes/nvpair)
Mar  2 14:45:47 bl460g6a attrd: [15544]: debug: find_nvpair_attr_delegate: Match <nvpair id="status-11111111-1111-1111-1111-111111111111-probe_complete" name="probe_complete" value="true" />
Mar  2 14:45:49 bl460g6a cib: [15541]: debug: activateCibXml: Triggering CIB write for cib_replace op
Mar  2 14:45:49 bl460g6a cib: [15541]: info: cib_replace_notify: Replaced: -1.-1.-1 -> 0.5.4 from bl460g6b
Mar  2 14:45:49 bl460g6a attrd: [15544]: info: do_cib_replaced: Sending full refresh
Mar  2 14:45:49 bl460g6a attrd: [15544]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Mar  2 14:45:49 bl460g6a crmd: [15545]: debug: do_cib_replaced: Updating the CIB after a replace: DC=false
Mar  2 14:45:49 bl460g6a cib: [15541]: debug: cib_process_xpath: Processing cib_query op for //cib/status//node_state[@id='11111111-1111-1111-1111-111111111111']//transient_attributes//nvpair[@name='probe_complete'] (/cib/status/node_state[2]/transient_attributes/instance_attributes/nvpair)
Mar  2 14:45:49 bl460g6a attrd: [15544]: debug: find_nvpair_attr_delegate: Match <nvpair id="status-11111111-1111-1111-1111-111111111111-probe_complete" name="probe_complete" value="true" />
Mar  2 14:45:49 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:49 bl460g6a attrd: [15544]: debug: attrd_cib_callback: Update 7 for probe_complete=true passed
Mar  2 14:45:49 bl460g6a crmd: [15545]: debug: config_query_callback: Call 12 : Parsing CIB options
Mar  2 14:45:49 bl460g6a crmd: [15545]: debug: config_query_callback: Shutdown escalation occurs after: 1200000ms
Mar  2 14:45:49 bl460g6a crmd: [15545]: debug: config_query_callback: Checking for expired actions every 60000ms
Mar  2 14:45:49 bl460g6a cib: [15541]: debug: Forking temp process write_cib_contents
Mar  2 14:45:51 bl460g6a attrd: [15544]: debug: attrd_cib_callback: Update 9 for probe_complete=true passed
Mar  2 14:45:51 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:51 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:51 bl460g6a cib: [15541]: info: Managed write_cib_contents process 15623 exited with return code 0.
Mar  2 14:45:51 bl460g6a cib: [15541]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 60 ms (> 30 ms) (GSource: 0x25b5150)
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: handle_request: Raising I_JOIN_OFFER: join-2
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_JOIN_OFFER: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_STOP
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_CL_JOIN_REQUEST
Mar  2 14:45:53 bl460g6a crmd: [15545]: info: update_dc: Set DC to bl460g6b (3.0.6)
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: do_cl_join_offer_respond: do_cl_join_offer_respond added action A_DC_TIMER_STOP to the FSA
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_STOP
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: join_query_callback: Respond to join offer join-2
Mar  2 14:45:53 bl460g6a crmd: [15545]: debug: join_query_callback: Acknowledging bl460g6b as our DC
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: handle_request: Raising I_JOIN_RESULT: join-2
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_JOIN_RESULT: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_CL_JOIN_RESULT
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: do_cl_join_finalize_respond: Confirming join join-2: join_ack_nack
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: do_cl_join_finalize_respond: join-2: Join complete.  Sending local LRM status to bl460g6b
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: attrd_update_delegate: Sent update: (null)=(null) for localhost
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_NOT_DC: [ state=S_PENDING cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_LOG   
Mar  2 14:45:55 bl460g6a attrd: [15544]: notice: attrd_local_callback: Sending full refresh (origin=crmd)
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: do_log: FSA: Input I_NOT_DC from do_cl_join_finalize_respond() received in state S_PENDING
Mar  2 14:45:55 bl460g6a attrd: [15544]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Mar  2 14:45:55 bl460g6a crmd: [15545]: notice: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_DC_TIMER_STOP
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_INTEGRATE_TIMER_STOP
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_FINALIZE_TIMER_STOP
Mar  2 14:45:55 bl460g6a cib: [15541]: debug: activateCibXml: Triggering CIB write for cib_replace op
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:55 bl460g6a cib: [15541]: debug: cib_process_xpath: Processing cib_query op for //cib/status//node_state[@id='11111111-1111-1111-1111-111111111111']//transient_attributes//nvpair[@name='probe_complete'] (/cib/status/node_state[2]/transient_attributes/instance_attributes/nvpair)
Mar  2 14:45:55 bl460g6a cib: [15541]: debug: Forking temp process write_cib_contents
Mar  2 14:45:55 bl460g6a attrd: [15544]: debug: find_nvpair_attr_delegate: Match <nvpair id="status-11111111-1111-1111-1111-111111111111-probe_complete" name="probe_complete" value="true" />
Mar  2 14:45:55 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:56 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:56 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:56 bl460g6a cib: [15541]: info: Managed write_cib_contents process 15624 exited with return code 0.
Mar  2 14:45:56 bl460g6a cib: [15541]: debug: cib_common_callback_worker: Setting cib_diff_notify callbacks for 15625 (7a2160b0-6a6d-4c1b-bf55-a9f3742ca431): off
Mar  2 14:45:56 bl460g6a cib: [15541]: debug: cib_common_callback_worker: Setting cib_diff_notify callbacks for 15625 (7a2160b0-6a6d-4c1b-bf55-a9f3742ca431): on
Mar  2 14:45:57 bl460g6a attrd: [15544]: info: attrd_ha_callback: flush message from bl460g6b
Mar  2 14:45:57 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:57 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:57 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:57 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:57 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:57 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:57 bl460g6a cib: [15541]: debug: cib_process_xpath: Processing cib_query op for //cib/status//node_state[@id='11111111-1111-1111-1111-111111111111']//transient_attributes//nvpair[@name='probe_complete'] (/cib/status/node_state[2]/transient_attributes/instance_attributes/nvpair)
Mar  2 14:45:57 bl460g6a attrd: [15544]: debug: find_nvpair_attr_delegate: Match <nvpair id="status-11111111-1111-1111-1111-111111111111-probe_complete" name="probe_complete" value="true" />
Mar  2 14:45:57 bl460g6a attrd: [15544]: debug: attrd_cib_callback: Update 11 for probe_complete=true passed
Mar  2 14:45:59 bl460g6a lrmd: [15542]: debug: on_msg_add_rsc:client [15545] adds resource dummy01
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: do_lrm_rsc_op: Performing key=4:1:7:02f08202-4db7-4748-8dc9-958b2ba6dc49 op=dummy01_monitor_0
Mar  2 14:45:59 bl460g6a lrmd: [15542]: debug: on_msg_perform_op:2385: copying parameters for rsc dummy01
Mar  2 14:45:59 bl460g6a lrmd: [15542]: debug: on_msg_perform_op: add an operation operation monitor[2] on ocf::Dummy::dummy01 for client 15545, its parameters: crm_feature_set=[3.0.6] CRM_meta_timeout=[20000]  to the operation list.
Mar  2 14:45:59 bl460g6a lrmd: [15542]: info: rsc:dummy01:2: probe
Mar  2 14:45:59 bl460g6a lrmd: [15542]: debug: on_msg_add_rsc:client [15545] adds resource dummy02
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: do_lrm_rsc_op: Performing key=5:1:7:02f08202-4db7-4748-8dc9-958b2ba6dc49 op=dummy02_monitor_0
Mar  2 14:45:59 bl460g6a lrmd: [15542]: debug: on_msg_perform_op:2385: copying parameters for rsc dummy02
Mar  2 14:45:59 bl460g6a lrmd: [15542]: debug: on_msg_perform_op: add an operation operation monitor[3] on ocf::Dummy-stop-NG::dummy02 for client 15545, its parameters: crm_feature_set=[3.0.6] CRM_meta_timeout=[20000]  to the operation list.
Mar  2 14:45:59 bl460g6a lrmd: [15542]: info: rsc:dummy02:3: probe
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:59 bl460g6a attrd: [15544]: debug: attrd_cib_callback: Update 13 for probe_complete=true passed
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:45:59 bl460g6a Dummy[15626]: DEBUG: dummy01 monitor : 7
Mar  2 14:45:59 bl460g6a Dummy-stop-NG[15627]: DEBUG: dummy02 monitor : 7
Mar  2 14:45:59 bl460g6a lrmd: [15542]: WARN: Managed dummy01:monitor process 15626 exited with return code 7.
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: create_operation_update: do_update_resource: Updating resouce dummy01 after complete monitor op (interval=0)
Mar  2 14:45:59 bl460g6a lrmd: [15542]: WARN: Managed dummy02:monitor process 15627 exited with return code 7.
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: get_rsc_restart_list: Attr state is not reloadable
Mar  2 14:45:59 bl460g6a crmd: [15545]: info: process_lrm_event: LRM operation dummy01_monitor_0 (call=2, rc=7, cib-update=14, confirmed=true) not running
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: update_history_cache: Appending monitor op to history for 'dummy01'
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: create_operation_update: do_update_resource: Updating resouce dummy02 after complete monitor op (interval=0)
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: get_rsc_restart_list: Attr state is not reloadable
Mar  2 14:45:59 bl460g6a crmd: [15545]: info: process_lrm_event: LRM operation dummy02_monitor_0 (call=3, rc=7, cib-update=15, confirmed=true) not running
Mar  2 14:45:59 bl460g6a crmd: [15545]: debug: update_history_cache: Appending monitor op to history for 'dummy02'
Mar  2 14:46:01 bl460g6a crmd: [15545]: debug: attrd_update_delegate: Sent update: probe_complete=true for localhost
Mar  2 14:46:01 bl460g6a attrd: [15544]: debug: attrd_local_callback: update message from crmd: probe_complete=true
Mar  2 14:46:01 bl460g6a attrd: [15544]: debug: attrd_local_callback: Supplied: true, Current: true, Stored: true
Mar  2 14:46:01 bl460g6a crmd: [15545]: debug: do_lrm_rsc_op: Performing key=9:1:0:02f08202-4db7-4748-8dc9-958b2ba6dc49 op=dummy01_start_0
Mar  2 14:46:01 bl460g6a lrmd: [15542]: debug: on_msg_perform_op:2385: copying parameters for rsc dummy01
Mar  2 14:46:01 bl460g6a lrmd: [15542]: debug: on_msg_perform_op: add an operation operation start[4] on ocf::Dummy::dummy01 for client 15545, its parameters: CRM_meta_name=[start] crm_feature_set=[3.0.6] CRM_meta_on_fail=[restart] CRM_meta_timeout=[60000]  to the operation list.
Mar  2 14:46:01 bl460g6a lrmd: [15542]: info: rsc:dummy01:4: start
Mar  2 14:46:01 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:01 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:01 bl460g6a Dummy[15648]: DEBUG: dummy01 start : 0
Mar  2 14:46:01 bl460g6a lrmd: [15542]: info: Managed dummy01:start process 15648 exited with return code 0.
Mar  2 14:46:01 bl460g6a crmd: [15545]: debug: create_operation_update: do_update_resource: Updating resouce dummy01 after complete start op (interval=0)
Mar  2 14:46:01 bl460g6a crmd: [15545]: info: process_lrm_event: LRM operation dummy01_start_0 (call=4, rc=0, cib-update=16, confirmed=true) ok
Mar  2 14:46:01 bl460g6a crmd: [15545]: debug: update_history_cache: Appending start op to history for 'dummy01'
Mar  2 14:46:03 bl460g6a crmd: [15545]: debug: do_lrm_rsc_op: Performing key=10:1:0:02f08202-4db7-4748-8dc9-958b2ba6dc49 op=dummy01_monitor_7000
Mar  2 14:46:03 bl460g6a lrmd: [15542]: debug: on_msg_perform_op: add an operation operation monitor[5] on ocf::Dummy::dummy01 for client 15545, its parameters: CRM_meta_name=[monitor] crm_feature_set=[3.0.6] CRM_meta_on_fail=[restart] CRM_meta_interval=[7000] CRM_meta_timeout=[60000]  to the operation list.
Mar  2 14:46:03 bl460g6a lrmd: [15542]: info: rsc:dummy01:5: monitor
Mar  2 14:46:03 bl460g6a crmd: [15545]: debug: do_lrm_rsc_op: Performing key=11:1:0:02f08202-4db7-4748-8dc9-958b2ba6dc49 op=dummy02_start_0
Mar  2 14:46:03 bl460g6a lrmd: [15542]: debug: on_msg_perform_op:2385: copying parameters for rsc dummy02
Mar  2 14:46:03 bl460g6a lrmd: [15542]: debug: on_msg_perform_op: add an operation operation start[6] on ocf::Dummy-stop-NG::dummy02 for client 15545, its parameters: CRM_meta_name=[start] crm_feature_set=[3.0.6] CRM_meta_on_fail=[restart] CRM_meta_timeout=[60000]  to the operation list.
Mar  2 14:46:03 bl460g6a lrmd: [15542]: info: rsc:dummy02:6: start
Mar  2 14:46:03 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:03 bl460g6a Dummy[15656]: DEBUG: dummy01 monitor : 0
Mar  2 14:46:03 bl460g6a Dummy-stop-NG[15657]: DEBUG: dummy02 start : 0
Mar  2 14:46:03 bl460g6a lrmd: [15542]: info: Managed dummy01:monitor process 15656 exited with return code 0.
Mar  2 14:46:03 bl460g6a crmd: [15545]: debug: create_operation_update: do_update_resource: Updating resouce dummy01 after complete monitor op (interval=7000)
Mar  2 14:46:03 bl460g6a crmd: [15545]: info: process_lrm_event: LRM operation dummy01_monitor_7000 (call=5, rc=0, cib-update=17, confirmed=false) ok
Mar  2 14:46:03 bl460g6a crmd: [15545]: debug: update_history_cache: Appending monitor op to history for 'dummy01'
Mar  2 14:46:03 bl460g6a lrmd: [15542]: info: Managed dummy02:start process 15657 exited with return code 0.
Mar  2 14:46:03 bl460g6a crmd: [15545]: debug: create_operation_update: do_update_resource: Updating resouce dummy02 after complete start op (interval=0)
Mar  2 14:46:03 bl460g6a crmd: [15545]: info: process_lrm_event: LRM operation dummy02_start_0 (call=6, rc=0, cib-update=18, confirmed=true) ok
Mar  2 14:46:03 bl460g6a crmd: [15545]: debug: update_history_cache: Appending start op to history for 'dummy02'
Mar  2 14:46:05 bl460g6a crmd: [15545]: debug: do_lrm_rsc_op: Performing key=12:1:0:02f08202-4db7-4748-8dc9-958b2ba6dc49 op=dummy02_monitor_7000
Mar  2 14:46:05 bl460g6a lrmd: [15542]: debug: on_msg_perform_op: add an operation operation monitor[7] on ocf::Dummy-stop-NG::dummy02 for client 15545, its parameters: CRM_meta_name=[monitor] crm_feature_set=[3.0.6] CRM_meta_on_fail=[restart] CRM_meta_interval=[7000] CRM_meta_timeout=[60000]  to the operation list.
Mar  2 14:46:05 bl460g6a lrmd: [15542]: info: rsc:dummy02:7: monitor
Mar  2 14:46:05 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:05 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:05 bl460g6a Dummy-stop-NG[15671]: DEBUG: dummy02 monitor : 0
Mar  2 14:46:05 bl460g6a lrmd: [15542]: info: Managed dummy02:monitor process 15671 exited with return code 0.
Mar  2 14:46:05 bl460g6a crmd: [15545]: debug: create_operation_update: do_update_resource: Updating resouce dummy02 after complete monitor op (interval=7000)
Mar  2 14:46:05 bl460g6a crmd: [15545]: info: process_lrm_event: LRM operation dummy02_monitor_7000 (call=7, rc=0, cib-update=19, confirmed=false) ok
Mar  2 14:46:05 bl460g6a crmd: [15545]: debug: update_history_cache: Appending monitor op to history for 'dummy02'
Mar  2 14:46:07 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:10 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:46:10 bl460g6a Dummy[15678]: DEBUG: dummy01 monitor : 0
Mar  2 14:46:12 bl460g6a lrmd: [15542]: debug: rsc:dummy02:7: monitor
Mar  2 14:46:12 bl460g6a Dummy-stop-NG[15685]: DEBUG: dummy02 monitor : 0
Mar  2 14:46:17 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:46:17 bl460g6a Dummy[15693]: DEBUG: dummy01 monitor : 0
Mar  2 14:46:17 bl460g6a heartbeat: [15530]: debug: Process 15530 processing SIGTERM
Mar  2 14:46:17 bl460g6a heartbeat: [15530]: debug: hb_initiate_shutdown() called.
Mar  2 14:46:17 bl460g6a heartbeat: [15530]: debug: hb_initiate_shutdown(): calling hb_mcp_final_shutdown()
Mar  2 14:46:17 bl460g6a heartbeat: [15530]: debug: hb_mcp_final_shutdown() phase 0
Mar  2 14:46:17 bl460g6a heartbeat: [15530]: debug: Shutting down client /usr/lib64/heartbeat/crmd
Mar  2 14:46:17 bl460g6a heartbeat: [15530]: info: killing /usr/lib64/heartbeat/crmd process group 15545 with signal 15
Mar  2 14:46:17 bl460g6a crmd: [15545]: info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
Mar  2 14:46:17 bl460g6a crmd: [15545]: notice: crm_shutdown: Requesting shutdown, upper limit is 1200000ms
Mar  2 14:46:17 bl460g6a crmd: [15545]: debug: crm_timer_start: Started Shutdown Escalation (I_STOP:1200000ms), src=32
Mar  2 14:46:17 bl460g6a crmd: [15545]: debug: s_crmd_fsa: Processing I_SHUTDOWN: [ state=S_NOT_DC cause=C_SHUTDOWN origin=crm_shutdown ]
Mar  2 14:46:17 bl460g6a crmd: [15545]: debug: do_fsa_action: actions:trace: 	// A_SHUTDOWN_REQ
Mar  2 14:46:17 bl460g6a crmd: [15545]: info: do_shutdown_req: Sending shutdown request to bl460g6b
Mar  2 14:46:19 bl460g6a lrmd: [15542]: debug: rsc:dummy02:7: monitor
Mar  2 14:46:19 bl460g6a attrd: [15544]: info: attrd_ha_callback: Update relayed from bl460g6b
Mar  2 14:46:19 bl460g6a attrd: [15544]: debug: attrd_local_callback: update message from bl460g6b: shutdown=1330667179
Mar  2 14:46:19 bl460g6a attrd: [15544]: debug: attrd_local_callback: Supplied: 1330667179, Current: (null), Stored: (null)
Mar  2 14:46:19 bl460g6a attrd: [15544]: debug: attrd_local_callback: New value of shutdown is 1330667179
Mar  2 14:46:19 bl460g6a attrd: [15544]: notice: attrd_trigger_update: Sending flush op to all hosts for: shutdown (1330667179)
Mar  2 14:46:19 bl460g6a cib: [15541]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='11111111-1111-1111-1111-111111111111']//transient_attributes//nvpair[@name='shutdown'] does not exist
Mar  2 14:46:19 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:19 bl460g6a cib: [15541]: debug: cib_process_xpath: Processing cib_query op for /cib (/cib)
Mar  2 14:46:19 bl460g6a attrd: [15544]: notice: attrd_perform_update: Sent update 16: shutdown=1330667179
Mar  2 14:46:19 bl460g6a Dummy-stop-NG[15712]: DEBUG: dummy02 monitor : 0
Mar  2 14:46:21 bl460g6a attrd: [15544]: debug: attrd_cib_callback: Update 16 for shutdown=1330667179 passed
Mar  2 14:46:21 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:23 bl460g6a crmd: [15545]: WARN: G_CH_check_int: working on IPC channel took 1010 ms (> 100 ms)
Mar  2 14:46:23 bl460g6a crmd: [15545]: debug: cancel_op: Cancelling op 7 for dummy02 (dummy02:7)
Mar  2 14:46:23 bl460g6a lrmd: [15542]: info: cancel_op: operation monitor[7] on ocf::Dummy-stop-NG::dummy02 for client 15545, its parameters: CRM_meta_name=[monitor] crm_feature_set=[3.0.6] CRM_meta_on_fail=[restart] CRM_meta_interval=[7000] CRM_meta_timeout=[60000]  cancelled
Mar  2 14:46:23 bl460g6a lrmd: [15542]: debug: on_msg_cancel_op: operation 7 cancelled
Mar  2 14:46:23 bl460g6a crmd: [15545]: debug: cancel_op: Op 7 for dummy02 (dummy02:7): cancelled
Mar  2 14:46:23 bl460g6a crmd: [15545]: debug: do_lrm_rsc_op: Performing key=10:2:0:02f08202-4db7-4748-8dc9-958b2ba6dc49 op=dummy02_stop_0
Mar  2 14:46:23 bl460g6a lrmd: [15542]: debug: on_msg_perform_op: add an operation operation stop[8] on ocf::Dummy-stop-NG::dummy02 for client 15545, its parameters: CRM_meta_name=[stop] crm_feature_set=[3.0.6] CRM_meta_on_fail=[block] CRM_meta_timeout=[60000]  to the operation list.
Mar  2 14:46:23 bl460g6a lrmd: [15542]: info: rsc:dummy02:8: stop
Mar  2 14:46:23 bl460g6a crmd: [15545]: info: process_lrm_event: LRM operation dummy02_monitor_7000 (call=7, status=1, cib-update=0, confirmed=true) Cancelled
Mar  2 14:46:23 bl460g6a crmd: [15545]: debug: update_history_cache: Appending monitor op to history for 'dummy02'
Mar  2 14:46:23 bl460g6a lrmd: [15542]: WARN: Managed dummy02:stop process 15721 exited with return code 1.
Mar  2 14:46:23 bl460g6a crmd: [15545]: debug: create_operation_update: do_update_resource: Updating resouce dummy02 after complete stop op (interval=0)
Mar  2 14:46:23 bl460g6a crmd: [15545]: info: process_lrm_event: LRM operation dummy02_stop_0 (call=8, rc=1, cib-update=20, confirmed=true) unknown error
Mar  2 14:46:23 bl460g6a crmd: [15545]: debug: update_history_cache: Appending stop op to history for 'dummy02'
Mar  2 14:46:24 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:46:24 bl460g6a Dummy[15724]: DEBUG: dummy01 monitor : 0
Mar  2 14:46:26 bl460g6a attrd: [15544]: info: attrd_ha_callback: Update relayed from bl460g6b
Mar  2 14:46:26 bl460g6a attrd: [15544]: debug: attrd_local_callback: update message from bl460g6b: fail-count-dummy02=INFINITY
Mar  2 14:46:26 bl460g6a attrd: [15544]: info: find_hash_entry: Creating hash entry for fail-count-dummy02
Mar  2 14:46:26 bl460g6a attrd: [15544]: debug: attrd_local_callback: Supplied: INFINITY, Current: (null), Stored: (null)
Mar  2 14:46:26 bl460g6a attrd: [15544]: debug: attrd_local_callback: New value of fail-count-dummy02 is INFINITY
Mar  2 14:46:26 bl460g6a attrd: [15544]: notice: attrd_trigger_update: Sending flush op to all hosts for: fail-count-dummy02 (INFINITY)
Mar  2 14:46:26 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:26 bl460g6a cib: [15541]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='11111111-1111-1111-1111-111111111111']//transient_attributes//nvpair[@name='fail-count-dummy02'] does not exist
Mar  2 14:46:26 bl460g6a cib: [15541]: debug: cib_process_xpath: Processing cib_query op for /cib (/cib)
Mar  2 14:46:26 bl460g6a attrd: [15544]: notice: attrd_perform_update: Sent update 19: fail-count-dummy02=INFINITY
Mar  2 14:46:26 bl460g6a attrd: [15544]: info: attrd_ha_callback: Update relayed from bl460g6b
Mar  2 14:46:26 bl460g6a attrd: [15544]: debug: attrd_local_callback: update message from bl460g6b: last-failure-dummy02=1330667185
Mar  2 14:46:26 bl460g6a attrd: [15544]: info: find_hash_entry: Creating hash entry for last-failure-dummy02
Mar  2 14:46:26 bl460g6a attrd: [15544]: debug: attrd_local_callback: Supplied: 1330667185, Current: (null), Stored: (null)
Mar  2 14:46:26 bl460g6a attrd: [15544]: debug: attrd_local_callback: New value of last-failure-dummy02 is 1330667185
Mar  2 14:46:26 bl460g6a attrd: [15544]: notice: attrd_trigger_update: Sending flush op to all hosts for: last-failure-dummy02 (1330667185)
Mar  2 14:46:26 bl460g6a cib: [15541]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='11111111-1111-1111-1111-111111111111']//transient_attributes//nvpair[@name='last-failure-dummy02'] does not exist
Mar  2 14:46:26 bl460g6a cib: [15541]: debug: cib_process_xpath: Processing cib_query op for /cib (/cib)
Mar  2 14:46:26 bl460g6a attrd: [15544]: notice: attrd_perform_update: Sent update 22: last-failure-dummy02=1330667185
Mar  2 14:46:28 bl460g6a attrd: [15544]: debug: attrd_cib_callback: Update 19 for fail-count-dummy02=INFINITY passed
Mar  2 14:46:28 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:28 bl460g6a attrd: [15544]: debug: attrd_cib_callback: Update 22 for last-failure-dummy02=1330667185 passed
Mar  2 14:46:28 bl460g6a crmd: [15545]: debug: get_xpath_object: No match for //cib_update_result//diff-added//crm_config in /notify
Mar  2 14:46:29 bl460g6a ccm: [15540]: WARN: G_CH_check_int: working on IPC channel took 1010 ms (> 100 ms)
Mar  2 14:46:32 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:46:32 bl460g6a heartbeat: [15530]: WARN: Gmain_timeout_dispatch: Dispatch function for cpu limit was delayed 590 ms (> 50 ms) before being called (GSource: 0xf38cf0)
Mar  2 14:46:32 bl460g6a heartbeat: [15530]: info: Gmain_timeout_dispatch: started at 453774616 should have started at 453774557
Mar  2 14:46:32 bl460g6a Dummy[15731]: DEBUG: dummy01 monitor : 0
Mar  2 14:46:39 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:46:39 bl460g6a Dummy[15738]: DEBUG: dummy01 monitor : 0
Mar  2 14:46:46 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:46:46 bl460g6a Dummy[15751]: DEBUG: dummy01 monitor : 0
Mar  2 14:46:53 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:46:53 bl460g6a Dummy[15758]: DEBUG: dummy01 monitor : 0
Mar  2 14:47:00 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:47:00 bl460g6a Dummy[15765]: DEBUG: dummy01 monitor : 0
Mar  2 14:47:07 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:47:07 bl460g6a Dummy[15772]: DEBUG: dummy01 monitor : 0
Mar  2 14:47:14 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:47:14 bl460g6a Dummy[15779]: DEBUG: dummy01 monitor : 0
Mar  2 14:47:21 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:47:21 bl460g6a Dummy[15786]: DEBUG: dummy01 monitor : 0
Mar  2 14:47:28 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:47:28 bl460g6a Dummy[15793]: DEBUG: dummy01 monitor : 0
Mar  2 14:47:35 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:47:35 bl460g6a Dummy[15800]: DEBUG: dummy01 monitor : 0
Mar  2 14:47:42 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:47:42 bl460g6a Dummy[15815]: DEBUG: dummy01 monitor : 0
Mar  2 14:47:49 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:47:49 bl460g6a Dummy[15822]: DEBUG: dummy01 monitor : 0
Mar  2 14:47:56 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:47:56 bl460g6a Dummy[15829]: DEBUG: dummy01 monitor : 0
Mar  2 14:48:03 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:48:03 bl460g6a Dummy[15836]: DEBUG: dummy01 monitor : 0
Mar  2 14:48:08 bl460g6a root: Mark:HB_REPORT:1330667286
Mar  2 14:48:10 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:48:10 bl460g6a Dummy[16059]: DEBUG: dummy01 monitor : 0
Mar  2 14:48:11 bl460g6a ccm: [15540]: info: client (pid=16058) removed from ccm
Mar  2 14:48:17 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:48:17 bl460g6a Dummy[16915]: DEBUG: dummy01 monitor : 0
Mar  2 14:48:24 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:48:24 bl460g6a Dummy[16922]: DEBUG: dummy01 monitor : 0
Mar  2 14:48:31 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:48:31 bl460g6a Dummy[16929]: DEBUG: dummy01 monitor : 0
Mar  2 14:48:38 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:48:38 bl460g6a Dummy[16936]: DEBUG: dummy01 monitor : 0
Mar  2 14:48:45 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:48:45 bl460g6a Dummy[16949]: DEBUG: dummy01 monitor : 0
Mar  2 14:48:52 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:48:52 bl460g6a Dummy[16956]: DEBUG: dummy01 monitor : 0
Mar  2 14:48:59 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:48:59 bl460g6a Dummy[16965]: DEBUG: dummy01 monitor : 0
Mar  2 14:49:06 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:49:06 bl460g6a Dummy[16972]: DEBUG: dummy01 monitor : 0
Mar  2 14:49:07 bl460g6a root: Mark:HB_REPORT:1330667346
Mar  2 14:49:10 bl460g6a ccm: [15540]: info: client (pid=17194) removed from ccm
Mar  2 14:49:13 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:49:13 bl460g6a Dummy[17930]: DEBUG: dummy01 monitor : 0
Mar  2 14:49:20 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:49:20 bl460g6a Dummy[17998]: DEBUG: dummy01 monitor : 0
Mar  2 14:49:27 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:49:27 bl460g6a Dummy[18005]: DEBUG: dummy01 monitor : 0
Mar  2 14:49:34 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:49:34 bl460g6a Dummy[18012]: DEBUG: dummy01 monitor : 0
Mar  2 14:49:41 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:49:41 bl460g6a Dummy[18025]: DEBUG: dummy01 monitor : 0
Mar  2 14:49:48 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:49:48 bl460g6a Dummy[18032]: DEBUG: dummy01 monitor : 0
Mar  2 14:49:55 bl460g6a lrmd: [15542]: debug: rsc:dummy01:5: monitor
Mar  2 14:49:55 bl460g6a Dummy[18039]: DEBUG: dummy01 monitor : 0
