Nov 30 11:42:24 ubuntu_1 crmd: [24154]: info: do_state_transition: Starting PEngine Recheck Timer +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: - Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: need_abort: Aborting on change to admin_epoch Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: do_state_transition: All 2 cluster nodes are eligible to run resources. Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: do_pe_invoke: Query 72: Requesting the current CIB: S_POLICY_ENGINE Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: log_data_element: cib:diff: + Nov 30 11:43:02 ubuntu_1 cib: [24150]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=ubuntu_2/crm_attribute/4, version=1.88.1): ok (rc=0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1259599382-40, seq=600, quorate=1 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 30 11:43:02 ubuntu_1 pengine: [24153]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: info: determine_online_status: Node ubuntu_1 is online Nov 30 11:43:02 ubuntu_1 pengine: [24153]: info: unpack_status: Node ubuntu_2 is in standby-mode Nov 30 11:43:02 ubuntu_1 pengine: [24153]: info: determine_online_status: Node ubuntu_2 is standby Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: native_print: world1^I(ocf::bbnd:world1test):^IStarted ubuntu_2 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: native_print: world2^I(ocf::bbnd:world2test):^IStarted ubuntu_2 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: native_print: world3^I(ocf::bbnd:world3test):^IStarted ubuntu_2 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: native_print: world4^I(ocf::bbnd:world4test):^IStarted ubuntu_2 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: RecurringOp: Start recurring monitor (10s) for world1 on ubuntu_1 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: RecurringOp: Start recurring monitor (10s) for world2 on ubuntu_1 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: RecurringOp: Start recurring monitor (10s) for world3 on ubuntu_1 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: RecurringOp: Start recurring monitor (10s) for world4 on ubuntu_1 Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: LogActions: Move resource world1^I(Started ubuntu_2 -> ubuntu_1) Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: LogActions: Move resource world2^I(Started ubuntu_2 -> ubuntu_1) Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: LogActions: Move resource world3^I(Started ubuntu_2 -> ubuntu_1) Nov 30 11:43:02 ubuntu_1 pengine: [24153]: notice: LogActions: Move resource world4^I(Started ubuntu_2 -> ubuntu_1) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: unpack_graph: Unpacked transition 4: 13 actions in 13 synapses Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: do_te_invoke: Processing graph 4 (ref=pe_calc-dc-1259599382-40) derived from /var/lib/pengine/pe-input-12405.bz2 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: te_graph_trigger: Invoking graph 4 in state S_TRANSITION_ENGINE Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Entering graph 4 callback Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 0 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 12 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 0 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 0 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 1 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 1 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 1 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 2 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 2 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 2 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 3 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 15 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 3 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 3 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 4 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 4 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 4 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 5 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 5 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 5 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 6 Nov 30 11:43:02 ubuntu_1 cib: [24364]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-6.raw Nov 30 11:43:02 ubuntu_1 pengine: [24153]: info: process_pe_message: Transition 4: PEngine Input stored in: /var/lib/pengine/pe-input-12405.bz2 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 18 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 6 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 6 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 7 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 7 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 7 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 8 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 8 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 8 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 9 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 9 fired Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 9 fired Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing rsc-event: 18 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: info: te_rsc_command: Initiating action 18: stop world4_stop_0 on ubuntu_2 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: send_ais_text: Sending message 37 to ubuntu_2.lrmd (data=581, total=1173) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 10 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 10 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 10 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 11 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 19 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 11 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 11 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 12 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 12 not satisfied Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 12 cannot fire Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: ==================================================== Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: run_graph: Transition 4 (Complete=0, Pending=1, Fired=1, Skipped=0, Incomplete=12, Source=/var/lib/pengine/pe-input-12405.bz2): In-progress Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Graph 4 (13 actions in 13 synapses): batch-limit=30 jobs, network-delay=5000ms Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 0 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 1 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 2 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 11]: Pending (id: world1_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 3 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Pending (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 4 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 5 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 14]: Pending (id: world2_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 6 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 15]: Pending (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Pending (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 7 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Pending (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 8 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 17]: Pending (id: world3_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 9 was executed (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 18]: In-flight (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 10 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Pending (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 11 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 20]: Pending (id: world4_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 12 is pending (priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 5]: Pending (id: all_stopped, type: pseduo, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Pending (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Pending (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:02 ubuntu_1 crmd: [24154]: debug: debug3: te_graph_trigger: Transition not yet complete Nov 30 11:43:03 ubuntu_1 cib: [24364]: info: write_cib_contents: Wrote version 1.88.0 of the CIB to disk (digest: 392bfa471cf2deab09ded609e1118bfb) Nov 30 11:43:03 ubuntu_1 cib: [24364]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.DxZSAb (digest: /var/lib/heartbeat/crm/cib.9VvETy) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: info: match_graph_event: Action world4_stop_0 (18) confirmed on ubuntu_2 (rc=0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: te_graph_trigger: Invoking graph 4 in state S_TRANSITION_ENGINE Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Entering graph 4 callback Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 0 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 12 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 0 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 0 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 1 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 1 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 1 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 2 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 2 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 2 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 3 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 15 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 3 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 3 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 4 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 4 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 4 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 5 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 5 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 5 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 6 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 18 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 6 fired Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 6 fired Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing rsc-event: 15 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: info: te_rsc_command: Initiating action 15: stop world3_stop_0 on ubuntu_2 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: send_ais_text: Sending message 38 to ubuntu_2.lrmd (data=581, total=1173) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 7 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 7 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 7 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 8 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 8 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 8 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 9 complete Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 10 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 10 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 10 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 11 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 19 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 11 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 11 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 12 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 12 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 12 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: ==================================================== Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: run_graph: Transition 4 (Complete=1, Pending=1, Fired=1, Skipped=0, Incomplete=11, Source=/var/lib/pengine/pe-input-12405.bz2): In-progress Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Graph 4 (13 actions in 13 synapses): batch-limit=30 jobs, network-delay=5000ms Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 0 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 1 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 2 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 11]: Pending (id: world1_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 3 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Pending (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 4 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 5 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 14]: Pending (id: world2_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 6 was executed (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 15]: In-flight (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 7 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Pending (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 8 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 17]: Pending (id: world3_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 9 was confirmed (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 10 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 11 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 20]: Pending (id: world4_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 12 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 5]: Pending (id: all_stopped, type: pseduo, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Pending (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: te_graph_trigger: Transition not yet complete Nov 30 11:43:03 ubuntu_1 crmd: [24154]: info: match_graph_event: Action world3_stop_0 (15) confirmed on ubuntu_2 (rc=0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: te_graph_trigger: Invoking graph 4 in state S_TRANSITION_ENGINE Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Entering graph 4 callback Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 0 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 12 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 0 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 0 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 1 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 1 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 1 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 2 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 2 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 2 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 3 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 15 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 3 fired Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 3 fired Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing rsc-event: 12 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: info: te_rsc_command: Initiating action 12: stop world2_stop_0 on ubuntu_2 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: send_ais_text: Sending message 39 to ubuntu_2.lrmd (data=581, total=1173) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 4 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 4 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 4 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 5 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 5 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 5 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 6 complete Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 7 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 7 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 7 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 8 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 8 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 8 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 9 complete Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 10 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 10 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 10 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 11 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 19 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 11 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 11 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 12 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 12 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 12 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: ==================================================== Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: run_graph: Transition 4 (Complete=2, Pending=1, Fired=1, Skipped=0, Incomplete=10, Source=/var/lib/pengine/pe-input-12405.bz2): In-progress Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Graph 4 (13 actions in 13 synapses): batch-limit=30 jobs, network-delay=5000ms Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 0 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 1 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 2 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 11]: Pending (id: world1_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 3 was executed (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 12]: In-flight (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 4 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 5 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 14]: Pending (id: world2_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 6 was confirmed (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 7 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Completed (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 8 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 17]: Pending (id: world3_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 9 was confirmed (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 10 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 11 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 20]: Pending (id: world4_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 12 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 5]: Pending (id: all_stopped, type: pseduo, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Pending (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Completed (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: te_graph_trigger: Transition not yet complete Nov 30 11:43:03 ubuntu_1 crmd: [24154]: info: match_graph_event: Action world2_stop_0 (12) confirmed on ubuntu_2 (rc=0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: te_graph_trigger: Invoking graph 4 in state S_TRANSITION_ENGINE Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Entering graph 4 callback Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 0 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 12 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 0 fired Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 0 fired Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing rsc-event: 9 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: info: te_rsc_command: Initiating action 9: stop world1_stop_0 on ubuntu_2 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: send_ais_text: Sending message 40 to ubuntu_2.lrmd (data=579, total=1171) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 1 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 1 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 1 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 2 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 2 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 2 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 3 complete Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 4 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 4 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 4 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 5 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 5 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 5 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 6 complete Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 7 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 7 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 7 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 8 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 8 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 8 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 9 complete Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 10 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 10 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 10 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 11 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 19 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 11 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 11 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 12 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 12 not satisfied Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 12 cannot fire Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: ==================================================== Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: run_graph: Transition 4 (Complete=3, Pending=1, Fired=1, Skipped=0, Incomplete=9, Source=/var/lib/pengine/pe-input-12405.bz2): In-progress Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Graph 4 (13 actions in 13 synapses): batch-limit=30 jobs, network-delay=5000ms Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 0 was executed (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 9]: In-flight (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 1 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 2 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 11]: Pending (id: world1_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 3 was confirmed (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 4 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Completed (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 5 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 14]: Pending (id: world2_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 6 was confirmed (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 7 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Completed (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 8 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 17]: Pending (id: world3_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 9 was confirmed (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 10 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 11 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 20]: Pending (id: world4_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 12 is pending (priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 5]: Pending (id: all_stopped, type: pseduo, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 9]: Pending (id: world1_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Completed (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Completed (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:03 ubuntu_1 crmd: [24154]: debug: debug3: te_graph_trigger: Transition not yet complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: match_graph_event: Action world1_stop_0 (9) confirmed on ubuntu_2 (rc=0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: te_graph_trigger: Invoking graph 4 in state S_TRANSITION_ENGINE Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Entering graph 4 callback Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 0 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 1 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 1 fired Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 1 fired Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing rsc-event: 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: te_rsc_command: Initiating action 10: start world1_start_0 on ubuntu_1 (local) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: do_lrm_invoke: LRM command from: tengine Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: get_lrm_resource: Retrieving world1 from the LRM. Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: xml2list: Unpacking Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: construct_op: Constructed start op for world1: interval=0 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: do_lrm_rsc_op: Performing key=10:4:0:a791b1f6-1dd6-4598-a465-f3abcf51bebb op=world1_start_0 ) Nov 30 11:43:04 ubuntu_1 lrmd: [24151]: info: rsc:world1:6: start Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: do_lrm_rsc_op: Recording pending op: 6 - world1_start_0 world1:6 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 2 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 2 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 2 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 3 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 4 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 4 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 4 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 5 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 5 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 5 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 6 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 7 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 7 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 7 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 8 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 8 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 8 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 9 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 10 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 10 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 11 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 19 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 11 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 11 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 12 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 9 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 12 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 15 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 18 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 12 fired Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 12 fired Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing pseudo-event: 5 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: te_pseudo_action: Pseudo action 5 fired and confirmed Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: update_graph: Synapse complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: update_graph: Synapse executed Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_confirmed: Processing action 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_confirmed: Synapse 1 still not confirmed after action 5 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: update_graph: Synapse complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 12 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 13 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: update_graph: Synapse complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 13 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 15 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 16 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: update_graph: Synapse complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 16 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 18 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_ready: Processing input 19 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: update_graph: Synapse executed Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_confirmed: Processing action 5 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: update_synapse_confirmed: Confirmed: Action 5 of Synapse 12 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: update_synapse_confirmed: Confirmed: Synapse 12 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: update_synapse_confirmed: Updated synapse 12 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: update_graph: Updated graph with completed action 5 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: trigger_graph_processing: te_pseudo_action:58 - Triggered graph processing Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: ==================================================== Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: run_graph: Transition 4 (Complete=4, Pending=1, Fired=2, Skipped=0, Incomplete=7, Source=/var/lib/pengine/pe-input-12405.bz2): In-progress Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Graph 4 (13 actions in 13 synapses): batch-limit=30 jobs, network-delay=5000ms Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 0 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 1 was executed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 10]: In-flight (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 2 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 11]: Pending (id: world1_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 3 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 4 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Completed (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 5 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 14]: Pending (id: world2_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 6 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 7 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Completed (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 8 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 17]: Pending (id: world3_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 9 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 10 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 11 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 20]: Pending (id: world4_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 12 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: te_graph_trigger: Transition not yet complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: te_graph_trigger: Invoking graph 4 in state S_TRANSITION_ENGINE Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Entering graph 4 callback Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 0 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 1: confirmation pending Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 2 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 2 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 2 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 3 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 4 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 4 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 4 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 5 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 5 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 5 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 6 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 7 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 7 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 7 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 8 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 8 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 8 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 9 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 10 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 10 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 11 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 19 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 11 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 11 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 12 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: ==================================================== Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: run_graph: Transition 4 (Complete=5, Pending=1, Fired=0, Skipped=0, Incomplete=7, Source=/var/lib/pengine/pe-input-12405.bz2): In-progress Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Graph 4 (13 actions in 13 synapses): batch-limit=30 jobs, network-delay=5000ms Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 0 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 1 was executed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 10]: In-flight (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 2 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 11]: Pending (id: world1_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 3 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 4 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 10]: Pending (id: world1_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 12]: Completed (id: world2_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 5 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 14]: Pending (id: world2_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 6 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 7 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Completed (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 8 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 17]: Pending (id: world3_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 9 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 10 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 world1(as: root) GOT START REQUEST Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 11 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 20]: Pending (id: world4_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 12 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: te_graph_trigger: Transition not yet complete - no actions fired Nov 30 11:43:04 ubuntu_1 world1(as: root) EXECUTING START REQUEST Nov 30 11:43:04 ubuntu_1 world1(as: root) STARTUP REQUEST SUCCESSFULL Nov 30 11:43:04 ubuntu_1 world1(as: root) POST-STARTUP MONITOR OK Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: process_lrm_event: LRM operation world1_start_0 (call=6, rc=0, cib-update=73, confirmed=true) ok Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: match_graph_event: Action world1_start_0 (10) confirmed on ubuntu_1 (rc=0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: te_graph_trigger: Invoking graph 4 in state S_TRANSITION_ENGINE Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Entering graph 4 callback Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 0 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 1 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 2 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 2 fired Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 2 fired Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing rsc-event: 11 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: te_rsc_command: Initiating action 11: monitor world1_monitor_10000 on ubuntu_1 (local) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: do_lrm_invoke: LRM command from: tengine Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: get_lrm_resource: Retrieving world1 from the LRM. Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: xml2list: Unpacking Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: construct_op: Constructed monitor op for world1: interval=10000 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: do_lrm_rsc_op: Performing key=11:4:0:a791b1f6-1dd6-4598-a465-f3abcf51bebb op=world1_monitor_10000 ) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: do_lrm_rsc_op: Recording pending op: 7 - world1_monitor_10000 world1:7 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 3 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 4 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 12 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 4 fired Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 4 fired Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing rsc-event: 13 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: te_rsc_command: Initiating action 13: start world2_start_0 on ubuntu_1 (local) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: do_lrm_invoke: LRM command from: tengine Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: get_lrm_resource: Retrieving world2 from the LRM. Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: xml2list: Unpacking Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: construct_op: Constructed start op for world2: interval=0 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: info: do_lrm_rsc_op: Performing key=13:4:0:a791b1f6-1dd6-4598-a465-f3abcf51bebb op=world2_start_0 ) Nov 30 11:43:04 ubuntu_1 lrmd: [24151]: info: rsc:world2:8: start Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: do_lrm_rsc_op: Recording pending op: 8 - world2_start_0 world2:8 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 5 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 5 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 5 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 6 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 7 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 7 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 7 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 8 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 8 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 8 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 9 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 10 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 10 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 10 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 11 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 19 Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 11 not satisfied Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 11 cannot fire Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 12 complete Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: ==================================================== Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: run_graph: Transition 4 (Complete=6, Pending=2, Fired=2, Skipped=0, Incomplete=5, Source=/var/lib/pengine/pe-input-12405.bz2): In-progress Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Graph 4 (13 actions in 13 synapses): batch-limit=30 jobs, network-delay=5000ms Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 0 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 1 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 2 was executed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 11]: In-flight (id: world1_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 3 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 4 was executed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 13]: In-flight (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 5 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 14]: Pending (id: world2_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 6 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 7 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Completed (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 8 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 17]: Pending (id: world3_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 9 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 10 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 11 is pending (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 20]: Pending (id: world4_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 12 was confirmed (priority: 0) Nov 30 11:43:04 ubuntu_1 crmd: [24154]: debug: debug3: te_graph_trigger: Transition not yet complete Nov 30 11:43:04 ubuntu_1 world1(as: root) GOT MONITOR REQUEST Nov 30 11:43:04 ubuntu_1 world2(as: root) GOT START REQUEST Nov 30 11:43:04 ubuntu_1 world1(as: root) EXECUTING MONITOR REQUEST (found state file) Nov 30 11:43:05 ubuntu_1 world2(as: root) EXECUTING START REQUEST Nov 30 11:43:05 ubuntu_1 world1(as: root) MONITOR FOUND world1 ACTIVE Nov 30 11:43:05 ubuntu_1 crmd: [24154]: info: process_lrm_event: LRM operation world1_monitor_10000 (call=7, rc=0, cib-update=74, confirmed=false) ok Nov 30 11:43:05 ubuntu_1 crmd: [24154]: info: match_graph_event: Action world1_monitor_10000 (11) confirmed on ubuntu_1 (rc=0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: te_graph_trigger: Invoking graph 4 in state S_TRANSITION_ENGINE Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Entering graph 4 callback Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 0 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 1 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 2 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 3 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 4: confirmation pending Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 5 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 5 not satisfied Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 5 cannot fire Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 6 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 7 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 7 not satisfied Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 7 cannot fire Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 8 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 8 not satisfied Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 8 cannot fire Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 9 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 10 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 16 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 10 not satisfied Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 10 cannot fire Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 11 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 19 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Inputs for synapse 11 not satisfied Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 11 cannot fire Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 12 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: ==================================================== Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: run_graph: Transition 4 (Complete=7, Pending=1, Fired=0, Skipped=0, Incomplete=5, Source=/var/lib/pengine/pe-input-12405.bz2): In-progress Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Graph 4 (13 actions in 13 synapses): batch-limit=30 jobs, network-delay=5000ms Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 0 was confirmed (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 1 was confirmed (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 2 was confirmed (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 3 was confirmed (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 4 was executed (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 13]: In-flight (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 5 is pending (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 14]: Pending (id: world2_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 6 was confirmed (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 7 is pending (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 13]: Pending (id: world2_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 15]: Completed (id: world3_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 8 is pending (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 17]: Pending (id: world3_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 9 was confirmed (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 10 is pending (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 16]: Pending (id: world3_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 18]: Completed (id: world4_stop_0, loc: ubuntu_2, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 11 is pending (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: [Action 20]: Pending (id: world4_monitor_10000, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_elem: * [Input 19]: Pending (id: world4_start_0, loc: ubuntu_1, priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: print_elem: ^I^I^IRaw xml: Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: print_graph: Synapse 12 was confirmed (priority: 0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: te_graph_trigger: Transition not yet complete - no actions fired Nov 30 11:43:05 ubuntu_1 world2(as: root) STARTUP REQUEST SUCCESSFULL Nov 30 11:43:05 ubuntu_1 APP1: running with pid 24376 (1) Nov 30 11:43:05 ubuntu_1 world2(as: root) POST-STARTUP MONITOR OK Nov 30 11:43:05 ubuntu_1 crmd: [24154]: info: process_lrm_event: LRM operation world2_start_0 (call=8, rc=0, cib-update=75, confirmed=true) ok Nov 30 11:43:05 ubuntu_1 crmd: [24154]: info: match_graph_event: Action world2_start_0 (13) confirmed on ubuntu_1 (rc=0) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: te_graph_trigger: Invoking graph 4 in state S_TRANSITION_ENGINE Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Entering graph 4 callback Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 0 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 1 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 2 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 3 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 4 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 5 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 5 fired Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 5 fired Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing rsc-event: 14 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: info: te_rsc_command: Initiating action 14: monitor world2_monitor_10000 on ubuntu_1 (local) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: do_lrm_invoke: LRM command from: tengine Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: get_lrm_resource: Retrieving world2 from the LRM. Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: xml2list: Unpacking Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: construct_op: Constructed monitor op for world2: interval=10000 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: info: do_lrm_rsc_op: Performing key=14:4:0:a791b1f6-1dd6-4598-a465-f3abcf51bebb op=world2_monitor_10000 ) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: do_lrm_rsc_op: Recording pending op: 9 - world2_monitor_10000 world2:9 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: run_graph: Synapse 6 complete Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Checking pre-reqs for 7 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 13 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: should_fire_synapse: Processing input 15 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: run_graph: Synapse 7 fired Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: fire_synapse: Synapse 7 fired Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: initiate_action: Executing rsc-event: 16 Nov 30 11:43:05 ubuntu_1 crmd: [24154]: info: te_rsc_command: Initiating action 16: start world3_start_0 on ubuntu_1 (local) Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: do_lrm_invoke: LRM command from: tengine Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug2: get_lrm_resource: Retrieving world3 from the LRM. Nov 30 11:43:05 ubuntu_1 crmd: [24154]: debug: debug3: log_data_element: xml2list: Unpacking <