<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 12 (filtered medium)"><title>Exec Failure issues.</title><style><!--
/* Font Definitions */
@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:purple;
        text-decoration:underline;}
p
        {mso-style-priority:99;
        mso-margin-top-alt:auto;
        margin-right:0in;
        mso-margin-bottom-alt:auto;
        margin-left:0in;
        font-size:12.0pt;
        font-family:"Times New Roman","serif";}
span.EmailStyle18
        {mso-style-type:personal-reply;
        font-family:"Calibri","sans-serif";
        color:#1F497D;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-size:10.0pt;}
@page WordSection1
        {size:8.5in 11.0in;
        margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
        {page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Quick update to this <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +     <resources ><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +       <group id="IPS" ><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +         <primitive id="ETH2" ><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +           <meta_attributes id="ETH2-meta_attributes" ><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +             <nvpair id="ETH2-meta_attributes-is-managed" name="is-managed" value="true" __crm_diff_marker__="added:top" /><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: need_abort: Aborting on change to admin_epoch<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +           </meta_attributes><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +         </primitive><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +       </group><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: do_pe_invoke: Query 80: Requesting the current CIB: S_POLICY_ENGINE<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +     </resources><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: +   </configuration><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: log_data_element: cib:diff: + </cib><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost cib: [2638]: info: cib_process_request: Operation complete: op cib_replace for section resources (origin=local/cibadmin/2, version=0.19.1): ok (rc=0)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: do_pe_invoke_callback: Invoking the PE: query=80, ref=pe_calc-dc-1318961480-51, seq=976, quorate=1<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: unpack_config: Startup probes: enabled<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: unpack_config: On loss of CCM Quorum: Ignore<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: unpack_domains: Unpacking domains<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: determine_online_status: Node sgn-pau-hub1 is online<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: ERROR: unpack_rsc_op: Hard error - ETH2_stop_0 failed with rc=3: Preventing ETH2 from re-starting on sgn-pau-hub1<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: WARN: unpack_rsc_op: Processing failed op ETH2_stop_0 on sgn-pau-hub1: unimplemented feature (3)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: native_add_running: resource ETH2 isnt managed<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: WARN: unpack_rsc_op: Processing failed op ETH3_stop_0 on sgn-pau-hub1: unknown exec error (-2)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: native_add_running: resource ETH3 isnt managed<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: determine_online_status: Node sgn-pau-hub0 is online<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: group_print:  Resource Group: IPS<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: native_print:      ETH2#011(ocf::heartbeat:IPaddr):#011Started sgn-pau-hub1 (unmanaged) FAILED<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: native_print:      ETH3#011(ocf::heartbeat:IPaddr):#011Started sgn-pau-hub1 (unmanaged) FAILED<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: clone_print:  Clone Set: ping-On-both<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: short_print:      Started: [ sgn-pau-hub1 sgn-pau-hub0 ]<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: get_failcount: ETH2 has failed INFINITY times on sgn-pau-hub1<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: WARN: common_apply_stickiness: Forcing ETH2 away from sgn-pau-hub1 after 1000000 failures (max=1000000)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: get_failcount: ETH3 has failed INFINITY times on sgn-pau-hub1<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: WARN: common_apply_stickiness: Forcing ETH3 away from sgn-pau-hub1 after 1000000 failures (max=1000000)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: native_color: Unmanaged resource ETH2 allocated to 'nowhere': failed<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: native_color: Unmanaged resource ETH3 allocated to 'nowhere': failed<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: LogActions: Leave resource ETH2#011(Started unmanaged)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: LogActions: Leave resource ETH3#011(Started unmanaged)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: LogActions: Leave resource peth2:0#011(Started sgn-pau-hub1)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: notice: LogActions: Leave resource peth2:1#011(Started sgn-pau-hub0)<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: WARN: should_dump_input: Ignoring requirement that ETH2_stop_0 comeplete before IPS_stopped_0: unmanaged failed resources cannot prevent shutdown<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: WARN: should_dump_input: Ignoring requirement that ETH3_stop_0 comeplete before IPS_stopped_0: unmanaged failed resources cannot prevent shutdown<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: WARN: should_dump_input: Ignoring requirement that ETH3_stop_0 comeplete before IPS_stopped_0: unmanaged failed resources cannot prevent shutdown<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: unpack_graph: Unpacked transition 15: 2 actions in 2 synapses<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: do_te_invoke: Processing graph 15 (ref=pe_calc-dc-1318961480-51) derived from /var/lib/pengine/pe-input-73.bz2<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: te_pseudo_action: Pseudo action 15 fired and confirmed<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: te_pseudo_action: Pseudo action 16 fired and confirmed<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: run_graph: ====================================================<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: notice: run_graph: Transition 15 (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-73.bz2): Complete<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: te_graph_trigger: Transition 15 is now complete<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: notify_crmd: Transition 15 status: done - <null><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost crmd: [2642]: info: do_state_transition: Starting PEngine Recheck Timer<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:11:20 localhost pengine: [2641]: info: process_pe_message: Transition 15: PEngine Input stored in: /var/lib/pengine/pe-input-73.bz2<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Oct 18 18:12:02 localhost cib: [2638]: info: cib_stats: Processed 147 operations (5102.00us average, 0% utilization) in the last 10min<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> James Horsfall (CTR) [mailto:jameshorsfall@stratosgsi.com] <br><b>Sent:</b> Tuesday, October 18, 2011 1:39 PM<br><b>To:</b> pacemaker@oss.clusterlabs.org<br><b>Subject:</b> [Pacemaker] Exec Failure issues.<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Hello all, I’m having some problems getting resources to fail over properly I need the IP’s to swith to a different node when it</span> <span style='font-family:"Calibri","sans-serif"'>cannot ping. We’re doing a</span> <span style='font-family:"Calibri","sans-serif"'>“shut” on the respective interfaces to simulate cables being</span> <span style='font-family:"Calibri","sans-serif"'>unplugged but I keep getting exec timeouts and unknown</span> <span style='font-family:"Calibri","sans-serif"'>errors.</span> <o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>crm_mon</span> <span style='font-family:"Calibri","sans-serif"'>–fortA</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>============</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Last updated: Tue Oct 18 17:32:10 2011</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Stack: openais</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Current DC: sgn-pau-hub0 - partition with quorum</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Version: 1.1.2-f059ec7ced7a86f18e5490b67ebf4a0b963bccfe</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>2 Nodes configured, 2 expected votes</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>2 Resources configured.</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>============</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Online: [ sgn-pau-hub0 sgn-pau-hub1 ]</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Full list of resources:</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'> Resource Group: IPS</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>     ETH2       (ocf::heartbeat:IPaddr):        Started sgn-pau-hub0 (unmanaged) FAILED</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>     ETH3       (ocf::heartbeat:IPaddr):        Started sgn-pau-hub0 (unmanaged) FAILED</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'> Clone Set: ping-On-both</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>     peth2:1    (ocf::pacemaker:ping):  Started sgn-pau-hub0 FAILED</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>     Started: [ sgn-pau-hub1 ]</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Node Attributes:</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>* Node sgn-pau-hub0:   #sometimes this says :1000 (degraded)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>* Node sgn-pau-hub1:</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + pingd                             : 2000</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Operations:</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>* Node sgn-pau-hub0:</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>   ETH2: migration-threshold=1000000</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (5) start: last-rc-change='Tue Oct 18 17:28:11 2011' last-run='Tue Oct 18 17:28:11 2011' exec-time=100ms queue-time=0ms rc=0 (ok)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (7) monitor: interval=30000ms last-rc-change='Tue Oct 18 17:28:11 2011' last-run='Tue Oct 18 17:28:41 2011' exec-time=30ms queue-time=0ms rc=0 (</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>ok)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (15) stop: last-rc-change='Tue Oct 18 17:30:29 2011' last-run='Tue Oct 18 17:30:09 2011' exec-time=20000ms queue-time=0ms rc=-2 (unknown exec er</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>ror)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>   ETH3: migration-threshold=1000000</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (8) start: last-rc-change='Tue Oct 18 17:28:11 2011' last-run='Tue Oct 18 17:28:11 2011' exec-time=80ms queue-time=0ms rc=0 (ok)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (9) monitor: interval=30000ms last-rc-change='Tue Oct 18 17:28:11 2011' last-run='Tue Oct 18 17:28:41 2011' exec-time=30ms queue-time=0ms rc=0 (</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>ok)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (12) stop: last-rc-change='Tue Oct 18 17:29:45 2011' last-run='Tue Oct 18 17:29:25 2011' exec-time=20000ms queue-time=0ms rc=-2 (unknown exec er</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>ror)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>   peth2:1: migration-threshold=1000000</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (24) stop: last-rc-change='Tue Oct 18 17:33:10 2011' last-run='Tue Oct 18 17:33:10 2011' exec-time=10020ms queue-time=0ms rc=0 (ok)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (25) start: last-rc-change='Tue Oct 18 17:33:20 2011' last-run='Tue Oct 18 17:33:20 2011' exec-time=19030ms queue-time=0ms rc=1 (unknown error)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>* Node sgn-pau-hub1:</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>   peth2:0: migration-threshold=1000000</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (5) start: last-rc-change='Tue Oct 18 17:26:36 2011' last-run='Tue Oct 18 17:26:36 2011' exec-time=8070ms queue-time=0ms rc=0 (ok)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    + (6) monitor: interval=10000ms last-rc-change='Tue Oct 18 17:26:45 2011' last-run='Tue Oct 18 17:27:21 2011' exec-time=8030ms queue-time=0ms rc=0</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'> (ok)</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>Failed actions:</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    ETH2_stop_0 (node=sgn-pau-hub0, call=15, rc=-2, status=Timed Out): unknown exec error</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    ETH3_stop_0 (node=sgn-pau-hub0, call=12, rc=-2, status=Timed Out): unknown exec error</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    peth2:1_start_0 (node=sgn-pau-hub0, call=25, rc=1, status=complete): unknown error</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>-------------------------------------------------------CRM configuration----------------------------------------------------- </span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>ode sgn-pau-hub0</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>node sgn-pau-hub1</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>primitive ETH2 ocf:heartbeat:IPaddr \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        params ip="10.151.9.42" cidr_netmask="255.255.255.248" nic="eth2" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        op monitor interval="30s" timeout="60" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        meta target-role="Started" allow-migrate="true"</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>primitive ETH3 ocf:heartbeat:IPaddr \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        params ip="10.151.9.49" cidr_netmask="255.255.255.248" nic="eth3" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        op monitor interval="30s" timeout="60" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        meta target-role="Started" allow-migrate="true"</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>primitive peth2 ocf:pacemaker:ping \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        params multiplier="1000" host_list="10.151.9.41 10.151.9.50" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        operations $id="peth2-operations" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        op monitor interval="10" timeout="20"</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>group IPS ETH2 ETH3 \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        meta target-role="Started"</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>clone ping-On-both peth2 \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        meta target-role="Started"</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>location UPchk IPS \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        rule $id="UPchk-rule" pingd: defined pingd</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>property $id="cib-bootstrap-options" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        dc-version="1.1.2-f059ec7ced7a86f18e5490b67ebf4a0b963bccfe" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        cluster-infrastructure="openais" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        stonith-enabled="false" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        default-resource-stickiness="100" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        no-quorum-policy="ignore" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        last-lrm-refresh="1318948973" \</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        expected-quorum-votes="2"</span><o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p><span style='font-family:"Calibri","sans-serif"'>-------------------------------------------- Cib.xml ----------------------------------------------------------------</span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'><?xml version="1.0" ?></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'><cib admin_epoch="0" crm_feature_set="3.0.2" dc-uuid="sgn-pau-hub0" epoch="10" have-quorum="1" num_updates="5" validate-with="pacemaker-1.2"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>  <configuration></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    <crm_config></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      <cluster_property_set id="cib-bootstrap-options"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.1.2-f059ec7ced7a86f18e5490b67ebf4a0b963bccfe"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="openais"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <nvpair id="cib-bootstrap-options-stonith-enabled" name="stonith-enabled" value="false"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <nvpair id="cib-bootstrap-options-default-resource-stickiness" name="default-resource-stickiness" value="100"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <nvpair id="cib-bootstrap-options-no-quorum-policy" name="no-quorum-policy" value="ignore"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1318948973"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <nvpair id="cib-bootstrap-options-expected-quorum-votes" name="expected-quorum-votes" value="2"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      </cluster_property_set></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    </crm_config></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    <rsc_defaults/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    <op_defaults/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    <nodes></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      <node id="sgn-pau-hub1" type="normal" uname="sgn-pau-hub1"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      <node id="sgn-pau-hub0" type="normal" uname="sgn-pau-hub0"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    </nodes></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    <resources></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      <clone id="ping-On-both"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <meta_attributes id="ping-On-both-meta_attributes"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <nvpair id="ping-On-both-meta_attributes-target-role" name="target-role" value="Started"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        </meta_attributes></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <primitive class="ocf" id="peth2" provider="pacemaker" type="ping"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <instance_attributes id="peth2-instance_attributes"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="peth2-instance_attributes-multiplier" name="multiplier" value="1000"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="peth2-instance_attributes-host_list" name="host_list" value="10.151.9.41 10.151.9.50"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          </instance_attributes></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <operations id="peth2-operations"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <op id="peth2-monitor-10" interval="10" name="monitor" timeout="20"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          </operations></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        </primitive></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      </clone></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      <group id="IPS"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <meta_attributes id="IPS-meta_attributes"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <nvpair id="IPS-meta_attributes-target-role" name="target-role" value="Started"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        </meta_attributes></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <primitive class="ocf" id="ETH2" provider="heartbeat" type="IPaddr"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <instance_attributes id="ETH2-instance_attributes"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH2-instance_attributes-ip" name="ip" value="10.151.9.42"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH2-instance_attributes-cidr_netmask" name="cidr_netmask" value="255.255.255.248"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH2-instance_attributes-nic" name="nic" value="eth2"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          </instance_attributes></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <operations></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <op id="ETH2-monitor-30s" interval="30s" name="monitor" timeout="60"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          </operations></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <meta_attributes id="ETH2-meta_attributes"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH2-meta_attributes-target-role" name="target-role" value="Started"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH2-meta_attributes-allow-migrate" name="allow-migrate" value="true"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          </meta_attributes></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        </primitive></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <primitive class="ocf" id="ETH3" provider="heartbeat" type="IPaddr"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <instance_attributes id="ETH3-instance_attributes"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH3-instance_attributes-ip" name="ip" value="10.151.9.49"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH3-instance_attributes-cidr_netmask" name="cidr_netmask" value="255.255.255.248"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH3-instance_attributes-nic" name="nic" value="eth3"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          </instance_attributes></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <operations></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <op id="ETH3-monitor-30s" interval="30s" name="monitor" timeout="60"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          </operations></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <meta_attributes id="ETH3-meta_attributes"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH3-meta_attributes-target-role" name="target-role" value="Started"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>            <nvpair id="ETH3-meta_attributes-allow-migrate" name="allow-migrate" value="true"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          </meta_attributes></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        </primitive></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      </group></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    </resources></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    <constraints></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      <rsc_location id="UPchk" rsc="IPS"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        <rule id="UPchk-rule" score-attribute="pingd"></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>          <expression attribute="pingd" id="UPchk-expression" operation="defined"/></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>        </rule></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>      </rsc_location></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>    </constraints></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'>  </configuration></span><o:p></o:p></p><p><span style='font-family:"Calibri","sans-serif"'></cib></span><o:p></o:p></p></div></body></html>