<html><head></head><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px"><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128680"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128681">TL;DR Pacemaker configuration no longer works after moving from Pacemaker 1.0 to 1.1. What do we need to do to fix it?</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128682"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128683"><br id="yui_3_16_0_ym19_1_1484283548729_128685"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128686"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128687">A working cluster running on Pacemaker 1.0.12 on RHEL5 has been copied with minimal modifications to Pacemaker 1.1.10 on Ubuntu 14.04. The version string is "1.1.10+git20130802-1ubuntu2.3".</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128688"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128689"><br id="yui_3_16_0_ym19_1_1484283548729_128690"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128691"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128692">We run simple active/standby two-node clusters. </span><span style="background-color: transparent; font-family: Arial; font-size: 14.6667px; white-space: pre-wrap;">There are four resources on each node:</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128698"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128699">- a stateful resource (Encryptor) representing a process in either active or standby mode.</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128700"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128701">-- this process does not maintain persistent data.</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128702"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128703">- a clone resource (CredProxy) representing a helper process.</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128704"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128705">- two clone resources (Ingress, Egress) representing network interfaces.</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128706"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128707"><br id="yui_3_16_0_ym19_1_1484283548729_128708"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128709"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128710">Colocation constraints require that all three clone resources must be in Started role in order for the stateful Encryptor resource to be in Master role.</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128711"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128712"><br id="yui_3_16_0_ym19_1_1484283548729_128713"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128714"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128715">The full configuration is at the end of this message.</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128716"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128717"><br id="yui_3_16_0_ym19_1_1484283548729_128718"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128719"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128720">The Encryptor resource should fail over on these events:</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128721"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128722">- active node (i.e. node containing active Encryptor process) goes down</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128723"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128724">- active Encryptor process goes down and cannot be restarted</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128725"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128726">- auxiliary CredProxy process on active node goes down and cannot be restarted</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128727"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128728">- either interface on active node goes down</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128729"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128730"><br id="yui_3_16_0_ym19_1_1484283548729_128731"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128732"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128733">All of these events trigger failover on the old platform (Pacemaker 1.0 on RHEL5).</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128734"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128735"><br id="yui_3_16_0_ym19_1_1484283548729_128736"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128737"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128738">However, on the new platform (Pacemaker 1.1 on Ubuntu) neither interface failure nor auxiliary process failure trigger failover. Pacemaker goes into a loop where it starts and stops the active Encryptor resource and never promotes the standby Encryptor resource. Cleaning up the failed resource manually and issuing "crm_resource --cleanup" clears the jam and the standby Encryptor resource is promoted. So does taking the former active node offline completely.</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128739"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128740"><br id="yui_3_16_0_ym19_1_1484283548729_128741"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128742"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128743">The pe-input-X.bz2 files show this sequence:</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128744"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128745"><br id="yui_3_16_0_ym19_1_1484283548729_128746"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128747"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128748">(EncryptBase:1 is active, EncryptBase:0 is standby)</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128749"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128750"><br id="yui_3_16_0_ym19_1_1484283548729_128751"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128752"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128753">T: pacemaker recognizes that Ingress has failed</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128754"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128755">transition: recover Ingress on active node</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128756"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128757"><br id="yui_3_16_0_ym19_1_1484283548729_128758"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128759"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128760">T+1: transition: recover Ingress on active node</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128761"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128762"><br id="yui_3_16_0_ym19_1_1484283548729_128763"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128764"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128765">T+2: transition: recover Ingress on active node</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128766"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128767"><br id="yui_3_16_0_ym19_1_1484283548729_128768"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128769"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128770">T+3: transitions: promote EncryptBase:0, demote EncryptBase:1, stop Ingress on active node (no-op)</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128771"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128772"><br id="yui_3_16_0_ym19_1_1484283548729_128773"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128774"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128775">T+4: EncryptBase:1 demoted (both clones are now in slave mode), Ingress stopped</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128776"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128777">transitions: promote EncryptBase:0, stop EncryptBase:1</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128778"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128779"><br id="yui_3_16_0_ym19_1_1484283548729_128780"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128781"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128782">T+5: EncryptBase:1 stopped, EncryptBase:0 still in slave role</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128783"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128784">transitions: promote EncryptBase:0, start EncryptBase:1</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128785"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128786"><br id="yui_3_16_0_ym19_1_1484283548729_128787"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128788"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128789">T+6: EncryptBase:1 started (slave role)</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128790"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128791">transitions: promote EncryptBase:0, stop EncryptBase:1</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128792"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128793"><br id="yui_3_16_0_ym19_1_1484283548729_128794"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128795"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128796">The last two steps repeat. Although pengine has decided that EncryptBase:0 should be promoted, Pacemaker keeps stopping and starting EncryptBase:1 (the one on the node with the failed interface) without ever promoting EncryptBase:0.</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128797"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128798"><br id="yui_3_16_0_ym19_1_1484283548729_128799"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128800"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128801">More precisely, crmd never issues the command that would cause promotion. For a normal promotion, I see a sequence like this:</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128802"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128803"><br id="yui_3_16_0_ym19_1_1484283548729_128804"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128805"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128806">2017-01-12T20:04:39.887154+00:00 encryptor4 pengine[2201]: notice: LogActions: Promote EncryptBase:0</span><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128807"><span style="white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128808"> </span></span><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128809">(Slave -> Master encryptor4)</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128810"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128811">2017-01-12T20:04:39.888018+00:00 encryptor4 pengine[2201]: notice: process_pe_message: Calculated Transition 3: /var/lib/pacemaker/pengine/pe-input-3.bz2</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128812"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128813">2017-01-12T20:04:39.888428+00:00 encryptor4 crmd[2202]: notice: te_rsc_command: Initiating action 9: promote EncryptBase_promote_0 on encryptor4 (local)</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128814"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128815">2017-01-12T20:04:39.903827+00:00 encryptor4 Encryptor_ResourceAgent: INFO: Promoting Encryptor.</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128816"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128817">2017-01-12T20:04:44.959804+00:00 encryptor4 crmd[2202]: notice: process_lrm_event: LRM operation EncryptBase_promote_0 (call=42, rc=0, cib-update=43, confirmed=true) ok</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128818"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128819"><br id="yui_3_16_0_ym19_1_1484283548729_128820"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128821"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128822">in which crmd initiates an action for promotion and the RA logs a message indicating that it was called with the arg "promote".</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128823"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128824"><br id="yui_3_16_0_ym19_1_1484283548729_128825"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128826"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128827">In contrast, the looping sections look like this:</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128828"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128829"><br id="yui_3_16_0_ym19_1_1484283548729_128830"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128831"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128832">(EncryptBase:1 on encryptor5 is the active/Master instance, EncryptBase:0 on encryptor4 is the standby/Slave instance)</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128833"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128834"><br id="yui_3_16_0_ym19_1_1484283548729_128835"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128836"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128837">2017-01-12T20:12:36.548980+00:00 encryptor4 pengine[2201]: notice: LogActions: Promote EncryptBase:0 (Slave -> Master encryptor4)</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128838"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128839">2017-01-12T20:12:36.549005+00:00 encryptor4 pengine[2201]: notice: LogActions: Stop EncryptBase:1 (encryptor5)</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128840"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128841">2017-01-12T20:12:36.550306+00:00 encryptor4 pengine[2201]: notice: process_pe_message: Calculated Transition 15: /var/lib/pacemaker/pengine/pe-input-15.bz2</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128842"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128843">2017-01-12T20:12:36.550958+00:00 encryptor4 crmd[2202]: notice: te_rsc_command: Initiating action 14: stop EncryptBase_stop_0 on encryptor5</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128844"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128845">2017-01-12T20:12:38.649416+00:00 encryptor4 crmd[2202]: notice: run_graph: Transition 15 (Complete=3, Pending=0, Fired=0, Skipped=4, Incomplete=1, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Stopped</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128846"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128847"><br id="yui_3_16_0_ym19_1_1484283548729_128848"><br id="yui_3_16_0_ym19_1_1484283548729_128849"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128850"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128851"> 2017-01-12T20:12:38.655686+00:00 encryptor4 pengine[2201]: notice: LogActions: Promote EncryptBase:0 (Slave -> Master encryptor4)</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128852"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128853">2017-01-12T20:12:38.655706+00:00 encryptor4 pengine[2201]: notice: LogActions: Start EncryptBase:1 (encryptor5)</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128854"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128855">2017-01-12T20:12:38.656696+00:00 encryptor4 pengine[2201]: notice: process_pe_message: Calculated Transition 16: /var/lib/pacemaker/pengine/pe-input-16.bz2</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128856"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128857">2017-01-12T20:12:38.657426+00:00 encryptor4 crmd[2202]: notice: te_rsc_command: Initiating action 14: start EncryptBase_start_0 on encryptor5</span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128858"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128859">2017-01-12T20:12:43.790672+00:00 encryptor4 crmd[2202]: notice: run_graph: Transition 16 (Complete=3, Pending=0, Fired=0, Skipped=4, Incomplete=1, Source=/var/lib/pacemaker/pengine/pe-input-16.bz2): Stopped</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128860"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128861"><br id="yui_3_16_0_ym19_1_1484283548729_128862"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128863"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128864">The promote action is never initiated, and the RA promote operation is never called. But the normal logs don't explain why.</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128865"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128866"><br id="yui_3_16_0_ym19_1_1484283548729_128867"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128868"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128869">The debug logs are overwhelming. Even if the answer is in there, I don’t think I can extract it from all the detail. I’ve tried looking at the dot files created by crm_simulate but they either aren’t being generated correctly or aren’t rendering correctly on my machine.</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128870"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128871"><br id="yui_3_16_0_ym19_1_1484283548729_128872"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128873"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128874">Any ideas what we need to do to get failover working again? I’m fine with leaving the formerly active node in a state where it requires manual intervention to get it going again. I just want the standby node to take over if an interface goes down.</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128875"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128876"><br id="yui_3_16_0_ym19_1_1484283548729_128877"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128878"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128879">Here is the configuration:</span></div><div id="yui_3_16_0_ym19_1_1484283548729_128880"><b style="font-weight:normal;" id="yui_3_16_0_ym19_1_1484283548729_128881"><br id="yui_3_16_0_ym19_1_1484283548729_128882"></b></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128883"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128884"> <configuration></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128885"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128886"> <crm_config></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128887"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128888"> <cluster_property_set id="cib-bootstrap-options"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128889"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128890"> <nvpair name="stonith-enabled" value="false" id="cib-bootstrap-options-stonith-enabled"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128891"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128892"> <nvpair name="no-quorum-policy" value="ignore" id="cib-bootstrap-options-no-quorum-policy"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128893"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128894"> <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1484336062"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128895"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128896"> </cluster_property_set></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128897"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128898"> </crm_config></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128899"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128900"> <nodes></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128901"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128902"> <node id="3232262401" uname="encryptor4"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128903"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128904"> <node id="3232262402" uname="encryptor5"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128905"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128906"> </nodes></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128907"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128908"> <resources></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128909"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128910"> <master id="Encryptor"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128911"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128912"> <meta_attributes id="Encryptor-meta_attributes"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128913"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128914"> <nvpair name="clone-max" value="2" id="Encryptor-meta_attributes-clone-max"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128915"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128916"> <nvpair name="clone-node-max" value="1" id="Encryptor-meta_attributes-clone-node-max"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128917"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128918"> <nvpair name="master-max" value="1" id="Encryptor-meta_attributes-master-max"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128919"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128920"> <nvpair name="notify" value="false" id="Encryptor-meta_attributes-notify"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128921"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128922"> <nvpair name="target-role" value="Master" id="Encryptor-meta_attributes-target-role"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128923"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128924"> </meta_attributes></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128925"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128926"> <primitive id="EncryptBase" class="ocf" provider="fnord" type="encryptor"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128927"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128928"> <operations></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128929"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128930"> <op name="start" interval="0s" timeout="20s" id="EncryptBase-start-0s"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128931"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128932"> <op name="monitor" interval="1s" role="Master" timeout="2s" id="EncryptBase-monitor-1s"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128933"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128934"> <op name="monitor" interval="2s" role="Slave" timeout="2s" id="EncryptBase-monitor-2s"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128935"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128936"> </operations></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128937"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128938"> </primitive></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128939"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128940"> </master></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128941"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128942"> <clone id="CredProxy"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128943"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128944"> <meta_attributes id="CredProxy-meta_attributes"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128945"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128946"> <nvpair name="clone-max" value="2" id="CredProxy-meta_attributes-clone-max"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128947"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128948"> <nvpair name="clone-node-max" value="1" id="CredProxy-meta_attributes-clone-node-max"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128949"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128950"> <nvpair name="notify" value="false" id="CredProxy-meta_attributes-notify"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128951"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128952"> <nvpair name="target-role" value="Started" id="CredProxy-meta_attributes-target-role"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128953"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128954"> </meta_attributes></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128955"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128956"> <primitive id="CredBase" class="ocf" provider="fnord" type="credproxy"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128957"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128958"> <operations></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128959"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128960"> <op name="start" interval="0s" timeout="20s" id="CredBase-start-0s"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128961"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128962"> <op name="monitor" interval="1s" timeout="2s" id="CredBase-monitor-1s"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128963"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128964"> </operations></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128965"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128966"> </primitive></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128967"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128968"> </clone></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128969"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128970"> <clone id="Ingress"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128971"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128972"> <meta_attributes id="Ingress-meta_attributes"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128973"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128974"> <nvpair name="clone-max" value="2" id="Ingress-meta_attributes-clone-max"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128975"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128976"> <nvpair name="clone-node-max" value="1" id="Ingress-meta_attributes-clone-node-max"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128977"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128978"> <nvpair name="notify" value="false" id="Ingress-meta_attributes-notify"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128979"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128980"> <nvpair name="target-role" value="Started" id="Ingress-meta_attributes-target-role"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128981"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128982"> </meta_attributes></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128983"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128984"> <primitive id="IngressBase" class="ocf" provider="fnord" type="interface"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128985"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128986"> <operations></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128987"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128988"> <op name="start" interval="0s" timeout="5s" id="IngressBase-start-0s"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128989"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128990"> <op name="monitor" interval="1s" timeout="1s" id="IngressBase-monitor-1s"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128991"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128992"> </operations></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128993"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128994"> <instance_attributes id="IngressBase-instance_attributes"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128995"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128996"> <nvpair name="interface" value="em1" id="IngressBase-instance_attributes-interface"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128997"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_128998"> <nvpair name="label" value="ingress" id="IngressBase-instance_attributes-label"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_128999"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129000"> <nvpair name="min_retries" value="5" id="IngressBase-instance_attributes-min_retries"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129001"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129002"> <nvpair name="max_retries" value="100" id="IngressBase-instance_attributes-max_retries"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129003"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129004"> </instance_attributes></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129005"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129006"> </primitive></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129007"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129008"> </clone></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129009"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129010"> <clone id="Egress"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129011"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129012"> <meta_attributes id="Egress-meta_attributes"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129013"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129014"> <nvpair name="clone-max" value="2" id="Egress-meta_attributes-clone-max"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129015"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129016"> <nvpair name="clone-node-max" value="1" id="Egress-meta_attributes-clone-node-max"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129017"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129018"> <nvpair name="notify" value="false" id="Egress-meta_attributes-notify"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129019"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129020"> <nvpair name="target-role" value="Started" id="Egress-meta_attributes-target-role"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129021"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129022"> </meta_attributes></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129023"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129024"> <primitive id="EgressBase" class="ocf" provider="fnord" type="interface"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129025"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129026"> <operations></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129027"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129028"> <op name="start" interval="0s" timeout="5s" id="EgressBase-start-0s"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129029"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129030"> <op name="monitor" interval="1s" timeout="1s" id="EgressBase-monitor-1s"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129031"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129032"> </operations></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129033"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129034"> <instance_attributes id="EgressBase-instance_attributes"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129035"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129036"> <nvpair name="interface" value="em2" id="EgressBase-instance_attributes-interface"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129037"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129038"> <nvpair name="label" value="egress" id="EgressBase-instance_attributes-label"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129039"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129040"> <nvpair name="min_retries" value="5" id="EgressBase-instance_attributes-min_retries"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129041"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129042"> <nvpair name="max_retries" value="100" id="EgressBase-instance_attributes-max_retries"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129043"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129044"> </instance_attributes></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129045"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129046"> </primitive></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129047"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129048"> </clone></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129049"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129050"> </resources></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129051"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129052"> <constraints></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129053"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129054"> <rsc_colocation id="encryptor-with-credproxy" score="INFINITY" rsc="Encryptor" rsc-role="Master" with-rsc="CredProxy" with-rsc-role="Started"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129055"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129056"> <rsc_colocation id="encryptor-with-ingress" score="INFINITY" rsc="Encryptor" rsc-role="Master" with-rsc="Ingress" with-rsc-role="Started"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129057"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129058"> <rsc_colocation id="encryptor-with-egress" score="INFINITY" rsc="Encryptor" rsc-role="Master" with-rsc="Egress" with-rsc-role="Started"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129059"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129060"> </constraints></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129061"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129062"> <rsc_defaults></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129063"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129064"> <meta_attributes id="rsc-options"></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129065"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129066"> <nvpair name="resource-stickiness" value="10" id="rsc-options-resource-stickiness"/></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129067"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129068"> </meta_attributes></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129069"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129070"> </rsc_defaults></span></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129071"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129072"> </configuration></span></div><div dir="ltr" id="yui_3_16_0_ym19_1_1484283548729_131271"><br id="yui_3_16_0_ym19_1_1484283548729_129073"><br id="yui_3_16_0_ym19_1_1484283548729_129074"></div><div dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;" id="yui_3_16_0_ym19_1_1484283548729_129075"><span style="font-size:14.666666666666666px;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;" id="yui_3_16_0_ym19_1_1484283548729_129076">Thanks for your time.</span></div></div></body></html>