<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <div class="moz-cite-prefix">On 07/24/2017 09:46 PM, Kristián
      Feldsam wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:3377E551-4048-48E7-8B6A-51D2A69BCB83@feldhost.cz">
      <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
      so why to use some other fencing method like disablink port on
      switch, so nobody can acces faultly node and write data to it. it
      is common practice too.<br class="">
    </blockquote>
    <br>
    Well don't get me wrong here. I don't want to hard-sell sbd.<br>
    Just though that very likely requirements that prevent usage<br>
    of a remote-controlled power-switch will make access<br>
    to a switch to disable the ports unusable as well.<br>
    And if a working qdevice setup is there already the gap between<br>
    what he thought he would get from qdevice and what he actually<br>
    had just matches exactly quorum-based-watchdog-fencing.<br>
    <br>
    But you are of course right.<br>
    I don't really know the scenario.<br>
    Maybe fabric fencing is the perfect match - good to mention it<br>
    here as a possibility.<br>
    <br>
    Regards,<br>
    Klaus<br>
      <br>
    <blockquote type="cite"
      cite="mid:3377E551-4048-48E7-8B6A-51D2A69BCB83@feldhost.cz">
      <div class="">
        <br class="Apple-interchange-newline">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">S pozdravem Kristián Feldsam</span><br
          style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">Tel.: +420 773 303 353, +421 944 137 535</span><br
          style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">E-mail.: <a
            href="mailto:support@feldhost.cz" class=""
            moz-do-not-send="true">support@feldhost.cz</a></span><br
          style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <br style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class=""><a href="http://www.feldhost.cz"
            class="" moz-do-not-send="true">www.feldhost.cz</a> -<span
            class="Apple-converted-space"> </span></span><span
          style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; letter-spacing: normal; text-align: start;
          text-indent: 0px; text-transform: none; white-space: normal;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          font-weight: bold;" class="">Feld</span><span style="color:
          rgb(0, 0, 0); font-family: Baskerville; font-size: 16px;
          font-style: normal; font-variant-caps: normal; font-weight:
          normal; letter-spacing: normal; text-align: start;
          text-indent: 0px; text-transform: none; white-space: normal;
          word-spacing: 0px; -webkit-text-stroke-width: 0px; float:
          none; display: inline !important;" class="">Host</span><span
          style="color: rgb(0, 0, 0); font-variant-caps: normal;
          letter-spacing: normal; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">™</span><span style="color: rgb(0, 0,
          0); font-family: Baskerville; font-size: 16px; font-style:
          normal; font-variant-caps: normal; font-weight: normal;
          letter-spacing: normal; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class=""><span class="Apple-converted-space"> </span>–
          profesionální hostingové a serverové služby za adekvátní ceny.</span><br
          style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <br style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">FELDSAM s.r.o.</span><br style="color:
          rgb(0, 0, 0); font-family: Baskerville; font-size: 16px;
          font-style: normal; font-variant-caps: normal; font-weight:
          normal; letter-spacing: normal; text-align: start;
          text-indent: 0px; text-transform: none; white-space: normal;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">V rohu 434/3</span><br style="color:
          rgb(0, 0, 0); font-family: Baskerville; font-size: 16px;
          font-style: normal; font-variant-caps: normal; font-weight:
          normal; letter-spacing: normal; text-align: start;
          text-indent: 0px; text-transform: none; white-space: normal;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">Praha 4 – Libuš, PSČ 142 00</span><br
          style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">IČ: 290 60 958, DIČ: CZ290 60 958</span><br
          style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">C 200350 vedená u Městského soudu v
          Praze</span><br style="color: rgb(0, 0, 0); font-family:
          Baskerville; font-size: 16px; font-style: normal;
          font-variant-caps: normal; font-weight: normal;
          letter-spacing: normal; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <br style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">Banka: Fio banka a.s.</span><br
          style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">Číslo účtu: 2400330446/2010</span><br
          style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">BIC: FIOBCZPPXX</span><br style="color:
          rgb(0, 0, 0); font-family: Baskerville; font-size: 16px;
          font-style: normal; font-variant-caps: normal; font-weight:
          normal; letter-spacing: normal; text-align: start;
          text-indent: 0px; text-transform: none; white-space: normal;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
        <span style="color: rgb(0, 0, 0); font-family: Baskerville;
          font-size: 16px; font-style: normal; font-variant-caps:
          normal; font-weight: normal; letter-spacing: normal;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; float: none; display: inline
          !important;" class="">IBAN: CZ82 2010 0000 0024 0033 0446</span>
      </div>
      <br class="">
      <div>
        <blockquote type="cite" class="">
          <div class="">On 24 Jul 2017, at 21:16, Klaus Wenninger <<a
              href="mailto:kwenning@redhat.com" class=""
              moz-do-not-send="true">kwenning@redhat.com</a>> wrote:</div>
          <br class="Apple-interchange-newline">
          <div class="">
            <div class="moz-cite-prefix" style="font-family:
              Baskerville; font-size: 16px; font-style: normal;
              font-variant-caps: normal; font-weight: normal;
              letter-spacing: normal; text-align: start; text-indent:
              0px; text-transform: none; white-space: normal;
              word-spacing: 0px; -webkit-text-stroke-width: 0px;
              background-color: rgb(255, 255, 255);">On 07/24/2017 08:27
              PM, Prasad, Shashank wrote:<br class="">
            </div>
            <blockquote type="cite"
              cite="mid:8A8F98BF0CDFD5438985D4397358E6C7ECC85F@idc.vanu.com"
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; orphans:
              auto; text-align: start; text-indent: 0px; text-transform:
              none; white-space: normal; widows: auto; word-spacing:
              0px; -webkit-text-size-adjust: auto;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
              <div class="WordSection1" style="page: WordSection1;">
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class="">My
                    understanding is that  SBD will need a shared
                    storage between clustered nodes.<o:p class=""></o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class="">And
                    that, SBD will need at least 3 nodes in a cluster,
                    if using w/o shared storage.</span></div>
              </div>
            </blockquote>
            <br style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">Haven't tried to be honest but reason for 3 nodes
              is that without</span><br style="font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              text-align: start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">shared disk you need a real quorum-source and not
              something</span><br style="font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              text-align: start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">'faked' as with 2-node-feature in corosync.</span><br
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">But I don't see anything speaking against getting
              the proper</span><br style="font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              text-align: start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">quorum via qdevice instead with a third full
              cluster-node.</span><br style="font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              text-align: start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <br style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <blockquote type="cite"
              cite="mid:8A8F98BF0CDFD5438985D4397358E6C7ECC85F@idc.vanu.com"
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; orphans:
              auto; text-align: start; text-indent: 0px; text-transform:
              none; white-space: normal; widows: auto; word-spacing:
              0px; -webkit-text-size-adjust: auto;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
              <div class="WordSection1" style="page: WordSection1;">
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class=""><o:p
                      class=""></o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class=""><o:p
                      class=""> </o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class="">Therefore,
                    for systems which do NOT use shared storage between
                    1+1 HA clustered nodes, SBD may NOT be an option.<o:p
                      class=""></o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class="">Correct
                    me, if I am wrong.<o:p class=""></o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class=""><o:p
                      class=""> </o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class="">For
                    cluster systems using the likes of iDRAC/IMM2
                    fencing agents, which have redundant but shared
                    power supply units with the nodes, the normal
                    fencing mechanisms should work for all resiliency
                    scenarios, but for IMM2/iDRAC are being NOT
                    reachable for whatsoever reasons. And, to bail out
                    of those situations in the absence of SBD, I believe
                    using used-defined failover hooks (via scripts) into
                    Pacemaker Alerts, with sudo permissions for
                    ‘hacluster’, should help.</span></div>
              </div>
            </blockquote>
            <br style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">If you don't see your fencing device assuming
              after some time</span><br style="font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              text-align: start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">the the corresponding node will probably be down
              is quite risky</span><br style="font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              text-align: start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">in my opinion.</span><br style="font-family:
              Baskerville; font-size: 16px; font-style: normal;
              font-variant-caps: normal; font-weight: normal;
              letter-spacing: normal; text-align: start; text-indent:
              0px; text-transform: none; white-space: normal;
              word-spacing: 0px; -webkit-text-stroke-width: 0px;
              background-color: rgb(255, 255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">But why not assure it to be down using a
              watchdog?</span><br style="font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              text-align: start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <br style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <blockquote type="cite"
              cite="mid:8A8F98BF0CDFD5438985D4397358E6C7ECC85F@idc.vanu.com"
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; orphans:
              auto; text-align: start; text-indent: 0px; text-transform:
              none; white-space: normal; widows: auto; word-spacing:
              0px; -webkit-text-size-adjust: auto;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
              <div class="WordSection1" style="page: WordSection1;">
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class=""><o:p
                      class=""></o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class=""><o:p
                      class=""> </o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class="">Thanx.<o:p
                      class=""></o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class=""><o:p
                      class=""> </o:p></span></div>
                <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                  font-family: 'Times New Roman', serif;" class=""><span
                    style="font-size: 11pt; font-family: Calibri,
                    sans-serif; color: rgb(31, 73, 125);" class=""><o:p
                      class=""> </o:p></span></div>
                <div style="border-style: none none none solid;
                  border-left-width: 1.5pt; border-left-color: blue;
                  padding: 0in 0in 0in 4pt;" class="">
                  <div class="">
                    <div style="border-style: solid none none;
                      border-top-width: 1pt; border-top-color: rgb(181,
                      196, 223); padding: 3pt 0in 0in;" class="">
                      <div style="margin: 0in 0in 0.0001pt; font-size:
                        12pt; font-family: 'Times New Roman', serif;"
                        class=""><b class=""><span style="font-size:
                            10pt; font-family: Tahoma, sans-serif;
                            color: windowtext;" class="">From:</span></b><span
                          style="font-size: 10pt; font-family: Tahoma,
                          sans-serif; color: windowtext;" class=""><span
                            class="Apple-converted-space"> </span>Klaus
                          Wenninger [<a class="moz-txt-link-freetext"
                            href="mailto:kwenning@redhat.com"
                            style="color: purple; text-decoration:
                            underline;" moz-do-not-send="true">mailto:kwenning@redhat.com</a>]<span
                            class="Apple-converted-space"> </span><br
                            class="">
                          <b class="">Sent:</b><span
                            class="Apple-converted-space"> </span>Monday,
                          July 24, 2017 11:31 PM<br class="">
                          <b class="">To:</b><span
                            class="Apple-converted-space"> </span>Cluster
                          Labs - All topics related to open-source
                          clustering welcomed; Prasad, Shashank<br
                            class="">
                          <b class="">Subject:</b><span
                            class="Apple-converted-space"> </span>Re:
                          [ClusterLabs] Two nodes cluster issue<o:p
                            class=""></o:p></span></div>
                    </div>
                  </div>
                  <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                    font-family: 'Times New Roman', serif;" class=""><o:p
                      class=""> </o:p></div>
                  <div class="">
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class="">On 07/24/2017 07:32 PM, Prasad, Shashank
                      wrote:<o:p class=""></o:p></div>
                  </div>
                  <blockquote style="margin-top: 5pt; margin-bottom:
                    5pt;" class="">
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class="">Sometimes IPMI fence devices
                        use shared power of the node, and it cannot be
                        avoided.</span><o:p class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class="">In such scenarios the HA
                        cluster is NOT able to handle the power failure
                        of a node, since the power is shared with its
                        own fence device.</span><o:p class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class="">The failure of IPMI based
                        fencing can also exist due to other reasons
                        also.</span><o:p class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class=""> </span><o:p class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class="">A failure to fence the
                        failed node will cause cluster to be marked
                        UNCLEAN.</span><o:p class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class="">To get over it, the
                        following command needs to be invoked on the
                        surviving node.</span><o:p class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class=""> </span><o:p class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class="">pcs stonith confirm
                        <failed_node_name> --force</span><o:p
                        class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class=""> </span><o:p class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class="">This can be automated by
                        hooking a recovery script, when the the Stonith
                        resource ‘Timed Out’ event.</span><o:p class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class="">To be more specific, the
                        Pacemaker Alerts can be used for watch for
                        Stonith timeouts and failures.</span><o:p
                        class=""></o:p></div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><span style="font-size: 11pt;
                        font-family: Calibri, sans-serif; color: rgb(31,
                        73, 125);" class="">In that script, all that’s
                        essentially to be executed is the aforementioned
                        command.</span><o:p class=""></o:p></div>
                  </blockquote>
                  <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                    font-family: 'Times New Roman', serif;" class=""><br
                      class="">
                    If I get you right here you can disable fencing then
                    in the first place.<br class="">
                    Actually quorum-based-watchdog-fencing is the way to
                    do this in a<br class="">
                    safe manner. This of course assumes you have a
                    proper source for<br class="">
                    quorum in your 2-node-setup with e.g. qdevice or
                    using a shared<br class="">
                    disk with sbd (not directly pacemaker quorum here
                    but similar thing<br class="">
                    handled inside sbd).<br class="">
                    <br class="">
                    <br class="">
                    <o:p class=""></o:p></div>
                  <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                    font-family: 'Times New Roman', serif;" class=""><span
                      style="font-size: 11pt; font-family: Calibri,
                      sans-serif; color: rgb(31, 73, 125);" class="">Since
                      the alerts are issued from ‘hacluster’ login, sudo
                      permissions for ‘hacluster’ needs to be
                      configured.</span><o:p class=""></o:p></div>
                  <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                    font-family: 'Times New Roman', serif;" class=""><span
                      style="font-size: 11pt; font-family: Calibri,
                      sans-serif; color: rgb(31, 73, 125);" class=""> </span><o:p
                      class=""></o:p></div>
                  <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                    font-family: 'Times New Roman', serif;" class=""><span
                      style="font-size: 11pt; font-family: Calibri,
                      sans-serif; color: rgb(31, 73, 125);" class="">Thanx.</span><o:p
                      class=""></o:p></div>
                  <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                    font-family: 'Times New Roman', serif;" class=""><span
                      style="font-size: 11pt; font-family: Calibri,
                      sans-serif; color: rgb(31, 73, 125);" class=""> </span><o:p
                      class=""></o:p></div>
                  <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                    font-family: 'Times New Roman', serif;" class=""><span
                      style="font-size: 11pt; font-family: Calibri,
                      sans-serif; color: rgb(31, 73, 125);" class=""> </span><o:p
                      class=""></o:p></div>
                  <div style="border-style: none none none solid;
                    border-left-width: 1.5pt; border-left-color: blue;
                    padding: 0in 0in 0in 4pt;" class="">
                    <div class="">
                      <div style="border-style: solid none none;
                        border-top-width: 1pt; border-top-color:
                        rgb(181, 196, 223); padding: 3pt 0in 0in;"
                        class="">
                        <div style="margin: 0in 0in 0.0001pt; font-size:
                          12pt; font-family: 'Times New Roman', serif;"
                          class=""><b class=""><span style="font-size:
                              10pt; font-family: Tahoma, sans-serif;
                              color: windowtext;" class="">From:</span></b><span
                            style="font-size: 10pt; font-family: Tahoma,
                            sans-serif; color: windowtext;" class=""><span
                              class="Apple-converted-space"> </span>Klaus
                            Wenninger [<a
                              href="mailto:kwenning@redhat.com"
                              moz-do-not-send="true" style="color:
                              purple; text-decoration: underline;"
                              class="">mailto:kwenning@redhat.com</a>]<span
                              class="Apple-converted-space"> </span><br
                              class="">
                            <b class="">Sent:</b><span
                              class="Apple-converted-space"> </span>Monday,
                            July 24, 2017 9:24 PM<br class="">
                            <b class="">To:</b><span
                              class="Apple-converted-space"> </span>Kristián
                            Feldsam; Cluster Labs - All topics related
                            to open-source clustering welcomed<br
                              class="">
                            <b class="">Subject:</b><span
                              class="Apple-converted-space"> </span>Re:
                            [ClusterLabs] Two nodes cluster issue</span><o:p
                            class=""></o:p></div>
                      </div>
                    </div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""> <o:p class=""></o:p></div>
                    <div class="">
                      <div style="margin: 0in 0in 0.0001pt; font-size:
                        12pt; font-family: 'Times New Roman', serif;"
                        class="">On 07/24/2017 05:37 PM, Kristián
                        Feldsam wrote:<o:p class=""></o:p></div>
                    </div>
                    <blockquote style="margin-top: 5pt; margin-bottom:
                      5pt;" class="">
                      <div style="margin: 0in 0in 0.0001pt; font-size:
                        12pt; font-family: 'Times New Roman', serif;"
                        class="">I personally think that power off node
                        by switched pdu is more safe, or not?<o:p
                          class=""></o:p></div>
                    </blockquote>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""><br class="">
                      True if that is working in you environment. If you
                      can't do a physical setup<br class="">
                      where you aren't simultaneously loosing connection
                      to both your node and<br class="">
                      the switch-device (or you just want to cover cases
                      where that happens)<br class="">
                      you have to come up with something else.<br
                        class="">
                      <br class="">
                      <br class="">
                      <br class="">
                      <o:p class=""></o:p></div>
                    <div class="">
                      <div style="margin: 0in 0in 0.0001pt; font-size:
                        12pt; font-family: 'Times New Roman', serif;"
                        class=""><br class="">
                        <span style="font-family: Baskerville, serif;"
                          class="">S pozdravem Kristián Feldsam<br
                            class="">
                          Tel.: +420 773 303 353, +421 944 137 535<br
                            class="">
                          E-mail.:<span class="Apple-converted-space"> </span><a
                            href="mailto:support@feldhost.cz"
                            moz-do-not-send="true" style="color: purple;
                            text-decoration: underline;" class="">support@feldhost.cz</a><br
                            class="">
                          <br class="">
                          <a href="http://www.feldhost.cz/"
                            moz-do-not-send="true" style="color: purple;
                            text-decoration: underline;" class="">www.feldhost.cz</a><span
                            class="Apple-converted-space"> </span>-<span
                            class="apple-converted-space"> </span><b
                            class="">Feld</b>Host</span>™<span
                          class="apple-converted-space"><span
                            style="font-family: Baskerville, serif;"
                            class=""> </span></span><span
                          style="font-family: Baskerville, serif;"
                          class="">– profesionální hostingové a
                          serverové služby za adekvátní ceny.<br
                            class="">
                          <br class="">
                          FELDSAM s.r.o.<br class="">
                          V rohu 434/3<br class="">
                          Praha 4 – Libuš, PSČ 142 00<br class="">
                          IČ: 290 60 958, DIČ: CZ290 60 958<br class="">
                          C 200350 vedená u Městského soudu v Praze<br
                            class="">
                          <br class="">
                          Banka: Fio banka a.s.<br class="">
                          Číslo účtu: 2400330446/2010<br class="">
                          BIC: FIOBCZPPXX<br class="">
                          IBAN: CZ82 2010 0000 0024 0033 0446</span><o:p
                          class=""></o:p></div>
                    </div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""> <o:p class=""></o:p></div>
                    <div class="">
                      <blockquote style="margin-top: 5pt; margin-bottom:
                        5pt;" class="">
                        <div class="">
                          <div style="margin: 0in 0in 0.0001pt;
                            font-size: 12pt; font-family: 'Times New
                            Roman', serif;" class="">On 24 Jul 2017, at
                            17:27, Klaus Wenninger <<a
                              href="mailto:kwenning@redhat.com"
                              moz-do-not-send="true" style="color:
                              purple; text-decoration: underline;"
                              class="">kwenning@redhat.com</a>>
                            wrote:<o:p class=""></o:p></div>
                        </div>
                        <div style="margin: 0in 0in 0.0001pt; font-size:
                          12pt; font-family: 'Times New Roman', serif;"
                          class=""> <o:p class=""></o:p></div>
                        <div class="">
                          <div class="">
                            <div style="margin: 0in 0in 0.0001pt;
                              font-size: 12pt; font-family: 'Times New
                              Roman', serif; background-color: white;"
                              class=""><span style="font-family:
                                Baskerville, serif;" class="">On
                                07/24/2017 05:15 PM, Tomer Azran wrote:</span><o:p
                                class=""></o:p></div>
                          </div>
                          <blockquote style="margin-top: 5pt;
                            margin-bottom: 5pt; font-variant-caps:
                            normal; text-align: start;
                            -webkit-text-stroke-width: 0px;
                            background-color: rgb(255, 255, 255);
                            word-spacing: 0px;" class="">
                            <div class="">
                              <div style="margin: 0in 0in 0.0001pt;
                                font-size: 12pt; font-family: 'Times New
                                Roman', serif; background-color: white;"
                                class=""><span style="font-size: 11pt;
                                  font-family: Arial, sans-serif;"
                                  class="">I still don't understand why
                                  the qdevice concept doesn't help on
                                  this situation. Since the master node
                                  is down, I would expect the quorum to
                                  declare it as dead.</span><o:p
                                  class=""></o:p></div>
                            </div>
                            <div class="">
                              <div style="margin: 0in 0in 0.0001pt;
                                font-size: 12pt; font-family: 'Times New
                                Roman', serif; background-color: white;"
                                class=""><span style="font-size: 11pt;
                                  font-family: Arial, sans-serif;"
                                  class="">Why doesn't it happens?</span><o:p
                                  class=""></o:p></div>
                            </div>
                          </blockquote>
                          <div style="margin: 0in 0in 0.0001pt;
                            font-size: 12pt; font-family: 'Times New
                            Roman', serif;" class=""><span
                              style="font-family: Baskerville, serif;"
                              class=""><br class="">
                              That is not how quorum works. It just
                              limits the decision-making to the quorate
                              subset of the cluster.<br class="">
                              Still the unknown nodes are not sure to be
                              down.<br class="">
                              That is why I suggested to have
                              quorum-based watchdog-fencing with sbd.<br
                                class="">
                              That would assure that within a certain
                              time all nodes of the non-quorate part<br
                                class="">
                              of the cluster are down.<br class="">
                              <br class="">
                              <br class="">
                              <br class="">
                            </span><o:p class=""></o:p></div>
                          <p class="MsoNormal" style="margin: 0in 0in
                            12pt; font-size: 12pt; font-family: 'Times
                            New Roman', serif;"><span
                              style="font-family: Baskerville, serif;"
                              class=""><br class="">
                              <br class="">
                              <br class="">
                            </span><o:p class=""></o:p></p>
                          <div class="">
                            <p class="MsoNormal" style="margin: 0in 0in
                              12pt; font-size: 12pt; font-family: 'Times
                              New Roman', serif;"><span
                                style="font-family: Baskerville, serif;"
                                class="">On Mon, Jul 24, 2017 at 4:15 PM
                                +0300, "Dmitri Maziuk"<span
                                  class="apple-converted-space"> </span><<a
                                  href="mailto:dmitri.maziuk@gmail.com"
                                  target="_blank" moz-do-not-send="true"
                                  style="color: purple; text-decoration:
                                  underline;" class="">dmitri.maziuk@gmail.com</a>><span
                                  class="apple-converted-space"> </span>wrote:</span><o:p
                                class=""></o:p></p>
                            <div class="">
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">On 2017-07-24 07:51, Tomer Azran wrote:<o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">> We don't have the ability to use it.<o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">> Is that the only solution?<o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class=""> <o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">No, but I'd recommend thinking about it first. Are you sure you will <o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">care about your cluster working when your server room is on fire? 'Cause <o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">unless you have halon suppression, your server room is a complete <o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">write-off anyway. (Think water from sprinklers hitting rich chunky volts <o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">in the servers.)<o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class=""> <o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Dima<o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class=""> <o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">_______________________________________________<o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Users mailing list: <a href="mailto:Users@clusterlabs.org" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">Users@clusterlabs.org</a><o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class=""><a href="http://lists.clusterlabs.org/mailman/listinfo/users" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://lists.clusterlabs.org/mailman/listinfo/users</a><o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class=""> <o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Project Home: <a href="http://www.clusterlabs.org/" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://www.clusterlabs.org</a><o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><o:p class=""></o:p></pre>
                              <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Bugs: <a href="http://bugs.clusterlabs.org/" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://bugs.clusterlabs.org</a><o:p class=""></o:p></pre>
                            </div>
                          </div>
                          <div style="margin: 0in 0in 0.0001pt;
                            font-size: 12pt; font-family: 'Times New
                            Roman', serif;" class=""><span
                              style="font-family: Baskerville, serif;"
                              class=""><br class="">
                              <br class="">
                              <br class="">
                              <br class="">
                            </span><o:p class=""></o:p></div>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">_______________________________________________<o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Users mailing list: <a href="mailto:Users@clusterlabs.org" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">Users@clusterlabs.org</a><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class=""><a href="http://lists.clusterlabs.org/mailman/listinfo/users" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://lists.clusterlabs.org/mailman/listinfo/users</a><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class=""> <o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Project Home: <a href="http://www.clusterlabs.org/" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://www.clusterlabs.org</a><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Bugs: <a href="http://bugs.clusterlabs.org/" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://bugs.clusterlabs.org</a><o:p class=""></o:p></pre>
                          <div style="margin: 0in 0in 0.0001pt;
                            font-size: 12pt; font-family: 'Times New
                            Roman', serif; font-variant-caps: normal;
                            text-align: start;
                            -webkit-text-stroke-width: 0px;
                            background-color: rgb(255, 255, 255);
                            word-spacing: 0px;" class=""><span
                              style="font-family: Baskerville, serif;"
                              class=""> </span><o:p class=""></o:p></div>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; background-color: white; font-variant-caps: normal; text-align: start; -webkit-text-stroke-width: 0px; word-spacing: 0px;" class=""><span style="font-size: 12pt;" class="">-- </span><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; background-color: white;" class=""><span style="font-size: 12pt;" class="">Klaus Wenninger</span><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; background-color: white;" class=""><span style="font-size: 12pt;" class=""> </span><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; background-color: white;" class=""><span style="font-size: 12pt;" class="">Senior Software Engineer, EMEA ENG Openstack Infrastructure</span><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; background-color: white;" class=""><span style="font-size: 12pt;" class=""> </span><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; background-color: white;" class=""><span style="font-size: 12pt;" class="">Red Hat</span><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; background-color: white;" class=""><span style="font-size: 12pt;" class=""> </span><o:p class=""></o:p></pre>
                          <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; background-color: white;" class=""><span style="font-size: 12pt;" class=""><a href="mailto:kwenning@redhat.com" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">kwenning@redhat.com</a>   </span><o:p class=""></o:p></pre>
                          <div style="margin: 0in 0in 0.0001pt;
                            font-size: 12pt; font-family: 'Times New
                            Roman', serif;" class=""><span
                              style="font-family: Baskerville, serif;"
                              class="">_______________________________________________<br
                                class="">
                              Users mailing list:<span
                                class="apple-converted-space"> </span></span><a
                              href="mailto:Users@clusterlabs.org"
                              moz-do-not-send="true" style="color:
                              purple; text-decoration: underline;"
                              class=""><span style="font-family:
                                Baskerville, serif; background-color:
                                white; background-position: initial
                                initial; background-repeat: initial
                                initial;" class="">Users@clusterlabs.org</span></a><span
                              style="font-family: Baskerville, serif;"
                              class=""><br class="">
                            </span><a
                              href="http://lists.clusterlabs.org/mailman/listinfo/users"
                              moz-do-not-send="true" style="color:
                              purple; text-decoration: underline;"
                              class=""><span style="font-family:
                                Baskerville, serif;" class="">http://lists.clusterlabs.org/mailman/listinfo/users</span></a><span
                              style="font-family: Baskerville, serif;"
                              class=""><br class="">
                              <br class="">
                              Project Home:<span
                                class="apple-converted-space"> </span></span><a
                              href="http://www.clusterlabs.org/"
                              moz-do-not-send="true" style="color:
                              purple; text-decoration: underline;"
                              class=""><span style="font-family:
                                Baskerville, serif; background-color:
                                white; background-position: initial
                                initial; background-repeat: initial
                                initial;" class="">http://www.clusterlabs.org</span></a><span
                              style="font-family: Baskerville, serif;"
                              class=""><br class="">
                              Getting started:<span
                                class="apple-converted-space"> </span></span><a
href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf"
                              moz-do-not-send="true" style="color:
                              purple; text-decoration: underline;"
                              class=""><span style="font-family:
                                Baskerville, serif;" class="">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</span></a><span
                              style="font-family: Baskerville, serif;"
                              class=""><br class="">
                              Bugs:<span class="apple-converted-space"> </span></span><a
                              href="http://bugs.clusterlabs.org/"
                              moz-do-not-send="true" style="color:
                              purple; text-decoration: underline;"
                              class=""><span style="font-family:
                                Baskerville, serif; background-color:
                                white; background-position: initial
                                initial; background-repeat: initial
                                initial;" class="">http://bugs.clusterlabs.org</span></a><o:p
                              class=""></o:p></div>
                        </div>
                      </blockquote>
                    </div>
                    <div style="margin: 0in 0in 0.0001pt; font-size:
                      12pt; font-family: 'Times New Roman', serif;"
                      class=""> <o:p class=""></o:p></div>
                  </div>
                  <div style="margin: 0in 0in 0.0001pt; font-size: 12pt;
                    font-family: 'Times New Roman', serif;" class=""><br
                      class="">
                    <br class="">
                    <br class="">
                    <o:p class=""></o:p></div>
                  <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">_______________________________________________<o:p class=""></o:p></pre>
                  <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Users mailing list: <a href="mailto:Users@clusterlabs.org" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">Users@clusterlabs.org</a><o:p class=""></o:p></pre>
                  <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class=""><a href="http://lists.clusterlabs.org/mailman/listinfo/users" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://lists.clusterlabs.org/mailman/listinfo/users</a><o:p class=""></o:p></pre>
                  <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class=""><o:p class=""> </o:p></pre>
                  <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Project Home: <a href="http://www.clusterlabs.org/" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://www.clusterlabs.org</a><o:p class=""></o:p></pre>
                  <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><o:p class=""></o:p></pre>
                  <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">Bugs: <a href="http://bugs.clusterlabs.org/" moz-do-not-send="true" style="color: purple; text-decoration: underline;" class="">http://bugs.clusterlabs.org</a><o:p class=""></o:p></pre>
                  <pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New';" class="">  <o:p class=""></o:p></pre>
                </div>
              </div>
            </blockquote>
            <br style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">_______________________________________________</span><br
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">Users mailing list:<span
                class="Apple-converted-space"> </span></span><a
              href="mailto:Users@clusterlabs.org" style="color: purple;
              text-decoration: underline; font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              orphans: auto; text-align: start; text-indent: 0px;
              text-transform: none; white-space: normal; widows: auto;
              word-spacing: 0px; -webkit-text-size-adjust: auto;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="" moz-do-not-send="true">Users@clusterlabs.org</a><br
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <a
              href="http://lists.clusterlabs.org/mailman/listinfo/users"
              style="color: purple; text-decoration: underline;
              font-family: Baskerville; font-size: 16px; font-style:
              normal; font-variant-caps: normal; font-weight: normal;
              letter-spacing: normal; orphans: auto; text-align: start;
              text-indent: 0px; text-transform: none; white-space:
              normal; widows: auto; word-spacing: 0px;
              -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
              0px; background-color: rgb(255, 255, 255);" class=""
              moz-do-not-send="true">http://lists.clusterlabs.org/mailman/listinfo/users</a><br
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <br style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">Project Home:<span class="Apple-converted-space"> </span></span><a
              href="http://www.clusterlabs.org/" style="color: purple;
              text-decoration: underline; font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              orphans: auto; text-align: start; text-indent: 0px;
              text-transform: none; white-space: normal; widows: auto;
              word-spacing: 0px; -webkit-text-size-adjust: auto;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="" moz-do-not-send="true">http://www.clusterlabs.org</a><br
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">Getting started:<span
                class="Apple-converted-space"> </span></span><a
              href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf"
              style="color: purple; text-decoration: underline;
              font-family: Baskerville; font-size: 16px; font-style:
              normal; font-variant-caps: normal; font-weight: normal;
              letter-spacing: normal; orphans: auto; text-align: start;
              text-indent: 0px; text-transform: none; white-space:
              normal; widows: auto; word-spacing: 0px;
              -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
              0px; background-color: rgb(255, 255, 255);" class=""
              moz-do-not-send="true">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
            <span style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255); float: none; display: inline !important;"
              class="">Bugs:<span class="Apple-converted-space"> </span></span><a
              href="http://bugs.clusterlabs.org/" style="color: purple;
              text-decoration: underline; font-family: Baskerville;
              font-size: 16px; font-style: normal; font-variant-caps:
              normal; font-weight: normal; letter-spacing: normal;
              orphans: auto; text-align: start; text-indent: 0px;
              text-transform: none; white-space: normal; widows: auto;
              word-spacing: 0px; -webkit-text-size-adjust: auto;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="" moz-do-not-send="true">http://bugs.clusterlabs.org</a><br
              style="font-family: Baskerville; font-size: 16px;
              font-style: normal; font-variant-caps: normal;
              font-weight: normal; letter-spacing: normal; text-align:
              start; text-indent: 0px; text-transform: none;
              white-space: normal; word-spacing: 0px;
              -webkit-text-stroke-width: 0px; background-color: rgb(255,
              255, 255);" class="">
          </div>
        </blockquote>
      </div>
      <br class="">
    </blockquote>
    <br>
  </body>
</html>