<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <div class="moz-cite-prefix">Did you try VDO in sync-mode for the
      case the flush-fua</div>
    <div class="moz-cite-prefix">stuff isn't working through the layers?</div>
    <div class="moz-cite-prefix">Did you check that VDO-service is
      disabled and solely under</div>
    <div class="moz-cite-prefix">pacemaker-control and that the
      dependencies are set correctly?</div>
    <div class="moz-cite-prefix"><br>
    </div>
    <div class="moz-cite-prefix">Klaus<br>
    </div>
    <div class="moz-cite-prefix"><br>
    </div>
    <div class="moz-cite-prefix">On 5/17/21 6:17 AM, Eric Robinson
      wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:SA2PR03MB5884E2AD09473F913B1659BAFA2D9@SA2PR03MB5884.namprd03.prod.outlook.com">
      <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
      <meta name="Generator" content="Microsoft Word 15 (filtered
        medium)">
      <style>@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}@font-face
        {font-family:Roboto;}p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        font-size:11.0pt;
        font-family:"Calibri",sans-serif;}a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}p.yiv0265739749msonormal, li.yiv0265739749msonormal, div.yiv0265739749msonormal
        {mso-style-name:yiv0265739749msonormal;
        mso-margin-top-alt:auto;
        margin-right:0in;
        mso-margin-bottom-alt:auto;
        margin-left:0in;
        font-size:11.0pt;
        font-family:"Calibri",sans-serif;}p.yiv0265739749msonormal4, li.yiv0265739749msonormal4, div.yiv0265739749msonormal4
        {mso-style-name:yiv0265739749msonormal4;
        mso-margin-top-alt:auto;
        margin-right:0in;
        mso-margin-bottom-alt:auto;
        margin-left:0in;
        font-size:11.0pt;
        font-family:"Arial",sans-serif;}p.yiv0265739749msonormal31, li.yiv0265739749msonormal31, div.yiv0265739749msonormal31
        {mso-style-name:yiv0265739749msonormal31;
        mso-margin-top-alt:auto;
        margin-right:0in;
        mso-margin-bottom-alt:auto;
        margin-left:0in;
        font-size:11.0pt;
        font-family:"Arial",sans-serif;}span.EmailStyle32
        {mso-style-type:personal-reply;
        font-family:"Calibri",sans-serif;
        color:windowtext;}.MsoChpDefault
        {mso-style-type:export-only;
        font-family:"Calibri",sans-serif;}div.WordSection1
        {page:WordSection1;}</style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
      <div class="WordSection1">
        <p class="MsoNormal">Yes, DRBD is working fine. <o:p></o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <div style="border:none;border-left:solid blue 1.5pt;padding:0in
          0in 0in 4.0pt">
          <div>
            <div style="border:none;border-top:solid #E1E1E1
              1.0pt;padding:3.0pt 0in 0in 0in">
              <p class="MsoNormal"><b>From:</b> Strahil Nikolov
                <a class="moz-txt-link-rfc2396E" href="mailto:hunter86_bg@yahoo.com"><hunter86_bg@yahoo.com></a> <br>
                <b>Sent:</b> Sunday, May 16, 2021 6:06 PM<br>
                <b>To:</b> Eric Robinson
                <a class="moz-txt-link-rfc2396E" href="mailto:eric.robinson@psmnv.com"><eric.robinson@psmnv.com></a>; Cluster Labs - All
                topics related to open-source clustering welcomed
                <a class="moz-txt-link-rfc2396E" href="mailto:users@clusterlabs.org"><users@clusterlabs.org></a><br>
                <b>Subject:</b> RE: [ClusterLabs] DRBD + VDO HowTo?<o:p></o:p></p>
            </div>
          </div>
          <p class="MsoNormal"><o:p> </o:p></p>
          <p class="MsoNormal">Are you sure that the DRBD is working
            properly ?<o:p></o:p></p>
          <div id="yMail_cursorElementTracker_1621206371208">
            <p class="MsoNormal"><o:p> </o:p></p>
          </div>
          <div id="yMail_cursorElementTracker_1621206371394">
            <p class="MsoNormal">Best Regards,<o:p></o:p></p>
          </div>
          <div id="yMail_cursorElementTracker_1621206375706">
            <p class="MsoNormal" style="margin-bottom:12.0pt">Strahil
              Nikolov<o:p></o:p></p>
            <blockquote
              style="margin-left:0in;margin-right:0in;margin-bottom:15.0pt">
              <div>
                <div>
                  <p class="MsoNormal"><span
                      style="font-family:Roboto;color:#6D00F6">On Mon,
                      May 17, 2021 at 0:32, Eric Robinson<o:p></o:p></span></p>
                </div>
                <div>
                  <p class="MsoNormal"><span
                      style="font-family:Roboto;color:#6D00F6"><<a
                        href="mailto:eric.robinson@psmnv.com"
                        moz-do-not-send="true">eric.robinson@psmnv.com</a>>
                      wrote:<o:p></o:p></span></p>
                </div>
              </div>
              <div style="border:none;border-left:solid #6D00F6
                1.0pt;padding:0in 0in 0in 15.0pt;margin-top:7.5pt">
                <div id="yiv0265739749">
                  <div>
                    <div>
                      <p class="yiv0265739749msonormal">Okay, it turns
                        out I was wrong. I thought I had it working, but
                        I keep running into problems. Sometimes when I
                        demote a DRBD resource on Node A and promote it
                        on Node B, and I try to mount the filesystem,
                        the system complains that it cannot read the
                        superblock. But when I move the DRBD primary
                        back to Node A, the file system is mountable
                        again. Also, I have problems with filesystems
                        not mounting because the vdo devices are not
                        present. All kinds of issues.<o:p></o:p></p>
                      <div>
                        <p class="yiv0265739749msonormal"> <o:p></o:p></p>
                      </div>
                      <p class="yiv0265739749msonormal"> <o:p></o:p></p>
                      <div style="border:none;border-left:solid blue
                        1.5pt;padding:0in 0in 0in 4.0pt">
                        <div>
                          <div style="border:none;border-top:solid
                            #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
                            <div id="yiv0265739749yqtfd39754">
                              <p class="yiv0265739749msonormal"><b>From:</b>
                                Users <<a
                                  href="mailto:users-bounces@clusterlabs.org"
                                  moz-do-not-send="true">users-bounces@clusterlabs.org</a>>
                                <b>On Behalf Of </b>Eric Robinson<br>
                                <b>Sent:</b> Friday, May 14, 2021 3:55
                                PM<br>
                                <b>To:</b> Strahil Nikolov <<a
                                  href="mailto:hunter86_bg@yahoo.com"
                                  moz-do-not-send="true">hunter86_bg@yahoo.com</a>>;
                                Cluster Labs - All topics related to
                                open-source clustering welcomed <<a
                                  href="mailto:users@clusterlabs.org"
                                  moz-do-not-send="true">users@clusterlabs.org</a>><br>
                                <b>Subject:</b> Re: [ClusterLabs] DRBD +
                                VDO HowTo?<o:p></o:p></p>
                            </div>
                          </div>
                        </div>
                        <div id="yiv0265739749yqtfd80248">
                          <p class="yiv0265739749msonormal"> <o:p></o:p></p>
                          <p class="yiv0265739749msonormal"> <o:p></o:p></p>
                          <p class="yiv0265739749msonormal">Okay, I have
                            it working now. The default systemd service
                            definitions did not work, so I created my
                            own.
                            <o:p></o:p></p>
                          <p class="yiv0265739749msonormal"> <o:p></o:p></p>
                          <p class="yiv0265739749msonormal"> <o:p></o:p></p>
                          <div style="border:none;border-left:solid blue
                            1.5pt;padding:0in 0in 0in 4.0pt">
                            <div>
                              <div style="border:none;border-top:solid
                                #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
                                <p class="yiv0265739749msonormal"><b>From:</b>
                                  Strahil Nikolov <<a
                                    href="mailto:hunter86_bg@yahoo.com"
                                    target="_blank"
                                    moz-do-not-send="true">hunter86_bg@yahoo.com</a>>
                                  <br>
                                  <b>Sent:</b> Friday, May 14, 2021 3:41
                                  AM<br>
                                  <b>To:</b> Eric Robinson <<a
                                    href="mailto:eric.robinson@psmnv.com"
                                    target="_blank"
                                    moz-do-not-send="true">eric.robinson@psmnv.com</a>>;
                                  Cluster Labs - All topics related to
                                  open-source clustering welcomed <<a
                                    href="mailto:users@clusterlabs.org"
                                    target="_blank"
                                    moz-do-not-send="true">users@clusterlabs.org</a>><br>
                                  <b>Subject:</b> RE: [ClusterLabs] DRBD
                                  + VDO HowTo?<o:p></o:p></p>
                              </div>
                            </div>
                            <p class="yiv0265739749msonormal"> <o:p></o:p></p>
                            <p class="yiv0265739749msonormal">There is
                              no VDO RA according to my knowledge, but
                              you can use systemd service as a resource.<o:p></o:p></p>
                            <div
                              id="yiv0265739749yMail_cursorElementTracker_1620979503479">
                              <p class="yiv0265739749msonormal"> <o:p></o:p></p>
                            </div>
                            <div
                              id="yiv0265739749yMail_cursorElementTracker_1620979505648">
                              <p class="yiv0265739749msonormal">Yet, the
                                VDO service that comes with thr OS is a
                                generic one and controlls all VDOs - so
                                you need to create your own vdo service.<o:p></o:p></p>
                            </div>
                            <div
                              id="yiv0265739749yMail_cursorElementTracker_1620979573043">
                              <p class="yiv0265739749msonormal"> <o:p></o:p></p>
                            </div>
                            <div
                              id="yiv0265739749yMail_cursorElementTracker_1620979573221">
                              <p class="yiv0265739749msonormal">Best
                                Regards,<o:p></o:p></p>
                            </div>
                            <div
                              id="yiv0265739749yMail_cursorElementTracker_1620981647955">
                              <p class="yiv0265739749msonormal"
                                style="margin-bottom:12.0pt">Strahil
                                Nikolov<o:p></o:p></p>
                              <blockquote
style="margin-left:0in;margin-top:5.0pt;margin-right:0in;margin-bottom:15.0pt">
                                <div>
                                  <div>
                                    <p class="yiv0265739749msonormal"><span
style="font-family:Roboto;color:#6D00F6">On Fri, May 14, 2021 at 6:55,
                                        Eric Robinson</span><o:p></o:p></p>
                                  </div>
                                  <div>
                                    <p class="yiv0265739749msonormal"><span
style="font-family:Roboto;color:#6D00F6"><<a
                                          href="mailto:eric.robinson@psmnv.com"
                                          target="_blank"
                                          moz-do-not-send="true">eric.robinson@psmnv.com</a>>
                                        wrote:</span><o:p></o:p></p>
                                  </div>
                                </div>
                                <div
                                  style="border:none;border-left:solid
                                  #6D00F6 1.0pt;padding:0in 0in 0in
                                  15.0pt;margin-top:7.5pt">
                                  <div id="yiv0265739749">
                                    <div>
                                      <div>
                                        <p
                                          class="yiv0265739749msonormal4">I
                                          created the VDO volumes fine
                                          on the drbd devices, formatted
                                          them as xfs filesystems,
                                          created cluster filesystem
                                          resources, and the cluster us
                                          using them. But the cluster
                                          won’t fail over. Is there a
                                          VDO cluster RA out there
                                          somewhere already? <o:p></o:p></p>
                                        <p
                                          class="yiv0265739749msonormal4"> <o:p></o:p></p>
                                        <p
                                          class="yiv0265739749msonormal4"> <o:p></o:p></p>
                                        <div
                                          style="border:none;border-left:solid
                                          blue 1.5pt;padding:0in 0in 0in
                                          4.0pt">
                                          <div>
                                            <div
                                              style="border:none;border-top:solid
                                              #E1E1E1
                                              1.0pt;padding:3.0pt 0in
                                              0in 0in">
                                              <p
                                                class="yiv0265739749msonormal4"><b>From:</b>
                                                Strahil Nikolov <<a
                                                  href="mailto:hunter86_bg@yahoo.com"
                                                  target="_blank"
                                                  moz-do-not-send="true">hunter86_bg@yahoo.com</a>>
                                                <br>
                                                <b>Sent:</b> Thursday,
                                                May 13, 2021 10:07 PM<br>
                                                <b>To:</b> Cluster Labs
                                                - All topics related to
                                                open-source clustering
                                                welcomed <<a
                                                  href="mailto:users@clusterlabs.org"
                                                  target="_blank"
                                                  moz-do-not-send="true">users@clusterlabs.org</a>>;
                                                Eric Robinson <<a
                                                  href="mailto:eric.robinson@psmnv.com"
                                                  target="_blank"
                                                  moz-do-not-send="true">eric.robinson@psmnv.com</a>><br>
                                                <b>Subject:</b> Re:
                                                [ClusterLabs] DRBD + VDO
                                                HowTo?<o:p></o:p></p>
                                            </div>
                                          </div>
                                          <p
                                            class="yiv0265739749msonormal4"> <o:p></o:p></p>
                                          <p
                                            class="yiv0265739749msonormal4">For
                                            DRBD there is enough info,
                                            so let's focus on VDO.<o:p></o:p></p>
                                          <div
                                            id="yiv0265739749yMail_cursorElementTracker_1620961478467">
                                            <p
                                              class="yiv0265739749msonormal4">There
                                              is a systemd service that
                                              starts all VDOs on the
                                              system. You can create the
                                              VDO once drbs is open for
                                              writes and then you can
                                              create your own systemd
                                              '.service' file which can
                                              be used as a cluster
                                              resource.<br>
                                              <br>
                                              <br>
                                              Best Regards,<o:p></o:p></p>
                                          </div>
                                          <div
                                            id="yiv0265739749yMail_cursorElementTracker_1620961591508">
                                            <p
                                              class="yiv0265739749msonormal4">Strahil
                                              Nikolov<o:p></o:p></p>
                                          </div>
                                          <div
                                            id="yiv0265739749yMail_cursorElementTracker_1620961598346">
                                            <p
                                              class="yiv0265739749msonormal4"> <o:p></o:p></p>
                                            <blockquote
style="margin-left:0in;margin-top:5.0pt;margin-right:0in;margin-bottom:15.0pt">
                                              <div>
                                                <div>
                                                  <p
                                                    class="yiv0265739749msonormal4"><span
style="color:#6D00F6">On Fri, May 14, 2021 at 2:33, Eric Robinson</span><o:p></o:p></p>
                                                </div>
                                                <div>
                                                  <p
                                                    class="yiv0265739749msonormal4"><span
style="color:#6D00F6"><<a href="mailto:eric.robinson@psmnv.com"
                                                        target="_blank"
moz-do-not-send="true">eric.robinson@psmnv.com</a>> wrote:</span><o:p></o:p></p>
                                                </div>
                                              </div>
                                              <div
                                                style="border:none;border-left:solid
                                                #6D00F6
                                                1.0pt;padding:0in 0in
                                                0in
                                                15.0pt;margin-top:7.5pt">
                                                <div id="yiv0265739749">
                                                  <div>
                                                    <div>
                                                      <p
                                                        class="yiv0265739749msonormal31">Can
                                                        anyone point to
                                                        a document on
                                                        how to use VDO
                                                        de-duplication
                                                        with DRBD?
                                                        Linbit has a
                                                        blog page about
                                                        it, but it was
                                                        last updated 6
                                                        years ago and
                                                        the embedded
                                                        links are dead.<o:p></o:p></p>
                                                      <p
                                                        class="yiv0265739749msonormal31"> <o:p></o:p></p>
                                                      <p
                                                        class="yiv0265739749msonormal31"><a
href="https://linbit.com/blog/albireo-virtual-data-optimizer-vdo-on-drbd/"
target="_blank" moz-do-not-send="true">https://linbit.com/blog/albireo-virtual-data-optimizer-vdo-on-drbd/</a><o:p></o:p></p>
                                                      <p
                                                        class="yiv0265739749msonormal31"> <o:p></o:p></p>
                                                      <p
                                                        class="yiv0265739749msonormal31">-Eric<o:p></o:p></p>
                                                      <p
                                                        class="yiv0265739749msonormal31"> <o:p></o:p></p>
                                                      <p
                                                        class="yiv0265739749msonormal31"> <o:p></o:p></p>
                                                      <p
                                                        class="yiv0265739749msonormal31"> <o:p></o:p></p>
                                                      <p
                                                        class="yiv0265739749msonormal31"> <o:p></o:p></p>
                                                    </div>
                                                    <p
                                                      class="yiv0265739749msonormal31">Disclaimer
                                                      : This email and
                                                      any files
                                                      transmitted with
                                                      it are
                                                      confidential and
                                                      intended solely
                                                      for intended
                                                      recipients. If you
                                                      are not the named
                                                      addressee you
                                                      should not
                                                      disseminate,
                                                      distribute, copy
                                                      or alter this
                                                      email. Any views
                                                      or opinions
                                                      presented in this
                                                      email are solely
                                                      those of the
                                                      author and might
                                                      not represent
                                                      those of Physician
                                                      Select Management.
                                                      Warning: Although
                                                      Physician Select
                                                      Management has
                                                      taken reasonable
                                                      precautions to
                                                      ensure no viruses
                                                      are present in
                                                      this email, the
                                                      company cannot
                                                      accept
                                                      responsibility for
                                                      any loss or damage
                                                      arising from the
                                                      use of this email
                                                      or attachments.
                                                      <o:p></o:p></p>
                                                  </div>
                                                </div>
                                                <p
                                                  class="yiv0265739749msonormal4">_______________________________________________<br>
                                                  Manage your
                                                  subscription:<br>
                                                  <a
                                                    href="https://lists.clusterlabs.org/mailman/listinfo/users"
                                                    target="_blank"
                                                    moz-do-not-send="true">https://lists.clusterlabs.org/mailman/listinfo/users</a><br>
                                                  <br>
                                                  ClusterLabs home: <a
href="https://www.clusterlabs.org/" target="_blank"
                                                    moz-do-not-send="true">https://www.clusterlabs.org/</a><o:p></o:p></p>
                                              </div>
                                            </blockquote>
                                          </div>
                                        </div>
                                      </div>
                                      <div id="yiv0265739749yqtfd67470">
                                        <p
                                          class="yiv0265739749msonormal4">Disclaimer
                                          : This email and any files
                                          transmitted with it are
                                          confidential and intended
                                          solely for intended
                                          recipients. If you are not the
                                          named addressee you should not
                                          disseminate, distribute, copy
                                          or alter this email. Any views
                                          or opinions presented in this
                                          email are solely those of the
                                          author and might not represent
                                          those of Physician Select
                                          Management. Warning: Although
                                          Physician Select Management
                                          has taken reasonable
                                          precautions to ensure no
                                          viruses are present in this
                                          email, the company cannot
                                          accept responsibility for any
                                          loss or damage arising from
                                          the use of this email or
                                          attachments.
                                          <o:p></o:p></p>
                                      </div>
                                    </div>
                                  </div>
                                </div>
                              </blockquote>
                            </div>
                          </div>
                          <p class="yiv0265739749msonormal">Disclaimer :
                            This email and any files transmitted with it
                            are confidential and intended solely for
                            intended recipients. If you are not the
                            named addressee you should not disseminate,
                            distribute, copy or alter this email. Any
                            views or opinions presented in this email
                            are solely those of the author and might not
                            represent those of Physician Select
                            Management. Warning: Although Physician
                            Select Management has taken reasonable
                            precautions to ensure no viruses are present
                            in this email, the company cannot accept
                            responsibility for any loss or damage
                            arising from the use of this email or
                            attachments.
                            <o:p></o:p></p>
                        </div>
                      </div>
                    </div>
                    <div id="yiv0265739749yqtfd01577">
                      <p class="MsoNormal">Disclaimer : This email and
                        any files transmitted with it are confidential
                        and intended solely for intended recipients. If
                        you are not the named addressee you should not
                        disseminate, distribute, copy or alter this
                        email. Any views or opinions presented in this
                        email are solely those of the author and might
                        not represent those of Physician Select
                        Management. Warning: Although Physician Select
                        Management has taken reasonable precautions to
                        ensure no viruses are present in this email, the
                        company cannot accept responsibility for any
                        loss or damage arising from the use of this
                        email or attachments.
                        <o:p></o:p></p>
                    </div>
                  </div>
                </div>
              </div>
            </blockquote>
          </div>
        </div>
      </div>
      Disclaimer : This email and any files transmitted with it are
      confidential and intended solely for intended recipients. If you
      are not the named addressee you should not disseminate,
      distribute, copy or alter this email. Any views or opinions
      presented in this email are solely those of the author and might
      not represent those of Physician Select Management. Warning:
      Although Physician Select Management has taken reasonable
      precautions to ensure no viruses are present in this email, the
      company cannot accept responsibility for any loss or damage
      arising from the use of this email or attachments.
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <pre class="moz-quote-pre" wrap="">_______________________________________________
Manage your subscription:
<a class="moz-txt-link-freetext" href="https://lists.clusterlabs.org/mailman/listinfo/users">https://lists.clusterlabs.org/mailman/listinfo/users</a>

ClusterLabs home: <a class="moz-txt-link-freetext" href="https://www.clusterlabs.org/">https://www.clusterlabs.org/</a>
</pre>
    </blockquote>
    <br>
  </body>
</html>