<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p><font face="monospace">FYI: I was using ELREPO's packages:<br>
        kmod-drbd90.x86_64               9.0.25-2.el8_3.elrepo<br>
        drbd90-utils.x86_64              9.13.1-1.el8.elrepo<br>
        drbd90-utils-sysvinit.x86_64     9.13.1-1.el8.elrepo<br>
      </font></p>
    <p><font face="monospace">I just tried EPEL's packages (still needed
        elrepos's kmod) and nothing seemed to work there (the cluster
        couldn't seem to load DRBD) even though it worked manually.<br>
      </font></p>
    <p><font face="monospace">drbd.x86_64                     
        9.13.1-1.el8<br>
        drbd-pacemaker.x86_64            9.13.1-1.el8<br>
        drbd-udev.x86_64                 9.13.1-1.el8<br>
        drbd-utils.x86_64                9.13.1-1.el8<br>
        kmod-drbd90.x86_64               9.0.25-2.el8_3.elrepo</font><br>
    </p>
    <p><font face="monospace">e.g. output:<br>
        pacemaker-execd[1702]: notice: drbd0_stop_0[2992] error output [
        /usr/lib/ocf/resource.d/linbit/drbd: line 318: USAGE:: command
        not found ]<br>
        pacemaker-execd[1702]: notice: drbd0_stop_0[2992] error output [
        /usr/lib/ocf/resource.d/linbit/drbd: line 320: Commands::
        command not found ]<br>
        pacemaker-execd[1702]: notice: drbd0_stop_0[2992] error output [
        /usr/lib/ocf/resource.d/linbit/drbd: line 321: primary: command
        not found ]<br>
        pacemaker-execd[1702]: notice: drbd0_stop_0[2992] error output [
        /usr/lib/ocf/resource.d/linbit/drbd: line 322: secondary:
        command not found ]<br>
        pacemaker-execd[1702]: notice: drbd0_stop_0[2992] error output [
        /usr/lib/ocf/resource.d/linbit/drbd: line 323: attach: command
        not found ]<br>
        pacemaker-execd[1702]: notice: drbd0_stop_0[2992] error output [
        /usr/lib/ocf/resource.d/linbit/drbd: line 324: disk-options:
        command not found ]<br>
        pacemaker-execd[1702]: notice: drbd0_stop_0[2992] error output [
        /usr/lib/ocf/resource.d/linbit/drbd: line 325: detach: command
        not found ]<br>
        pacemaker-execd[1702]: notice: drbd0_stop_0[2992] error output [
        /usr/lib/ocf/resource.d/linbit/drbd: eval: line 326: syntax
        error near unexpected token `(' ]<br>
        <br>
      </font></p>
    <p><font face="monospace">Brent<br>
      </font></p>
    <div class="moz-cite-prefix">On 1/16/2021 11:07 AM, Strahil Nikolov
      wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:78768641fb3d8935692cb096897c50adcb1866bd.camel@yahoo.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div>В 14:10 -0700 на 15.01.2021 (пт), Brent Jensen написа:</div>
      <blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px
        #729fcf solid;padding-left:1ex">
        <p> </p>
        <div class="moz-text-html" lang="x-unicode">
          <div dir="ltr">Problem: When performing "pcs node standby" on
            the current master, this node demotes fine but the slave
            doesn't promote to master. It keeps  looping the same error
            including "Refusing to be Primary while peer is  not
            outdated" and "Could not connect to the CIB." At this point
            the old  master has already unloaded drbd. The only way to
            fix it is to start  drbd on the standby node (e.g. drbdadm
            r0 up). Logs contained herein are  from the node trying to
            be master.<br>
            <br>
          </div>
        </div>
      </blockquote>
      <div>In order to debug, stop the cluster and verify that drbd is
        running properly. Promote one of the nodes, then demote and
        promote another one...</div>
      <blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px
        #729fcf solid;padding-left:1ex">
        <div class="moz-text-html" lang="x-unicode">
          <div dir="ltr"> I have done this on DRBD9/Centos7/Pacemaker1
            w/o any problems. So I don't know were the issue is (<a
              href="http://crm-fence-peer.9.sh" moz-do-not-send="true">crm-fence-peer.9.sh</a><br>
          </div>
          <div dir="ltr"><br>
          </div>
          <div dir="ltr">Another odd data point: On the slave if I do a
            "pcs node standby" & then unstandby, DRBD is loaded
            again; HOWEVER, when I do this on the master (which should
            then be slave), DRBD doesn't get loaded.<br>
            <br>
            Stonith/Fencing doesn't seem to make a difference. Not sure
            if auto-promote is required.<br>
          </div>
        </div>
        <div dir="ltr"><br>
        </div>
      </blockquote>
      <div>Quote from official documentation (<a
href="https://www.linbit.com/drbd-user-guide/drbd-guide-9_0-en/#s-pacemaker-crm-drbd-backed-service"
          moz-do-not-send="true">https://www.linbit.com/drbd-user-guide/drbd-guide-9_0-en/#s-pacemaker-crm-drbd-backed-service</a>):</div>
      <div><span style="color: rgba(0, 0, 0, 0.6); font-family: Roboto,
          sans-serif; font-size: 14.4px; font-variant-ligatures: normal;
          orphans: 2; white-space: normal; widows: 2; background-color:
          rgb(248, 248, 248); text-decoration-thickness: initial;">If
          you are employing the DRBD OCF resource agent, it is
          recommended that you defer DRBD startup, shutdown, promotion,
          and demotion </span><em style="box-sizing: border-box; color:
          rgba(0, 0, 0, 0.6); font-family: Roboto, sans-serif;
          font-size: 14.4px; font-variant-ligatures: normal; orphans: 2;
          white-space: normal; widows: 2; text-decoration-thickness:
          initial;">exclusively</em><span style="color: rgba(0, 0, 0,
          0.6); font-family: Roboto, sans-serif; font-size: 14.4px;
          font-variant-ligatures: normal; orphans: 2; white-space:
          normal; widows: 2; background-color: rgb(248, 248, 248);
          text-decoration-thickness: initial;"> to the OCF resource
          agent. That means that you should disable the DRBD init
          script:<br>
        </span>
      </div>
      <div>So remove the autopromote and disable the drbd service at
        all.</div>
      <div><br>
      </div>
      <div>Best Regards,
        Strahil Nikolov</div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <pre class="moz-quote-pre" wrap="">_______________________________________________
Manage your subscription:
<a class="moz-txt-link-freetext" href="https://lists.clusterlabs.org/mailman/listinfo/users">https://lists.clusterlabs.org/mailman/listinfo/users</a>

ClusterLabs home: <a class="moz-txt-link-freetext" href="https://www.clusterlabs.org/">https://www.clusterlabs.org/</a>
</pre>
    </blockquote>
  <div id="DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2"><br />
<table style="border-top: 1px solid #D3D4DE;">
        <tr>
        <td style="width: 55px; padding-top: 13px;"><a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient&utm_term=icon" target="_blank"><img src="https://ipmcdn.avast.com/images/icons/icon-envelope-tick-round-orange-animated-no-repeat-v1.gif" alt="" width="46" height="29" style="width: 46px; height: 29px;" /></a></td>
                <td style="width: 470px; padding-top: 12px; color: #41424e; font-size: 13px; font-family: Arial, Helvetica, sans-serif; line-height: 18px;">Virus-free. <a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient&utm_term=link" target="_blank" style="color: #4453ea;">www.avast.com</a>
                </td>
        </tr>
</table><a href="#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2" width="1" height="1"> </a></div></body>
</html>