<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>I have already verified DRBD works. As always, I use the OCF to
      manage DRBD; never started initially. I added auto-promote to see
      if that made a difference (it didn't). So I'm still at a loss as
      to why it won't promote. It behaves as if DRBD gets unleaded on
      the master node before it demoting to allows the secondary to
      promote. <br>
    </p>
    <p>For example (I'm doing this manually w/o the cluster running).</p>
    <p>On master node (as primary), I stop DRBD (normally you'd demote
      it first)<br>
    </p>
    <p>On secondary node (as secondary):</p>
    <p>drbdadm primary all</p>
    <p>crm-fence-peer.9.sh[564707]: (ipc_post_disconnect) #011info:
      Disconnected from controller IPC API<br>
      crm-fence-peer.9.sh[564707]: (pcmk_free_ipc_api) #011debug:
      Releasing controller IPC API<br>
      crm-fence-peer.9.sh[564707]: (crm_xml_cleanup) #011info: Cleaning
      up memory from libxml2<br>
      crm-fence-peer.9.sh[564707]: (crm_exit) #011info: Exiting crm_node
      | with status 0<br>
      crm-fence-peer.9.sh[564707]: /<br>
      crm-fence-peer.9.sh[564707]: Could not connect to the CIB: No such
      device or address<br>
      crm-fence-peer.9.sh[564707]: Init failed, could not perform
      requested operations<br>
      crm-fence-peer.9.sh[564707]: WARNING DATA INTEGRITY at RISK: could
      not place the fencing constraint!<br>
      kernel: drbd r0 nfs6: helper command: /sbin/drbdadm fence-peer
      exit code 1 (0x100)<br>
      kernel: drbd r0 nfs6: fence-peer helper broken, returned 1<br>
    </p>
    <p>All of this is EXPECTED BEHAVIOR. With DRBD unloaded PRIOR to
      demoting on the primary node, the other node CANNOT promote to
      primary. This is the same thing I'm experiencing when running in
      the cluster. It looks like DRBD is being unloaded PRIOR to the
      master being demoted. WHY??? I'm pretty sure I'm using the basic
      configurations. It seems as though there's a bug somewhere.<br>
    </p>
    <p>Note my versions:<br>
    </p>
    <ul>
      <li>pacemaker-2.0.4-6.el8_3.1.x86_64</li>
      <li>drbd90-utils-9.13.1-1.el8.elrepo.x86_64<br>
      </li>
    </ul>
    <p><br>
      Thanks,</p>
    <p>Brent<br>
      <br>
    </p>
    <div class="moz-cite-prefix">On 1/16/2021 11:07 AM, Strahil Nikolov
      wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:78768641fb3d8935692cb096897c50adcb1866bd.camel@yahoo.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div>В 14:10 -0700 на 15.01.2021 (пт), Brent Jensen написа:</div>
      <blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px
        #729fcf solid;padding-left:1ex">
        <p> </p>
        <div class="moz-text-html" lang="x-unicode">
          <div dir="ltr">Problem: When performing "pcs node standby" on
            the current master, this node demotes fine but the slave
            doesn't promote to master. It keeps  looping the same error
            including "Refusing to be Primary while peer is  not
            outdated" and "Could not connect to the CIB." At this point
            the old  master has already unloaded drbd. The only way to
            fix it is to start  drbd on the standby node (e.g. drbdadm
            r0 up). Logs contained herein are  from the node trying to
            be master.<br>
            <br>
          </div>
        </div>
      </blockquote>
      <div>In order to debug, stop the cluster and verify that drbd is
        running properly. Promote one of the nodes, then demote and
        promote another one...</div>
      <blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px
        #729fcf solid;padding-left:1ex">
        <div class="moz-text-html" lang="x-unicode">
          <div dir="ltr"> I have done this on DRBD9/Centos7/Pacemaker1
            w/o any problems. So I don't know were the issue is (<a
              href="http://crm-fence-peer.9.sh" moz-do-not-send="true">crm-fence-peer.9.sh</a><br>
          </div>
          <div dir="ltr"><br>
          </div>
          <div dir="ltr">Another odd data point: On the slave if I do a
            "pcs node standby" & then unstandby, DRBD is loaded
            again; HOWEVER, when I do this on the master (which should
            then be slave), DRBD doesn't get loaded.<br>
            <br>
            Stonith/Fencing doesn't seem to make a difference. Not sure
            if auto-promote is required.<br>
          </div>
        </div>
        <div dir="ltr"><br>
        </div>
      </blockquote>
      <div>Quote from official documentation (<a
href="https://www.linbit.com/drbd-user-guide/drbd-guide-9_0-en/#s-pacemaker-crm-drbd-backed-service"
          moz-do-not-send="true">https://www.linbit.com/drbd-user-guide/drbd-guide-9_0-en/#s-pacemaker-crm-drbd-backed-service</a>):</div>
      <div><span style="color: rgba(0, 0, 0, 0.6); font-family: Roboto,
          sans-serif; font-size: 14.4px; font-variant-ligatures: normal;
          orphans: 2; white-space: normal; widows: 2; background-color:
          rgb(248, 248, 248); text-decoration-thickness: initial;">If
          you are employing the DRBD OCF resource agent, it is
          recommended that you defer DRBD startup, shutdown, promotion,
          and demotion </span><em style="box-sizing: border-box; color:
          rgba(0, 0, 0, 0.6); font-family: Roboto, sans-serif;
          font-size: 14.4px; font-variant-ligatures: normal; orphans: 2;
          white-space: normal; widows: 2; text-decoration-thickness:
          initial;">exclusively</em><span style="color: rgba(0, 0, 0,
          0.6); font-family: Roboto, sans-serif; font-size: 14.4px;
          font-variant-ligatures: normal; orphans: 2; white-space:
          normal; widows: 2; background-color: rgb(248, 248, 248);
          text-decoration-thickness: initial;"> to the OCF resource
          agent. That means that you should disable the DRBD init
          script:<br>
        </span>
      </div>
      <div>So remove the autopromote and disable the drbd service at
        all.</div>
      <div><br>
      </div>
      <div>Best Regards,
        Strahil Nikolov</div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <pre class="moz-quote-pre" wrap="">_______________________________________________
Manage your subscription:
<a class="moz-txt-link-freetext" href="https://lists.clusterlabs.org/mailman/listinfo/users">https://lists.clusterlabs.org/mailman/listinfo/users</a>

ClusterLabs home: <a class="moz-txt-link-freetext" href="https://www.clusterlabs.org/">https://www.clusterlabs.org/</a>
</pre>
    </blockquote>
  <div id="DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2"><br />
<table style="border-top: 1px solid #D3D4DE;">
        <tr>
        <td style="width: 55px; padding-top: 13px;"><a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient&utm_term=icon" target="_blank"><img src="https://ipmcdn.avast.com/images/icons/icon-envelope-tick-round-orange-animated-no-repeat-v1.gif" alt="" width="46" height="29" style="width: 46px; height: 29px;" /></a></td>
                <td style="width: 470px; padding-top: 12px; color: #41424e; font-size: 13px; font-family: Arial, Helvetica, sans-serif; line-height: 18px;">Virus-free. <a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient&utm_term=link" target="_blank" style="color: #4453ea;">www.avast.com</a>
                </td>
        </tr>
</table><a href="#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2" width="1" height="1"> </a></div></body>
</html>