<div dir="ltr">Hi Jiaqi,<div><br></div><div>The most reliable way to add a new node according to my practice is the following:</div><div><div dir="ltr" style="outline:none;color:rgb(18,18,18);font-size:13.3333px">1. update corosync.conf files among all hosts in cluster including the new node</div><div dir="ltr" style="outline:none;color:rgb(18,18,18);font-size:13.3333px">2. copy corosync auth file to the new node</div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px">3. enable maintenance:</div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px">a) sudo crm configure property maintenance-mode=true</div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px"><div dir="ltr" style="outline:none;font-size:13.3333px"><span style="font-size:13.3333px">When global maintenance mode is enabled you may safely stop pacemaker and corosync services</span><br></div></div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px"><br></div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px">b) sudo crm status<br></div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px">ensure it is enabled on all nodes(it is global mode, but if you have split-brain not all nodes can be affected by command)</div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px">4. stop <span style="font-size:small;color:rgb(34,34,34)">pacemaker and corosync services on all nodes</span></div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px"><span style="font-size:small;color:rgb(34,34,34)">5. start </span><span style="font-size:small;color:rgb(34,34,34)">pacemaker and corosync services on all node <b>on by one (one node at a time)</b></span></div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px"><span style="font-size:small;color:rgb(34,34,34)"><b><br></b></span></div><div style="outline:none;color:rgb(18,18,18);font-size:13.3333px"><span style="font-size:small;color:rgb(34,34,34)">After this you will have all nodes in a cluster. You may try to do a simple restart of </span><span style="font-size:small;color:rgb(34,34,34)">pacemaker and corosync services without stopping them and without starting in a sequence, but this will not always work.</span></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Oct 21, 2020 at 5:03 PM Jiaqi Tian1 <<a href="mailto:Dylan.Jiaqi.Tian@ibm.com">Dylan.Jiaqi.Tian@ibm.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:10pt"><div dir="ltr"><div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">Hi,</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">I'm trying to add a new node into an active pacemaker cluster with resources up and running.</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">After steps:</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">1. update corosync.conf files among all hosts in cluster including the new node</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">2. copy corosync auth file to the new node</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">3. enable corosync and pacemaker on the new node </div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">4. adding the new node to the list of node in /var/lib/pacemaker/cib/cib.xml</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"> </div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">Then I run crm status, the new node is displayed as offline. It will not become online, unless we run restart corosync and pacemaker on all nodes in cluster. But this is not what we want, since we want to keep existing nodes and resources up and running. Also in this case crm_node -l doesn't list the new node.</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"> </div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">So my question is:</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"> </div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">1. Is there another approach to have the existing nodes aware of the new node and have crm status indicates the node is online while keeping other nodes and resources up and running?</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">2. which config file crm_node command reads?</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"> </div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">Thanks,</div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"> </div>
<div dir="ltr" style="outline:none;color:rgb(18,18,18);font-family:Arial,Helvetica,sans-serif;font-size:13.3333px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">Jiaqi Tian</div></div></div><br>

_______________________________________________<br>
Manage your subscription:<br>
<a href="https://lists.clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><br>
<br>
ClusterLabs home: <a href="https://www.clusterlabs.org/" rel="noreferrer" target="_blank">https://www.clusterlabs.org/</a><br>
</blockquote></div>