<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div>
<blockquote type="cite" class="">
<div class="">On Jan 10, 2019, at 10:57 AM, Israel Brewster <<a href="mailto:ibrewster@flyravn.com" class="">ibrewster@flyravn.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div class="">
<div class="" style="word-wrap:break-word; line-break:after-white-space">So in my ongoing work to upgrade my cluster to CentOS 7, I got one box up and running on CentOS 7, with the cluster fully configured and functional, and moved all my services over to it.
Now I'm trying to add a second node, following the directions here:
<div class=""><br class="">
</div>
<div class=""><a href="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/high_availability_add-on_reference/s1-clusternodemanage-haar#s2-nodeadd-HAAR" class="">https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/high_availability_add-on_reference/s1-clusternodemanage-haar#s2-nodeadd-HAAR</a></div>
<div class=""><br class="">
</div>
<div class="">However, it doesn't appear to be working. The existing node is named "follow3", and the new node I am trying to add is named "follow1":</div>
<div class=""><br class="">
</div>
<div class="">- The auth command run from follow3 returns "follow1: Authorized", so that looks good.</div>
<div class="">- The "pcs cluster node add follow1" command, again run on follow3, gives the following output:</div>
<div class=""><br class="">
</div>
<div class="">Disabling SBD service...<br class="">
follow1: sbd disabled<br class="">
Sending remote node configuration files to 'follow1'<br class="">
follow1: successful distribution of the file 'pacemaker_remote authkey'<br class="">
follow3: Corosync updated<br class="">
Setting up corosync...<br class="">
follow1: Succeeded<br class="">
Synchronizing pcsd certificates on nodes follow1...<br class="">
follow1: Success<br class="">
Restarting pcsd on the nodes in order to reload the certificates...<br class="">
follow1: Success<br class="">
<br class="">
...So it would appear that that worked as well. I then issued the "pcs cluster start --all" command, which gave the following output:</div>
<div class=""><br class="">
</div>
<div class="">[root@follow3 ~]# pcs cluster start --all<br class="">
follow3: Starting Cluster (corosync)...<br class="">
follow1: Starting Cluster (corosync)...<br class="">
follow3: Starting Cluster (pacemaker)...<br class="">
follow1: Starting Cluster (pacemaker)...</div>
<div class=""><br class="">
</div>
<div class="">So again, everything looks good (to me). However, when I run "pcs status" on the existing node, I get the following:</div>
<div class=""><br class="">
</div>
<div class="">[root@follow3 ~]# pcs status<br class="">
Cluster name: follow<br class="">
Stack: corosync<br class="">
Current DC: follow3 (version 1.1.19-8.el7_6.2-c3c624ea3d) - partition with quorum<br class="">
Last updated: Thu Jan 10 10:47:33 2019<br class="">
Last change: Wed Jan 9 21:39:37 2019 by root via cibadmin on follow3<br class="">
<br class="">
1 node configured<br class="">
29 resources configured<br class="">
<br class="">
Online: [ follow3 ]<br class="">
<br class="">
Full list of resources:<br class="">
<br class="">
which would seem to indicate that it doesn't know about the node I just added (follow1). Meanwhile, follow1 "pcs status" shows this:</div>
<div class=""><br class="">
</div>
<div class="">[root@follow1 ~]# pcs status<br class="">
Cluster name: follow<br class="">
Stack: corosync<br class="">
Current DC: follow1 (version 1.1.19-8.el7_6.2-c3c624ea3d) - partition WITHOUT quorum<br class="">
Last updated: Thu Jan 10 10:54:25 2019<br class="">
Last change: Thu Jan 10 10:54:13 2019 by root via cibadmin on follow1<br class="">
<br class="">
2 nodes configured<br class="">
0 resources configured<br class="">
<br class="">
Online: [ follow1 ]<br class="">
OFFLINE: [ follow3 ]<br class="">
<br class="">
No resources<br class="">
<br class="">
<br class="">
Daemon Status:<br class="">
corosync: active/disabled<br class="">
pacemaker: active/disabled<br class="">
pcsd: active/enabled<br class="">
</div>
<div class=""><br class="">
</div>
<div class="">So it got at least *some* of the config, but apparently not the full thing (no resources), and it shows follow3 as offline, even though it is online and reachable. Oddly "pcs cluster status" shows both follow1 and follow3 pcsd status as online.
What am I missing here?<br class="">
<div class="">
<div class="" style="text-indent:0px; line-height:normal; orphans:2; widows:2; word-wrap:break-word; line-break:after-white-space">
<div class="">
<div class="" style="margin:0in 0in 0.0001pt; font-size:12pt; font-family:"Times New Roman",serif">
<span class="" style="font-size:9pt; font-family:Helvetica,sans-serif">-----------------------------------------------</span></div>
</div>
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<div class="" style="margin:0in 0in 0.0001pt"><font face="Arial" class="">Israel Brewster</font></div>
</div>
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<div class="" style="margin:0in 0in 0.0001pt"><font face="Arial" class="">Systems Analyst II</font></div>
</div>
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<div class="" style="margin:0in 0in 0.0001pt"><font face="Arial" class="">5245 Airport Industrial Rd</font></div>
</div>
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<div class="" style="margin:0in 0in 0.0001pt"><font face="Arial" class="">Fairbanks, AK 99709</font></div>
</div>
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<div class="" style="margin:0in 0in 0.0001pt"><font face="Arial" class="">(907) 450-7293</font><font face="Helvetica, sans-serif" class="" style="font-size:9pt; font-weight:normal; font-style:normal; font-family:Helvetica"></font></div>
</div>
<div class="" style="font-family: Helvetica, sans-serif; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<div class="" style="margin:0in 0in 0.0001pt; font-size:12pt; font-family:"Times New Roman",serif">
<span class="" style="font-size:9pt; font-family:Helvetica,sans-serif">-----------------------------------------------</span></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<div><br class="">
</div>
<div>As a follow-up to the above, restarting corosync on the functioning node (follow3) at least allows the second node (follow1) to show up when I do a pcs status, however the second node still shows as OFFLINE (and follow3 shows as offline on follow1), and
follow1 is still missing pretty much all of the config. If I try to remove and re-add follow1, the removal works as expected (node count on follow3 drops to 1), but the add behaves exactly the same as before, with pcs status not acknowledging the added node.</div>
<div>
<div style="text-align: -webkit-auto; font-variant-ligatures: normal; font-variant-east-asian: normal; font-variant-position: normal; line-height: normal; orphans: 2; widows: 2; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div style="font-family: Helvetica, sans-serif;" class="">
<div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "Times New Roman", serif;" class="">
<span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">-----------------------------------------------<o:p class=""></o:p></span></div>
</div>
<div class="">
<div style="margin: 0in 0in 0.0001pt;" class=""><font face="Arial" class="">Israel Brewster<o:p class=""></o:p></font></div>
</div>
<div class="">
<div style="margin: 0in 0in 0.0001pt;" class=""><font face="Arial" class="">Systems Analyst II</font></div>
</div>
<div class="">
<div style="margin: 0in 0in 0.0001pt;" class=""><font face="Arial" class="">5245 Airport Industrial Rd<o:p class=""></o:p></font></div>
</div>
<div class="">
<div style="margin: 0in 0in 0.0001pt;" class=""><font face="Arial" class="">Fairbanks, AK 99709<o:p class=""></o:p></font></div>
</div>
<div class="">
<div style="margin: 0in 0in 0.0001pt;" class=""><font face="Arial" class="">(907) 450-7293</font><font style="font-size: 9pt;" class=""><o:p class=""></o:p></font></div>
</div>
<div style="font-family: Helvetica, sans-serif;" class="">
<div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "Times New Roman", serif;" class="">
<span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">-----------------------------------------------</span></div>
</div>
</div>
</div>
<br class="">
<blockquote type="cite" class="">
<div class="">
<div class="">
<div class="" style="word-wrap:break-word; line-break:after-white-space">
<div class="">
<div class="">
<div class="" style="text-indent:0px; line-height:normal; orphans:2; widows:2; word-wrap:break-word; line-break:after-white-space">
<div class="" style="font-family: Helvetica, sans-serif; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
</div>
</div>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><br class="x_Apple-interchange-newline" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
</span></span></span><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""></span></span></span></span></span></span></span></span></span></span></span></span></span></span></div>
</div>
</div>
<div class=""><span id="cid:da9e47ee-066d-4dcf-888a-fd9cd23813c9@flyravn.com"><image001.jpg></span>
</div>
<div style="word-wrap:break-word; line-break:after-white-space" class="">
<div class="">
<div id="x_AppleMailSignature" class=""><span class="x_Apple-string-attachment" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class=""></span><br class="x_Apple-interchange-newline">
<span class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none; float: none; display: inline !important;"> </span><br class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><br class="x_Apple-interchange-newline">
<span class=""></span></span></span></span></span></span></span></span></span></span></span></span></span></span></div>
</span></span></span></span></span></span></span></span></span></span></span></span></span></div>
</div>
</div>
<div class=""><span id="cid:f03eb32f-5ff5-49b8-926e-5120f8aef3a2@flyravn.com"><image002.jpg></span>
</div>
<div style="word-wrap:break-word; line-break:after-white-space" class="">
<div class="">
<div id="x_AppleMailSignature" class=""><span class="x_Apple-string-attachment" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment">
<div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class="">
<span class="x_Apple-string-attachment" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class="x_Apple-string-attachment"><span class=""></span>
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<span class=""><br class="x_Apple-interchange-newline">
<br class="x_Apple-interchange-newline">
<br class="x_Apple-interchange-newline">
<br class="x_Apple-interchange-newline">
</span></div>
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<span class=""><br class="x_Apple-interchange-newline" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span class=""></span></span></span></span></span></div>
</span></span></span></span></span></span></span></span></span></span></span></span></span></div>
</span></span></span></span></span></span></span></span></span></span></span></span></span></div>
</div>
</div>
<div class="" style="word-wrap:break-word; line-break:after-white-space">
<div class="">
<div class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class="">
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class=""><span class="">
<div class="" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;">
<span class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; text-decoration: none;" class=""><span class=""><span class=""><span class=""></span></span></span></span></span></div>
</span></span></span></span></span></span></span></span></span></span></span></span></span></div>
</span></span></span></span></span></span></span></span></span></span></span></span></span></div>
<br class="">
</div>
</div>
</div>
<span id="cid:D2FC096494799A44BD9FF76CA3E3412B@flyravn.com"><Israel Brewster.vcf></span>_______________________________________________<br class="">
Users mailing list: <a href="mailto:Users@clusterlabs.org" class="">Users@clusterlabs.org</a><br class="">
<a href="https://lists.clusterlabs.org/mailman/listinfo/users" class="">https://lists.clusterlabs.org/mailman/listinfo/users</a><br class="">
<br class="">
Project Home: http://www.clusterlabs.org<br class="">
Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf<br class="">
Bugs: http://bugs.clusterlabs.org<br class="">
</div>
</blockquote>
</div>
<br class="">
</body>
</html>