<div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Aug 30, 2023 at 2:34 PM David Dolan <<a href="mailto:daithidolan@gmail.com">daithidolan@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)">Hi All,<br aria-hidden="true"><br aria-hidden="true">I'm running Pacemaker on Centos7</div><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)">Name : pcs<div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Version : 0.9.169</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Release : 3.el7.centos.3</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Architecture: x86_64</div><br aria-hidden="true"></div></div></blockquote><div><br></div><div>Besides the pcs-version versions of the other cluster-stack-components could be interesting. (pacemaker, corosync) </div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"></div><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"><br aria-hidden="true"></div><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)">I'm performing some cluster failover tests in a 3 node cluster. We have 3 resources in the cluster.<br aria-hidden="true">I was trying to see if I could get it working if 2 nodes fail at different times. I'd like the 3 resources to then run on one node.</div><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"><br aria-hidden="true"></div><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)">The quorum options I've configured are as follows<br aria-hidden="true">[root@node1 ~]# pcs quorum config<div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Options:</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"> auto_tie_breaker: 1</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"> last_man_standing: 1</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"> last_man_standing_window: 10000</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"> wait_for_all: 1</div><br aria-hidden="true"></div></div></blockquote><div><br></div><div>Not sure if the combination of auto_tie_breaker and last_man_standing makes sense.</div><div>And as you have a cluster with an odd number of nodes auto_tie_breaker should be</div><div>disabled anyway I guess.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"></div><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)">[root@node1 ~]# pcs quorum status<div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Quorum information</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">------------------</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Date: Wed Aug 30 11:20:04 2023</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Quorum provider: corosync_votequorum</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Nodes: 3</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Node ID: 1</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Ring ID: 1/1538</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Quorate: Yes</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"><br aria-hidden="true"></div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Votequorum information</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">----------------------</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Expected votes: 3</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Highest expected: 3</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Total votes: 3</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Quorum: 2 </div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Flags: Quorate WaitForAll LastManStanding AutoTieBreaker</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"><br aria-hidden="true"></div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">Membership information</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">----------------------</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"> Nodeid Votes Qdevice Name</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"> 1 1 NR node1 (local)</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"> 2 1 NR node2</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"> 3 1 NR node3</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"><br aria-hidden="true"></div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">If I stop the cluster services on node 2 and 3, the groups all failover to node 1 since it is the node with the lowest ID</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">But if I stop them on node1 and node 2 or node1 and node3, the cluster fails.</div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit"><br aria-hidden="true"></div><div style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit">I tried adding this line to corosync.conf and I could then bring down the services on node 1 and 2 or node 2 and 3 but if I left node 2 until last, the cluster failed<br aria-hidden="true">auto_tie_breaker_node: 1 3<br aria-hidden="true"></div><br aria-hidden="true"></div><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:15px;line-height:inherit;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(36,36,36)"><div style="border:0px;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)">This line had the same outcome as using 1 3</div><div style="border:0px;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"><span style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit;display:inline">auto_tie_breaker_node: 1 2 3</span><br aria-hidden="true"></div><div style="border:0px;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"><span style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit;display:inline"><br aria-hidden="true"></span></div></div></div></blockquote><div><br></div><div>Giving multiple auto_tie_breaker-nodes doesn't make sense to me but rather sounds dangerous if that configuration is possible at all.</div><div><br></div><div>Maybe the misbehavior of last_man_standing is due to this (maybe not recognized) misconfiguration.</div><div>Did you wait long enough between letting the 2 nodes fail?</div><div><br></div><div>Klaus</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div style="border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-variant-alternates:inherit;font-stretch:inherit;font-size:15px;line-height:inherit;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(36,36,36)"><div style="border:0px;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"><span style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit;display:inline"></span></div><div style="border:0px;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"><span style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit;display:inline">So I'd like it to failover when any combination of two nodes fail but I've only had success when the middle node isn't last.</span></div><div style="border:0px;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"><span style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit;display:inline"><br aria-hidden="true"></span></div><div style="border:0px;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"><span style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit;display:inline">Thanks</span></div><div style="border:0px;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-kerning:inherit;font-feature-settings:inherit;margin:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0)"><span style="border:0px;font:inherit;margin:0px;padding:0px;vertical-align:baseline;color:inherit;display:inline">David</span></div></div></div>
_______________________________________________<br>
Manage your subscription:<br>
<a href="https://lists.clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><br>
<br>
ClusterLabs home: <a href="https://www.clusterlabs.org/" rel="noreferrer" target="_blank">https://www.clusterlabs.org/</a><br>
</blockquote></div></div>