<div dir="ltr"><div>Hi, Sathish. I'm sorry that we missed your November email. Thanks for following up. I'm not sure what happened to the original email from October 30. As you'll see here in the archive, it was never received: <a href="https://lists.clusterlabs.org/pipermail/users/2020-October/">https://lists.clusterlabs.org/pipermail/users/2020-October/</a></div><div><br></div><div>We also don't have the log file attachments. Without seeing the logs, I would guess that node 2 (with no resources) somehow had a newer version of the CIB when the two-node membership formed, and its version was chosen as the latest source of truth. Could you attach logs again?</div><div><br></div><div>I also strongly recommend that you configure fencing and ensure that no-quorum-policy is set to a sane value like "stop" for the most reliable Pacemaker behavior, especially during a split-brain situation.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Nov 2, 2020 at 6:20 AM S Sathish S <<a href="mailto:s.s.sathish@ericsson.com">s.s.sathish@ericsson.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US">
<div class="gmail-m_-2627944580690880567WordSection1">
<p class="MsoNormal">Hi Team,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Any update on below query .<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks and Regards,<u></u><u></u></p>
<p class="MsoNormal">S Sathish S<u></u><u></u></p>
<div>
<div style="border-color:rgb(225,225,225) currentcolor currentcolor;border-style:solid none none;border-width:1pt medium medium;padding:3pt 0in 0in">
<p class="MsoNormal"><b>From:</b> S Sathish S <br>
<b>Sent:</b> Friday, October 30, 2020 2:36 PM<br>
<b>To:</b> '<a href="mailto:users@clusterlabs.org" target="_blank">users@clusterlabs.org</a>' <<a href="mailto:users@clusterlabs.org" target="_blank">users@clusterlabs.org</a>><br>
<b>Cc:</b> Anandan Gunasekar <<a href="mailto:gunasekar.anandan@globallogic.com" target="_blank">gunasekar.anandan@globallogic.com</a>><br>
<b>Subject:</b> resources configured in the nodes are removed automatically after split-brain<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Hi Team,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">The version of pacemaker rpm's being used is:<br>
corosync-2.4.4 --> <a href="https://protect2.fireeye.com/v1/url?k=f922dd52-a6b9e479-f9229dc9-866038973a15-a5f3de1dbfc1c39a&q=1&e=524f71fb-249f-4239-a262-2fc78f9ad31c&u=https%3A%2F%2Fgithub.com%2Fcorosync%2Fcorosync%2Ftree%2Fv2.4.4" target="_blank">https://github.com/corosync/corosync/tree/v2.4.4</a><br>
pacemaker-2.0.2 --> <a href="https://protect2.fireeye.com/v1/url?k=c7032bdb-989812f0-c7036b40-866038973a15-7901e2417b6e6fb9&q=1&e=524f71fb-249f-4239-a262-2fc78f9ad31c&u=https%3A%2F%2Fgithub.com%2FClusterLabs%2Fpacemaker%2Ftree%2FPacemaker-2.0.2" target="_blank">
https://github.com/ClusterLabs/pacemaker/tree/Pacemaker-2.0.2</a><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b><u>Issue Details:-</u></b><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Two nodes (Node 1 and Node2 ) will be joined in the Cluster lab's pcs cluster. <u></u><u></u></p>
<p class="MsoNormal">Node 1 is configured and resources are added in it and then Node 2 is planned to add with Node1<u></u><u></u></p>
<p class="MsoNormal">While joining the Node 2 with Node 1, looks like the split brain and quorum voting issue happened and some time later both the nodes rejoined as a cluster. <u></u><u></u></p>
<p class="MsoNormal"><b>But the resources configured in the Nodes are removed automatically.</b><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b><u>Expectation:-</u></b><u></u><u></u></p>
<p class="MsoNormal">In our application we have not configured FENCING/STONITH as per the needs. <u></u><u></u></p>
<p class="MsoNormal">So can you help us to know why the resources are getting removed after the split brain (or) quorum voting issue occurred in the node.<u></u><u></u></p>
<p class="MsoNormal">Also kindly let us know if any prevent steps available to prevent the automatic resource deletion.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b><u>Logs and Other details:-</u></b><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b>PCS STATUS output from Node 1:-</b><u></u><u></u></p>
<p class="MsoNormal"><img style="width: 5.8541in; height: 4.9444in;" id="gmail-m_-2627944580690880567_x0000_i1025" src="cid:176b58733927745b41" alt="image.png" width="562" height="475" border="0"><u></u><u></u></p>
<p class="MsoNormal"><b>Corosync log snipped in Node 2:-</b><u></u><u></u></p>
<p class="MsoNormal"><img style="width: 5.8541in; height: 3.6666in;" id="gmail-m_-2627944580690880567_x0000_i1026" src="cid:176b5873394855d352" alt="image.png" width="562" height="352" border="0"><u></u><u></u></p>
<p class="MsoNormal"><b>PCS STATUS command output from Node 1 </b>(resource are removed automatically)<u></u><u></u></p>
<p class="MsoNormal"><img style="width: 5.8541in; height: 2.8958in;" id="gmail-m_-2627944580690880567_x0000_i1027" src="cid:176b58733949374b63" alt="image.png" width="562" height="278" border="0"><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b><u>Logs Attached (both nodes):-</u></b><u></u><u></u></p>
<ul type="disc">
<li class="MsoNormal">
Corosync log<u></u><u></u></li><li class="MsoNormal">
cib file<u></u><u></u></li><li class="MsoNormal">
pcs and crm command output<u></u><u></u></li></ul>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks and Regards,<u></u><u></u></p>
<p class="MsoNormal">S Sathish S<u></u><u></u></p>
</div>
</div>
_______________________________________________<br>
Manage your subscription:<br>
<a href="https://lists.clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><br>
<br>
ClusterLabs home: <a href="https://www.clusterlabs.org/" rel="noreferrer" target="_blank">https://www.clusterlabs.org/</a><br>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div>Regards,<br><br></div>Reid Wahl, RHCA<br></div><div>Senior Software Maintenance Engineer, Red Hat<br></div>CEE - Platform Support Delivery - ClusterHA</div></div></div></div></div></div></div></div></div></div></div></div></div></div>