[ClusterLabs] resources configured in the nodes are removed automatically after split-brain

[Reid Wahl]

Hi, Sathish. I'm sorry that we missed your November email. Thanks for
following up. I'm not sure what happened to the original email from October
30. As you'll see here in the archive, it was never received:
https://lists.clusterlabs.org/pipermail/users/2020-October/

We also don't have the log file attachments. Without seeing the logs, I
would guess that node 2 (with no resources) somehow had a newer version of
the CIB when the two-node membership formed, and its version was chosen as
the latest source of truth. Could you attach logs again?

I also strongly recommend that you configure fencing and ensure that
no-quorum-policy is set to a sane value like "stop" for the most reliable
Pacemaker behavior, especially during a split-brain situation.

On Mon, Nov 2, 2020 at 6:20 AM S Sathish S <s.s.sathish at ericsson.com> wrote:

> Hi Team,
>
>
>
> Any update on below query .
>
>
>
> Thanks and Regards,
>
> S Sathish S
>
> *From:* S Sathish S
> *Sent:* Friday, October 30, 2020 2:36 PM
> *To:* 'users at clusterlabs.org' <users at clusterlabs.org>
> *Cc:* Anandan Gunasekar <gunasekar.anandan at globallogic.com>
> *Subject:* resources configured in the nodes are removed automatically
> after split-brain
>
>
>
> Hi Team,
>
>
>
> The version of pacemaker rpm's being used is:
> corosync-2.4.4 -->  https://github.com/corosync/corosync/tree/v2.4.4
> <https://protect2.fireeye.com/v1/url?k=f922dd52-a6b9e479-f9229dc9-866038973a15-a5f3de1dbfc1c39a&q=1&e=524f71fb-249f-4239-a262-2fc78f9ad31c&u=https%3A%2F%2Fgithub.com%2Fcorosync%2Fcorosync%2Ftree%2Fv2.4.4>
> pacemaker-2.0.2 -->
> https://github.com/ClusterLabs/pacemaker/tree/Pacemaker-2.0.2
> <https://protect2.fireeye.com/v1/url?k=c7032bdb-989812f0-c7036b40-866038973a15-7901e2417b6e6fb9&q=1&e=524f71fb-249f-4239-a262-2fc78f9ad31c&u=https%3A%2F%2Fgithub.com%2FClusterLabs%2Fpacemaker%2Ftree%2FPacemaker-2.0.2>
>
>
>
> *Issue Details:-*
>
>
>
> Two nodes (Node 1 and Node2 ) will be joined in the Cluster lab's pcs
> cluster.
>
> Node 1 is configured and resources are added in it and then Node 2 is
> planned to add with Node1
>
> While joining the Node 2 with Node 1, looks like the split brain and
> quorum voting issue happened and some time later both the nodes rejoined as
> a cluster.
>
> *But the resources configured in the Nodes are removed automatically.*
>
>
>
> *Expectation:-*
>
> In our application we have not configured FENCING/STONITH as per the
> needs.
>
> So can you help us to know why the resources are getting removed after the
> split brain (or) quorum voting issue occurred in the node.
>
> Also kindly let us know if any prevent steps available to prevent the
> automatic resource deletion.
>
>
>
> *Logs and Other details:-*
>
>
>
> *PCS STATUS output from Node 1:-*
>
> [image: image.png]
>
> *Corosync log snipped in Node 2:-*
>
> [image: image.png]
>
> *PCS STATUS command output from Node 1 *(resource are removed
> automatically)
>
> [image: image.png]
>
>
>
> *Logs Attached (both nodes):-*
>
>    - Corosync log
>    - cib file
>    - pcs and crm command output
>
>
>
> Thanks and Regards,
>
> S Sathish S
> _______________________________________________
> Manage your subscription:
> https://lists.clusterlabs.org/mailman/listinfo/users
>
> ClusterLabs home: https://www.clusterlabs.org/
>


-- 
Regards,

Reid Wahl, RHCA
Senior Software Maintenance Engineer, Red Hat
CEE - Platform Support Delivery - ClusterHA
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.clusterlabs.org/pipermail/users/attachments/20201230/415a45af/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 380352 bytes
Desc: not available
URL: <http://lists.clusterlabs.org/pipermail/users/attachments/20201230/415a45af/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 477435 bytes
Desc: not available
URL: <http://lists.clusterlabs.org/pipermail/users/attachments/20201230/415a45af/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.png
Type: image/png
Size: 112051 bytes
Desc: not available
URL: <http://lists.clusterlabs.org/pipermail/users/attachments/20201230/415a45af/attachment-0005.png>