<div dir="ltr"><p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">Hi All, </span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> </span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">We have a scenario on SLES 12 SP3 cluster.</span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">The scenario is explained as follows in the
order of events: </span></p>
<p class="gmail-MsoListParagraph" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36)">-<span style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:7pt;line-height:normal;font-family:"Times New Roman"">
</span></span><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">There
is a 2-node cluster (FILE-1, FILE-2)</span></p>
<p class="gmail-MsoListParagraph" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36)">-<span style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:7pt;line-height:normal;font-family:"Times New Roman"">
</span></span><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">The
cluster and the resources were up and running fine initially . </span></p>
<p class="gmail-MsoListParagraph" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36)">-<span style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:7pt;line-height:normal;font-family:"Times New Roman"">
</span></span><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">Then
fencing request from pacemaker got issued on both nodes simultaneously </span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.5in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> </span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">Logs from 1<sup>st</sup>
node: </span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:silver">2022-02-22T03:26:36.737075+00:00
FILE-1 corosync[12304]: [TOTEM ] Failed to receive the leave message. failed: 2</span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:silver">.</span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:silver">.</span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:silver">2022-02-22T03:26:36.977888+00:00
FILE-1 pacemaker-fenced[12331]: notice: Requesting that FILE-1 perform 'off'
action targeting FILE-2</span><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:rgb(253,212,114)"></span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> </span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">Logs from 2nd node:
</span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:silver">2022-02-22T03:26:36.738080+00:00
FILE-2 corosync[4989]: [TOTEM ] Failed to receive the leave message. failed: 1</span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:silver">.</span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:silver">.</span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:silver">Feb
22 03:26:38 FILE-2 pacemaker-fenced [5015] (call_remote_stonith) notice:
Requesting that FILE-2 perform 'off' action targeting FILE-1</span><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:rgb(253,212,114)"> </span></p>
<p class="MsoNormal" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:rgb(253,212,114)"> </span></p>
<p class="gmail-MsoListParagraph" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Segoe UI",sans-serif;color:rgb(47,85,151)">-<span style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:7pt;line-height:normal;font-family:"Times New Roman"">
</span></span><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">When
the nodes came up after unfencing, the DC got set after election</span><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:rgb(253,212,114)"></span></p>
<p class="gmail-MsoListParagraph" style="margin:0in 0in 0in 0.75in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Segoe UI",sans-serif;color:rgb(47,85,151)">-<span style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:7pt;line-height:normal;font-family:"Times New Roman"">
</span></span><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">After
that the resources which were expected to run on only one node became active on
both (all) nodes of the cluster.</span><span style="font-size:10pt;font-family:"Courier New";color:rgb(47,85,151);background:rgb(253,212,114)"></span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:rgb(47,85,151);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> </span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> </span></p>
<table class="gmail-MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="margin-left:63.25pt;border-collapse:collapse">
<tbody><tr>
<td width="1061" valign="top" style="width:796pt;border:1pt solid windowtext;padding:0in 5.4pt">
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27290 2022-02-22T04:16:31.699186+00:00 FILE-2
pacemaker-schedulerd[5018]: <span style="background:yellow">error: Resource stonith-sbd is active on 2 nodes (attempting
recovery)</span></span><span style="font-size:10pt;font-family:"Courier New";color:rgb(36,36,36)"><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27291 2022-02-22T04:16:31.699397+00:00 FILE-2
pacemaker-schedulerd[5018]: notice: See </span></span><span style="font-size:10pt;font-family:"Courier New""><a href="https://wiki.clusterlabs.org/wiki/FAQ#Resource_" target="_blank" title="https://wiki.clusterlabs.org/wiki/faq#resource_" style="color:rgb(5,99,193)"><span style="color:rgb(91,95,199);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;text-decoration-line:none">https://wiki.clusterlabs.org/wiki/FAQ#Resource_</span></a><span style="color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> is_Too_Active for more
information</span><span style="color:rgb(36,36,36)"><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27292 2022-02-22T04:16:31.699590+00:00 FILE-2
pacemaker-schedulerd[5018]: <span style="background:yellow">error: Resource FILE_Filesystem is active on 2 nodes (attem pting
recovery)</span></span><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27293 2022-02-22T04:16:31.699731+00:00 FILE-2
pacemaker-schedulerd[5018]: notice: See </span></span><a href="https://wiki.clusterlabs.org/wiki/FAQ#Resource_" target="_blank" title="https://wiki.clusterlabs.org/wiki/faq#resource_" style="color:rgb(5,99,193)"><span style="color:rgb(91,95,199);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;text-decoration-line:none">https://wiki.clusterlabs.org/wiki/FAQ#Resource_</span></a><span style="color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> is_Too_Active for more
information</span><span style="color:rgb(36,36,36)"><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27294 2022-02-22T04:16:31.699878+00:00 FILE-2
pacemaker-schedulerd[5018]: <span style="background:yellow">error: Resource IP_Floating is active on 2 nodes (attemptin g
recovery)</span></span><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27295 2022-02-22T04:16:31.700027+00:00 FILE-2
pacemaker-schedulerd[5018]: notice: See </span></span><a href="https://wiki.clusterlabs.org/wiki/FAQ#Resource_" target="_blank" title="https://wiki.clusterlabs.org/wiki/faq#resource_" style="color:rgb(5,99,193)"><span style="color:rgb(91,95,199);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;text-decoration-line:none">https://wiki.clusterlabs.org/wiki/FAQ#Resource_</span></a><span style="color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> is_Too_Active for more
information</span><span style="color:rgb(36,36,36)"><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27296 2022-02-22T04:16:31.700203+00:00 FILE-2
pacemaker-schedulerd[5018]: <span style="background:yellow">error: Resource Service_Postgresql is active on 2 nodes (at tempting
recovery)</span></span><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27297 2022-02-22T04:16:31.700354+00:00 FILE-2
pacemaker-schedulerd[5018]: notice: See </span></span><a href="https://wiki.clusterlabs.org/wiki/FAQ#Resource_" target="_blank" title="https://wiki.clusterlabs.org/wiki/faq#resource_" style="color:rgb(5,99,193)"><span style="color:rgb(91,95,199);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;text-decoration-line:none">https://wiki.clusterlabs.org/wiki/FAQ#Resource_</span></a><span style="color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> is_Too_Active for more
information</span><span style="color:rgb(36,36,36)"><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27298 2022-02-22T04:16:31.700501+00:00 FILE-2
pacemaker-schedulerd[5018]: error: <span style="background:yellow">Resource Service_Postgrest is active on 2 nodes (att empting
recovery)</span></span><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27299 2022-02-22T04:16:31.700648+00:00 FILE-2
pacemaker-schedulerd[5018]: notice: See </span></span><a href="https://wiki.clusterlabs.org/wiki/FAQ#Resource_" target="_blank" title="https://wiki.clusterlabs.org/wiki/faq#resource_" style="color:rgb(5,99,193)"><span style="color:rgb(91,95,199);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;text-decoration-line:none">https://wiki.clusterlabs.org/wiki/FAQ#Resource_</span></a><span style="color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> is_Too_Active for more
information</span><span style="color:rgb(36,36,36)"><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27300 2022-02-22T04:16:31.700792+00:00 FILE-2
pacemaker-schedulerd[5018]: <span style="background:yellow">error: Resource Service_esm_primary is active on 2 nodes (a ttempting
recovery)</span></span><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27301 2022-02-22T04:16:31.700939+00:00 FILE-2
pacemaker-schedulerd[5018]: notice: See </span></span><a href="https://wiki.clusterlabs.org/wiki/FAQ#Resource_" target="_blank" title="https://wiki.clusterlabs.org/wiki/faq#resource_" style="color:rgb(5,99,193)"><span style="color:rgb(91,95,199);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;text-decoration-line:none">https://wiki.clusterlabs.org/wiki/FAQ#Resource_</span></a><span style="color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> is_Too_Active for more
information</span><span style="color:rgb(36,36,36)"><br>
<span style="background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial">27302 2022-02-22T04:16:31.701086+00:00 FILE-2
pacemaker-schedulerd[5018]: <span style="background:yellow">error: Resource Shared_Cluster_Backup is active on 2 nodes
(attempting recovery)</span></span></span></span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> </span></p>
</td>
</tr>
</tbody></table>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:"Courier New";color:rgb(36,36,36);background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"> </span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">Can you guys please help us understand if this is indeed a split-brain
scenario ? Under what circumstances can such a scenario be observed? </p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">We can have very serious impact if such a case can re-occur
inspite of stonith already configured. Hence the ask .</p>
<p class="MsoNormal" style="margin:0in 0in 12pt;font-size:11pt;font-family:Calibri,sans-serif">In case this situation gets
reproduced, how can it be handled? </p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">Note: We have stonith configured and it has been working
fine so far. In this case also, the initial fencing happened from stonith only.</p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"> </p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">Thanks in advance!</p><p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">Priyanka</p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"> </p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"> </p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif"> </p></div>