You can use 'kind' and 'symmetrical' to control order constraints. The default value for symmetrical is 'true' which means that in order to stop dummy1 , the cluster has to stop dummy1 & dummy2.<div><br></div><div>Best Regards,</div><div>Strahil Nikolov<br> <br> <blockquote style="margin: 0 0 20px 0;"> <div style="font-family:Roboto, sans-serif; color:#6D00F6;"> <div>On Fri, Apr 8, 2022 at 15:29, ChittaNagaraj, Raghav</div><div><Raghav.ChittaNagaraj@dell.com> wrote:</div> </div> <div style="padding: 10px 0 0 20px; margin: 10px 0 0 0; border-left: 1px solid #6D00F6;"> <div id="yiv9734321973">
<style><!--
#yiv9734321973
_filtered {}
_filtered {}
_filtered {}
_filtered {}
#yiv9734321973
#yiv9734321973 p.yiv9734321973MsoNormal, #yiv9734321973 li.yiv9734321973MsoNormal, #yiv9734321973 div.yiv9734321973MsoNormal
{margin:0in;font-size:11.0pt;font-family:"Calibri", sans-serif;}
#yiv9734321973 span.yiv9734321973EmailStyle17
{font-family:"Calibri", sans-serif;color:windowtext;}
#yiv9734321973 .yiv9734321973MsoChpDefault
{font-family:"Calibri", sans-serif;}
_filtered {}
#yiv9734321973 div.yiv9734321973WordSection1
{}
--></style>
<div>
<div class="yiv9734321973WordSection1">
<p class="yiv9734321973MsoNormal">Hello Team,</p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">Hope you are doing well.</p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">I have a 4 node pacemaker cluster where I created clone dummy resources test-1, test-2 and test-3 below:</p>
<p class="yiv9734321973MsoNormal"> </p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>$ sudo pcs resource create test-1 ocf:heartbeat:Dummy op monitor timeout="20" interval="10" clone</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>$ sudo pcs resource create test-2 ocf:heartbeat:Dummy op monitor timeout="20" interval="10" clone</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>$ sudo pcs resource create test-3 ocf:heartbeat:Dummy op monitor timeout="20" interval="10" clone</b></p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">Then I ordered them so test-2-clone starts after test-1-clone and test-3-clone starts after test-2-clone:</p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>$ sudo pcs constraint order test-1-clone then test-2-clone</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>Adding test-1-clone test-2-clone (kind: Mandatory) (Options: first-action=start then-action=start)</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>$ sudo pcs constraint order test-2-clone then test-3-clone</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>Adding test-2-clone test-3-clone (kind: Mandatory) (Options: first-action=start then-action=start)</b></p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">Here are my clone sets(snippet of "pcs status" output pasted below):</p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"> <b>* Clone Set: test-1-clone [test-1]:</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b> * Started: [ node2_a node2_b node1_a node1_b ]</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b> * Clone Set: test-2-clone [test-2]:</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b> * Started: [ node2_a node2_b node1_a node1_b ]</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b> * Clone Set: test-3-clone [test-3]:</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b> * Started: [ node2_a node2_b node1_a node1_b ]</b></p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">Then I restart test-1 on just node1_a:</p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>$ sudo pcs resource restart test-1 node1_a</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>Warning: using test-1-clone... (if a resource is a clone, master/slave or bundle you must use the clone, master/slave or bundle name)</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>test-1-clone successfully restarted</b></p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">This causes test-2 and test-3 clones to restart on all pacemaker nodes when my intention is for them to restart on just node1_a.</p>
<p class="yiv9734321973MsoNormal">Below is the log tracing seen on the Designated Controller NODE1-B:</p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>Apr 07 20:25:01 NODE1-B pacemaker-schedulerd[95746]: notice: * Stop test-1:1 ( node1_a ) due to node availability</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>Apr 07 20:25:03 NODE1-B pacemaker-schedulerd[95746]: notice: * Restart test-2:0 (
<span style="background:yellow;">node1_b</span> ) due to required test-1-clone running</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>Apr 07 20:25:03 NODE1-B pacemaker-schedulerd[95746]: notice: * Restart test-2:1 ( node1_a ) due to required test-1-clone running</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>Apr 07 20:25:03 NODE1-B pacemaker-schedulerd[95746]: notice: * Restart test-2:2 (
<span style="background:yellow;">node2_b</span> ) due to required test-1-clone running</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b>Apr 07 20:25:03 NODE1-B pacemaker-schedulerd[95746]: notice: * Restart test-2:3 (
<span style="background:yellow;">node2_a</span> ) due to required test-1-clone running</b></p>
<p style="margin-left:.5in;" class="yiv9734321973MsoNormal"><b> </b></p>
<p class="yiv9734321973MsoNormal">Above is a representation of the observed behavior using dummy resources.
</p>
<p class="yiv9734321973MsoNormal">Is this the expected behavior of cloned resources?</p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">My goal is to be able to restart test-2-clone and test-3-clone on just the node that experienced test-1 restart rather than all other nodes in the cluster.</p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">Please let us know if any additional information will help for you to be able to provide feedback.</p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">Thanks for your help!</p>
<p class="yiv9734321973MsoNormal"> </p>
<p class="yiv9734321973MsoNormal">- Raghav</p>
<br>
<p align="Left" style="margin:0;" class="yiv9734321973msipfooter90245289"><span style="font-size:7.0pt;font-family:Calibri;color:#737373;">Internal Use - Confidential</span></p>
</div>
</div>
</div>_______________________________________________<br>Manage your subscription:<br><a href="https://lists.clusterlabs.org/mailman/listinfo/users" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><br><br>ClusterLabs home: <a href="https://www.clusterlabs.org/" target="_blank">https://www.clusterlabs.org/</a><br> </div> </blockquote></div>