<!DOCTYPE html>
<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>Hi Olaf,</p>
    <div class="moz-cite-prefix">Dne 05. 01. 26 v 20:20 Faaland, Olaf P.
      via Users napsal(a):<br>
    </div>
    <blockquote type="cite"
      cite="mid:578CB05D-9DE3-4620-8546-7D36470E749F@llnl.gov">
      <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
      <meta name="Generator"
        content="Microsoft Word 15 (filtered medium)">
      <style>@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
        {font-family:Aptos;
        panose-1:2 11 0 4 2 2 2 2 2 4;}@font-face
        {font-family:Menlo;
        panose-1:2 11 6 9 3 8 4 2 2 4;}p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        font-size:12.0pt;
        font-family:"Aptos",sans-serif;
        mso-ligatures:standardcontextual;}span.EmailStyle17
        {mso-style-type:personal-compose;
        font-family:"Aptos",sans-serif;
        color:windowtext;}p.p1, li.p1, div.p1
        {mso-style-name:p1;
        margin:0in;
        font-size:8.5pt;
        font-family:Menlo;
        color:black;}span.s1
        {mso-style-name:s1;
        color:#F62218;}span.s2
        {mso-style-name:s2;}span.apple-converted-space
        {mso-style-name:apple-converted-space;}.MsoChpDefault
        {mso-style-type:export-only;}div.WordSection1
        {page:WordSection1;}</style>
      <div class="WordSection1">
        <p class="MsoNormal">Hi,<o:p></o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal">I’m starting to use stonith levels.<o:p></o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal">My existing (1-level stonith config) looks
          like this:<o:p></o:p></p>
        <p class="p1"><span class="s1">#</span><span class="s2"> pcs
            stonith config</span><o:p></o:p></p>
        <p class="p1"><span class="s2">Resource: fence_pm (class=stonith
            type=fence_powerman)</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">  </span><span
            class="s2">Attributes: fence_pm-instance_attributes</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">    </span><span
            class="s2">ipaddr=localhost</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">    </span><span
            class="s2">ipport=10101</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">    </span><span
            class="s2">pcmk_delay_base=60s</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">    </span><span
            class="s2">pcmk_delay_max=90s</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">    </span><span
            class="s2">pcmk_host_check=static-list</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">    </span><span
            class="s2">pcmk_host_list=gopher1,gopher2,gopher3,gopher4,gopher5,gopher6,gopher7,gopher8,gopher9,gopher10</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">  </span><span
            class="s2">Operations:</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">    </span><span
            class="s2">monitor: fence_pm-monitor-interval-60s</span><o:p></o:p></p>
        <p class="p1"><span class="apple-converted-space">      </span><span
            class="s2">interval=60s</span><o:p></o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal">And I want to switch to a 2-level stonith
          config.  I’d expected these commands to work:<o:p></o:p></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:#2EAEBB;mso-ligatures:none">lustre_servers</span>=<span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">gopher1,gopher2,gopher3,gopher4,gopher5,gopher6,gopher7,gopher8,gopher9,gopher10</span><span
style="font-size:8.5pt;font-family:Menlo;color:#C814C9;mso-ligatures:none"><o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:#400BD9;mso-ligatures:none">#
            set up new fence agent<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">pcs
            stonith create fence_kdump fence_kdump
          </span><span
style="font-size:8.5pt;font-family:Menlo;color:#2EAEBB;mso-ligatures:none">pcmk_host_check</span><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">=static-list
          </span><span
style="font-size:8.5pt;font-family:Menlo;color:#2EAEBB;mso-ligatures:none">pcmk_host_list</span><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">=</span><span
style="font-size:8.5pt;font-family:Menlo;color:#C814C9;mso-ligatures:none">${lustre_servers}</span><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none"><o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:#400BD9;mso-ligatures:none">#
            set levels (priority) so pacemaker knows which to use first<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">pcs
            stonith level add
          </span><span
style="font-size:8.5pt;font-family:Menlo;color:#B42419;mso-ligatures:none">1</span><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">
          </span><span
style="font-size:8.5pt;font-family:Menlo;color:#C814C9;mso-ligatures:none">${lustre_servers}</span><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">
            fence_kdump<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">pcs
            stonith level add
          </span><span
style="font-size:8.5pt;font-family:Menlo;color:#B42419;mso-ligatures:none">2</span><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">
          </span><span
style="font-size:8.5pt;font-family:Menlo;color:#C814C9;mso-ligatures:none">${lustre_servers}</span><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">
            fence_pm<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:#400BD9;mso-ligatures:none">#
            verify config<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none">pcs 
            stonith level verify<o:p></o:p></span></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal">The “pcs stonith create” succeeds, but the
          “pcs stonith level add” fails.  Looking at the man page, it
          looks like a comma-separated target list isn’t allowed for
          “pcs stonith level add”.  Is that correct?</p>
      </div>
    </blockquote>
    <p>It would be helpful to see the error messages pcs printed.</p>
    <p>Anyway, the target is supposed to be a single value, e.g. a node
      name, as the man page describes. I don't think a list has ever
      been allowed there.</p>
    <p>Since your fence_kdump and fence_pm handle all cluster nodes, you
      can use them for all your nodes. Meaning you need to run those two
      commands for every node, unless you decide to specify nodes using
      regular expressions or node attributes.</p>
    <blockquote type="cite"
      cite="mid:578CB05D-9DE3-4620-8546-7D36470E749F@llnl.gov">
      <div class="WordSection1">
        <p class="MsoNormal"><o:p></o:p></p>
        <p class="MsoNormal">In the man page, I see<o:p></o:p></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none"> 
                  Target may be a node name <node_name> or
            %<node_name> or<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none"> 
                  node%<node_name>, a node name regular expression
            regexp%<node_pattern><o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:8.5pt;font-family:Menlo;color:black;mso-ligatures:none"> 
                  or a node attribute value
            attrib%<name>=<value>.<o:p></o:p></span></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal">Is “%” literal, here?</p>
      </div>
    </blockquote>
    yes
    <blockquote type="cite"
      cite="mid:578CB05D-9DE3-4620-8546-7D36470E749F@llnl.gov">
      <div class="WordSection1">
        <p class="MsoNormal"><o:p></o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal">Do<o:p></o:p></p>
        <p class="MsoNormal">“pcs stonith level add <level>
          node%<node_name> <stonith_id>” and<o:p></o:p></p>
        <p class="MsoNormal">“pcs stonith level add <level>
          %<node_name> <stonith_id>” and<o:p></o:p></p>
        <p class="MsoNormal">“pcs stonith level add <level>
          <node_name> <stonith_id>” mean something
          different?  They seem identical from brief experiments.</p>
      </div>
    </blockquote>
    They are the same. If type (the part in front of %) is not
    specified, it defaults to 'node'.
    <blockquote type="cite"
      cite="mid:578CB05D-9DE3-4620-8546-7D36470E749F@llnl.gov">
      <div class="WordSection1">
        <p class="MsoNormal"><o:p></o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal">How is “attrib%<name>=<value>”
          used?</p>
      </div>
    </blockquote>
    <p>This makes the level apply to nodes with the specified attribute
      name and value. It is documented at
<a class="moz-txt-link-freetext" href="https://clusterlabs.org/projects/pacemaker/doc/3.0/Pacemaker_Explained/html/fencing.html#fencing-topologies">https://clusterlabs.org/projects/pacemaker/doc/3.0/Pacemaker_Explained/html/fencing.html#fencing-topologies</a>
      . Node attributes are managed using 'pcs node attribute' command.</p>
    <p>Regards,<br>
      Tomas</p>
    <blockquote type="cite"
      cite="mid:578CB05D-9DE3-4620-8546-7D36470E749F@llnl.gov">
      <div class="WordSection1">
        <p class="MsoNormal"><o:p></o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal">Thanks,<o:p></o:p></p>
        <p class="MsoNormal">Olaf<o:p></o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
      </div>
      <br>
      <fieldset class="moz-mime-attachment-header"></fieldset>
      <pre wrap="" class="moz-quote-pre">_______________________________________________
Manage your subscription:
<a class="moz-txt-link-freetext" href="https://lists.clusterlabs.org/mailman/listinfo/users">https://lists.clusterlabs.org/mailman/listinfo/users</a>

ClusterLabs home: <a class="moz-txt-link-freetext" href="https://www.clusterlabs.org/">https://www.clusterlabs.org/</a>
</pre>
    </blockquote>
  </body>
</html>