<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:p="urn:schemas-microsoft-com:office:powerpoint" xmlns:a="urn:schemas-microsoft-com:office:access" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:s="uuid:BDC6E3F0-6DA3-11d1-A2A3-00AA00C14882" xmlns:rs="urn:schemas-microsoft-com:rowset" xmlns:z="#RowsetSchema" xmlns:b="urn:schemas-microsoft-com:office:publisher" xmlns:ss="urn:schemas-microsoft-com:office:spreadsheet" xmlns:c="urn:schemas-microsoft-com:office:component:spreadsheet" xmlns:odc="urn:schemas-microsoft-com:office:odc" xmlns:oa="urn:schemas-microsoft-com:office:activation" xmlns:html="http://www.w3.org/TR/REC-html40" xmlns:q="http://schemas.xmlsoap.org/soap/envelope/" xmlns:rtc="http://microsoft.com/officenet/conferencing" xmlns:D="DAV:" xmlns:Repl="http://schemas.microsoft.com/repl/" xmlns:mt="http://schemas.microsoft.com/sharepoint/soap/meetings/" xmlns:x2="http://schemas.microsoft.com/office/excel/2003/xml" xmlns:ppda="http://www.passport.com/NameSpace.xsd" xmlns:ois="http://schemas.microsoft.com/sharepoint/soap/ois/" xmlns:dir="http://schemas.microsoft.com/sharepoint/soap/directory/" xmlns:ds="http://www.w3.org/2000/09/xmldsig#" xmlns:dsp="http://schemas.microsoft.com/sharepoint/dsp" xmlns:udc="http://schemas.microsoft.com/data/udc" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:sub="http://schemas.microsoft.com/sharepoint/soap/2002/1/alerts/" xmlns:ec="http://www.w3.org/2001/04/xmlenc#" xmlns:sp="http://schemas.microsoft.com/sharepoint/" xmlns:sps="http://schemas.microsoft.com/sharepoint/soap/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:udcs="http://schemas.microsoft.com/data/udc/soap" xmlns:udcxf="http://schemas.microsoft.com/data/udc/xmlfile" xmlns:udcp2p="http://schemas.microsoft.com/data/udc/parttopart" xmlns:wf="http://schemas.microsoft.com/sharepoint/soap/workflow/" xmlns:dsss="http://schemas.microsoft.com/office/2006/digsig-setup" xmlns:dssi="http://schemas.microsoft.com/office/2006/digsig" xmlns:mdssi="http://schemas.openxmlformats.org/package/2006/digital-signature" xmlns:mver="http://schemas.openxmlformats.org/markup-compatibility/2006" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns:mrels="http://schemas.openxmlformats.org/package/2006/relationships" xmlns:spwp="http://microsoft.com/sharepoint/webpartpages" xmlns:ex12t="http://schemas.microsoft.com/exchange/services/2006/types" xmlns:ex12m="http://schemas.microsoft.com/exchange/services/2006/messages" xmlns:pptsl="http://schemas.microsoft.com/sharepoint/soap/SlideLibrary/" xmlns:spsl="http://microsoft.com/webservices/SharePointPortalServer/PublishedLinksService" xmlns:Z="urn:schemas-microsoft-com:" xmlns:st="" xmlns="http://www.w3.org/TR/REC-html40">

<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<style>
<!--
 /* Font Definitions */
 @font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
        {font-family:Verdana;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:11.0pt;
        font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:purple;
        text-decoration:underline;}
span.EmailStyle17
        {mso-style-type:personal-compose;
        font-family:"Calibri","sans-serif";
        color:windowtext;}
span.m1
        {mso-style-name:m1;
        color:blue;}
span.t1
        {mso-style-name:t1;
        color:#990000;}
span.b1
        {mso-style-name:b1;
        font-family:"Courier New";
        color:red;
        font-weight:bold;
        text-decoration:none none;}
.MsoChpDefault
        {mso-style-type:export-only;}
@page Section1
        {size:8.5in 11.0in;
        margin:1.0in 1.0in 1.0in 1.0in;}
div.Section1
        {page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext="edit">
  <o:idmap v:ext="edit" data="1" />
 </o:shapelayout></xml><![endif]-->
</head>

<body lang=EN-US link=blue vlink=purple>

<div class=Section1>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'>I’m experimenting with startup sequence and co-location
control, and think I may have stumbled across a bug.<o:p></o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'>I have two xml files that I use in my testing as my
initial configuration of a two node cluster.  I start each node with no
configuration, and then use cibadmin to “source in” the xml file. 
Each file defines two resources as well as a startup order and collocation definition. 
The only difference between the two files is the syntax I use to specify the
startup order.<o:p></o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'>When I use the syntax:<o:p></o:p></span></span></p>

<p class=MsoNormal><o:p> </o:p></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><</span></span><span class=t1><span
style='font-size:10.0pt;font-family:"Verdana","sans-serif"'>rsc_order</span></span><span
style='font-size:10.0pt;font-family:"Verdana","sans-serif"'> <span class=t1>id</span><span
class=m1>="</span><b>order-1</b><span class=m1>"</span><span
class=t1> first</span><span class=m1>="</span><b>world1</b><span class=m1>"</span><span
class=t1> then</span><span class=m1>="</span><b>world2</b><span class=m1>"</span><span
class=t1> score</span><span class=m1>="</span><b>INFINITY</b><span
class=m1>" /><o:p></o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'>Everything works fine.  I can put either of the
two nodes into standby while resources are running there, and the resources
move to the other node as expected.<o:p></o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'>However, when I use the syntax:<o:p></o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal style='text-indent:-24.0pt'><span style='font-size:10.0pt;
font-family:"Verdana","sans-serif"'><span class=MsoHyperlink><b><span
style='font-family:"Courier New";color:red'>-</span></b></span> <span class=m1><<</span><span
class=t1>rsc_order id</span><span class=m1>="</span><b>order-1</b><span
class=m1>"></span><o:p></o:p></span></p>

<p class=MsoNormal style='text-indent:-24.0pt'><span style='font-size:10.0pt;
font-family:"Verdana","sans-serif"'><span class=MsoHyperlink><b><span
style='font-family:"Courier New";color:red'>-</span></b></span> <span class=m1><  <</span><span
class=t1>resource_set id</span><span class=m1>="</span><b>order-1-set-1</b><span
class=m1>"</span><span class=t1> sequential</span><span class=m1>="</span><b>true</b><span
class=m1>"></span><o:p></o:p></span></p>

<p class=MsoNormal style='text-indent:-24.0pt'><span class=b1><span
style='font-size:10.0pt'> </span></span><span style='font-size:10.0pt;
font-family:"Verdana","sans-serif"'> <span class=m1><            <</span><span
class=t1>resource_ref</span> <span class=t1>id</span><span class=m1>="</span><b>world1</b><span
class=m1>" /></span> <o:p></o:p></span></p>

<p class=MsoNormal style='text-indent:-24.0pt'><span class=b1><span
style='font-size:10.0pt'> </span></span><span style='font-size:10.0pt;
font-family:"Verdana","sans-serif"'> <span class=m1><            <</span><span
class=t1>resource_ref</span> <span class=t1>id</span><span class=m1>="</span><b>world2</b><span
class=m1>" /></span> <o:p></o:p></span></p>

<p class=MsoNormal style='text-indent:-12.0pt'><span class=b1><span
style='font-size:10.0pt'> </span></span><span style='font-size:10.0pt;
font-family:"Verdana","sans-serif"'>  <span class=m1></</span><span
class=t1>resource_set</span><span class=m1>></span><o:p></o:p></span></p>

<p class=MsoNormal style='text-indent:-12.0pt'><span class=b1><span
style='font-size:10.0pt'> </span></span><span class=m1><span
style='font-size:10.0pt;font-family:"Verdana","sans-serif"'></</span></span><span
class=t1><span style='font-size:10.0pt;font-family:"Verdana","sans-serif"'>rsc_order</span></span><span
class=m1><span style='font-size:10.0pt;font-family:"Verdana","sans-serif"'>><o:p></o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'>Several bad things happen.  First, the resources
don’t move off the node that is put into standby, even though the
alternate node is running and able to run the resources.  Second,
attempting to shut down openais on the node running the resources after
attempting a forced move (by putting the node into standby) leaves both the lrmd
and pengine processes running (but children of process 1 (init), and the
resources continue to run on the that node even after openais is stopped.<o:p></o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'>I turned debug on in crmd and in the logs and recorded
what happens when I force standby, and I notice that using the first syntax
causes te_rsc_command to be executed to send a shut down message to the node where
the resources are running (which seems to work), while using the second syntax
causes te_pseudo_action to be called in approximately the same place in the log,
but no shutdown of resources happens (I can’t really tell what this is
supposed to be doing).<o:p></o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'>Has anyone else noticed this behavior?  Is this a
bug, or am I misusing this compact syntax somehow?<o:p></o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'>-Frank</span></span><span style='font-size:10.0pt;
font-family:"Verdana","sans-serif"'><o:p></o:p></span></p>

<p class=MsoNormal><span class=m1><span style='font-size:10.0pt;font-family:
"Verdana","sans-serif"'><o:p> </o:p></span></span></p>

<p class=MsoNormal><o:p> </o:p></p>

<p class=MsoNormal><o:p> </o:p></p>

<p class=MsoNormal><o:p> </o:p></p>

</div>

</body>

</html>