<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:p="urn:schemas-microsoft-com:office:powerpoint" xmlns:a="urn:schemas-microsoft-com:office:access" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:s="uuid:BDC6E3F0-6DA3-11d1-A2A3-00AA00C14882" xmlns:rs="urn:schemas-microsoft-com:rowset" xmlns:z="#RowsetSchema" xmlns:b="urn:schemas-microsoft-com:office:publisher" xmlns:ss="urn:schemas-microsoft-com:office:spreadsheet" xmlns:c="urn:schemas-microsoft-com:office:component:spreadsheet" xmlns:odc="urn:schemas-microsoft-com:office:odc" xmlns:oa="urn:schemas-microsoft-com:office:activation" xmlns:html="http://www.w3.org/TR/REC-html40" xmlns:q="http://schemas.xmlsoap.org/soap/envelope/" xmlns:rtc="http://microsoft.com/officenet/conferencing" xmlns:D="DAV:" xmlns:Repl="http://schemas.microsoft.com/repl/" xmlns:mt="http://schemas.microsoft.com/sharepoint/soap/meetings/" xmlns:x2="http://schemas.microsoft.com/office/excel/2003/xml" xmlns:ppda="http://www.passport.com/NameSpace.xsd" xmlns:ois="http://schemas.microsoft.com/sharepoint/soap/ois/" xmlns:dir="http://schemas.microsoft.com/sharepoint/soap/directory/" xmlns:ds="http://www.w3.org/2000/09/xmldsig#" xmlns:dsp="http://schemas.microsoft.com/sharepoint/dsp" xmlns:udc="http://schemas.microsoft.com/data/udc" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:sub="http://schemas.microsoft.com/sharepoint/soap/2002/1/alerts/" xmlns:ec="http://www.w3.org/2001/04/xmlenc#" xmlns:sp="http://schemas.microsoft.com/sharepoint/" xmlns:sps="http://schemas.microsoft.com/sharepoint/soap/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:udcs="http://schemas.microsoft.com/data/udc/soap" xmlns:udcxf="http://schemas.microsoft.com/data/udc/xmlfile" xmlns:udcp2p="http://schemas.microsoft.com/data/udc/parttopart" xmlns:wf="http://schemas.microsoft.com/sharepoint/soap/workflow/" xmlns:dsss="http://schemas.microsoft.com/office/2006/digsig-setup" xmlns:dssi="http://schemas.microsoft.com/office/2006/digsig" xmlns:mdssi="http://schemas.openxmlformats.org/package/2006/digital-signature" xmlns:mver="http://schemas.openxmlformats.org/markup-compatibility/2006" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns:mrels="http://schemas.openxmlformats.org/package/2006/relationships" xmlns:spwp="http://microsoft.com/sharepoint/webpartpages" xmlns:ex12t="http://schemas.microsoft.com/exchange/services/2006/types" xmlns:ex12m="http://schemas.microsoft.com/exchange/services/2006/messages" xmlns:pptsl="http://schemas.microsoft.com/sharepoint/soap/SlideLibrary/" xmlns:spsl="http://microsoft.com/webservices/SharePointPortalServer/PublishedLinksService" xmlns:Z="urn:schemas-microsoft-com:" xmlns:st="" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Segoe UI";
panose-1:2 11 5 2 4 2 4 2 2 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.Section1
{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=Section1>
<p class=MsoNormal>Hi,<o:p></o:p></p>
<p class=MsoNormal> We are having trouble with our two node cluster after
one node experiences an abrupt power failure. The resources do not seem
to start on the remaining node (ie DRBD resources do not promote to master).
In the log we notice:<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:12:27 qpr4 stonithd: [6622]: info: external_run_cmd: Calling
'/usr/lib64/stonith/plugins/external/ipmi reset qpr3' returned 256<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:12:27 qpr4 stonithd: [6622]: CRIT: external_reset_req: 'ipmi reset' for
host qpr3 failed with rc 256<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:12:27 qpr4 stonithd: [5854]: info: failed to STONITH node qpr3 with local
device stonith0 (exitcode 5), gonna try the next local device<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:12:27 qpr4 stonithd: [5854]: info: we can't manage qpr3, broadcast request
to other nodes<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:13:27 qpr4 stonithd: [5854]: ERROR: Failed to STONITH the node qpr3:
optype=RESET, op_result=TIMEOUT<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:13:27 qpr4 stonithd: [6763]: info: external_run_cmd: Calling
'/usr/lib64/stonith/plugins/external/ipmi reset qpr3' returned 256<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:13:27 qpr4 stonithd: [6763]: CRIT: external_reset_req: 'ipmi reset' for
host qpr3 failed with rc 256<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:13:27 qpr4 stonithd: [5854]: info: failed to STONITH node qpr3 with local
device stonith0 (exitcode 5), gonna try the next local device<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:13:27 qpr4 stonithd: [5854]: info: we can't manage qpr3, broadcast request
to other nodes<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Jan
8 02:14:27 qpr4 stonithd: [5854]: ERROR: Failed to STONITH the node qpr3:
optype=RESET, op_result=TIMEOUT<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Our
bootstrap options are:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>cluster-infrastructure="Heartbeat"
\<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>
expected-quorum-votes="2" \<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>
no-quorum-policy="ignore" \<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>
stonith-enabled="true" \<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>
cluster-delay="60s" \<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>
start-failure-is-fatal="false" \<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>
cluster-recheck-interval="15m" \<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Some
info from the hbreport is attached.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Thanks
for any insight.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;font-family:"Segoe UI","sans-serif"'>Diane
Schaefer<o:p></o:p></span></p>
</div>
</body>
</html>