<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1752119307;
mso-list-type:hybrid;
mso-list-template-ids:-1957157406 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">I have a two-node cluster with a problem. If I start Corosync/Pacemaker on one node, and then delay startup on the 2<sup>nd</sup> node (which is otherwise up and running), the 2<sup>nd</sup> node will be rebooted very soon after STONITH
is enabled on the first node. This reboot seems to be gratuitous and could under some circumstances be problematic. While, at present, I “manually” start Corosync/Pacemaker by invoking a script from an
<b><i>ssh</i></b> session, in a production environment, this script would be started by a
<b><i>systemd</i></b> service. It’s not hard to imagine that if both nodes were started at approximately the same time (each node runs on a separate motherboard in the same chassis), this behavior could cause one of the nodes to be rebooted while it’s in the
process of booting up.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The two nodes’ host names are <b><i>mgraid-16201289RN00023-0</i></b> and
<b><i>mgraid-16201289RN00023-1</i></b>. Both hosts are running, but Pacemaker has been started on neither. If Pacemaker is started on
<b><i>mgraid-16201289RN00023-0</i></b>, within a few seconds after STONITH is enabled, the following messages will appear in the system log file, and soon thereafter STONITH will be invoked to reboot the other node, on which Pacemaker has not yet been started.
(NB: The fence agent is a process named <b><i>mgpstonith</i></b> which uses the <b>
<i>ipmi</i></b> interface to reboot the other node. For debugging, it prints the data it receives from stdin. )<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:14.907668-07:00 mgraid-16201289RN00023-0 HA_STARTSTOP: Configure mgraid-stonith
<b><i># This message indicates that STONITH is about to be configured and enabled</i></b><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:15.018131-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16299]: info:... action=metadata#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:15.050817-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16301]: info:... action=metadata#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:21.085092-07:00 mgraid-16201289RN00023-0 pengine[16216]: warning: Scheduling Node mgraid-16201289RN00023-1 for STONITH<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:21.085615-07:00 mgraid-16201289RN00023-0 pengine[16216]: notice: * Fence (reboot) mgraid-16201289RN00023-1 'node is unclean'<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:21.085663-07:00 mgraid-16201289RN00023-0 pengine[16216]: notice: * Promote SS16201289RN00023:0 ( Stopped -> Master mgraid-16201289RN00023-0 )
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:21.085704-07:00 mgraid-16201289RN00023-0 pengine[16216]: notice: * Start mgraid-stonith:0 ( mgraid-16201289RN00023-0 )
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:21.091673-07:00 mgraid-16201289RN00023-0 pengine[16216]: warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-3.bz2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:21.093155-07:00 mgraid-16201289RN00023-0 crmd[16218]: notice: Initiating monitor operation SS16201289RN00023:0_monitor_0 locally on mgraid-16201289RN00023-0
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:21.124403-07:00 mgraid-16201289RN00023-0 crmd[16218]: notice: Initiating monitor operation mgraid-stonith:0_monitor_0 locally on mgraid-16201289RN00023-0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:21.132994-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16361]: info:... action=metadata#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.128139-07:00 mgraid-16201289RN00023-0 crmd[16218]: notice: Requesting fencing (reboot) of node mgraid-16201289RN00023-1
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.129150-07:00 mgraid-16201289RN00023-0 crmd[16218]: notice: Result of probe operation for SS16201289RN00023 on mgraid-16201289RN00023-0: 7 (not running)
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.129191-07:00 mgraid-16201289RN00023-0 crmd[16218]: notice: mgraid-16201289RN00023-0-SS16201289RN00023_monitor_0:6 [ \n\n ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.133846-07:00 mgraid-16201289RN00023-0 stonith-ng[16213]: notice: Client crmd.16218.a7e3cbae wants to fence (reboot) 'mgraid-16201289RN00023-1' with device '(any)'<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.133997-07:00 mgraid-16201289RN00023-0 stonith-ng[16213]: notice: Requesting peer fencing (reboot) of mgraid-16201289RN00023-1
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.136287-07:00 mgraid-16201289RN00023-0 crmd[16218]: notice: Result of probe operation for mgraid-stonith on mgraid-16201289RN00023-0: 7 (not running)
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.141393-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16444]: info:... action=status#012
<b><i># Status requests always return 0.</i></b><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.141418-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16444]: info:... nodename=mgraid-16201289RN00023-1#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.141432-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16444]: info:... port=mgraid-16201289RN00023-1#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.141444-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16444]: info:Ignoring: port<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.148973-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16445]: info:... action=status#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.148997-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16445]: info:... nodename=mgraid-16201289RN00023-1#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.149009-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16445]: info:... port=mgraid-16201289RN00023-1#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.149019-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16445]: info:Ignoring: port<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.155226-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16446]: info:... action=reboot#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.155250-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16446]: info:... nodename=mgraid-16201289RN00023-1#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.155263-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16446]: info:... port=mgraid-16201289RN00023-1#012<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2019-07-08T13:11:22.155273-07:00 mgraid-16201289RN00023-0 MGPSTONITH[16446]: info:Ignoring: port<o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:9.0pt;font-family:"Courier New"">
<hr size="2" width="100%" align="center">
</span></div>
<p class="MsoNormal">Following is a relevant excerpt of the corosync.log file –<o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: unpack_config: STONITH timeout: 60000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: unpack_config: STONITH of failed nodes is enabled<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: unpack_config: Concurrent fencing is disabled<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: unpack_config: Stop all active resources: false<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: unpack_config: Cluster is symmetric - resources can run anywhere by default<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: unpack_config: Default stickiness: 0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: unpack_config: On loss of CCM Quorum: Stop ALL resources<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: determine_online_status_fencing: Node mgraid-16201289RN00023-0 is active<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: determine_online_status: Node mgraid-16201289RN00023-0 is online<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: unpack_node_loop: Node 1 is already processed<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: unpack_node_loop: Node 1 is already processed<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: clone_print: Master/Slave Set: ms-SS16201289RN00023 [SS16201289RN00023]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: short_print: Stopped: [ mgraid-16201289RN00023-0 mgraid-16201289RN00023-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: clone_print: Clone Set: mgraid-stonith-clone [mgraid-stonith]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: short_print: Stopped: [ mgraid-16201289RN00023-0 mgraid-16201289RN00023-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_rsc_location: Constraint (ms-SS16201289RN00023-master-w1-rule) is not active (role : Master vs.
Unknown)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_rsc_location: Constraint (ms-SS16201289RN00023-master-w1-rule) is not active (role : Master vs.
Unknown)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_rsc_location: Constraint (ms-SS16201289RN00023-master-w1-rule) is not active (role : Master vs.
Unknown)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: distribute_children: Allocating up to 2 ms-SS16201289RN00023 instances to a possible 1 nodes (at most 1
per host, 2 optimal)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_assign_node: Assigning mgraid-16201289RN00023-0 to SS16201289RN00023:0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_assign_node: All nodes for resource SS16201289RN00023:1 are unavailable, unclean or shutting down (mgraid-16201289RN00023-1:
0, -1000000)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_assign_node: Could not allocate a node for SS16201289RN00023:1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: native_color: Resource SS16201289RN00023:1 cannot run anywhere<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: distribute_children: Allocated 1 ms-SS16201289RN00023 instances of a possible 2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: master_color: SS16201289RN00023:0 master score: 99<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: master_color: Promoting SS16201289RN00023:0 (Stopped mgraid-16201289RN00023-0)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: master_color: SS16201289RN00023:1 master score: 0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: master_color: ms-SS16201289RN00023: Promoted 1 instances of a possible 1 to master<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: distribute_children: Allocating up to 2 mgraid-stonith-clone instances to a possible 1 nodes (at most 1
per host, 2 optimal)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_assign_node: Assigning mgraid-16201289RN00023-0 to mgraid-stonith:0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_assign_node: All nodes for resource mgraid-stonith:1 are unavailable, unclean or shutting down (mgraid-16201289RN00023-1:
0, -1000000)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_assign_node: Could not allocate a node for mgraid-stonith:1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: native_color: Resource mgraid-stonith:1 cannot run anywhere<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: distribute_children: Allocated 1 mgraid-stonith-clone instances of a possible 2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_create_probe: Probing SS16201289RN00023:0 on mgraid-16201289RN00023-0 (Stopped) 1 (nil)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_create_probe: Probing mgraid-stonith:0 on mgraid-16201289RN00023-0 (Stopped) 1 (nil)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: master_create_actions: Creating actions for ms-SS16201289RN00023<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: RecurringOp: Start recurring monitor (3s) for SS16201289RN00023:0 on mgraid-16201289RN00023-0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: RecurringOp: Start recurring monitor (3s) for SS16201289RN00023:0 on mgraid-16201289RN00023-0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: warning: stage6: Scheduling Node mgraid-16201289RN00023-1 for STONITH<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: native_start_constraints: Ordering mgraid-stonith:0_start_0 after mgraid-16201289RN00023-1 recovery<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: notice: LogNodeActions: * Fence (reboot) mgraid-16201289RN00023-1 'node is unclean'<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: notice: LogAction: * Promote SS16201289RN00023:0 ( Stopped -> Master mgraid-16201289RN00023-0 )
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: LogActions: Leave SS16201289RN00023:1 (Stopped)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: notice: LogAction: * Start mgraid-stonith:0 ( mgraid-16201289RN00023-0 )
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: info: LogActions: Leave mgraid-stonith:1 (Stopped)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: action2xml: Using anonymous clone name SS16201289RN00023 for SS16201289RN00023:0 (aka. (null))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: action2xml: Using anonymous clone name SS16201289RN00023 for SS16201289RN00023:0 (aka. (null))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: action2xml: Using anonymous clone name SS16201289RN00023 for SS16201289RN00023:0 (aka. (null))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: action2xml: Using anonymous clone name SS16201289RN00023 for SS16201289RN00023:0 (aka. (null))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: action2xml: Using anonymous clone name SS16201289RN00023 for SS16201289RN00023:0 (aka. (null))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: action2xml: Using anonymous clone name SS16201289RN00023 for SS16201289RN00023:0 (aka. (null))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: action2xml: Using anonymous clone name SS16201289RN00023 for SS16201289RN00023:0 (aka. (null))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: action2xml: Using anonymous clone name mgraid-stonith for mgraid-stonith:0 (aka. (null))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: debug: action2xml: Using anonymous clone name mgraid-stonith for mgraid-stonith:0 (aka. (null))<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Jul 08 13:11:21 [16216] mgraid-16201289RN00023-0 pengine: warning: process_pe_message: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-3.bz2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:9.0pt;font-family:"Courier New"">
<hr size="2" width="100%" align="center">
</span></div>
<p class="MsoNormal">Here is the status of the first node, once Pacemaker is started –<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">[root@mgraid-16201289RN00023-0 bin]# pcs status<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Cluster name:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Stack: corosync<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Current DC: mgraid-16201289RN00023-0 (version 1.1.19-8.el7-c3c624ea3d) - partition with quorum<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Last updated: Mon Jul 8 17:51:22 2019<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Last change: Mon Jul 8 16:11:23 2019 by root via cibadmin on mgraid-16201289RN00023-0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2 nodes configured<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">4 resources configured<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Online: [ mgraid-16201289RN00023-0 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">OFFLINE: [ mgraid-16201289RN00023-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Full list of resources:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Master/Slave Set: ms-SS16201289RN00023 [SS16201289RN00023]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> SS16201289RN00023 (ocf::omneon:ss): Starting mgraid-16201289RN00023-0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Stopped: [ mgraid-16201289RN00023-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Clone Set: mgraid-stonith-clone [mgraid-stonith]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Started: [ mgraid-16201289RN00023-0 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Stopped: [ mgraid-16201289RN00023-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Daemon Status:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> corosync: active/disabled<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> pacemaker: active/disabled<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> pcsd: inactive/disabled<o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:9.0pt;font-family:"Courier New"">
<hr size="2" width="100%" align="center">
</span></div>
<p class="MsoNormal">Here’s the configuration, from the first node –<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">[root@mgraid-16201289RN00023-0 bin]# pcs status<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Cluster name:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Stack: corosync<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Current DC: mgraid-16201289RN00023-0 (version 1.1.19-8.el7-c3c624ea3d) - partition with quorum<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Last updated: Mon Jul 8 17:51:22 2019<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Last change: Mon Jul 8 16:11:23 2019 by root via cibadmin on mgraid-16201289RN00023-0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">2 nodes configured<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">4 resources configured<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Online: [ mgraid-16201289RN00023-0 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">OFFLINE: [ mgraid-16201289RN00023-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Full list of resources:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Master/Slave Set: ms-SS16201289RN00023 [SS16201289RN00023]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> SS16201289RN00023 (ocf::omneon:ss): Starting mgraid-16201289RN00023-0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Stopped: [ mgraid-16201289RN00023-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Clone Set: mgraid-stonith-clone [mgraid-stonith]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Started: [ mgraid-16201289RN00023-0 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Stopped: [ mgraid-16201289RN00023-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Daemon Status:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> corosync: active/disabled<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> pacemaker: active/disabled<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> pcsd: inactive/disabled<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">[root@mgraid-16201289RN00023-0 bin]# pcs config<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Cluster Name:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Corosync Nodes:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">mgraid-16201289RN00023-0 mgraid-16201289RN00023-1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Pacemaker Nodes:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">mgraid-16201289RN00023-0 mgraid-16201289RN00023-1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Resources:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Master: ms-SS16201289RN00023<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Meta Attrs: clone-max=2 notify=true globally-unique=false target-role=Started<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Resource: SS16201289RN00023 (class=ocf provider=omneon type=ss)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Attributes: ss_resource=SS16201289RN00023 ssconf=/var/omneon/config/config.16201289RN00023<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Operations: monitor interval=3s role=Master timeout=7s (SS16201289RN00023-monitor-3s)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> monitor interval=10s role=Slave timeout=7 (SS16201289RN00023-monitor-10s)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> stop interval=0 timeout=20 (SS16201289RN00023-stop-0)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> start interval=0 timeout=300 (SS16201289RN00023-start-0)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Clone: mgraid-stonith-clone<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Resource: mgraid-stonith (class=stonith type=mgpstonith)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Operations: monitor interval=0 timeout=20s (mgraid-stonith-monitor-interval-0)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Stonith Devices:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Fencing Levels:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Location Constraints:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Resource: ms-SS16201289RN00023<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Constraint: ms-SS16201289RN00023-master-w1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Rule: role=master score=100 (id:ms-SS16201289RN00023-master-w1-rule)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Expression: #uname eq mgraid-16201289rn00023-0 (id:ms-SS16201289RN00023-master-w1-rule-expression)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Ordering Constraints:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Colocation Constraints:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Ticket Constraints:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Alerts:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">No alerts defined<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Resources Defaults:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">failure-timeout: 1min<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Operations Defaults:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">No defaults set<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Cluster Properties:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">cluster-infrastructure: corosync<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">cluster-recheck-interval: 1min<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">dc-deadtime: 5s<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">dc-version: 1.1.19-8.el7-c3c624ea3d<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">have-watchdog: false<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">last-lrm-refresh: 1562513532<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">stonith-enabled: true<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">Quorum:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> Options:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> wait_for_all: 0<o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:9.0pt;font-family:"Courier New"">
<hr size="2" width="100%" align="center">
</span></div>
<p class="MsoNormal">Interestingly, as you’ll note below, the “<i>two_node</i>” option is also set to 1, but is not reported as such above.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Finally, here’s <b><i>/etc/corosync/corosync.conf</i></b> –<o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">totem {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> version: 2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> crypto_cipher: none<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> crypto_hash: none<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> interface {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> ringnumber: 0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> bindnetaddr: 169.254.1.1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> mcastaddr: 239.255.1.1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> mcastport: 5405<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> ttl: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> }<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">logging {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> fileline: off<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> to_stderr: no<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> to_logfile: yes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> logfile: /var/log/cluster/corosync.log<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> to_syslog: yes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> debug: on<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> timestamp: on<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> logger_subsys {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> subsys: QUORUM<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> debug: on<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> }<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">nodelist {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> node {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> ring0_addr: mgraid-16201289RN00023-0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> nodeid: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> }<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> node {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> ring0_addr: mgraid-16201289RN00023-1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> nodeid: 2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> }<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">quorum {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> provider: corosync_votequorum<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> two_node: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New""> wait_for_all: 0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New"">}<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I’d appreciate any insight you can offer into this behavior, and any suggestions you may have.<br>
<br>
<o:p></o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal"> Michael<o:p></o:p></p>
<p class="MsoNormal"><img width="161" height="51" style="width:1.677in;height:.5312in" id="Picture_x005f_x0020_1" src="cid:image001.gif@01D535B2.D3781210" alt="cid:image004.gif@01D15F05.08FA4670"><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#1F497D"> Michael Powell<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#1F497D"> Sr. Staff Engineer<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#1F497D"> 15220 NW Greenbrier Pkwy<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#1F497D"> Suite 290<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#1F497D"> Beaverton, OR 97006<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#1F497D"> T 503-372-7327 M 503-789-3019 H 503-625-5332<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>