<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:宋体;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:等线;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"\@等线";
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"\@宋体";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
text-align:justify;
text-justify:inter-ideograph;
font-size:10.5pt;
font-family:等线;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin:0cm;
margin-bottom:.0001pt;
text-align:justify;
text-justify:inter-ideograph;
text-indent:21.0pt;
font-size:10.5pt;
font-family:等线;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:宋体;}
span.EmailStyle19
{mso-style-type:personal-compose;
font-family:等线;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
font-family:等线;}
/* Page Definitions */
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1651400897;
mso-list-type:hybrid;
mso-list-template-ids:930009902 886842760 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-text:"\(%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:18.0pt;
text-indent:-18.0pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-text:"%2\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:42.0pt;
text-indent:-21.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:63.0pt;
text-indent:-21.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:84.0pt;
text-indent:-21.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-text:"%5\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:105.0pt;
text-indent:-21.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:126.0pt;
text-indent:-21.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:147.0pt;
text-indent:-21.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-text:"%8\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:168.0pt;
text-indent:-21.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:189.0pt;
text-indent:-21.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="ZH-CN" link="#0563C1" vlink="#954F72" style="text-justify-trim:punctuation">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hello,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">I want to setup a cluster in two nodes. One is master and the other is slave. I don</span>’<span lang="EN-US">t need the fencing device because my internal network is stable. I use the following command to create the
resource, but all of the two nodes are slave and cluster don’t promote it to master. Could you please help check if there is anything wrong with my configuration?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal" align="left" style="text-align:left"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">pcs property set stonith-enabled=false;</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal" align="left" style="text-align:left"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">pcs resource create pgsqld ocf:heartbeat:pgsqlms bindir=/usr/local/pgsql/bin pgdata=/home/postgres/data op start
timeout=600s op stop timeout=60s op promote timeout=300s op demote timeout=120s op monitor interval=15s timeout=100s role="Master" op monitor interval=16s timeout=100s role="Slave" op notify timeout=60s;pcs resource master pgsql-ha pgsqld notify=true interleave=true;</span><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">The status is as below:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">[root@node1 ~]# pcs status<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Cluster name: cluster_pgsql<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Stack: corosync<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Current DC: node2-1 (version 1.1.15-11.el7-e174ec8) - partition with quorum<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Last updated: Mon Apr 2 21:51:57 2018 Last change: Mon Apr 2 21:32:22 2018 by hacluster via crmd on node2-1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">2 nodes and 3 resources configured<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Online: [ node1-1 node2-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Full list of resources:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Master/Slave Set: pgsql-ha [pgsqld]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"> Slaves: [ node1-1 node2-1 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">pgsql-master-ip (ocf::heartbeat:IPaddr2): Stopped<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Daemon Status:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"> corosync: active/disabled<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"> pacemaker: active/disabled<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"> pcsd: active/enabled<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">When I execute pcs resource cleanup in one node, there is always one node print the following waring message in the /var/log/messages. But the other nodes’ log show no error. The resource log</span>（<span lang="EN-US">pgsqlms</span>）<span lang="EN-US">
show the monitor action could return 0 but why the crmd log show failed?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: warning: No reason to expect node 1 to be down<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: notice: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: warning: No reason to expect node 2 to be down<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 pengine[2424]: notice: Start pgsqld:0#011(node1-1)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 pengine[2424]: notice: Start pgsqld:1#011(node2-1)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 pengine[2424]: notice: Calculated transition 4, saving inputs in /var/lib/pacemaker/pengine/pe-input-6.bz2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: notice: Initiating monitor operation pgsqld:0_monitor_0 on node1-1 | action 2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: notice: Initiating monitor operation pgsqld:1_monitor_0 locally on node2-1 | action 3<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 pgsqlms(pgsqld)[3644]: INFO: Action is monitor<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 pgsqlms(pgsqld)[3644]: INFO: pgsql_monitor: monitor is a probe<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 pgsqlms(pgsqld)[3644]: INFO: pgsql_monitor: instance "pgsqld" is listening<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 pgsqlms(pgsqld)[3644]: INFO: Action result is 0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: notice: Result of probe operation for pgsqld on node2-1: 0 (ok) | call=33 key=pgsqld_monitor_0 confirmed=true cib-update=62<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: warning: Action 3 (pgsqld:1_monitor_0) on node2-1 failed (target: 7 vs. rc: 0): Error<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: notice: Transition aborted by operation pgsqld_monitor_0 'create' on node2-1: Event failed | magic=0:0;3:4:7:3a132f28-d8b9-4948-bb6b-736edc221664
cib=0.28.2 source=match_graph_event:310 complete=false<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: warning: Action 3 (pgsqld:1_monitor_0) on node2-1 failed (target: 7 vs. rc: 0): Error<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: warning: Action 2 (pgsqld:0_monitor_0) on node1-1 failed (target: 7 vs. rc: 0): Error<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: warning: Action 2 (pgsqld:0_monitor_0) on node1-1 failed (target: 7 vs. rc: 0): Error<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: notice: Transition 4 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=10, Source=/var/lib/pacemaker/pengine/pe-input-6.bz2):
Complete<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 pengine[2424]: notice: Calculated transition 5, saving inputs in /var/lib/pacemaker/pengine/pe-input-7.bz2<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: notice: Initiating monitor operation pgsqld_monitor_16000 locally on node2-1 | action 4<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 crmd[2425]: notice: Initiating monitor operation pgsqld_monitor_16000 on node1-1 | action 7<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt;font-family:"Courier New";background:#D9D9D9">Apr 2 21:53:09 node2 pgsqlms(pgsqld)[3663]: INFO: Action is monitor<o:p></o:p></span></p>
</div>
</body>
</html>