<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:853376819;
mso-list-type:hybrid;
mso-list-template-ids:1325177542 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D">Hi <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">I am using a two node pacemaker cluster with teaming enabled. The cluster has<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo2"><![if !supportLists]><span style="color:#1F497D"><span style="mso-list:Ignore">1.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span style="color:#1F497D">Two team interfaces with different subents.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo2"><![if !supportLists]><span style="color:#1F497D"><span style="mso-list:Ignore">2.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span style="color:#1F497D">The team1 has a NFS VIP plumbed to it.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo2"><![if !supportLists]><span style="color:#1F497D"><span style="mso-list:Ignore">3.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span style="color:#1F497D">The VirtualIP from pacemaker is configured to plumb to team0(Corosync ring number is 0)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">In this case the corosync takes the NFS IP as its ring address and checks the same in the corosync.conf. Since conf file has team0 hostname the corosync start fails.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Outputs:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><u><span style="color:#1F497D">$ip a output:<o:p></o:p></span></u></b></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> inet 127.0.0.1/8 scope host lo<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> inet6 ::1/128 scope host <o:p>
</o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master team0 state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 38:63:bb:3f:a4:ac brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master team1 state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 38:63:bb:3f:a4:ad brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 38:63:bb:3f:a4:ae brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">5: eth3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 38:63:bb:3f:a4:af brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">6: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master team0 state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 36:f7:05:1f:b3:b1 brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">7: eth5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master team1 state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 38:63:bb:3f:a4:ad brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">8: eth6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 28:80:23:a7:dd:fe brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">9: eth7: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 28:80:23:a7:dd:ff brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10: team1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 38:63:bb:3f:a4:ad brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> inet 10.64.23.117/28 brd 10.64.23.127 scope global team1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> inet <span style="background:yellow;mso-highlight:yellow">
10.64.23.121</span>/24 scope global secondary team1:~m0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> inet6 fe80::3a63:bbff:fe3f:a4ad/64 scope link
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">11: team0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> link/ether 38:63:bb:3f:a4:ac brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> inet 10.64.23.103/28 brd 10.64.23.111 scope global team0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> inet6 fe80::3a63:bbff:fe3f:a4ac/64 scope link
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><u><span style="color:#1F497D">Corosync Conf File:<o:p></o:p></span></u></b></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">cat /etc/corosync/corosync.conf<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">totem {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> version: 2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> secauth: off<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> cluster_name: DES<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> transport: udp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> rrp_mode: passive<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> interface {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> ringnumber: 0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> bindnetaddr: 10.64.23.96<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> mcastaddr: 224.1.1.1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> mcastport: 6860<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> }<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">nodelist {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> node {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> ring0_addr: dl380x4415<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> nodeid: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> }<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> node {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> ring0_addr: dl360x4405<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> nodeid: 2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> }<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">quorum {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> provider: corosync_votequorum<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> two_node: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">logging {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> to_logfile: yes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> logfile: /var/log/cluster/corosync.log<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"> to_syslog: yes<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><u><span style="color:#1F497D">/etc/hosts:<o:p></o:p></span></u></b></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">$ cat /etc/hosts<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">::1 localhost localhost.localdomain localhost6 localhost6.localdomain6<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.101 dl380x4416<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.104 dl380x4389<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.106 dl360x4387<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.103 dl380x4415<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.105 dl360x4405<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.115 dl380x4416-int<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.117 dl380x4415-int<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.119 dl360x4405-int<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.120 dl360x4387-int<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.118 dl380x4389-int<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">10.64.23.102 dl380x4414<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><u><span style="color:#1F497D">Logs:<o:p></o:p></span></u></b></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[3029] dl380x4415 corosyncerror [MAIN ] Corosync Cluster Engine exiting with status 20 at service.c:356.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncnotice [MAIN ] Corosync Cluster Engine ('2.4.0'): started and ready to provide service.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncinfo [MAIN ] Corosync built-in features: dbus systemd xmlconf qdevices qnetd snmp pie relro bindnow<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncnotice [TOTEM ] Initializing transport (UDP/IP Multicast).<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncnotice [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncnotice [TOTEM ] The network interface [<span style="background:yellow;mso-highlight:yellow">10.64.23.121</span>] is now up.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncnotice [SERV ] Service engine loaded: corosync configuration map access [0]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncinfo [QB ] server name: cmap<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncnotice [SERV ] Service engine loaded: corosync configuration service [1]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncinfo [QB ] server name: cfg<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncnotice [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncinfo [QB ] server name: cpg<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncnotice [SERV ] Service engine loaded: corosync profile loading service [4]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncnotice [QUORUM] Using quorum provider corosync_votequorum<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosynccrit [QUORUM] Quorum provider: corosync_votequorum failed to initialize.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">[19040] dl380x4415 corosyncerror [SERV ] Service engine 'corosync_quorum' failed to load for reason 'configuration error: nodelist or quorum.expected_votes must be configured!'<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">With Regards<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Somanath Thilak J<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>