<html><body><div style="color:#000; background-color:#fff; font-family:times new roman, new york, times, serif;font-size:12pt"><div><span>Hello Keith,</span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><br><span></span></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;">you are right.</div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;">I don't have got an idea why there are two firewalls installed, beside iptables (that I checked) there is a</div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;">second firewalld on our systems and
this one was still active.</div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;">I noticed that there is something wrong when I changed the configuration back to unicast and <br></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;">saw ICMP drop packages.</div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><br></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;">Thanks,</div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style:
normal;">Hans<br></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><br></div><div style="color: rgb(0, 0, 0); font-size: 16px; font-family: times new roman,new york,times,serif; background-color: transparent; font-style: normal;"><br></div><div><br></div> <div style="font-family: times new roman, new york, times, serif; font-size: 12pt;"> <div style="font-family: times new roman, new york, times, serif; font-size: 12pt;"> <div dir="ltr"> <font face="Arial" size="2"> <hr size="1"> <b><span style="font-weight:bold;">Von:</span></b> Keith Ouellette <Keith.Ouellette@Airgas.com><br> <b><span style="font-weight: bold;"></span></b><b><span style="font-weight: bold;"></span></b></font><br></div><br><div id="yiv857393414">
<style>#yiv857393414 P {
MARGIN-TOP:0px;MARGIN-BOTTOM:0px;}
</style>
<div>
<div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt;">
<div>Hans, </div>
<div> </div>
<div> Is the multicast port 5405 "opened" in the firewall? That has bitten me before.</div>
<div> </div>
<div>Thanks,</div>
<div>Keith</div>
<div> </div>
<div style="FONT-FAMILY:Times New Roman;COLOR:#000000;FONT-SIZE:16px;">
<hr tabindex="-1">
<div style="DIRECTION:ltr;" id="yiv857393414divRpF827625"><font face="Tahoma" color="#000000" size="2"><b>From:</b> Hans Bert<br>
<b>Sent:</b> Wednesday, January 30, 2013 8:22 AM<br>
<b>To:</b> and k; The Pacemaker cluster resource manager<br>
<b>Subject:</b> Re: [Pacemaker] No communication between nodes (setup problem)<br>
</font><br>
</div>
<div></div>
<div>
<div style="BACKGROUND-COLOR:#fff;FONT-FAMILY:times new roman, new york, times, serif;COLOR:#000;FONT-SIZE:12pt;">
Hi,<br>
<br>
in the meantime I modified the configuration to check if it works with multicast<br>
<br>
totem {<br>
version: 2<br>
secauth: off<br>
cluster_name: mcscluster<br>
interface {<br>
ringnumber: 0<br>
bindnetaddr: 192.168.100.0<br>
mcastaddr: 239.255.1.12<br>
mcastport: 5405<br>
ttl: 1<br>
}<br>
}<br>
<br>
but unfortunately it is still not working.<br>
I started wireshark and I can see on both hosts MC packages from both hosts.<br>
<br>
YES selinux is disabled on both nodes<br>
<div><br>
<span></span></div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
[root@server1 corosync]# selinuxenabled <br>
[root@server1 corosync]# echo $?<br>
1</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
Something else I found out is:</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
[root@server1 corosync]# pcs status nodes both<br>
Error mapping 192.168.100.111<br>
Error mapping 192.168.100.112<br>
Corosync Nodes:<br>
Online: <br>
Offline: 192.168.100.111 192.168.100.112 <br>
Pacemaker Nodes:<br>
Online: server1 <br>
Standby: <br>
Offline: <br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
[root@server2 corosync]# pcs status nodes both<br>
Error mapping 192.168.100.111<br>
Error mapping 192.168.100.112<br>
Corosync Nodes:<br>
Online: <br>
Offline: 192.168.100.111 192.168.100.112 <br>
Pacemaker Nodes:<br>
Online: server2 <br>
Standby: <br>
Offline: <br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
any further hints?</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
Best regards,</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
Hans</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
</div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<br>
<span></span></div>
<div style="BACKGROUND-COLOR:transparent;FONT-STYLE:normal;FONT-FAMILY:times new roman, new york, times, serif;COLOR:rgb(0,0,0);FONT-SIZE:16px;">
<span><br>
</span></div>
<div><br>
</div>
<div style="FONT-FAMILY:times new roman, new york, times, serif;FONT-SIZE:12pt;">
<div style="FONT-FAMILY:times new roman, new york, times, serif;FONT-SIZE:12pt;">
<div dir="ltr"><font face="Arial" size="2">
<hr size="1">
<b><span style="FONT-WEIGHT:bold;"></span></b><br>
</font></div>
<br>
<div id="yiv857393414">
<div dir="ltr">Hi,
<div><br>
</div>
<div>It seem to be problem with network traffic.</div>
<div><br>
</div>
<div>Have you tried to sniff network traffic to be sure that udp traffic reaches from one node to another ??</div>
<div><br>
</div>
<div>Try on server1:</div>
<div><br>
</div>
<div>tcpdump -i interface -p udp -s <span style="FONT-FAMILY:arial, sans-serif;FONT-SIZE:13px;">192.168.100.112</span></div>
<div><span style="FONT-FAMILY:arial, sans-serif;FONT-SIZE:13px;"><br>
</span></div>
<div><span style="FONT-FAMILY:arial, sans-serif;FONT-SIZE:13px;">on server2:</span></div>
<div><span style="FONT-FAMILY:arial, sans-serif;FONT-SIZE:13px;"><br>
</span></div>
<div>tcpdump -i interface -p udp -s <span style="FONT-FAMILY:arial, sans-serif;FONT-SIZE:13px;">192.168.100.111</span><span style="FONT-FAMILY:arial, sans-serif;FONT-SIZE:13px;"><br>
</span></div>
<div><span style="FONT-FAMILY:arial, sans-serif;FONT-SIZE:13px;"><br>
</span></div>
<div><span style="FONT-FAMILY:arial, sans-serif;FONT-SIZE:13px;"><br>
</span></div>
<div><font face="arial, sans-serif">if there will be no packet traffic, that means you have some network issue.</font></div>
<div><font face="arial, sans-serif"><br>
</font></div>
<div><font face="arial, sans-serif">BTW: Is SELinux enabled on nodes ??</font></div>
<div><font face="arial, sans-serif"><br>
</font></div>
<div><font face="arial, sans-serif">--</font></div>
<div><font face="arial, sans-serif">Regards</font></div>
<div><font face="arial, sans-serif">Andrew </font></div>
<div><span style="FONT-FAMILY:arial, sans-serif;FONT-SIZE:13px;"><br>
</span></div>
</div>
<div class="yiv857393414gmail_extra"><br>
<br>
<div class="yiv857393414gmail_quote">2013/1/30 Hans Bert <span dir="ltr"></span><br>
<blockquote style="BORDER-LEFT:#ccc 1px solid;MARGIN:0px 0px 0px 0.8ex;PADDING-LEFT:1ex;" class="yiv857393414gmail_quote">
Hello,<br>
<br>
we had to move from Fedora 16 to Fedora 18 and wanted to set up Corosync with Pacemaker and PCS as management tool.<br>
With F16 our cluster was running pretty good, but with F18 after 5 days we are reaching the point were we don't have<br>
got ideas what might be the problem(s).<br>
<br>
<br>
The cluster is build of two servers (server1=192.168.100.111; server2=192.168.100.112)<br>
<br>
Based on the Howto for F18 with pcs we created the following corosync.conf:<br>
<br>
totem {<br>
version: 2<br>
secauth: off<br>
cluster_name: mcscluster<br>
transport: udpu<br>
}<br>
<br>
nodelist {<br>
node {<br>
ring0_addr: 192.168.100.111<br>
}<br>
node {<br>
ring0_addr: 192.168.100.112<br>
}<br>
}<br>
<br>
quorum {<br>
provider: corosync_votequorum<br>
}<br>
<br>
logging {<br>
fileline: off<br>
to_stderr: no<br>
to_logfile: yes<br>
to_syslog: yes<br>
logfile: /var/log/cluster/corosync.log<br>
debug: on<br>
timestamp: on<br>
}<br>
<br>
<br>
<br>
After we started the server a status check shows us:<br>
<br>
<br>
[root@server1 corosync]#pcs status corosync<br>
<br>
Membership information<br>
----------------------<br>
Nodeid Votes Name<br>
1868867776 1 server1 (local)<br>
<br>
[root@server1 ~]# pcs status<br>
Last updated: Wed Jan 30 10:45:17 2013<br>
Last change: Wed Jan 30 10:18:56 2013 via cibadmin on server1<br>
Stack: corosync<br>
Current DC: server1 (1868867776) - partition WITHOUT quorum<br>
Version: 1.1.8-3.fc18-394e906<br>
1 Nodes configured, unknown expected votes<br>
0 Resources configured.<br>
<br>
<br>
Online: [ server1 ]<br>
<br>
Full list of resources:<br>
<br>
<br>
<br>
And on the other server:<br>
<br>
<br>
[root@server2 corosync]# pcs status corosync<br>
<br>
Membership information<br>
----------------------<br>
Nodeid Votes Name<br>
1885644992 1 server2 (local)<br>
<br>
[root@server2 corosync]# pcs status<br>
Last updated: Wed Jan 30 10:44:40 2013<br>
Last change: Wed Jan 30 10:19:36 2013 via cibadmin on server2<br>
Stack: corosync<br>
Current DC: server2 (1885644992) - partition WITHOUT quorum<br>
Version: 1.1.8-3.fc18-394e906<br>
1 Nodes configured, unknown expected votes<br>
0 Resources configured.<br>
<br>
<br>
Online: [ server2 ]<br>
<br>
<br>
<br>
<br>
<br>
<br>
The only warnings and errors in the logfile are:<br>
<br>
[root@server1 ~]# cat /var/log/cluster/corosync.log | egrep "warning|error"<br>
Jan 30 10:25:59 [1608] server1 crmd: warning: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING<br>
Jan 30 10:25:59 [1607] server1 pengine: warning: cluster_status: We do not have quorum - fencing and resource management disabled<br>
Jan 30 10:28:25 [1525] server1 corosync debug [QUORUM] getinfo response error: 1<br>
Jan 30 10:40:59 [1607] server1 pengine: warning: cluster_status: We do not have quorum - fencing and resource management disabled<br>
<br>
<br>
root@server2 corosync]# cat /var/log/cluster/corosync.log | egrep "warning|error"<br>
Jan 30 10:27:18 [1458] server2 crmd: warning: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING<br>
Jan 30 10:27:18 [1457] server2 pengine: warning: cluster_status: We do not have quorum - fencing and resource management disabled<br>
Jan 30 10:29:19 [1349] server2 corosync debug [QUORUM] getinfo response error: 1<br>
Jan 30 10:42:18 [1457] server2 pengine: warning: cluster_status: We do not have quorum - fencing and resource management disabled<br>
Jan 30 10:44:36 [1349] server2 corosync debug [QUORUM] getinfo response error: 1<br>
<br>
<br>
<br>
<br>
We have installed the following packages:<br>
<br>
corosync-2.2.0-1.fc18.i686<br>
corosynclib-2.2.0-1.fc18.i686<br>
drbd-bash-completion-8.3.13-1.fc18.i686<br>
drbd-pacemaker-8.3.13-1.fc18.i686<br>
drbd-utils-8.3.13-1.fc18.i686<br>
pacemaker-1.1.8-3.fc18.i686<br>
pacemaker-cli-1.1.8-3.fc18.i686<br>
pacemaker-cluster-libs-1.1.8-3.fc18.i686<br>
pacemaker-libs-1.1.8-3.fc18.i686<br>
pcs-0.9.27-3.fc18.i686<br>
<br>
<br>
<br>
Firewalls are disabled, Pinging and SSH communication is working without any problems.<br>
<br>
With best regards<br>
<br>
_______________________________________________<br>
Pacemaker mailing list: <a rel="nofollow" ymailto="mailto:Pacemaker@oss.clusterlabs.org" target="_blank" href="mailto:Pacemaker@oss.clusterlabs.org">
Pacemaker@oss.clusterlabs.org</a><br>
<a rel="nofollow" target="_blank" href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a rel="nofollow" target="_blank" href="http://www.clusterlabs.org/">
http://www.clusterlabs.org</a><br>
Getting started: <a rel="nofollow" target="_blank" href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf">
http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a rel="nofollow" target="_blank" href="http://bugs.clusterlabs.org/">http://bugs.clusterlabs.org</a><br>
</blockquote>
</div>
<br>
</div>
</div>
<br>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div><br><br> </div> </div> </div></body></html>