<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br><div><div>On 2010-04-23, at 12:12 PM, Michael Schwartzkopff wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>Am Freitag, 23. April 2010 18:04:30 schrieb Dejan Muhamedagic:<br><blockquote type="cite">Hi,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">On Fri, Apr 23, 2010 at 11:44:16AM -0400, daniel qian wrote:<br></blockquote><blockquote type="cite"><blockquote type="cite">We have a simple two-node cluster with apache running together with two<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">floating IPs as shown below:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">node gamma<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">node sql<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">primitive ClusterIP ocf:heartbeat:IPaddr2 \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> params ip="x.x.x.x" cidr_netmask="32" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> op monitor interval="30s" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> meta target-role="Started"<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">primitive apache ocf:heartbeat:apache \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> params configfile="/usr/local/apache2/conf/httpd.conf"<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">httpd="/usr/local/apache2/bin/httpd" \ op monitor interval="1min" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> meta target-role="Started"<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">primitive secure2 ocf:heartbeat:IPaddr2 \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> params ip="y.y.y.y" cidr_netmask="32" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> op monitor interval="30s"<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">group WebCluster ClusterIP secure2 apache<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">property $id="cib-bootstrap-options" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> dc-version="1.0.6-f709c638237cdff7556cb6ab615f32826c0f8c06" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> cluster-infrastructure="openais" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> expected-quorum-votes="2" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> stonith-enabled="false" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> no-quorum-policy="ignore" \<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">The floating IPs can start fine on the node1 with eth0 in the same<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">network block of the two IPS - x.x.x.x and y.y.y.y but they cant start on<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">the second node with eth1 meant for binding these two floating IPs.<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">[root@sql conf]# crm_mon -1<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">============<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Last updated: Fri Apr 23 11:31:15 2010<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Stack: openais<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Current DC: sql - partition with quorum<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Version: 1.0.6-f709c638237cdff7556cb6ab615f32826c0f8c06<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">2 Nodes configured, 2 expected votes<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">1 Resources configured.<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">============<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Online: [ sql gamma ]<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> Resource Group: WebCluster<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> ClusterIP (ocf::heartbeat:IPaddr2): Started sql<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> secure2 (ocf::heartbeat:IPaddr2): Started sql<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> apache (ocf::heartbeat:apache): Started sql<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Failed actions:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"> ClusterIP_monitor_0 (node=gamma, call=2, rc=5, status=complete): not<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">installed secure2_monitor_0 (node=gamma, call=3, rc=5, status=complete):<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">not installed<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">snippet of /var/log/messages of the second node:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Apr 23 05:11:11 gamma attrd: [2664]: info: crm_new_peer: Node sql now has<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">id: 16847020 Apr 23 05:11:11 gamma attrd: [2664]: info: crm_new_peer:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Node 16847020 is now known as sql Apr 23 05:11:11 gamma attrd: [2664]:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">info: find_hash_entry: Creating hash entry for probe_complete Apr 23<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">05:11:11 gamma attrd: [2664]: info: attrd_perform_update: Delaying<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">operation probe_complete=<null>: cib not connected Apr 23 05:11:11 gamma<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">attrd: [2664]: info: attrd_perform_update: Delaying operation<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">terminate=<null>: cib not connected Apr 23 05:11:11 gamma attrd: [2664]:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">info: attrd_perform_update: Delaying operation shutdown=<null>: cib not<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">connected Apr 23 05:11:11 gamma attrd: [2664]: info: find_hash_entry:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Creating hash entry for last-failure-apache Apr 23 05:11:11 gamma attrd:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">[2664]: info: attrd_perform_update: Delaying operation<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">last-failure-apache=<null>: cib not connected Apr 23 05:11:11 gamma<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">attrd: [2664]: info: find_hash_entry: Creating hash entry for<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">fail-count-apache Apr 23 05:11:11 gamma attrd: [2664]: info:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">attrd_perform_update: Delaying operation fail-count-apache=<null>: cib<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">not connected Apr 23 05:11:11 gamma crmd: [2666]: info: do_lrm_rsc_op:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Performing key=8:299:7:645d88d1-3c62-4652-87a6-3f63037ee41c<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">op=ClusterIP_monitor_0 ) Apr 23 05:11:11 gamma lrmd: [2663]: info:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">rsc:ClusterIP:2: probe Apr 23 05:11:11 gamma crmd: [2666]: info:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">do_lrm_rsc_op: Performing<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">key=9:299:7:645d88d1-3c62-4652-87a6-3f63037ee41c op=secure2_monitor_0 )<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Apr 23 05:11:11 gamma lrmd: [2663]: info: rsc:secure2:3: probe<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Apr 23 05:11:11 gamma crmd: [2666]: info: do_lrm_rsc_op: Performing<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">key=10:299:7:645d88d1-3c62-4652-87a6-3f63037ee41c op=apache_monitor_0 )<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Apr 23 05:11:11 gamma lrmd: [2663]: info: rsc:apache:4: probe<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Apr 23 05:11:11 gamma IPaddr2[2678]: ERROR: Setup problem: Couldn't find<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">utility ip Apr 23 05:11:11 gamma crmd: [2666]: info: process_lrm_event:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">LRM operation ClusterIP_monitor_0 (call=2, rc=5, cib-update=8,<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">confirmed=true) not installed Apr 23 05:11:11 gamma IPaddr2[2679]: ERROR:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Setup problem: Couldn't find utility ip<br></blockquote></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">You need to install the ip utility (iproute2).<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Thanks,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Dejan<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><blockquote type="cite">Apr 23 05:11:11 gamma crmd: [2666]: info: process_lrm_event: LRM<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">operation secure2_monitor_0 (call=3, rc=5, cib-update=9, confirmed=true)<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">not installed Apr 23 05:11:11 gamma apache[2680]: INFO: apache not<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">running<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Apr 23 05:11:11 gamma crmd: [2666]: info: process_lrm_event: LRM<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">operation apache_monitor_0 (call=4, rc=7, cib-update=10, confirmed=true)<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">not running Apr 23 05:11:11 gamma attrd: [2664]: info:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">attrd_trigger_update: Sending flush op to all hosts for: probe_complete<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">(true) Apr 23 05:11:11 gamma attrd: [2664]: info: attrd_perform_update:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Delaying operation probe_complete=true: cib not connected Apr 23 05:11:11<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">gamma attrd: [2664]: info: attrd_trigger_update: Sending flush op to all<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">hosts for: probe_complete (true) Apr 23 05:11:11 gamma attrd: [2664]:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">info: attrd_perform_update: Delaying operation probe_complete=true: cib<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">not connected<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Is this problem all because the second node is using a different nic<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">instead of the default eth0? Is there a solution for this without<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">changing the nic settings?<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Thanks,<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Daniel<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">_______________________________________________<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Project Home: <a href="http://www.clusterlabs.org">http://www.clusterlabs.org</a><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br></blockquote></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_______________________________________________<br></blockquote><blockquote type="cite">Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br></blockquote><blockquote type="cite"><a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Project Home: <a href="http://www.clusterlabs.org">http://www.clusterlabs.org</a><br></blockquote><blockquote type="cite">Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br></blockquote><br>Also see:<br><a href="http://www.clusterlabs.org/doc/en-US/Pacemaker/1.0/html/Pacemaker_Explained/s-">http://www.clusterlabs.org/doc/en-US/Pacemaker/1.0/html/Pacemaker_Explained/s-</a><br>rules-resource-options.html<br><br></div></blockquote></div><br><div>Thanks for pointing me to the option. I might end up using <span class="Apple-style-span" style="font-family: monospace; white-space: pre; ">instance_attributes.</span></div><div><br></div></body></html>