<br><br><div class="gmail_quote">On Tue, Jun 7, 2011 at 9:04 AM, ruslan usifov <span dir="ltr"><<a href="mailto:ruslan.usifov@gmail.com">ruslan.usifov@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Hm, drbd RA for example work perfectly if drbd isn't installed on node. Also i found that probe error dissapear when i add "implementation" parameter to target and lun RA.<br></blockquote><div><br>That's really strange because DRBD RA has code like this:<br>
<br>drbd_init() {<br> check_binary $DRBDADM<br><br>......<br><br>drbd_validate_all () {<br> # First check the configuration file<br> if [ -n "$DRBDCONF" ] && [ ! -f "$DRBDCONF" ]; then<br>
ocf_log err "Configuration file does not exist: $DRBDCONF"<br> return $OCF_ERR_CONFIGURED<br> fi<br><br>.............<br><br>So it has to fail if it can't find binary or config file.<br>
<br><br>iSCSILogical Unit on its turn checks for this:<br><br>iSCSILogicalUnit_validate() {<br> # Do we have all required variables?<br> for var in implementation target_iqn lun path; do<br> param="OCF_RESKEY_${var}"<br>
if [ -z "${!param}" ]; then<br> ocf_log error "Missing resource parameter \"$var\"!"<br> exit $OCF_ERR_CONFIGURED<br> fi<br> done<br><br><br>So those parameters have to be set as far as I understand. <br>
<br>I've never used iSCSI resources but the basic idea is the same: all used RA in you cluster have to be able to confirm that all configured resources are down on any cluster node. Doesn't matter what kind of collocation rules you use.<br>
<br><br></div><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;"><br>PS: great thanks for your explanations<div><div></div><div class="h5"><br>
<br><div class="gmail_quote">2011/6/7 Serge Dubrouski <span dir="ltr"><<a href="mailto:sergeyfd@gmail.com" target="_blank">sergeyfd@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
No, RA acts like it should. It can't find necessary software and returns OCF_NOT_CONFIGURED, all RAs act this way. You have to install all software used in you cluster on all nodes even if you are not actually planning to run that software on some of them.<div>
<div></div><div><br>
<br><div class="gmail_quote">On Tue, Jun 7, 2011 at 8:02 AM, ruslan usifov <span dir="ltr"><<a href="mailto:ruslan.usifov@gmail.com" target="_blank">ruslan.usifov@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Thanks fo replay i undestend already this moment. Now i think that this is problem of ocf:heartbeat:iSCSITarget RA, which return unproperly return code, when no any iscssi target software installed<br><br><div class="gmail_quote">
2011/6/7 Serge Dubrouski <span dir="ltr"><<a href="mailto:sergeyfd@gmail.com" target="_blank">sergeyfd@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
This questions pops up over and over again. Pacemaker has to make sure that your resources aren't up anywhere in the cluster before start them up on designated nodes. That means that it has to be able to run status/monitor operations for all configured resources on all configured nodes. You can't just add a 3rd quorum node into cluster you have to make sure that all RAs that you use can run on that 3rd node properly.<br>
<br><div class="gmail_quote"><div><div></div><div>On Tue, Jun 7, 2011 at 1:58 AM, ruslan usifov <span dir="ltr"><<a href="mailto:ruslan.usifov@gmail.com" target="_blank">ruslan.usifov@gmail.com</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204, 204, 204);padding-left:1ex"><div><div></div><div>
Hello<br><br>I have 3 node cluster (in future we add another one node) with follow configuration:<br><br>crm(live)configure# show<br>node drbd1<br>node drbd2<br>node drbd3<br>primitive drbd_web ocf:linbit:drbd \<br> params drbd_resource="web" \<br>
op monitor interval="10s" timeout="60s"<br>primitive drbd_web-U ocf:linbit:drbd \<br> params drbd_resource="web-U" \<br> op monitor interval="10s" timeout="60s"<br>
primitive iscsi_ip_web ocf:heartbeat:IPaddr2 \<br> params ip="192.168.19.91" nic="eth1:1" cidr_netmask="24"<br>primitive iscsi_web_target ocf:heartbeat:iSCSITarget \<br> params iqn="iqn.2010-06.playrix.local:san.web" \<br>
op monitor interval="10s" timeout="30s"<br>primitive iscsi_web_target_lun0 ocf:heartbeat:iSCSILogicalUnit \<br> params lun="0" path="/dev/drbd10" target_iqn="iqn.2010-06.playrix.local:san.web"<br>
group iscsi_web iscsi_ip_web iscsi_web_target iscsi_web_target_lun0<br>ms ms_drbd_web drbd_web \<br> meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" globally-unique="false" target-role="Started" is-managed="true"<br>
ms ms_drbd_web-U drbd_web-U \<br> meta master-max="1" master-node-max="1" clone-max="1" clone-node-max="1" notify="true" is-managed="true" globally-unique="false"<br>
location ms_drbd_web-U_on_drbd1_or_drbd2 ms_drbd_web-U \<br> rule $id="ms_drbd_web-U_on_drbd1_or_drbd2-rule" -inf: #uname ne drbd1 and #uname ne drbd2<br>location ms_drbd_web_on_drbd1_or_drbd2 ms_drbd_web \<br>
rule $id="ms_drbd_web_on_drbd1_or_drbd2-rule" -inf: #uname ne drbd1 and #uname ne drbd2<br>colocation drbd_web-U_on_drbd_web inf: ms_drbd_web-U:Master ms_drbd_web:Master<br>colocation iscsi_ip_web_on_drbd_web inf: iscsi_ip_web ms_drbd_web:Master<br>
colocation iscsi_web_on_drbd_web-U inf: iscsi_web ms_drbd_web-U:Master<br>order iscsi_web_after_ms_drbd_web-U inf: ms_drbd_web-U:start iscsi_web<br>order ms_drbd_web-U_after_iscsi_ip_web inf: iscsi_ip_web:start ms_drbd_web-U:start<br>
order ms_drbd_web-U_before_ms_drbd_web inf: ms_drbd_web:promote iscsi_ip_web:start<br>property $id="cib-bootstrap-options" \<br> dc-version="1.0.11-db98485d06ed3fe0fe236509f023e1bd4a5566f1" \<br>
cluster-infrastructure="openais" \<br> expected-quorum-votes="3" \<br> stonith-enabled="false" \<br> last-lrm-refresh="1307432239" \<br> symmetric-cluster="true"<br>
<br><br><br>In this configuration i want that all resources ran only on drbd1 and drb2 nodes. And as i understand wit location constraint i should reach this objective. And all resource mast run on drbd1 and drbb2 nodes. But i got follow error:<br>
<br>Failed actions:<br> iscsi_web_target_monitor_0 (node=drbd3, call=5, rc=6, status=complete): not configured<br> iscsi_web_target_lun0_monitor_0 (node=drbd3, call=6, rc=6, status=complete): not configured<br><br>
<br>
<br>And i confused why drbd3? There is nothing must run o monitored. Please if it is possible explain this behavior<br><br><br>
<br></div></div>_______________________________________________<br>
Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org" target="_blank">Pacemaker@oss.clusterlabs.org</a><br>
<a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><font color="#888888">Serge Dubrouski.<br>
</font><br>_______________________________________________<br>
Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org" target="_blank">Pacemaker@oss.clusterlabs.org</a><br>
<a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
<br></blockquote></div><br>
<br>_______________________________________________<br>
Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org" target="_blank">Pacemaker@oss.clusterlabs.org</a><br>
<a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br>Serge Dubrouski.<br>
</div></div><br>_______________________________________________<br>
Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org" target="_blank">Pacemaker@oss.clusterlabs.org</a><br>
<a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
<br></blockquote></div><br>
</div></div><br>_______________________________________________<br>
Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
<a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker" target="_blank">http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br>Serge Dubrouski.<br>