If you are talking about two guest OSes on different ESX hosts, I think libvirt or any VIAPI variation for rebooting/poweroff the GuestOS is not a reliable STONITH.<br><br>The reason is: STONITH is to avoid "split brain" which means network partition. So it's very possible that network problem prevent the quorum winner accessing the one which is suppose to be shot. <br>
+ network problem cause vCenter cannot reach the target ESX, so VIAPI against vCenter won't work for STONITH<br>+ network problem cause STONITH requestor cannot reach the target ESX host, so it's very possible you have no chance to shoot the node by accessing VIAPI.<br>
<br>So any VIAPI variation won't be a reliable STONITH in my mind.<br>SBD could be a good candidate for virtulization environment. But I think we could need improve the reliability of SBD in Vmware ESX environment by following method:<br>
1. Using VM Guest App monitor replace software watchdog, since VM GuestApp monitor is heartbeat between ESX and GuestOS, stopping mark or touch the heartbeat would cause the ESX host reboot the VM. The mechanism is good to emulate a "hardware watchdog" in virtualization environment.<br>
2. SBD is suicide based, the quorum winner need wait sometime for sure the target is dead. But how long we need wait? It's up to experience. I think if STONITH initiator wait until the STONITH target clear the suicide request after reboot, it's reliable enough to believe the system has been shoot.<br>
<br>Just my 2 cents. <br><br><br><div class="gmail_quote">2010/5/21 <span dir="ltr"><<a href="mailto:martin.braun@icw.de">martin.braun@icw.de</a>></span><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
Hi Sebastian,<br>
<div class="im"><br>
> Do you have any experiences with the libvirt? It sounds very<br>
> promising to me. Normally a simple soap call to reboot the guest<br>
> would be enough to have kind of stonith.<br>
<br>
</div>I have some experiences with libvirt, but not yet with the ESX<br>
hypervisordriver. However with that driver configured you should be able<br>
to start|stop|reset your VM with virsh commands or even with one of the<br>
language bindings (e.g. python). It looks very promising to me.<br>
<div class="im"><br>
> The whole topic is kind of a black whole in my opinion because there<br>
> isn't that much information available.<br>
<br>
</div>You are right, the documentation of libvirt is not the best, but what I<br>
can recommend is the IRC support of the libvirt developers! They once<br>
helped me out a great deal with libvirts virtualbox driver.<br>
<br>
<br>
* server: <a href="http://irc.oftc.net" target="_blank">irc.oftc.net</a><br>
* port: 6667 (the usual IRC port)<br>
* channel: #virt<br>
<br>
HTH,<br>
<div class="im">Martin<br>
<br>
"Koch, Sebastian" <<a href="mailto:Sebastian.Koch@netzwerk.de">Sebastian.Koch@netzwerk.de</a>> wrote on 20.05.2010<br>
</div>18:18:26:<br>
<br>
> [image removed]<br>
<div class="im">><br>
> Re: [Pacemaker] VMWare Guest as Cluster Nodes - how to do stonith<br>
><br>
</div><div class="im">> Koch, Sebastian<br>
><br>
> to:<br>
><br>
> The Pacemaker cluster resource manager<br>
><br>
</div>> 20.05.2010 18:21<br>
<div><div></div><div class="h5">><br>
> Please respond to The Pacemaker cluster resource manager<br>
><br>
> Hi Martin,<br>
><br>
> thanks for the reply. Do you have any experience with external/<br>
> vmware? I read that it isn't compatible with ESX Hosts?<br>
><br>
> Do you have any experiences with the libvirt? It sounds very<br>
> promising to me. Normally a simple soap call to reboot the guest<br>
> would be enough to have kind of stonith.<br>
> You are right there could be a scenario where we would need to<br>
> stonith the esx host but lets start with the simple things.<br>
><br>
> The whole topic is kind of a black whole in my opinion because there<br>
> isn't that much information available.<br>
><br>
><br>
> Best Regards<br>
> Sebastian<br>
><br>
> -----Ursprüngliche Nachricht-----<br>
> Von: <a href="mailto:martin.braun@icw.de">martin.braun@icw.de</a> [mailto:<a href="mailto:martin.braun@icw.de">martin.braun@icw.de</a>]<br>
> Gesendet: Donnerstag, 20. Mai 2010 17:59<br>
> An: The Pacemaker cluster resource manager<br>
> Betreff: Re: [Pacemaker] VMWare Guest as Cluster Nodes - how to do<br>
stonith<br>
><br>
> Hi Sebastian,<br>
><br>
><br>
> > guests. Does anybody have experiences or advises on how to configure<br>
> > stonith for vmware guests or maybe there is another solution to build<br>
> > a reliable virtual cluster.<br>
><br>
> See this thread:<br>
> <a href="http://www.gossamer-threads.com/lists/linuxha/pacemaker/62850" target="_blank">http://www.gossamer-threads.com/lists/linuxha/pacemaker/62850</a>?<br>
> search_string=Pacemaker%20in%20VMware%20guests;#62850<br>
><br>
> I am planning to experiment with libvirt (<a href="http://libvirt.org/drvesx.html" target="_blank">http://libvirt.org/drvesx.html</a><br>
> ), so please let me know your proceedings when you go this way.<br>
><br>
> The only problem I see is: what about the esx-hosts, isn't there a<br>
> scenario when you want to kill the host (and that could be rather<br>
> problematic)?<br>
><br>
><br>
> Best,<br>
> Martin<br>
><br>
><br>
><br>
><br>
> "Koch, Sebastian" <<a href="mailto:Sebastian.Koch@netzwerk.de">Sebastian.Koch@netzwerk.de</a>> wrote on 20.05.2010<br>
> 16:13:59:<br>
><br>
> > [image removed]<br>
> ><br>
> > [Pacemaker] VMWare Guest as Cluster Nodes - how to do stonith<br>
> ><br>
> > Koch, Sebastian<br>
> ><br>
> > to:<br>
> ><br>
> > The Pacemaker cluster resource manager<br>
> ><br>
> > 20.05.2010 16:16<br>
> ><br>
> > Please respond to The Pacemaker cluster resource manager<br>
> ><br>
> > Hi,<br>
> ><br>
> > i was researching the whole vmware / stonith problem for a couple of<br>
> > days and i did not find any reliable information or examples on how to<br>
<br>
> > implement stonith with virtualized debian linux on vmware esx 4<br>
> > guests. Does anybody have experiences or advises on how to configure<br>
> > stonith for vmware guests or maybe there is another solution to build<br>
> > a reliable virtual cluster.<br>
> ><br>
> > Any help and hints is appreciated.<br>
> > Thanks in advance.<br>
> ><br>
> > Regards,<br>
> > Sebastian_______________________________________________<br>
> > Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
> > <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
> ><br>
> > Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a> Getting started:<br>
> > <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
><br>
<br>
><br>
> _______________________________________________<br>
> Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
> <a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
><br>
> Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
> Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
<br>
<br>
InterComponentWare AG:<br>
Vorstand: Peter Kirschbauer (Vors.), Jörg Stadler / Aufsichtsratsvors.: Prof. Dr. Christof Hettich<br>
Firmensitz: 69190 Walldorf, Altrottstraße 31 / AG Mannheim HRB 351761 / USt.-IdNr.: DE 198388516<br>
_______________________________________________<br>
Pacemaker mailing list: <a href="mailto:Pacemaker@oss.clusterlabs.org">Pacemaker@oss.clusterlabs.org</a><br>
<a href="http://oss.clusterlabs.org/mailman/listinfo/pacemaker" target="_blank">http://oss.clusterlabs.org/mailman/listinfo/pacemaker</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>Javen Wu<br>