<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.E-MailFormatvorlage17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=DE link=blue vlink=purple><div class=WordSection1><p class=MsoNormal>Dear all,<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span lang=EN-US>unfortunately my stonith does not work on my pacemaker cluster. If I do ifdown on the two cluster interconnect interfaces of server sv2827 the server sv2828 want to fence the server sv2827, but the messages log says: error: remote_op_done: Operation reboot of sv2827-p1 by sv2828-p1 for crmd.7979@sv2828-p1.076062f0: No such device<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Can somebody please help me?<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 corosync[7749]: [CMAN ] quorum lost, blocking activity<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 corosync[7749]: [QUORUM] This node is within the non-primary component and will NOT provide any services.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 corosync[7749]: [QUORUM] Members[1]: 1<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 corosync[7749]: [TOTEM ] A processor joined or left the membership and a new membership was formed.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: notice: cman_event_callback: Membership 1492: quorum lost<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: notice: crm_update_peer_state: cman_event_callback: Node sv2827-p1[2] - state is now lost (was member)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: warning: match_down_event: No match for shutdown action on sv2827-p1<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: notice: peer_update_callback: Stonith/shutdown of sv2827-p1 not matched<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 kernel: dlm: closing connection to node 2<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 corosync[7749]: [CPG ] chosen downlist: sender r(0) ip(192.168.2.28) r(1) ip(192.168.3.28) ; members(old:2 left:1)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: notice: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_FSA_INTERNAL origin=check_join_state ]<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 corosync[7749]: [MAIN ] Completed service synchronization, ready to provide service.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: warning: match_down_event: No match for shutdown action on sv2827-p1<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: notice: peer_update_callback: Stonith/shutdown of sv2827-p1 not matched<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 attrd[7977]: notice: attrd_local_callback: Sending full refresh (origin=crmd)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 attrd[7977]: notice: attrd_trigger_update: Sending flush op to all hosts for: last-failure-MYSQLFS (1404902183)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 attrd[7977]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 attrd[7977]: notice: attrd_trigger_update: Sending flush op to all hosts for: last-failure-MYSQL (1404901921)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 pengine[7978]: notice: unpack_config: On loss of CCM Quorum: Ignore<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 pengine[7978]: warning: pe_fence_node: Node sv2827-p1 will be fenced because the node is no longer part of the cluster<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 pengine[7978]: warning: determine_online_status: Node sv2827-p1 is unclean<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 pengine[7978]: warning: custom_action: Action ipmi-fencing-sv2828_stop_0 on sv2827-p1 is unrunnable (offline)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 pengine[7978]: warning: stage6: Scheduling Node sv2827-p1 for STONITH<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 pengine[7978]: notice: LogActions: Move ipmi-fencing-sv2828#011(Started sv2827-p1 -> sv2828-p1)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 pengine[7978]: warning: process_pe_message: Calculated Transition 38: /var/lib/pacemaker/pengine/pe-warn-28.bz2<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: notice: te_fence_node: Executing reboot fencing operation (20) on sv2827-p1 (timeout=60000)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 stonith-ng[7975]: notice: handle_request: Client crmd.7979.6c35e3f1 wants to fence (reboot) 'sv2827-p1' with device '(any)'<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 stonith-ng[7975]: notice: initiate_remote_stonith_op: Initiating remote operation reboot for sv2827-p1: 076062f0-eff3-4798-a504-16c5c5666a5b (0)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 stonith-ng[7975]: notice: can_fence_host_with_device: ipmi-fencing-sv2827 can not fence sv2827-p1: static-list<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 stonith-ng[7975]: notice: can_fence_host_with_device: ipmi-fencing-sv2828 can not fence sv2827-p1: static-list<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 stonith-ng[7975]: error: remote_op_done: Operation reboot of sv2827-p1 by sv2828-p1 for crmd.7979@sv2828-p1.076062f0: No such device<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: notice: tengine_stonith_callback: Stonith operation 8/20:38:0:71703806-8a7c-447f-a033-e3c26abd607c: No such device (-19)<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Jul 9 12:42:49 sv2828 crmd[7979]: notice: run_graph: Transition 38 (Complete=1, Pending=0, Fired=0, Skipped=5, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-warn-28.bz2): Stopped<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US>With the ipmitool I could test the correct work of the ipmi like power cycle.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US>pcs status<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Cluster name: mysql-int-prod<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Last updated: Wed Jul 9 12:46:43 2014<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Last change: Wed Jul 9 12:41:14 2014 via crm_resource on sv2828-p1<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Stack: cman<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Current DC: sv2828-p1 - partition with quorum<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Version: 1.1.10-1.el6_4.4-368c726<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>2 Nodes configured<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>5 Resources configured<o:p></o:p></span></p><p class=MsoNormal>Online: [ sv2827-p1 sv2828-p1 ]<o:p></o:p></p><p class=MsoNormal><span lang=EN-US>Full list of resources:<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> ipmi-fencing-sv2827 (stonith:fence_ipmilan): Started sv2828-p1 <o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> ipmi-fencing-sv2828 (stonith:fence_ipmilan): Started sv2827-p1 <o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> ClusterIP (ocf::heartbeat:IPaddr2): Started sv2828-p1 <o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> MYSQLFS (ocf::baader:MYSQLFS): Started sv2828-p1 <o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> MYSQL (ocf::baader:MYSQL): Started sv2828-p1<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US>pcs property <o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US>Cluster Properties:<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> cluster-infrastructure: cman<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> dc-version: 1.1.10-1.el6_4.4-368c726<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> last-lrm-refresh: 1404902348<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> no-quorum-policy: ignore<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US> stonith-enabled: true<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Arial","sans-serif";mso-fareast-language:DE'>Best regards</span><span style='font-size:8.0pt;font-family:"Arial","sans-serif";mso-fareast-language:DE'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Arial","sans-serif";mso-fareast-language:DE'>Andreas Dvorak</span><span style='font-size:12.0pt;font-family:"Times New Roman","serif";mso-fareast-language:DE'><o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>