<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: Times New Roman; font-size: 12pt; color: #000000'><font size="3">Hello,</font><div style="font-size: 12pt; font-family: 'Times New Roman'; "><br></div><div style="font-size: 12pt; font-family: 'Times New Roman'; ">I have a 3 node Pacemaker+Heartbeat cluster (two real nodes and one "standby" quorum node) with Ubuntu 10.04 LTS on the nodes and using the Pacemaker+Heartbeat packages from the Ubuntu HA Team PPA (<a href="https://launchpad.net/~ubuntu-ha-maintainers/+archive/ppa" style="font-size: 12pt; ">https://launchpad.net/~ubuntu-ha-maintainers/+archive/ppa</a>). I have configured 3 DRBD resources, a filesystem mount, and a KVM-based virtual machine (using the VirtualDomain resource). I have constraints in place so that the DRBD devices must become primary and the filesystem must be mounted before the VM can start:</div><div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">node $id="1ab0690c-5aa0-4d9c-ae4e-b662e0ca54e5" vmhost1</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">node $id="219e9bf6-ea99-41f4-895f-4c2c5c78484a" quorumnode \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> attributes standby="on"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">node $id="645e09b4-aee5-4cec-a241-8bd4e03a78c3" vmhost2</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive p_drbd_mount2 ocf:linbit:drbd \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params drbd_resource="mount2" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op start interval="0" timeout="240" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op stop interval="0" timeout="100" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="10" role="Master" timeout="30" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="20" role="Slave" timeout="30"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive p_drbd_mount1 ocf:linbit:drbd \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params drbd_resource="mount1" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op start interval="0" timeout="240" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op stop interval="0" timeout="100" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="10" role="Master" timeout="30" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="20" role="Slave" timeout="30"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive p_drbd_vmstore ocf:linbit:drbd \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params drbd_resource="vmstore" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op start interval="0" timeout="240" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op stop interval="0" timeout="100" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="10" role="Master" timeout="30" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="20" role="Slave" timeout="30"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive p_fs_vmstore ocf:heartbeat:Filesystem \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params device="/dev/drbd0" directory="/mnt/storage/vmstore" fstype="ext4" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op start interval="0" timeout="60" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op stop interval="0" timeout="60" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="20" timeout="40"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive p_ping ocf:pacemaker:ping \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params name="p_ping" host_list="192.168.1.25 192.168.1.26" multiplier="1000" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op start interval="0" timeout="60" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="20s" timeout="60"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive p_sysadmin_notify ocf:heartbeat:MailTo \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params email="alert@example.com" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params subject="Pacemaker Change" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op start interval="0" timeout="10" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op stop interval="0" timeout="10" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="10" timeout="10"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive p_vm_myvm ocf:heartbeat:VirtualDomain \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params config="/mnt/storage/vmstore/config/myvm.xml" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> meta allow-migrate="false" target-role="Started" is-managed="true" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op start interval="0" timeout="180" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op stop interval="0" timeout="180" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> op monitor interval="10" timeout="30"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive stonithquorumnode stonith:external/webpowerswitch \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params wps_ipaddr="192.168.3.100" wps_port="x" wps_username="xxx" wps_password="xxx" hostname_to_stonith="quorumnode"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive stonithvmhost1 stonith:external/webpowerswitch \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params wps_ipaddr="192.168.3.100" wps_port="x" wps_username="xxx" wps_password="xxx" hostname_to_stonith="vmhost1"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">primitive stonithvmhost2 stonith:external/webpowerswitch \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> params wps_ipaddr="192.168.3.100" wps_port="x" wps_username="xxx" wps_password="xxx" hostname_to_stonith="vmhost2"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">group g_vm p_fs_vmstore p_vm_myvm</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">ms ms_drbd_mount2 p_drbd_mount2 \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">ms ms_drbd_mount1 p_drbd_mount1 \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">ms ms_drbd_vmstore p_drbd_vmstore \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">clone cl_ping p_ping \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> meta interleave="true"</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">clone cl_sysadmin_notify p_sysadmin_notify</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">location loc_run_on_most_connected g_vm \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> rule $id="loc_run_on_most_connected-rule" p_ping: defined p_ping</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">location loc_st_nodescan stonithquorumnode -inf: vmhost1</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">location loc_st_vmhost1 stonithvmhost1 -inf: vmhost1</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">location loc_st_vmhost2 stonithvmhost2 -inf: vmhost2</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">colocation c_drbd_libvirt_vm inf: g_vm ms_drbd_vmstore:Master ms_drbd_tools:Master ms_drbd_crm:Master</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">order o_drbd-fs-vm inf: ms_drbd_vmstore:promote ms_drbd_tools:promote ms_drbd_crm:promote g_vm:start</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1">property $id="cib-bootstrap-options" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> dc-version="1.1.6-9971ebba4494012a93c03b40a2c58ec0eb60f50c" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> cluster-infrastructure="Heartbeat" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> stonith-enabled="true" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> no-quorum-policy="freeze" \</font></div><div><font face="courier new, courier, monaco, monospace, sans-serif" size="1"> last-lrm-refresh="1337746179"</font></div></div><div style="font-size: 12pt; font-family: 'Times New Roman'; "><br></div><div style="font-size: 12pt; font-family: 'Times New Roman'; ">This has been working well, however last week Pacemaker all of a sudden stopped the p_vm_myvm resource and then started it up again. I have attached the relevant section of /var/log/daemon.log - I am unable to determine what caused Pacemaker to restart this resource. Based on the log, could you tell me what event triggered this?</div><div style="font-size: 12pt; font-family: 'Times New Roman'; "><br></div><div style="font-size: 12pt; font-family: 'Times New Roman'; ">Thanks,</div><div style="font-size: 12pt; font-family: 'Times New Roman'; "><br></div><div style="font-size: 12pt; font-family: 'Times New Roman'; ">Andrew</div></div></body></html>