<div dir="auto">It could be the watchdog? Are u using diskless watchdog?Two nodes are not supported in diskless mode.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Dec 5, 2023, 5:40 PM Raphael DUBOIS-LISKI <<a href="mailto:raphael.dubois-liski@soget.fr">raphael.dubois-liski@soget.fr</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="FR" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="m_-8231062929519585837WordSection1">
<p class="MsoNormal"><span lang="EN-GB">Hello,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">I am seeking help for the setup of an Active/Active pacemaker cluster that relies on a DRBD cluster as the data storage backend, as the solution is mounted on 2 RHEL9 VMs, the file system used is GFS2.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">Linked, is a PDF of the infrastructure that I am currently experimenting on.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">For context, this is my Pacemaker cluster config:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Cluster Name: mycluster<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Corosync Nodes:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Node1 Node2<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Pacemaker Nodes:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Node1 Node2<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Resources:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Clone: Data-clone<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Meta Attributes: Data-clone-meta_attributes<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> clone-max=2<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> clone-node-max=1<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> notify=true<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> promotable=true<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> promoted-max=2<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> promoted-node-max=1<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Resource: Data (class=ocf provider=linbit type=drbd)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Attributes: Data-instance_attributes<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> drbd_resource=drbd0<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Operations:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> demote: Data-demote-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=90<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> monitor: Data-monitor-interval-60s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=60s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> notify: Data-notify-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=90<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> promote: Data-promote-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=90<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> reload: Data-reload-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=30<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> start: Data-start-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=240<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> stop: Data-stop-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=100<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Clone: dlm-clone<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">
</span><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Meta Attributes: dlm-clone-meta_attributes<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">clone-max=2<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> clone-node-max=1<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Resource: dlm (class=ocf provider=pacemaker type=controld)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Operations:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> monitor: dlm-monitor-interval-60s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=60s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> start: dlm-start-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=90s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> stop: dlm-stop-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=100s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Clone: FS-clone<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Resource: FS (class=ocf provider=heartbeat type=Filesystem)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">
</span><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Attributes: FS-instance_attributes<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> device=/dev/drbd0<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">directory=/home/vusers<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> fstype=gfs2<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Operations:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> monitor: FS-monitor-interval-20s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=20s timeout=40s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> start: FS-start-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=60s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> stop: FS-stop-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=60s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Clone: smtp_postfix-clone<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Meta Attributes: smtp_postfix-clone-meta_attributes<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> clone-max=2<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> clone-node-max=1<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Resource: smtp_postfix (class=ocf provider=heartbeat type=postfix)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Operations:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> monitor: smtp_postfix-monitor-interval-60s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=60s timeout=20s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> reload: smtp_postfix-reload-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=20s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> start: smtp_postfix-start-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=20s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> stop: smtp_postfix-stop-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=20s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Clone: WebSite-clone<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Resource: WebSite (class=ocf provider=heartbeat type=apache)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Attributes: WebSite-instance_attributes<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> configfile=/etc/httpd/conf/httpd.conf<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> statusurl=<a href="http://localhost/server-status" target="_blank" rel="noreferrer">http://localhost/server-status</a><u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Operations:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> monitor: WebSite-monitor-interval-1min<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=1min<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> start: WebSite-start-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">
</span><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">interval=0s timeout=40s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">stop: WebSite-stop-interval-0s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> interval=0s timeout=60s<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Colocation Constraints:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> resource 'FS-clone' with Promoted resource 'Data-clone' (id: colocation-FS-<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Data-clone-INFINITY)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> score=INFINITY<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> resource 'WebSite-clone' with resource 'FS-clone' (id: colocation-WebSite-FS-<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> INFINITY)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> score=INFINITY<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> resource 'FS-clone' with resource 'dlm-clone' (id: colocation-FS-dlm-clone-<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> INFINITY)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> score=INFINITY<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> resource 'FS-clone' with resource 'smtp_postfix-clone' (id: colocation-FS-<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> clone-smtp_postfix-clone-INFINITY)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> score=INFINITY<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Order Constraints:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> promote resource 'Data-clone' then start resource 'FS-clone' (id: order-Data-<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> clone-FS-mandatory)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> start resource 'FS-clone' then start resource 'WebSite-clone' (id: order-FS-<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> WebSite-mandatory)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> start resource 'dlm-clone' then start resource 'FS-clone' (id: order-dlm-<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> clone-FS-mandatory)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> start resource 'FS-clone' then start resource 'smtp_postfix-clone' (id: order-<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> FS-clone-smtp_postfix-clone-mandatory)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Resources Defaults:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Meta Attrs: build-resource-defaults<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> resource-stickiness=1 (id: build-resource-stickiness)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Operations Defaults:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> Meta Attrs: op_defaults-meta_attributes<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> timeout=240s (id: op_defaults-meta_attributes-timeout)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">Cluster Properties: cib-bootstrap-options<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> cluster-infrastructure=corosync<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> cluster-name=mycluster<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> dc-version=2.1.6-9.el9-6fdc9deea29<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> have-watchdog=true<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> last-lrm-refresh=1701787695<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> no-quorum-policy=ignore<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> stonith-enabled=true<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> stonith-watchdog-timeout=10</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black"><u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB">And this is my DRBD configuration :<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">global {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> usage-count no;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">}<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">common {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> disk {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> resync-rate 100M;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> al-extents 257;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> }<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">}<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">resource drbd0 {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> protocol C;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> handlers {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> pri-on-incon-degr "/usr/lib/drbd/notify-pri-on-incon-degr.sh; /usr/lib/drbd/notify-emergency-reboot.sh;
echo b > /proc/sysrq-trig;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> pri-lost-after-sb "/usr/lib/drbd/notify-pri-lost-after-sb.sh; /usr/lib/drbd/notify-emergency-reboot.sh;
echo b > /proc/sysrq-trig;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> local-io-error "/usr/lib/drbd/notify-io-error.sh; /usr/lib/drbd/notify-emergency-shutdown.sh;
echo o > /proc/sysrq-trigger ; halt;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> fence-peer "/usr/lib/drbd/<a href="http://crm-fence-peer.9.sh" target="_blank" rel="noreferrer">crm-fence-peer.9.sh</a>";<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> after-resync-target "/usr/lib/drbd/<a href="http://crm-unfence-peer.9.sh" target="_blank" rel="noreferrer">crm-unfence-peer.9.sh</a>";<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> split-brain "/usr/lib/drbd/notify-split-brain.sh root";<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> out-of-sync "/usr/lib/drbd/notify-out-of-sync.sh root";<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> }<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> startup {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> wfc-timeout 1;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> degr-wfc-timeout 1;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> become-primary-on both;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> }<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> net {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> # The following lines are dedicated to handle<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> # split-brain situations (e.g., if one of the nodes fails)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> after-sb-0pri discard-zero-changes; # If both nodes are secondary, just make one of
them primary<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> after-sb-1pri discard-secondary; # If one is primary, one is not, trust the primary
node<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> after-sb-2pri disconnect;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> allow-two-primaries yes;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> verify-alg sha1;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> }<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> disk {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> on-io-error detach;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> }<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> options {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> auto-promote yes;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> }<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> on fradevtestmail1 {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> device /dev/drbd0;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> disk /dev/rootvg/drbdlv;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> address X.X.X.X:7788;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> flexible-meta-disk internal;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> }<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> on fradevtestmail2 {<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> device /dev/drbd0;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> disk /dev/rootvg/drbdlv;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> address X.X.X.X:7788;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">
</span><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">flexible-meta-disk internal;<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white"> }<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:"Courier New";color:black;background:white">}<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">Knowing all this,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">The cluster works perfectly as expected when both nodes are up, but a problem arises when I put the cluster in a degraded state by killing one of the nodes improperly (to simulate an unexpected crash).<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">This causes the remaining node to reboot, restart the cluster, with all going well in the resource start process, until it's time to mount the File System, where it times out and fails.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">Would you have any idea why this behaviour happens, and possibly how I would be able to fix this behaviour, so that the cluster is still usable even with one node down?
<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">Until we can get the second node back and running in case of an unexpected crash ?<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">Many thanks for your help,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">Have a nice day,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">BR,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<table border="0" cellspacing="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%">
<tbody>
<tr style="height:15.0pt">
<td width="0" valign="bottom" style="width:.3pt;padding:.75pt 7.5pt 0cm .75pt;height:15.0pt">
<div id="m_-8231062929519585837logo">
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black"><img width="128" height="100" style="width:1.3333in;height:1.0416in" id="m_-8231062929519585837Image_x0020_1" src="cid:image001.png@01DA279B.F20EEED0" alt="SOGET"><span><u></u><u></u></span></span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt;height:15.0pt;color:inherit">
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%">
<tbody>
<tr style="color:inherit">
<td style="padding:.75pt .75pt .75pt .75pt;color:inherit">
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%">
<tbody>
<tr style="color:inherit">
<td width="396" style="width:297.0pt;background:white;padding:.75pt .75pt .75pt .75pt;color:inherit">
<div>
<p style="margin:0cm;line-height:13.5pt"><strong><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#004d9b">Raphael DUBOIS-LISKI</span></strong><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#87888a"><br>
<strong><span style="font-family:"Arial",sans-serif">Ingénieur Système et Réseau</span></strong><br>
+33 2 35 19 25 54<u></u><u></u></span></p>
</div>
</td>
</tr>
<tr style="color:inherit">
<td width="396" style="width:297.0pt;padding:.75pt .75pt .75pt .75pt;color:inherit">
<div>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#87888a">SOGET SA • 4, rue des Lamaneurs • 76600 Le Havre, FR</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black"><u></u><u></u></span></p>
</div>
</td>
</tr>
<tr style="height:15.0pt;color:inherit">
<td width="396" valign="bottom" style="width:297.0pt;padding:3.75pt .75pt .75pt .75pt;height:15.0pt;color:inherit;border-width:initial;border-style:initial">
<table border="0" cellspacing="0" cellpadding="0" align="left" style="border-collapse:collapse;text-align:inherit">
<tbody>
<tr style="height:15.0pt;color:inherit;border-width:initial;border-style:initial">
<td width="25" valign="top" style="width:18.75pt;padding:0cm 0cm 0cm 0cm;height:15.0pt;text-align:inherit">
<p class="MsoNormal"><a href="https://signature.soget.fr/l/dnA0alZ4cjRrTERoZlFWSDhaN0xYdz09-VzNGNG5oU1pWYjZRMTVQMUxBZ2xJZz09" target="_blank" rel="noreferrer"><span style="color:blue;text-decoration:none"><img border="0" width="20" height="20" style="width:.2083in;height:.2083in" id="m_-8231062929519585837Image_x0020_2" src="cid:image002.png@01DA279B.F20EEED0" alt="web"></span></a><u></u><u></u></p>
</td>
<td width="25" valign="top" style="width:18.75pt;padding:0cm 0cm 0cm 0cm;height:15.0pt;text-align:inherit">
<p class="MsoNormal"><a href="https://signature.soget.fr/l/dnA0alZ4cjRrTERoZlFWSDhaN0xYdz09-eFZMaExNZWZGQjMvaVVJaDArTTl6Zz09" target="_blank" rel="noreferrer"><span style="color:blue;text-decoration:none"><img border="0" width="20" height="20" style="width:.2083in;height:.2083in" id="m_-8231062929519585837Image_x0020_3" src="cid:image003.png@01DA279B.F20EEED0" alt="linkedin"></span></a><u></u><u></u></p>
</td>
<td width="25" valign="top" style="width:18.75pt;padding:0cm 0cm 0cm 0cm;height:15.0pt;text-align:inherit">
<p class="MsoNormal"><a href="https://signature.soget.fr/l/dnA0alZ4cjRrTERoZlFWSDhaN0xYdz09-VjFWNTBIYlNCUDdIbXlxKzJyRzFPUT09" target="_blank" rel="noreferrer"><span style="color:blue;text-decoration:none"><img border="0" width="20" height="20" style="width:.2083in;height:.2083in" id="m_-8231062929519585837Image_x0020_4" src="cid:image004.png@01DA279B.F20EEED0" alt="twitter"></span></a><u></u><u></u></p>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
<tr style="color:inherit">
<td style="padding:.75pt .75pt .75pt .75pt;color:inherit;border-width:initial;border-style:initial">
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#87888a"><a href="http://soget.fr/disclaimer" target="_blank" rel="noreferrer"><span style="color:#87888a">Disclaimer</span></a></span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black"><u></u><u></u></span></p>
</div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" id="m_-8231062929519585837banner-replace"><u></u> <u></u></p>
</div>
</div>
_______________________________________________<br>
Manage your subscription:<br>
<a href="https://lists.clusterlabs.org/mailman/listinfo/users" rel="noreferrer noreferrer" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><br>
<br>
ClusterLabs home: <a href="https://www.clusterlabs.org/" rel="noreferrer noreferrer" target="_blank">https://www.clusterlabs.org/</a><br>
</blockquote></div>