<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:Roboto;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.yiv7380066700msonormal, li.yiv7380066700msonormal, div.yiv7380066700msonormal
{mso-style-name:yiv7380066700msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
p.yiv7380066700msonormal1, li.yiv7380066700msonormal1, div.yiv7380066700msonormal1
{mso-style-name:yiv7380066700msonormal1;
margin:0in;
font-size:11.0pt;
font-family:"Arial",sans-serif;}
p.yiv7380066700msonormal41, li.yiv7380066700msonormal41, div.yiv7380066700msonormal41
{mso-style-name:yiv7380066700msonormal41;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Arial",sans-serif;}
p.yiv7380066700msonormal311, li.yiv7380066700msonormal311, div.yiv7380066700msonormal311
{mso-style-name:yiv7380066700msonormal311;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Arial",sans-serif;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.EmailStyle37
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">To Strahil and Klaus –<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I created the vdo devices using default parameters, so ‘<b><span style="font-family:Consolas">auto’</span></b> mode was selected by default.
<b><span style="font-family:Consolas">vdostatus</span></b> shows that the current mode is
<b><span style="font-family:Consolas">async</span></b>. The underlying drbd devices are running protocol C, so I assume that vdo should be changed to sync mode?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The VDO service is disabled and is solely under the control of Pacemaker, but I have been unable to get a resource agent to work reliably. I have two nodes. Under normal operation, Node A is primary for disk drbd0, and device vdo0 rides
on top of that. Node B is primary for disk drbd1 and device vdo1 rides on top of that. In the event of a node failure, the vdo device and the underlying drbd disk should migrate to the other node, and then that node will be primary for both drbd disks and
both vdo devices.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The default systemd <b><span style="font-family:Consolas">vdo</span></b> service does not work because it uses the –all flag and starts/stops all vdo devices. I noticed that there is also a
<b><span style="font-family:Consolas">vdo-start-by-dev.service</span></b>, but there is no documentation on how to use it. I wrote my own vdo-by-dev system service, but that did not work reliably either. Then I noticed that there is already an OCF resource
agent named <b><span style="font-family:Consolas">vdo-vol</span></b>, but that did not work either. I finally tried writing my own OCF-compliant RA, and then I tried writing an LSB-compliant script, but none of those worked very well.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">My big problem is that I don’t understand how Pacemaker uses the
<b><span style="font-family:Consolas">monitor</span></b> action. Pacemaker would often fail vdo resources because the monitor action received an error when it ran on the standby node. For example, when Node A is primary for disk drbd1 and device vdo1, Pacemaker
would fail device vdo1 because when it ran the monitor action on Node B, the RA reported an error. But OF COURSE it would report an error, because disk drbd1 is secondary on that node, and is therefore inaccessible to the vdo driver. I DON’T UNDERSTAND. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">-Eric<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Strahil Nikolov <hunter86_bg@yahoo.com> <br>
<b>Sent:</b> Monday, May 17, 2021 5:09 AM<br>
<b>To:</b> kwenning@redhat.com; Klaus Wenninger <kwenning@redhat.com>; Cluster Labs - All topics related to open-source clustering welcomed <users@clusterlabs.org>; Eric Robinson <eric.robinson@psmnv.com><br>
<b>Subject:</b> Re: [ClusterLabs] DRBD + VDO HowTo?<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Have you tried to set VDO in async mode ?<o:p></o:p></p>
<div id="yMail_cursorElementTracker_1621246131234">
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div id="yMail_cursorElementTracker_1621246131442">
<p class="MsoNormal">Best Regards,<o:p></o:p></p>
</div>
<div id="yMail_cursorElementTracker_1621246134824">
<p class="MsoNormal" style="margin-bottom:12.0pt">Strahil Nikolov<o:p></o:p></p>
<blockquote style="margin-left:0in;margin-right:0in;margin-bottom:15.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-family:Roboto;color:#6D00F6">On Mon, May 17, 2021 at 8:57, Klaus Wenninger<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:Roboto;color:#6D00F6"><<a href="mailto:kwenning@redhat.com">kwenning@redhat.com</a>> wrote:<o:p></o:p></span></p>
</div>
</div>
<div style="border:none;border-left:solid #6D00F6 1.0pt;padding:0in 0in 0in 15.0pt;margin-top:7.5pt">
<div id="yiv7380066700">
<div>
<div>
<p class="MsoNormal">Did you try VDO in sync-mode for the case the flush-fua<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">stuff isn't working through the layers?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Did you check that VDO-service is disabled and solely under<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">pacemaker-control and that the dependencies are set correctly?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Klaus<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On 5/17/21 6:17 AM, Eric Robinson wrote:<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="yiv7380066700msonormal">Yes, DRBD is working fine. <o:p></o:p></p>
<p class="yiv7380066700msonormal"> <o:p></o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="yiv7380066700msonormal"><b>From:</b> Strahil Nikolov <a href="mailto:hunter86_bg@yahoo.com" target="_blank">
<hunter86_bg@yahoo.com></a> <br>
<b>Sent:</b> Sunday, May 16, 2021 6:06 PM<br>
<b>To:</b> Eric Robinson <a href="mailto:eric.robinson@psmnv.com" target="_blank">
<eric.robinson@psmnv.com></a>; Cluster Labs - All topics related to open-source clustering welcomed
<a href="mailto:users@clusterlabs.org" target="_blank"><users@clusterlabs.org></a><br>
<b>Subject:</b> RE: [ClusterLabs] DRBD + VDO HowTo?<o:p></o:p></p>
</div>
</div>
<p class="yiv7380066700msonormal"> <o:p></o:p></p>
<p class="yiv7380066700msonormal">Are you sure that the DRBD is working properly ?<o:p></o:p></p>
<div id="yiv7380066700yMail_cursorElementTracker_1621206371208">
<p class="yiv7380066700msonormal"> <o:p></o:p></p>
</div>
<div id="yiv7380066700yMail_cursorElementTracker_1621206371394">
<p class="yiv7380066700msonormal">Best Regards,<o:p></o:p></p>
</div>
<div id="yiv7380066700yMail_cursorElementTracker_1621206375706">
<p class="yiv7380066700msonormal" style="margin-bottom:12.0pt">Strahil Nikolov<o:p></o:p></p>
<blockquote style="margin-left:0in;margin-top:5.0pt;margin-right:0in;margin-bottom:15.0pt">
<div>
<div>
<p class="yiv7380066700msonormal"><span style="font-family:Roboto;color:#6D00F6">On Mon, May 17, 2021 at 0:32, Eric Robinson</span><o:p></o:p></p>
</div>
<div>
<p class="yiv7380066700msonormal"><span style="font-family:Roboto;color:#6D00F6"><<a href="mailto:eric.robinson@psmnv.com" target="_blank">eric.robinson@psmnv.com</a>> wrote:</span><o:p></o:p></p>
</div>
</div>
<div style="border:none;border-left:solid #6D00F6 1.0pt;padding:0in 0in 0in 15.0pt;margin-top:7.5pt">
<div id="yiv7380066700">
<div>
<div>
<p class="yiv7380066700msonormal1">Okay, it turns out I was wrong. I thought I had it working, but I keep running into problems. Sometimes when I demote a DRBD resource on Node A and promote it on Node B, and I try to mount the filesystem, the system complains
that it cannot read the superblock. But when I move the DRBD primary back to Node A, the file system is mountable again. Also, I have problems with filesystems not mounting because the vdo devices are not present. All kinds of issues.<o:p></o:p></p>
<div>
<p class="yiv7380066700msonormal1"> <o:p></o:p></p>
</div>
<p class="yiv7380066700msonormal1"> <o:p></o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<div id="yiv7380066700yqtfd39754">
<p class="yiv7380066700msonormal1"><b>From:</b> Users <<a href="mailto:users-bounces@clusterlabs.org" target="_blank">users-bounces@clusterlabs.org</a>>
<b>On Behalf Of </b>Eric Robinson<br>
<b>Sent:</b> Friday, May 14, 2021 3:55 PM<br>
<b>To:</b> Strahil Nikolov <<a href="mailto:hunter86_bg@yahoo.com" target="_blank">hunter86_bg@yahoo.com</a>>; Cluster Labs - All topics related to open-source clustering welcomed <<a href="mailto:users@clusterlabs.org" target="_blank">users@clusterlabs.org</a>><br>
<b>Subject:</b> Re: [ClusterLabs] DRBD + VDO HowTo?<o:p></o:p></p>
</div>
</div>
</div>
<div id="yiv7380066700yqtfd80248">
<p class="yiv7380066700msonormal1"> <o:p></o:p></p>
<p class="yiv7380066700msonormal1"> <o:p></o:p></p>
<p class="yiv7380066700msonormal1">Okay, I have it working now. The default systemd service definitions did not work, so I created my own.
<o:p></o:p></p>
<p class="yiv7380066700msonormal1"> <o:p></o:p></p>
<p class="yiv7380066700msonormal1"> <o:p></o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="yiv7380066700msonormal1"><b>From:</b> Strahil Nikolov <<a href="mailto:hunter86_bg@yahoo.com" target="_blank">hunter86_bg@yahoo.com</a>>
<br>
<b>Sent:</b> Friday, May 14, 2021 3:41 AM<br>
<b>To:</b> Eric Robinson <<a href="mailto:eric.robinson@psmnv.com" target="_blank">eric.robinson@psmnv.com</a>>; Cluster Labs - All topics related to open-source clustering welcomed <<a href="mailto:users@clusterlabs.org" target="_blank">users@clusterlabs.org</a>><br>
<b>Subject:</b> RE: [ClusterLabs] DRBD + VDO HowTo?<o:p></o:p></p>
</div>
</div>
<p class="yiv7380066700msonormal1"> <o:p></o:p></p>
<p class="yiv7380066700msonormal1">There is no VDO RA according to my knowledge, but you can use systemd service as a resource.<o:p></o:p></p>
<div id="yiv7380066700yMail_cursorElementTracker_1620979503479">
<p class="yiv7380066700msonormal1"> <o:p></o:p></p>
</div>
<div id="yiv7380066700yMail_cursorElementTracker_1620979505648">
<p class="yiv7380066700msonormal1">Yet, the VDO service that comes with thr OS is a generic one and controlls all VDOs - so you need to create your own vdo service.<o:p></o:p></p>
</div>
<div id="yiv7380066700yMail_cursorElementTracker_1620979573043">
<p class="yiv7380066700msonormal1"> <o:p></o:p></p>
</div>
<div id="yiv7380066700yMail_cursorElementTracker_1620979573221">
<p class="yiv7380066700msonormal1">Best Regards,<o:p></o:p></p>
</div>
<div id="yiv7380066700yMail_cursorElementTracker_1620981647955">
<p class="yiv7380066700msonormal1" style="margin-bottom:12.0pt">Strahil Nikolov<o:p></o:p></p>
<blockquote style="margin-left:0in;margin-top:5.0pt;margin-right:0in;margin-bottom:15.0pt">
<div>
<div>
<p class="yiv7380066700msonormal1"><span style="font-family:Roboto;color:#6D00F6">On Fri, May 14, 2021 at 6:55, Eric Robinson</span><o:p></o:p></p>
</div>
<div>
<p class="yiv7380066700msonormal1"><span style="font-family:Roboto;color:#6D00F6"><<a href="mailto:eric.robinson@psmnv.com" target="_blank">eric.robinson@psmnv.com</a>> wrote:</span><o:p></o:p></p>
</div>
</div>
<div style="border:none;border-left:solid #6D00F6 1.0pt;padding:0in 0in 0in 15.0pt;margin-top:7.5pt">
<div id="yiv7380066700">
<div>
<div>
<p class="yiv7380066700msonormal41">I created the VDO volumes fine on the drbd devices, formatted them as xfs filesystems, created cluster filesystem resources, and the cluster us using them. But the cluster won’t fail over. Is there a VDO cluster RA out there
somewhere already? <o:p></o:p></p>
<p class="yiv7380066700msonormal41"> <o:p></o:p></p>
<p class="yiv7380066700msonormal41"> <o:p></o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="yiv7380066700msonormal41"><b>From:</b> Strahil Nikolov <<a href="mailto:hunter86_bg@yahoo.com" target="_blank">hunter86_bg@yahoo.com</a>>
<br>
<b>Sent:</b> Thursday, May 13, 2021 10:07 PM<br>
<b>To:</b> Cluster Labs - All topics related to open-source clustering welcomed <<a href="mailto:users@clusterlabs.org" target="_blank">users@clusterlabs.org</a>>; Eric Robinson <<a href="mailto:eric.robinson@psmnv.com" target="_blank">eric.robinson@psmnv.com</a>><br>
<b>Subject:</b> Re: [ClusterLabs] DRBD + VDO HowTo?<o:p></o:p></p>
</div>
</div>
<p class="yiv7380066700msonormal41"> <o:p></o:p></p>
<p class="yiv7380066700msonormal41">For DRBD there is enough info, so let's focus on VDO.<o:p></o:p></p>
<div id="yiv7380066700yMail_cursorElementTracker_1620961478467">
<p class="yiv7380066700msonormal41">There is a systemd service that starts all VDOs on the system. You can create the VDO once drbs is open for writes and then you can create your own systemd '.service' file which can be used as a cluster resource.<br>
<br>
<br>
Best Regards,<o:p></o:p></p>
</div>
<div id="yiv7380066700yMail_cursorElementTracker_1620961591508">
<p class="yiv7380066700msonormal41">Strahil Nikolov<o:p></o:p></p>
</div>
<div id="yiv7380066700yMail_cursorElementTracker_1620961598346">
<p class="yiv7380066700msonormal41"> <o:p></o:p></p>
<blockquote style="margin-left:0in;margin-top:5.0pt;margin-right:0in;margin-bottom:15.0pt">
<div>
<div>
<p class="yiv7380066700msonormal41"><span style="color:#6D00F6">On Fri, May 14, 2021 at 2:33, Eric Robinson</span><o:p></o:p></p>
</div>
<div>
<p class="yiv7380066700msonormal41"><span style="color:#6D00F6"><<a href="mailto:eric.robinson@psmnv.com" target="_blank">eric.robinson@psmnv.com</a>> wrote:</span><o:p></o:p></p>
</div>
</div>
<div style="border:none;border-left:solid #6D00F6 1.0pt;padding:0in 0in 0in 15.0pt;margin-top:7.5pt">
<div id="yiv7380066700">
<div>
<div>
<p class="yiv7380066700msonormal311">Can anyone point to a document on how to use VDO de-duplication with DRBD? Linbit has a blog page about it, but it was last updated 6 years ago and the embedded links are dead.<o:p></o:p></p>
<p class="yiv7380066700msonormal311"> <o:p></o:p></p>
<p class="yiv7380066700msonormal311"><a href="https://linbit.com/blog/albireo-virtual-data-optimizer-vdo-on-drbd/" target="_blank">https://linbit.com/blog/albireo-virtual-data-optimizer-vdo-on-drbd/</a><o:p></o:p></p>
<p class="yiv7380066700msonormal311"> <o:p></o:p></p>
<p class="yiv7380066700msonormal311">-Eric<o:p></o:p></p>
<p class="yiv7380066700msonormal311"> <o:p></o:p></p>
<p class="yiv7380066700msonormal311"> <o:p></o:p></p>
<p class="yiv7380066700msonormal311"> <o:p></o:p></p>
<p class="yiv7380066700msonormal311"> <o:p></o:p></p>
</div>
<p class="yiv7380066700msonormal311">Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email.
Any views or opinions presented in this email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this
email, the company cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
<o:p></o:p></p>
</div>
</div>
<p class="yiv7380066700msonormal41">_______________________________________________<br>
Manage your subscription:<br>
<a href="https://lists.clusterlabs.org/mailman/listinfo/users" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><br>
<br>
ClusterLabs home: <a href="https://www.clusterlabs.org/" target="_blank">https://www.clusterlabs.org/</a><o:p></o:p></p>
</div>
</blockquote>
</div>
</div>
</div>
<div id="yiv7380066700yqtfd73140">
<div id="yiv7380066700yqtfd67470">
<p class="yiv7380066700msonormal41">Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email.
Any views or opinions presented in this email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this
email, the company cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
<div id="yiv7380066700yqtfd12392">
<p class="yiv7380066700msonormal1">Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email. Any
views or opinions presented in this email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this email,
the company cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
<o:p></o:p></p>
</div>
</div>
</div>
</div>
<div id="yiv7380066700yqtfd90113">
<div id="yiv7380066700yqtfd01577">
<p class="yiv7380066700msonormal1">Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email. Any
views or opinions presented in this email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this email,
the company cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
<div id="yiv7380066700yqtfd48800">
<p class="MsoNormal">Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email. Any views or opinions
presented in this email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this email, the company
cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Manage your subscription:<o:p></o:p></pre>
<pre><a href="https://lists.clusterlabs.org/mailman/listinfo/users" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>ClusterLabs home: <a href="https://www.clusterlabs.org/" target="_blank">https://www.clusterlabs.org/</a><o:p></o:p></pre>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email. Any views or opinions presented in this
email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this email, the company cannot accept responsibility
for any loss or damage arising from the use of this email or attachments.
</body>
</html>