<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 02/16/2017 05:12 PM, Oscar Segarra
wrote:<br>
</div>
<blockquote
cite="mid:CAJq8taHymMC1vXUHaAsC9WW0qoMyuaaf1d_=JFqgvqm-JJLwEg@mail.gmail.com"
type="cite">
<div dir="ltr">Sorry, In the other node I get exactly the same log
entries:
<div><font face="monospace, monospace"><br>
</font></div>
<div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[125890]:
2017/02/16_17:11:45 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[125912]:
2017/02/16_17:11:45 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[125933]:
2017/02/16_17:11:45 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[125955]:
2017/02/16_17:11:45 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[125976]:
2017/02/16_17:11:45 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[125998]:
2017/02/16_17:11:45 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126019]:
2017/02/16_17:11:45 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126041]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126062]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126084]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126105]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126127]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126148]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126170]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126191]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126213]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126234]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126256]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126278]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126300]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126321]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126343]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126364]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126386]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126407]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126429]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126450]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126472]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126493]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126515]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126536]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126558]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126579]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126601]:
2017/02/16_17:11:46 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126622]:
2017/02/16_17:11:46 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126644]:
2017/02/16_17:11:47 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126665]:
2017/02/16_17:11:47 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126687]:
2017/02/16_17:11:47 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml not readable, resource
considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[126708]:
2017/02/16_17:11:47 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone01.xml does not exist or is
not readable.</font></div>
</div>
<div><br>
</div>
<div>Any help will be welcome!</div>
<div><br>
</div>
<div>Thanks a lot.</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2017-02-16 16:47 GMT+01:00 Oscar
Segarra <span dir="ltr"><<a moz-do-not-send="true"
href="mailto:oscar.segarra@gmail.com" target="_blank">oscar.segarra@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi Klaus,
<div><br>
</div>
<div>I have delted the op stop:</div>
<div><br>
</div>
<div>
<div><font face="monospace, monospace">pcs resource op
remove vm-vdicone01 stop interval=0s timeout=90</font></div>
<div><font face="monospace, monospace">pcs resource op
remove vm-vdicdb01 stop interval=0s timeout=90</font></div>
<div><font face="monospace, monospace">pcs resource op
remove vm-vdicsunstone01 stop interval=0s timeout=90</font></div>
<div><font face="monospace, monospace">pcs resource op
remove vm-vdicudsserver stop interval=0s timeout=90</font></div>
<div><font face="monospace, monospace">pcs resource op
remove vm-vdicudstuneler stop interval=0s timeout=90</font></div>
</div>
</div>
</blockquote>
</div>
</div>
</blockquote>
<br>
<font face="monospace, monospace">Oops that's not what I meant.<br>
I wasn't talking about the stop operation but about the monitoring<br>
operation that is to be executed when in the stopped role.<br>
Per default there is no monitoring done when in the stopped role
and<br>
thus you wouldn't get the repeated errors I guess.<br>
<br>
probably something like:<br>
</font><br>
<font face="monospace, monospace"><font face="monospace, monospace">pcs
resource op remove vm-vdicone01 monitor role=Stopped<br>
<br>
<br>
</font></font>
<blockquote
cite="mid:CAJq8taHymMC1vXUHaAsC9WW0qoMyuaaf1d_=JFqgvqm-JJLwEg@mail.gmail.com"
type="cite">
<div class="gmail_extra">
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div><br>
</div>
<div>But log continues growing (now all VirtualDomains
appear)</div>
<div><br>
</div>
<div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>72872]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[72873]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>72914]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[72917]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[72959]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>72958]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73000]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73001]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73044]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73045]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73086]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73089]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73130]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73133]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73172]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73175]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73217]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73216]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73259]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73258]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73303]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73302]:
2017/02/16_16:43:39 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73344]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73345]:
2017/02/16_16:43:39 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73388]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73389]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73430]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73433]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73475]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73474]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73519]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73516]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73560]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73561]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73602]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73605]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73656]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73657]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73698]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73701]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73742]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73745]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml not
readable, resource considered stopped.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73784]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml does not
exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-<wbr>vdicsunstone01)[73785]:
2017/02/16_16:43:40 ERROR: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicsunstone01.xml does
not exist or is not readable.</font></div>
<div><font face="monospace, monospace">VirtualDomain(vm-vdicone01)[<wbr>73828]:
2017/02/16_16:43:40 INFO: Configuration file
/mnt/nfs-vdic-mgmt-vm/<wbr>vdicone01.xml not
readable, resource considered stopped.</font></div>
</div>
<div><br>
</div>
<div>Thanks a lot!</div>
</div>
<div class="HOEnZb">
<div class="h5">
<div class="gmail_extra"><br>
<div class="gmail_quote">2017-02-16 14:04 GMT+01:00
Klaus Wenninger <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:kwenning@redhat.com"
target="_blank">kwenning@redhat.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"><span>
<div
class="m_6336318480116104151m_7748018195439379444moz-cite-prefix">On
02/16/2017 01:55 PM, Oscar Segarra wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Klaus,
<div><br>
</div>
<div>Thanks a lot, I will try to delete
the stop monitor.</div>
<div><br>
</div>
<div>Nevertheless, I have 6 domains
configured exactly the same... Is there
any reason why just this domain has this
behaviour ?</div>
</div>
</blockquote>
<br>
</span> None I can see here at least.<br>
Does the problem persist as is if you shut down
the whole cluster and<br>
bring it up again? Just to sort out history
issues ...
<div>
<div class="m_6336318480116104151h5"><br>
<br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>Thanks a lot.</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2017-02-16
11:12 GMT+01:00 Klaus Wenninger <span
dir="ltr"><<a
moz-do-not-send="true"
href="mailto:kwenning@redhat.com"
target="_blank">kwenning@redhat.com</a>></span>:<br>
<blockquote class="gmail_quote"
style="margin:0 0 0
.8ex;border-left:1px #ccc
solid;padding-left:1ex"><span>On
02/16/2017 11:02 AM, Oscar Segarra
wrote:<br>
> Hi Kaluss<br>
><br>
> Which is your proposal to fix
this behavior?<br>
<br>
</span>First you can try to remove
the monitor op for role=stopped.<br>
Then the startup-probing will
probably still fail but for that<br>
the behaviour is different.<br>
The startup-probing can be disabled
globally via cluster-property<br>
enable-startup-probes that is
defaulting to true.<br>
But be aware that the cluster then
wouldn't be able to react<br>
properly if services are already up
when pacemaker is starting.<br>
It should be possible to disable the
probing on a per resource<br>
or node basis as well iirc. But I
can't tell you out of my mind<br>
how that worked - there was a
discussion a few weeks ago<br>
on the list iirc.<br>
<br>
Regards,<br>
Klaus<br>
<span><br>
><br>
> Thanks a lot!<br>
><br>
><br>
> El 16 feb. 2017 10:57 a. m.,
"Klaus Wenninger" <<a
moz-do-not-send="true"
href="mailto:kwenning@redhat.com"
target="_blank">kwenning@redhat.com</a><br>
</span>> <mailto:<a
moz-do-not-send="true"
href="mailto:kwenning@redhat.com"
target="_blank">kwenning@redhat.com</a>>>
escribió:<br>
<div>
<div
class="m_6336318480116104151m_7748018195439379444h5">><br>
> On 02/16/2017 09:05 AM,
Oscar Segarra wrote:<br>
> > Hi,<br>
> ><br>
> > In my environment
I have deployed 5 VirtualDomains
as one can<br>
> see below:<br>
> > [root@vdicnode01
~]# pcs status<br>
> > Cluster name:
vdic-cluster<br>
> > Stack: corosync<br>
> > Current DC:
vdicnode01-priv (version
1.1.15-11.el7_3.2-e174ec8) -<br>
> > partition with
quorum<br>
> > Last updated: Thu
Feb 16 09:02:53 2017
Last change: Thu Feb<br>
> > 16 08:20:53 2017
by root via crm_attribute on
vdicnode02-priv<br>
> ><br>
> > 2 nodes and 14
resources configured: 5
resources DISABLED and 0<br>
> > BLOCKED from being
started due to failures<br>
> ><br>
> > Online: [
vdicnode01-priv vdicnode02-priv
]<br>
> ><br>
> > Full list of
resources:<br>
> ><br>
> >
nfs-vdic-mgmt-vm-vip
(ocf::heartbeat:IPaddr):
Started<br>
> > vdicnode01-priv<br>
> > Clone Set:
nfs_setup-clone [nfs_setup]<br>
> > Started: [
vdicnode01-priv vdicnode02-priv
]<br>
> > Clone Set:
nfs-mon-clone [nfs-mon]<br>
> > Started: [
vdicnode01-priv vdicnode02-priv
]<br>
> > Clone Set:
nfs-grace-clone [nfs-grace]<br>
> > Started: [
vdicnode01-priv vdicnode02-priv
]<br>
> > vm-vdicone01
(ocf::heartbeat:VirtualDomain<wbr>):
FAILED (disabled)[<br>
> > vdicnode02-priv
vdicnode01-priv ]<br>
> >
vm-vdicsunstone01
(ocf::heartbeat:VirtualDomain)<wbr>:
FAILED<br>
> > vdicnode01-priv
(disabled)<br>
> > vm-vdicdb01
(ocf::heartbeat:VirtualDomain)<wbr>:
FAILED (disabled)[<br>
> > vdicnode02-priv
vdicnode01-priv ]<br>
> > vm-vdicudsserver
(ocf::heartbeat:VirtualDomain<wbr>):
FAILED<br>
> > (disabled)[
vdicnode02-priv vdicnode01-priv
]<br>
> >
vm-vdicudstuneler
(ocf::heartbeat:VirtualDomain)<wbr>:
FAILED<br>
> > vdicnode01-priv
(disabled)<br>
> > Clone Set:
nfs-vdic-images-vip-clone
[nfs-vdic-images-vip]<br>
> > Stopped: [
vdicnode01-priv vdicnode02-priv
]<br>
> ><br>
> > Failed Actions:<br>
> > *
vm-vdicone01_monitor_20000 on
vdicnode02-priv 'not installed'
(5):<br>
> > call=2322,
status=complete,
exitreason='Configuration file<br>
> >
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not exist or is not<br>
> readable.',<br>
> >
last-rc-change='Thu Feb 16
09:02:07 2017', queued=0ms,
exec=21ms<br>
> > *
vm-vdicsunstone01_monitor_2000<wbr>0
on vdicnode02-priv 'not
installed'<br>
> > (5): call=2310,
status=complete,
exitreason='Configuration file<br>
> >
/mnt/nfs-vdic-mgmt-vm/vdicsuns<wbr>tone01.xml
does not exist or is not<br>
> > readable.',<br>
> >
last-rc-change='Thu Feb 16
09:02:07 2017', queued=0ms,
exec=37ms<br>
> > *
vm-vdicdb01_monitor_20000 on
vdicnode02-priv 'not installed'
(5):<br>
> > call=2320,
status=complete,
exitreason='Configuration file<br>
> >
/mnt/nfs-vdic-mgmt-vm/vdicdb01<wbr>.xml
does not exist or is not<br>
> readable.',<br>
> >
last-rc-change='Thu Feb 16
09:02:07 2017', queued=0ms,
exec=35ms<br>
> > *
vm-vdicudsserver_monitor_20000
on vdicnode02-priv 'not
installed'<br>
> > (5): call=2321,
status=complete,
exitreason='Configuration file<br>
> >
/mnt/nfs-vdic-mgmt-vm/vdicudss<wbr>erver.xml
does not exist or is not<br>
> > readable.',<br>
> >
last-rc-change='Thu Feb 16
09:02:07 2017', queued=0ms,
exec=42ms<br>
> > *
vm-vdicudstuneler_monitor_2000<wbr>0
on vdicnode01-priv 'not
installed'<br>
> > (5): call=1987183,
status=complete,
exitreason='Configuration file<br>
> >
/mnt/nfs-vdic-mgmt-vm/vdicudst<wbr>uneler.xml
does not exist or is not<br>
> > readable.',<br>
> >
last-rc-change='Thu Feb 16
04:00:25 2017', queued=0ms,
exec=30ms<br>
> > *
vm-vdicdb01_monitor_20000 on
vdicnode01-priv 'not installed'
(5):<br>
> > call=2550049,
status=complete,
exitreason='Configuration file<br>
> >
/mnt/nfs-vdic-mgmt-vm/vdicdb01<wbr>.xml
does not exist or is not<br>
> readable.',<br>
> >
last-rc-change='Thu Feb 16
08:13:37 2017', queued=0ms,
exec=44ms<br>
> > *
nfs-mon_monitor_10000 on
vdicnode01-priv 'unknown error'
(1):<br>
> > call=1984009,
status=Timed Out,
exitreason='none',<br>
> >
last-rc-change='Thu Feb 16
04:24:30 2017', queued=0ms,
exec=0ms<br>
> > *
vm-vdicsunstone01_monitor_2000<wbr>0
on vdicnode01-priv 'not
installed'<br>
> > (5): call=2552050,
status=complete,
exitreason='Configuration file<br>
> >
/mnt/nfs-vdic-mgmt-vm/vdicsuns<wbr>tone01.xml
does not exist or is not<br>
> > readable.',<br>
> >
last-rc-change='Thu Feb 16
08:14:07 2017', queued=0ms,
exec=22ms<br>
> > *
vm-vdicone01_monitor_20000 on
vdicnode01-priv 'not installed'
(5):<br>
> > call=2620052,
status=complete,
exitreason='Configuration file<br>
> >
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not exist or is not<br>
> readable.',<br>
> >
last-rc-change='Thu Feb 16
09:02:53 2017', queued=0ms,
exec=45ms<br>
> > *
vm-vdicudsserver_monitor_20000
on vdicnode01-priv 'not
installed'<br>
> > (5): call=2550052,
status=complete,
exitreason='Configuration file<br>
> >
/mnt/nfs-vdic-mgmt-vm/vdicudss<wbr>erver.xml
does not exist or is not<br>
> > readable.',<br>
> >
last-rc-change='Thu Feb 16
08:13:37 2017', queued=0ms,
exec=48ms<br>
> ><br>
> ><br>
> > Al VirtualDomain
resources are configured the
same:<br>
> ><br>
> > [root@vdicnode01
cluster]# pcs resource show
vm-vdicone01<br>
> > Resource:
vm-vdicone01 (class=ocf
provider=heartbeat<br>
> type=VirtualDomain)<br>
> > Attributes:
hypervisor=qemu:///system<br>
> >
config=/mnt/nfs-vdic-mgmt-vm/v<wbr>dicone01.xml<br>
> >
migration_network_suffix=tcp:/<wbr>/
migration_transport=ssh<br>
> > Meta Attrs:
allow-migrate=true
target-role=Stopped<br>
> > Utilization:
cpu=1 hv_memory=512<br>
> > Operations:
start interval=0s timeout=90<br>
> >
(vm-vdicone01-start-interval-0<wbr>s)<br>
> > stop
interval=0s timeout=90<br>
>
(vm-vdicone01-stop-interval-0<wbr>s)<br>
> >
monitor interval=20s
role=Stopped<br>
> >
(vm-vdicone01-monitor-interval<wbr>-20s)<br>
> >
monitor interval=30s<br>
>
(vm-vdicone01-monitor-interva<wbr>l-30s)<br>
> > [root@vdicnode01
cluster]# pcs resource show
vm-vdicdb01<br>
> > Resource:
vm-vdicdb01 (class=ocf
provider=heartbeat<br>
> type=VirtualDomain)<br>
> > Attributes:
hypervisor=qemu:///system<br>
> >
config=/mnt/nfs-vdic-mgmt-vm/v<wbr>dicdb01.xml<br>
> >
migration_network_suffix=tcp:/<wbr>/
migration_transport=ssh<br>
> > Meta Attrs:
allow-migrate=true
target-role=Stopped<br>
> > Utilization:
cpu=1 hv_memory=512<br>
> > Operations:
start interval=0s timeout=90<br>
>
(vm-vdicdb01-start-interval-0<wbr>s)<br>
> > stop
interval=0s timeout=90<br>
>
(vm-vdicdb01-stop-interval-0s<wbr>)<br>
> >
monitor interval=20s
role=Stopped<br>
> >
(vm-vdicdb01-monitor-interval-<wbr>20s)<br>
> >
monitor interval=30s<br>
>
(vm-vdicdb01-monitor-interval<wbr>-30s)<br>
> ><br>
> ><br>
> ><br>
> > Nevertheless, one
of the virtual domains is
logging hardly and<br>
> > fulfilling my hard
disk:<br>
> ><br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6359]:
2017/02/16_08:52:27 INFO:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
not readable,<br>
> > resource
considered stopped.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6401]:
2017/02/16_08:52:27 ERROR:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not<br>
> exist<br>
> > or is not
readable.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6423]:
2017/02/16_08:52:27 INFO:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
not readable,<br>
> > resource
considered stopped.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6444]:
2017/02/16_08:52:27 ERROR:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not<br>
> exist<br>
> > or is not
readable.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6466]:
2017/02/16_08:52:27 INFO:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
not readable,<br>
> > resource
considered stopped.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6487]:
2017/02/16_08:52:27 ERROR:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not<br>
> exist<br>
> > or is not
readable.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6509]:
2017/02/16_08:52:27 INFO:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
not readable,<br>
> > resource
considered stopped.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6530]:
2017/02/16_08:52:27 ERROR:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not<br>
> exist<br>
> > or is not
readable.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6552]:
2017/02/16_08:52:27 INFO:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
not readable,<br>
> > resource
considered stopped.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6573]:
2017/02/16_08:52:27 ERROR:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not<br>
> exist<br>
> > or is not
readable.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6595]:
2017/02/16_08:52:27 INFO:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
not readable,<br>
> > resource
considered stopped.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6616]:
2017/02/16_08:52:27 ERROR:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not<br>
> exist<br>
> > or is not
readable.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6638]:
2017/02/16_08:52:27 INFO:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
not readable,<br>
> > resource
considered stopped.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6659]:
2017/02/16_08:52:27 ERROR:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not<br>
> exist<br>
> > or is not
readable.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6681]:
2017/02/16_08:52:27 INFO:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
not readable,<br>
> > resource
considered stopped.<br>
> >
VirtualDomain(vm-vdicone01)[11<wbr>6702]:
2017/02/16_08:52:27 ERROR:<br>
> > Configuration file
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
does not<br>
> exist<br>
> > or is not
readable.<br>
> > [root@vdicnode01
cluster]# pcs status<br>
> ><br>
> ><br>
> > Note! Is it normal
the error as I have not mounted
the nfs<br>
> > resource
/mnt/nfs-vdic-mgmt-vm/vdicone0<wbr>1.xml
yet.<br>
><br>
> Well that is probably
the explanation already:<br>
> The resource should be
stopped. The config-file is not
available.<br>
> But the resource needs
the config-file to verify that
it is really<br>
> stopped.<br>
> So the probe is failing
and as you have a monitoring op
for<br>
> role="stopped" it<br>
> is doing that over and
over again.<br>
><br>
> ><br>
> > ¿Is there any
explanation for this heavy
logging?<br>
> ><br>
> > Thanks a lot!<br>
> ><br>
> ><br>
> >
______________________________<wbr>_________________<br>
> > Users mailing
list: <a moz-do-not-send="true"
href="mailto:Users@clusterlabs.org" target="_blank">Users@clusterlabs.org</a><br>
</div>
</div>
> <mailto:<a
moz-do-not-send="true"
href="mailto:Users@clusterlabs.org"
target="_blank">Users@clusterlabs.org</a><wbr>><br>
> > <a
moz-do-not-send="true"
href="http://lists.clusterlabs.org/mailman/listinfo/users"
rel="noreferrer" target="_blank">http://lists.clusterlabs.org/m<wbr>ailman/listinfo/users</a><br>
<span>> <<a
moz-do-not-send="true"
href="http://lists.clusterlabs.org/mailman/listinfo/users"
rel="noreferrer" target="_blank">http://lists.clusterlabs.org<wbr>/mailman/listinfo/users</a>><br>
> ><br>
> > Project Home: <a
moz-do-not-send="true"
href="http://www.clusterlabs.org"
rel="noreferrer" target="_blank">http://www.clusterlabs.org</a><br>
> > Getting started:<br>
> <a moz-do-not-send="true"
href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf"
rel="noreferrer" target="_blank">http://www.clusterlabs.org/do<wbr>c/Cluster_from_Scratch.pdf</a><br>
> <<a
moz-do-not-send="true"
href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf"
rel="noreferrer" target="_blank">http://www.clusterlabs.org/d<wbr>oc/Cluster_from_Scratch.pdf</a>><br>
> > Bugs: <a
moz-do-not-send="true"
href="http://bugs.clusterlabs.org"
rel="noreferrer" target="_blank">http://bugs.clusterlabs.org</a><br>
><br>
><br>
><br>
>
_____________________________<wbr>__________________<br>
> Users mailing list: <a
moz-do-not-send="true"
href="mailto:Users@clusterlabs.org"
target="_blank">Users@clusterlabs.org</a><br>
</span>> <mailto:<a
moz-do-not-send="true"
href="mailto:Users@clusterlabs.org"
target="_blank">Users@clusterlabs.org</a><wbr>><br>
> <a moz-do-not-send="true"
href="http://lists.clusterlabs.org/mailman/listinfo/users"
rel="noreferrer" target="_blank">http://lists.clusterlabs.org/<wbr>mailman/listinfo/users</a><br>
<div
class="m_6336318480116104151m_7748018195439379444HOEnZb">
<div
class="m_6336318480116104151m_7748018195439379444h5">>
<<a moz-do-not-send="true"
href="http://lists.clusterlabs.org/mailman/listinfo/users"
rel="noreferrer"
target="_blank">http://lists.clusterlabs.org<wbr>/mailman/listinfo/users</a>><br>
><br>
> Project Home: <a
moz-do-not-send="true"
href="http://www.clusterlabs.org"
rel="noreferrer"
target="_blank">http://www.clusterlabs.org</a><br>
> Getting started:<br>
> <a
moz-do-not-send="true"
href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf"
rel="noreferrer"
target="_blank">http://www.clusterlabs.org/do<wbr>c/Cluster_from_Scratch.pdf</a><br>
> <<a
moz-do-not-send="true"
href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf"
rel="noreferrer"
target="_blank">http://www.clusterlabs.org/d<wbr>oc/Cluster_from_Scratch.pdf</a>><br>
> Bugs: <a
moz-do-not-send="true"
href="http://bugs.clusterlabs.org"
rel="noreferrer"
target="_blank">http://bugs.clusterlabs.org</a><br>
><br>
><br>
<br>
<br>
______________________________<wbr>_________________<br>
Users mailing list: <a
moz-do-not-send="true"
href="mailto:Users@clusterlabs.org"
target="_blank">Users@clusterlabs.org</a><br>
<a moz-do-not-send="true"
href="http://lists.clusterlabs.org/mailman/listinfo/users"
rel="noreferrer"
target="_blank">http://lists.clusterlabs.org/m<wbr>ailman/listinfo/users</a><br>
<br>
Project Home: <a
moz-do-not-send="true"
href="http://www.clusterlabs.org"
rel="noreferrer"
target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a
moz-do-not-send="true"
href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf"
rel="noreferrer"
target="_blank">http://www.clusterlabs.org/doc<wbr>/Cluster_from_Scratch.pdf</a><br>
Bugs: <a moz-do-not-send="true"
href="http://bugs.clusterlabs.org" rel="noreferrer" target="_blank">http://bugs.clusterlabs.org</a><br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<p><br>
</p>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<p><br>
</p>
</body>
</html>