<div dir="ltr"><div><div><div><div>Thank you, lost of quorum could indeed be an intentional behavior, however I experience the same situation when there is a monitoring failure or when parameter "no-quorum-policy" is set to "ignore", i.e.<br></div>- normal pacemaker service stop or 'crm_resources' stop for all resources: A -> B -> C<br></div>- lost quorum (with 'no-quorum-policy=ignore') or 'crm_resources' stop for all resources, when on of the resources reported "monitor" error: not ordered stop<br><br></div>I will double check my tests, however it would be helpful to know if, by chance, it is as it suppose to be.<br><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Dec 7, 2016 at 1:40 AM, Ulrich Windl <span dir="ltr"><<a href="mailto:Ulrich.Windl@rz.uni-regensburg.de" target="_blank">Ulrich.Windl@rz.uni-regensburg.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">>>> Radoslaw Garbacz <<a href="mailto:radoslaw.garbacz@xtremedatainc.com">radoslaw.garbacz@<wbr>xtremedatainc.com</a>> schrieb am 06.12.2016 um<br>
18:50 in Nachricht<br>
<<a href="mailto:CAHBw7oTJX0CZdvaOO0cc%2Bk6TDS5PhJMjr0_rsyrpLPPEXtVSLg@mail.gmail.com">CAHBw7oTJX0CZdvaOO0cc+<wbr>k6TDS5PhJMjr0_rsyrpLPPEXtVSLg@<wbr>mail.gmail.com</a>>:<br>
<span class="">> Hi,<br>
><br>
> I have encountered a problem with pacemaker resources shutdown in case of<br>
> (seems like) any emergency situation, when order constraints are not<br>
> honored.<br>
> I would be grateful for any information, whether this behavior is<br>
> intentional or should not happen (i.e. some testing issue rather then<br>
> pacemaker behavior). It would also be helpful to know if there is any<br>
> configuration parameter altering this, or whether there can be any reason<br>
> (cluster event) triggering not ordered resources stop.<br>
><br>
> Thanks,<br>
><br>
> To illustrate the issue I provide an example below and my collected data.<br>
> My environment uses resources cloning feature - maybe this contributes to<br>
> my tests outcome.<br>
><br>
><br>
> * Example:<br>
> - having resources ordered with constraints: A -> B -> C<br>
> - when stopping with 'crm_resources' command (all at once) resources are<br>
> stopped: C, B, A<br>
> - when stopping by terminating pacemaker resources are stopped: C, B, A<br>
> - when there is a monitoring error or quorum lost: no order is honored e.g.<br>
> B, C, A<br>
<br>
</span>Hi!<br>
<br>
If the node does not have quorum, it cannot do any cluster operations (IMHO). Instead it will try to commit suicide, maby with the help of self-fencing. So I think this case is normal for no quorum.<br>
<br>
Ulrich<br>
<br>
><br>
><br>
><br>
> * Version details:<br>
<div><div class="h5">> Pacemaker 1.1.15-1.1f8e642.git.el6<br>
> Corosync Cluster Engine, version '2.4.1.2-0da1'<br>
><br>
><br>
><br>
> * My ordering constraints:<br>
> Ordering Constraints:<br>
> dbx_first_primary then dbx_head_head (kind:Mandatory)<br>
> dbx_first_primary-clone then dbx_head_head (kind:Mandatory)<br>
> dbx_head_head then dbx_mounts_nodes (kind:Mandatory)<br>
> dbx_head_head then dbx_mounts_nodes-clone (kind:Mandatory)<br>
> dbx_mounts_nodes then dbx_bind_mounts_nodes (kind:Mandatory)<br>
> dbx_mounts_nodes-clone then dbx_bind_mounts_nodes-clone (kind:Mandatory)<br>
> dbx_bind_mounts_nodes then dbx_nfs_nodes (kind:Mandatory)<br>
> dbx_bind_mounts_nodes-clone then dbx_nfs_nodes-clone (kind:Mandatory)<br>
> dbx_nfs_nodes then dbx_gss_datas (kind:Mandatory)<br>
> dbx_nfs_nodes-clone then dbx_gss_datas-clone (kind:Mandatory)<br>
> dbx_gss_datas then dbx_nfs_mounts_datas (kind:Mandatory)<br>
> dbx_gss_datas-clone then dbx_nfs_mounts_datas-clone (kind:Mandatory)<br>
> dbx_nfs_mounts_datas then dbx_swap_nodes (kind:Mandatory)<br>
> dbx_nfs_mounts_datas-clone then dbx_swap_nodes-clone (kind:Mandatory)<br>
> dbx_swap_nodes then dbx_sync_head (kind:Mandatory)<br>
> dbx_swap_nodes-clone then dbx_sync_head (kind:Mandatory)<br>
> dbx_sync_head then dbx_dbx_datas (kind:Mandatory)<br>
> dbx_sync_head then dbx_dbx_datas-clone (kind:Mandatory)<br>
> dbx_dbx_datas then dbx_dbx_head (kind:Mandatory)<br>
> dbx_dbx_datas-clone then dbx_dbx_head (kind:Mandatory)<br>
> dbx_dbx_head then dbx_web_head (kind:Mandatory)<br>
> dbx_web_head then dbx_ready_primary (kind:Mandatory)<br>
> dbx_web_head then dbx_ready_primary-clone (kind:Mandatory)<br>
><br>
><br>
><br>
> * Pacemaker stop (OK):<br>
> <a href="http://ready.ocf.sh" rel="noreferrer" target="_blank">ready.ocf.sh</a>(dbx_ready_<wbr>primary)[18639]: 2016/12/06_15:40:32 INFO:<br>
> ready_stop: Stopping resource<br>
> <a href="http://mng.ocf.sh" rel="noreferrer" target="_blank">mng.ocf.sh</a>(dbx_mng_head)[<wbr>20312]: 2016/12/06_15:40:44 INFO: mng_stop:<br>
> Stopping resource<br>
> <a href="http://web.ocf.sh" rel="noreferrer" target="_blank">web.ocf.sh</a>(dbx_web_head)[<wbr>20310]: 2016/12/06_15:40:44 INFO:<br>
> dbxcl_stop: Stopping resource<br>
> <a href="http://dbx.ocf.sh" rel="noreferrer" target="_blank">dbx.ocf.sh</a>(dbx_dbx_head)[<wbr>20569]: 2016/12/06_15:40:46 INFO:<br>
> dbxcl_stop: Stopping resource<br>
> <a href="http://sync.ocf.sh" rel="noreferrer" target="_blank">sync.ocf.sh</a>(dbx_sync_head)[<wbr>20719]: 2016/12/06_15:40:54 INFO:<br>
> sync_stop: Stopping resource<br>
> <a href="http://swap.ocf.sh" rel="noreferrer" target="_blank">swap.ocf.sh</a>(dbx_swap_nodes)[<wbr>21053]: 2016/12/06_15:40:56 INFO:<br>
> swap_stop: Stopping resource<br>
> <a href="http://nfs.ocf.sh" rel="noreferrer" target="_blank">nfs.ocf.sh</a>(dbx_nfs_nodes)[<wbr>21151]: 2016/12/06_15:40:58 INFO: nfs_stop:<br>
> Stopping resource<br>
> <a href="http://dbx_mounts.ocf.sh" rel="noreferrer" target="_blank">dbx_mounts.ocf.sh</a>(dbx_bind_<wbr>mounts_nodes)[21344]: 2016/12/06_15:40:59<br>
> INFO: dbx_mounts_stop: Stopping resource<br>
> <a href="http://dbx_mounts.ocf.sh" rel="noreferrer" target="_blank">dbx_mounts.ocf.sh</a>(dbx_mounts_<wbr>nodes)[21767]: 2016/12/06_15:41:01 INFO:<br>
> dbx_mounts_stop: Stopping resource<br>
> <a href="http://head.ocf.sh" rel="noreferrer" target="_blank">head.ocf.sh</a>(dbx_head_head)[<wbr>22213]: 2016/12/06_15:41:04 INFO:<br>
> head_stop: Stopping resource<br>
> <a href="http://first.ocf.sh" rel="noreferrer" target="_blank">first.ocf.sh</a>(dbx_first_<wbr>primary)[22999]: 2016/12/06_15:41:11 INFO:<br>
> first_stop: Stopping resource<br>
><br>
><br>
><br>
> * Quorum lost:<br>
> <a href="http://sync.ocf.sh" rel="noreferrer" target="_blank">sync.ocf.sh</a>(dbx_sync_head)[<wbr>23099]: 2016/12/06_16:42:04 INFO:<br>
> sync_stop: Stopping resource<br>
> <a href="http://nfs.ocf.sh" rel="noreferrer" target="_blank">nfs.ocf.sh</a>(dbx_nfs_nodes)[<wbr>23102]: 2016/12/06_16:42:04 INFO: nfs_stop:<br>
> Stopping resource<br>
> <a href="http://mng.ocf.sh" rel="noreferrer" target="_blank">mng.ocf.sh</a>(dbx_mng_head)[<wbr>23101]: 2016/12/06_16:42:04 INFO: mng_stop:<br>
> Stopping resource<br>
> <a href="http://ready.ocf.sh" rel="noreferrer" target="_blank">ready.ocf.sh</a>(dbx_ready_<wbr>primary)[23104]: 2016/12/06_16:42:04 INFO:<br>
> ready_stop: Stopping resource<br>
> <a href="http://web.ocf.sh" rel="noreferrer" target="_blank">web.ocf.sh</a>(dbx_web_head)[<wbr>23344]: 2016/12/06_16:42:04 INFO:<br>
> dbxcl_stop: Stopping resource<br>
> <a href="http://dbx_mounts.ocf.sh" rel="noreferrer" target="_blank">dbx_mounts.ocf.sh</a>(dbx_bind_<wbr>mounts_nodes)[23664]: 2016/12/06_16:42:05<br>
> INFO: dbx_mounts_stop: Stopping resource<br>
> <a href="http://dbx_mounts.ocf.sh" rel="noreferrer" target="_blank">dbx_mounts.ocf.sh</a>(dbx_mounts_<wbr>nodes)[24459]: 2016/12/06_16:42:08 INFO:<br>
> dbx_mounts_stop: Stopping resource<br>
> <a href="http://head.ocf.sh" rel="noreferrer" target="_blank">head.ocf.sh</a>(dbx_head_head)[<wbr>25036]: 2016/12/06_16:42:11 INFO:<br>
> head_stop: Stopping resource<br>
> <a href="http://swap.ocf.sh" rel="noreferrer" target="_blank">swap.ocf.sh</a>(dbx_swap_nodes)[<wbr>27491]: 2016/12/06_16:43:08 INFO:<br>
> swap_stop: Stopping resource<br>
><br>
><br>
> --<br>
> Best Regards,<br>
><br>
> Radoslaw Garbacz<br>
> XtremeData Incorporation<br>
<br>
<br>
<br>
<br>
</div></div>______________________________<wbr>_________________<br>
Users mailing list: <a href="mailto:Users@clusterlabs.org">Users@clusterlabs.org</a><br>
<a href="http://lists.clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.clusterlabs.org/<wbr>mailman/listinfo/users</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" rel="noreferrer" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" rel="noreferrer" target="_blank">http://www.clusterlabs.org/<wbr>doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://bugs.clusterlabs.org" rel="noreferrer" target="_blank">http://bugs.clusterlabs.org</a><br>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Best Regards,<br><br>Radoslaw Garbacz<br></div>XtremeData Incorporation<br></div></div>
</div>