<div dir="ltr">Dear users,<br><br>I have been facing one strange issue on active active HA configuration. when any resource service failed to start,pacemaker is unable to start resource on another cluster host.All the resource in cluster showing stopped status.when i run pcs resource refresh, resource move and start on another cluster host. I am unable to find issue,why cluster is not able to start on other host without resource refresh.<br><br>Below is log i see when resource is failed<br>-------------------------------------------<br>Mar 02 07:25:48 olp-gen-sbca02.lan pengine[4521]: warning: Processing failed monitor of php-fpm:1 on testsrv2: not running<br>Mar 02 07:25:48 olp-gen-sbca02.lan pengine[4521]: warning: Forcing php-fpm-clone away from testsrv2 after 1 failures (max=1)<br>Mar 02 07:25:48 olp-gen-sbca02.lan pengine[4521]: warning: Forcing php-fpm-clone away from testsrv2 after 1 failures (max=1)<br>Mar 02 07:25:48 olp-gen-sbca02.lan pengine[4521]: notice: * Stop Cluster_eno4 ( testsrv2 ) due to node availability<br>Mar 02 07:25:48 olp-gen-sbca02.lan pengine[4521]: notice: * Stop Cluster_eno1 ( testsrv2 ) due to node availability<br>Mar 02 07:25:48 olp-gen-sbca02.lan pengine[4521]: notice: * Stop Cluster_eno3 ( testsrv2 ) due to node availability<br>Mar 02 07:25:48 olp-gen-sbca02.lan pengine[4521]: notice: * Stop php-fpm:1 ( testsrv2 ) due to node availability<br>Mar 02 07:25:48 olp-gen-sbca02.lan pengine[4521]: warning: Calculated transition 14 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-1055.bz2<br>Mar 02 07:25:48 olp-gen-sbca02.lan crmd[4522]: notice: Initiating stop operation Cluster_eno4_stop_0 locally on testsrv2<br>Mar 02 07:25:48 olp-gen-sbca02.lan crmd[4522]: notice: Initiating stop operation Cluster_eno1_stop_0 locally on testsrv2<br>Mar 02 07:25:48 olp-gen-sbca02.lan crmd[4522]: notice: Initiating stop operation Cluster_eno3_stop_0 locally on testsrv2<br>Mar 02 07:25:48 olp-gen-sbca02.lan crmd[4522]: notice: Initiating stop operation php-fpm_stop_0 locally on testsrv2<br>Mar 02 07:25:48 olp-gen-sbca02.lan crmd[4522]: notice: Result of stop operation for Cluster_eno1 on testsrv2: 0 (ok)<br>Mar 02 07:25:48 olp-gen-sbca02.lan crmd[4522]: notice: Result of stop operation for Cluster_eno4 on testsrv2: 0 (ok)<br>Mar 02 07:25:48 olp-gen-sbca02.lan crmd[4522]: notice: Result of stop operation for Cluster_eno3 on testsrv2: 0 (ok)<br>Mar 02 07:25:50 olp-gen-sbca02.lan crmd[4522]: notice: Result of stop operation for php-fpm on testsrv2: 0 (ok)<br>Mar 02 07:25:50 olp-gen-sbca02.lan crmd[4522]: notice: Transition 14 (Complete=6, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-warn-1055.bz2): Complete<br>Mar 02 07:25:50 olp-gen-sbca02.lan crmd[4522]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE<br> <br><br>Below is version of OS and pacemaker configuration<br>-----------------------------------------------------<br>Corosync Cluster Engine, version '2.4.3'<br>Pace Maker version '1.1.20'<br>OS: CentOS Linux release 7.6.1810<br><br><br>I have configured 3 VIP for different interface and clone all other resources as active active. Below is step i try to configured for cluster<br><br>pcs property set stonith-enabled=false<br>pcs property set no-quorum-policy=ignore<br>pcs resource defaults resource-stickiness=INFINITY<br>pcs resource create Cluster_eno4 ocf:heartbeat:IPaddr2 ip=38.xx.xxx.xxx cidr_netmask=32 op monitor interval=20s<br>pcs resource create Cluster_eno1 ocf:heartbeat:IPaddr2 ip=10.xxx.x.xxx cidr_netmask=32 op monitor interval=20s<br>pcs resource create Cluster_eno3 ocf:heartbeat:IPaddr2 ip=209.xx.xx.xxx cidr_netmask=32 op monitor interval=20s<br><br>pcs resource create haproxy systemd:haproxy.service op monitor interval=5s meta failure-timeout=60s migration-threshold=1<br>pcs resource create cluster_rtpengine systemd:rtpengine.service op monitor interval=5s meta failure-timeout=60s migration-threshold=1<br>pcs resource create cluster_opensips systemd:opensips.service op monitor interval=5s meta failure-timeout=60s migration-threshold=1<br>pcs resource create nginx systemd:nginx.service op monitor interval=5s meta failure-timeout=60s migration-threshold=1<br>pcs resource create php-fpm systemd:php73-php-fpm.service op monitor interval=5s meta failure-timeout=60s migration-threshold=1<br>pcs resource create consumer systemd:consumer.service op monitor interval=5s meta failure-timeout=60s migration-threshold=1<br><br>pcs resource clone haproxy globally-unique=true clone-max=2 clone-node-max=1<br>pcs resource clone cluster_rtpengine globally-unique=true clone-max=1 clone-node-max=1<br>pcs resource clone cluster_opensips globally-unique=true clone-max=2 clone-node-max=1<br>pcs resource clone nginx globally-unique=true clone-max=2 clone-node-max=1<br>pcs resource clone php-fpm globally-unique=true clone-max=2 clone-node-max=1<br>pcs resource clone consumer globally-unique=true clone-max=2 clone-node-max=1<br><br><br>pcs constraint colocation add Cluster_eno4 with haproxy-clone<br>pcs constraint colocation add Cluster_eno1 with haproxy-clone<br>pcs constraint colocation add Cluster_eno3 with haproxy-clone<br>pcs constraint colocation add Cluster_eno4 with cluster_rtpengine-clone<br>pcs constraint colocation add Cluster_eno1 with cluster_rtpengine-clone<br>pcs constraint colocation add Cluster_eno3 with cluster_rtpengine-clone<br>pcs constraint colocation add Cluster_eno4 with cluster_opensips-clone<br>pcs constraint colocation add Cluster_eno1 with cluster_opensips-clone<br>pcs constraint colocation add Cluster_eno3 with cluster_opensips-clone<br>pcs constraint colocation add Cluster_eno4 with nginx-clone<br>pcs constraint colocation add Cluster_eno1 with nginx-clone<br>pcs constraint colocation add Cluster_eno3 with nginx-clone<br>pcs constraint colocation add Cluster_eno4 with php-fpm-clone<br>pcs constraint colocation add Cluster_eno1 with php-fpm-clone<br>pcs constraint colocation add Cluster_eno3 with php-fpm-clone<br>pcs constraint colocation add Cluster_eno4 with consumer-clone<br>pcs constraint colocation add Cluster_eno1 with consumer-clone<br>pcs constraint colocation add Cluster_eno3 with consumer-clone <br><br><br> Cluster_eno4 (ocf::heartbeat:IPaddr2): Stopped testsrv1<br> Cluster_eno1 (ocf::heartbeat:IPaddr2): Stopped testsrv1<br> Cluster_eno3 (ocf::heartbeat:IPaddr2): Stopped testsrv1<br> Clone Set: haproxy-clone [haproxy]<br> haproxy (systemd:haproxy.service): stopped testsrv1<br> haproxy (systemd:haproxy.service): Stopped testsrv2<br> Started: [ testsrv1 testsrv2 ]<br> Clone Set: cluster_rtpengine-clone [cluster_rtpengine]<br> cluster_rtpengine (systemd:rtpengine.service): Stopped testsrv1<br> Started: [ testsrv1 ]<br> Clone Set: cluster_opensips-clone [cluster_opensips]<br> cluster_opensips (systemd:opensips.service): Stopped testsrv1<br> cluster_opensips (systemd:opensips.service): Stopped testsrv2<br> Started: [ testsrv1 testsrv2 ]<br> Clone Set: nginx-clone [nginx]<br> nginx (systemd:nginx.service): Stopped testsrv1<br> nginx (systemd:nginx.service): Stopped testsrv2<br> Started: [ testsrv1 testsrv2 ]<br> Clone Set: php-fpm-clone [php-fpm]<br> php-fpm (systemd:php73-php-fpm.service): Stopped testsrv1<br> php-fpm (systemd:php73-php-fpm.service): failed testsrv2<br> Started: [ testsrv1 testsrv2 ]<br> Clone Set: consumer-clone [consumer]<br> consumer (systemd:consumer.service): Stopped testsrv1<br> consumer (systemd:consumer.service): Stopped testsrv2<br> Started: [ testsrv1 testsrv2 ]<br><br>Can anyone guide me in solving this problem<br clear="all"><div><br></div><div><br></div>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><span style="font-family:verdana,sans-serif">Thanks & Regards,</span><br></div><div dir="ltr"><font><div style="font-size:12.8px"><div><span style="font-size:small">Amit Nakum</span><font size="2"><span style="font-family:verdana,sans-serif"> | Sr. Support Engineer<br></span></font></div><font size="2"><span style="font-family:verdana,sans-serif">+91 982482283 | Hangout & </span></font><span style="font-family:verdana,sans-serif;font-size:small">Skype:</span><span style="font-family:verdana,sans-serif;font-size:small"> </span><a href="mailto:amit.nakum@ecosmob.com" style="font-size:small" target="_blank">amit.nakum@ecosmob.com</a></div><div style="font-size:12.8px"><a href="http://www.ecosmob.com/" style="color:rgb(17,85,204);font-family:helvetica,arial,sans-serif;font-size:10px" target="_blank"><img alt="Ecosmob Technologies Pvt. Ltd." src="https://htmlsigs.s3.amazonaws.com/logos/files/000/650/332/landscape/ecm_2048_1152.png" height="40" width="160" border="0"></a></div><div style="font-size:12.8px"><div dir="ltr"><div dir="ltr"><p style="line-height:12px;margin-bottom:10px"><font size="2"><span style="font-family:verdana,sans-serif"><span style="font-weight:bold;color:rgb(33,33,33)">Ecosmob Technologies Pvt. Ltd.</span> <br><span style="color:rgb(33,33,33)"></span><span style="color:rgb(33,33,33)"></span><span style="color:rgb(33,33,33)"></span><span style="color:rgb(33,33,33)"></span><a href="https://www.ecosmob.com/" style="color:rgb(71,124,204);display:inline" target="_blank">https://www.ecosmob.com</a></span></font></p><p style="line-height:12px;margin-bottom:10px"><font size="2"><span style="font-family:verdana,sans-serif">VoIP | Web | Mobile | IoT | Big Data</span></font></p><p style="font-size:0px;line-height:0;font-family:helvetica,arial,sans-serif"><a href="https://twitter.com/ecosmob" style="color:rgb(17,85,204);display:inline" target="_blank">ssdsds<br></a></p><p style="font-size:0px;line-height:0;font-family:helvetica,arial,sans-serif"><a href="https://twitter.com/ecosmob" style="color:rgb(17,85,204);display:inline" target="_blank">sasadsdasdasdasdasdas<img alt="" src="https://s3.amazonaws.com/htmlsig-assets/round/twitter.png" height="16" width="16" style="margin-bottom:2px;border-width:medium;border-style:none;display:inline"> </a><span style="white-space:nowrap"><img src="https://s3.amazonaws.com/htmlsig-assets/spacer.gif" width="2"> </span><a href="https://www.facebook.com/Ecosmob" style="color:rgb(17,85,204);display:inline" target="_blank"><img alt="" src="https://s3.amazonaws.com/htmlsig-assets/round/facebook.png" height="16" width="16" style="margin-bottom:2px;border-width:medium;border-style:none;display:inline"> </a><span style="white-space:nowrap"><img src="https://s3.amazonaws.com/htmlsig-assets/spacer.gif" width="2"> </span><a href="https://plus.google.com/+Ecosmob" style="color:rgb(17,85,204);display:inline" target="_blank"><img alt="" src="https://s3.amazonaws.com/htmlsig-assets/round/googleplus.png" height="16" width="16" style="margin-bottom:2px;border-width:medium;border-style:none;display:inline"> </a><span style="white-space:nowrap"><img src="https://s3.amazonaws.com/htmlsig-assets/spacer.gif" width="2"> </span><a href="https://www.linkedin.com/company/ecosmob" style="color:rgb(17,85,204);display:inline" target="_blank"><img alt="" src="https://s3.amazonaws.com/htmlsig-assets/round/linkedin.png" height="16" width="16" style="margin-bottom:2px;border-width:medium;border-style:none;display:inline"></a><span style="white-space:nowrap"><img src="https://s3.amazonaws.com/htmlsig-assets/spacer.gif" width="2"> </span><a style="display:inline"> </a><span style="white-space:nowrap"></span><a href="https://in.pinterest.com/ecosmob" style="color:rgb(17,85,204);display:inline" target="_blank"><img alt="" src="https://s3.amazonaws.com/htmlsig-assets/round/pinterest.png" height="16" width="16" style="margin-bottom:2px;border-width:medium;border-style:none;display:inline"> </a><span style="white-space:nowrap"><img src="https://s3.amazonaws.com/htmlsig-assets/spacer.gif" width="2"></span></p></div></div></div></font><span></span><br><br></div></div></div></div></div></div>
<br>
<div><font face="Arial" size="2" style="background-color:white" color="#808080"><b>Disclaimer</b></font></div><div><div><span style="background-color:white;color:rgb(128,128,128);font-family:Arial;font-size:small">In addition to generic Disclaimer which you have agreed on our website, any views or opinions presented in this email are solely those of the originator and do not necessarily represent those of the Company or its sister concerns. Any liability (in negligence, contract or otherwise) arising from any third party taking any action, or refraining from taking any action on the basis of any of the information contained in this email is hereby excluded.</span></div></div><div><span style="background-color:white;color:rgb(128,128,128);font-family:Arial;font-size:small"><br></span></div><div><font face="Arial" size="2" style="background-color:white" color="#808080"><b>Confidentiality</b></font></div><div><font face="Arial" size="2" style="background-color:white" color="#808080">This communication (including any attachment/s) is intended only for the use of the addressee(s) and contains information that is PRIVILEGED AND CONFIDENTIAL. Unauthorized reading, dissemination, distribution, or copying of this communication is prohibited. Please inform originator if you have received it in error.</font></div><div><font face="Arial" size="2" style="background-color:white" color="#808080"><br></font></div><div><span style="background-color:white;color:rgb(128,128,128);font-family:Arial;font-size:small"><b>Caution for viruses, malware etc.</b></span></div><div><font face="Arial" size="2" style="background-color:white" color="#808080">This communication, including any attachments, may not be free of viruses, trojans, similar or new contaminants/malware, interceptions or interference, and may not be compatible with your systems. You shall carry out virus/malware scanning on your own before opening any attachment to this e-mail. The sender of this e-mail and Company including its sister concerns shall not be liable for any damage that may incur to you as a result of viruses, incompleteness of this message, a delay in receipt of this message or any other computer problems. </font></div>