<div dir="ltr">
<span style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">Hi - I am running corosync on 3 nodes of CentOS release 6.9 (Final). Corosync version is corosync-1.4.7.</span><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial">The nodes are not seeing each other and not able to form memberships.</div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial">What I see is continuous message about " A processor joined or left the membership and a new membership was formed."</div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial">For example:on node: <span> </span><span style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">vm2883711991<span> </span></span></div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial"><br></div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial"><br><div><div>Jun 07 07:54:52 corosync [pcmk ] info: pcmk_peer_update: MEMB: vm2883711991 184555180</div><div>Jun 07 07:54:52 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:54:52 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.11) ; members(old:1 left:0)</div><div>Jun 07 07:54:52 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:55:04 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71084: memb=1, new=0, lost=0</div><div>Jun 07 07:55:04 corosync [pcmk ] info: pcmk_peer_update: memb: vm2883711991 184555180</div><div>Jun 07 07:55:04 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71084: memb=1, new=0, lost=0</div><div>Jun 07 07:55:04 corosync [pcmk ] info: pcmk_peer_update: MEMB: vm2883711991 184555180</div><div>Jun 07 07:55:04 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:55:04 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.11) ; members(old:1 left:0)</div><div>Jun 07 07:55:04 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:55:16 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71096: memb=1, new=0, lost=0</div><div>Jun 07 07:55:16 corosync [pcmk ] info: pcmk_peer_update: memb: vm2883711991 184555180</div><div>Jun 07 07:55:16 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71096: memb=1, new=0, lost=0</div><div>Jun 07 07:55:16 corosync [pcmk ] info: pcmk_peer_update: MEMB: vm2883711991 184555180</div><div>Jun 07 07:55:16 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:55:16 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.11) ; members(old:1 left:0)</div><div>Jun 07 07:55:16 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:55:28 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71108: memb=1, new=0, lost=0</div><div>Jun 07 07:55:28 corosync [pcmk ] info: pcmk_peer_update: memb: vm2883711991 184555180</div><div>Jun 07 07:55:28 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71108: memb=1, new=0, lost=0</div><div>Jun 07 07:55:28 corosync [pcmk ] info: pcmk_peer_update: MEMB: vm2883711991 184555180</div><div>Jun 07 07:55:28 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:55:28 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.11) ; members(old:1 left:0)</div><div>Jun 07 07:55:28 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:55:40 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71120: memb=1, new=0, lost=0</div><div>Jun 07 07:55:40 corosync [pcmk ] info: pcmk_peer_update: memb: vm2883711991 184555180</div><div>Jun 07 07:55:40 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71120: memb=1, new=0, lost=0</div><div>Jun 07 07:55:40 corosync [pcmk ] info: pcmk_peer_update: MEMB: vm2883711991 184555180</div><div>Jun 07 07:55:40 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:55:40 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.11) ; members(old:1 left:0)</div><div>Jun 07 07:55:40 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:55:52 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71132: memb=1, new=0, lost=0</div><div>Jun 07 07:55:52 corosync [pcmk ] info: pcmk_peer_update: memb: vm2883711991 184555180</div><div>Jun 07 07:55:52 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71132: memb=1, new=0, lost=0</div><div>Jun 07 07:55:52 corosync [pcmk ] info: pcmk_peer_update: MEMB: vm2883711991 184555180</div><div>Jun 07 07:55:52 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:55:52 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.11) ; members(old:1 left:0)</div><div>Jun 07 07:55:52 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:56:04 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71144: memb=1, new=0, lost=0</div><div>Jun 07 07:56:04 corosync [pcmk ] info: pcmk_peer_update: memb: vm2883711991 184555180</div><div>Jun 07 07:56:04 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71144: memb=1, new=0, lost=0</div><div>Jun 07 07:56:04 corosync [pcmk ] info: pcmk_peer_update: MEMB: vm2883711991 184555180</div><div>Jun 07 07:56:04 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:56:17 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71156: memb=1, new=0, lost=0</div><div>Jun 07 07:56:17 corosync [pcmk ] info: pcmk_peer_update: memb: vm2883711991 184555180</div><div>Jun 07 07:56:17 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71156: memb=1, new=0, lost=0</div><div>Jun 07 07:56:17 corosync [pcmk ] info: pcmk_peer_update: MEMB: vm2883711991 184555180</div><div>Jun 07 07:56:17 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:56:17 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.11) ; members(old:1 left:0)</div><div>Jun 07 07:56:17 corosync [MAIN ] Completed service synchronization, ready to provide service.</div></div></div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial"><br></div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial">Similarly on node: <span> </span><span style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">vme6c95166f0<span> </span></span></div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial"><br></div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial"><div>Jun 07 07:55:12 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71088: memb=1, new=0, lost=0</div><div>Jun 07 07:55:12 corosync [pcmk ] info: pcmk_peer_update: memb: vme6c95166f0 67114668</div><div>Jun 07 07:55:12 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71088: memb=1, new=0, lost=0</div><div>Jun 07 07:55:12 corosync [pcmk ] info: pcmk_peer_update: MEMB: vme6c95166f0 67114668</div><div>Jun 07 07:55:12 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:55:12 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.4) ; members(old:1 left:0)</div><div>Jun 07 07:55:12 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:55:24 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71100: memb=1, new=0, lost=0</div><div>Jun 07 07:55:24 corosync [pcmk ] info: pcmk_peer_update: memb: vme6c95166f0 67114668</div><div>Jun 07 07:55:24 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71100: memb=1, new=0, lost=0</div><div>Jun 07 07:55:24 corosync [pcmk ] info: pcmk_peer_update: MEMB: vme6c95166f0 67114668</div><div>Jun 07 07:55:24 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:55:24 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.4) ; members(old:1 left:0)</div><div>Jun 07 07:55:24 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:55:37 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71112: memb=1, new=0, lost=0</div><div>Jun 07 07:55:37 corosync [pcmk ] info: pcmk_peer_update: memb: vme6c95166f0 67114668</div><div>Jun 07 07:55:37 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71112: memb=1, new=0, lost=0</div><div>Jun 07 07:55:37 corosync [pcmk ] info: pcmk_peer_update: MEMB: vme6c95166f0 67114668</div><div>Jun 07 07:55:37 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:55:49 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71124: memb=1, new=0, lost=0</div><div>Jun 07 07:55:49 corosync [pcmk ] info: pcmk_peer_update: memb: vme6c95166f0 67114668</div><div>Jun 07 07:55:49 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71124: memb=1, new=0, lost=0</div><div>Jun 07 07:55:49 corosync [pcmk ] info: pcmk_peer_update: MEMB: vme6c95166f0 67114668</div><div>Jun 07 07:55:49 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:55:49 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.4) ; members(old:1 left:0)</div><div>Jun 07 07:55:49 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:56:02 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71136: memb=1, new=0, lost=0</div><div>Jun 07 07:56:02 corosync [pcmk ] info: pcmk_peer_update: memb: vme6c95166f0 67114668</div><div>Jun 07 07:56:02 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71136: memb=1, new=0, lost=0</div><div>Jun 07 07:56:02 corosync [pcmk ] info: pcmk_peer_update: MEMB: vme6c95166f0 67114668</div><div>Jun 07 07:56:02 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:56:02 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.4) ; members(old:1 left:0)</div><div>Jun 07 07:56:02 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div>Jun 07 07:56:14 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71148: memb=1, new=0, lost=0</div><div>Jun 07 07:56:14 corosync [pcmk ] info: pcmk_peer_update: memb: vme6c95166f0 67114668</div><div>Jun 07 07:56:14 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71148: memb=1, new=0, lost=0</div><div>Jun 07 07:56:14 corosync [pcmk ] info: pcmk_peer_update: MEMB: vme6c95166f0 67114668</div><div>Jun 07 07:56:14 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:56:27 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71160: memb=1, new=0, lost=0</div><div>Jun 07 07:56:27 corosync [pcmk ] info: pcmk_peer_update: memb: vme6c95166f0 67114668</div><div>Jun 07 07:56:27 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71160: memb=1, new=0, lost=0</div><div>Jun 07 07:56:27 corosync [pcmk ] info: pcmk_peer_update: MEMB: vme6c95166f0 67114668</div><div>Jun 07 07:56:27 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:56:39 corosync [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 71172: memb=1, new=0, lost=0</div><div>Jun 07 07:56:39 corosync [pcmk ] info: pcmk_peer_update: memb: vme6c95166f0 67114668</div><div>Jun 07 07:56:39 corosync [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 71172: memb=1, new=0, lost=0</div><div>Jun 07 07:56:39 corosync [pcmk ] info: pcmk_peer_update: MEMB: vme6c95166f0 67114668</div><div>Jun 07 07:56:39 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.</div><div>Jun 07 07:56:39 corosync [CPG ] chosen downlist: sender r(0) ip(172.22.0.4) ; members(old:1 left:0)</div><div>Jun 07 07:56:39 corosync [MAIN ] Completed service synchronization, ready to provide service.</div><div><br></div><div>and similar message on the third node as well.</div><div><br></div><div>my corosync.conf is as follows:</div><div><div>compatibility: whitetank</div><div>totem {</div><div> version: 2</div><div> secauth: off</div><div> threads: 0</div><div> interface {</div><div> member {</div><div> memberaddr: 172.22.0.4</div><div> }</div><div>member {</div><div> memberaddr: 172.22.0.11</div><div> }</div><div>member {</div><div> memberaddr: 172.22.0.13</div><div> }</div><div><br></div><div> bindnetaddr: 172.22.0.4</div><div><br></div><div> ringnumber: 0</div><div> mcastport: 5405</div><div> ttl: 1</div><div> }</div><div> transport: udpu</div><div> token: 10000</div><div> token_retransmits_before_loss_<wbr>const: 10</div><div>}</div><div><br></div><div>logging {</div><div> fileline: off</div><div> to_stderr: yes</div><div> to_logfile: yes</div><div> to_syslog: no</div><div> logfile: /var/log/cluster/corosync.log</div><div> timestamp: on</div><div> logger_subsys {</div><div> subsys: AMF</div><div> debug: on</div><div> }</div><div>}</div><div>service {</div><div> name: pacemaker</div><div> ver: 1</div><div>}</div><div>amf {</div><div> mode: disabled</div><div>}</div></div><div><br></div><div>In general , this configuration has worked for me in other clusters I have, but this particular setup is running into this issue. Request help on how to debug and resolve this condition.</div></div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial"><br></div><div style="font-size:12.8px;text-decoration-style:initial;text-decoration-color:initial">Thanks</div>
<br></div>