<div dir="ltr">Hello,<div>Im getting crazy about this problem, that I expect to resolve here, with your help guys:</div><div><span style="color:rgb(0,0,0);white-space:pre-wrap"><br></span></div>I have 2 nodes with Corosync redundant ring feature.<br><br>Each node has 2 similarly connected/configured NIC's. Both nodes are connected each other by two crossover cables.<div><br></div><div>I configured both nodes with rrp mode passive. Everything is working well at this point, but when I shutdown 1 node to test failover, and this node returns to be online, corosync is marking the interface as FAULTY and rrp fails to recover the initial state:</div><div><br></div><div>1. Initial scenario:</div><div><br></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div><div># corosync-cfgtool -s</div></div><div><div>Printing ring status.</div></div><div><div>Local node ID 1</div></div><div><div>RING ID 0</div></div><div><div> id = 192.168.0.1</div></div><div><div> status = ring 0 active with no faults</div></div><div><div>RING ID 1</div></div><div><div> id = 192.168.1.1</div></div><div><div> status = ring 1 active with no faults</div></div></blockquote><div><div><br></div><div>2. When I shutdown the node 2, all continues with no faults. Sometimes the ring ID's are bonding with 127.0.0.1 and then bond back to their respective heartbeat IP.</div><div><br></div><div>3. When node 2 is back online:</div><div><br></div></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div><div><div style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"># corosync-cfgtool -s</div></div></div><div><div><div style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">Printing ring status.</div></div></div><div><div><div style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">Local node ID 1</div></div></div><div><div><div style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">RING ID 0</div></div></div><div><div><div style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"> id = 192.168.0.1</div></div></div><div><div><div style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"> status = ring 0 active with no faults</div></div></div><div><div><div style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">RING ID 1</div></div></div><div><div><div style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"> id = 192.168.1.1</div></div></div><div><div><div style="font-size:small;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"> status = Marking ringid 1 interface 192.168.1.1 FAULTY</div></div></div></blockquote><div><div>
<div><br></div>
</div></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div><div><div># service corosync status</div></div></div><div><div><div>● corosync.service - Corosync Cluster Engine</div></div></div><div><div><div> Loaded: loaded (/lib/systemd/system/corosync.service; enabled; vendor preset: enabled)</div></div></div><div><div><div> Active: active (running) since Wed 2018-08-22 14:44:09 CEST; 1min 38s ago</div></div></div><div><div><div> Docs: man:corosync</div></div></div><div><div><div> man:corosync.conf</div></div></div><div><div><div> man:corosync_overview</div></div></div><div><div><div> Main PID: 1439 (corosync)</div></div></div><div><div><div> Tasks: 2 (limit: 4915)</div></div></div><div><div><div> CGroup: /system.slice/corosync.service</div></div></div><div><div><div> └─1439 /usr/sbin/corosync -f</div></div></div></blockquote><div><div><div><br></div></div></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div><div><div>Aug 22 14:44:11 node1 corosync[1439]: Aug 22 14:44:11 notice [TOTEM ] The network interface [192.168.0.1] is now up.</div></div></div><div><div><div>Aug 22 14:44:11 node1 corosync[1439]: [TOTEM ] The network interface [192.168.0.1] is now up.</div></div></div><div><div><div>Aug 22 14:44:11 node1 corosync[1439]: Aug 22 14:44:11 notice [TOTEM ] The network interface [192.168.1.1] is now up.</div></div></div><div><div><div>Aug 22 14:44:11 node1 corosync[1439]: [TOTEM ] The network interface [192.168.1.1] is now up.</div></div></div><div><div><div>Aug 22 14:44:26 node1 corosync[1439]: Aug 22 14:44:26 notice [TOTEM ] A new membership (<a href="http://192.168.0.1:601760">192.168.0.1:601760</a>) was formed. Members</div></div></div><div><div><div>Aug 22 14:44:26 node1 corosync[1439]: [TOTEM ] A new membership (<a href="http://192.168.0.1:601760">192.168.0.1:601760</a>) was formed. Members</div></div></div><div><div><div>Aug 22 14:44:32 node1 corosync[1439]: Aug 22 14:44:32 notice [TOTEM ] A new membership (<a href="http://192.168.0.1:601764">192.168.0.1:601764</a>) was formed. Members joined: 2</div></div></div><div><div><div>Aug 22 14:44:32 node1 corosync[1439]: [TOTEM ] A new membership (<a href="http://192.168.0.1:601764">192.168.0.1:601764</a>) was formed. Members joined: 2</div></div></div><div><div><div>Aug 22 14:44:34 node1 corosync[1439]: Aug 22 14:44:34 error [TOTEM ] Marking ringid 1 interface 192.168.1.1 FAULTY</div></div></div><div><div><div>Aug 22 14:44:34 node1 corosync[1439]: [TOTEM ] Marking ringid 1 interface 192.168.1.1 FAULTY</div></div></div></blockquote><div><div><br></div>If I execute corosync-cfgtool, clears the faulty error but after some seconds return to be FAULTY.</div><div>The only thing that it resolves the problem is to restart de service with service corosync restart.<br><br>Here you have some of my configuration settings on node 1 (I probed already to change rrp_mode):</div><div><br></div><div><b>- corosync.conf</b></div><div><b><br></b></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div><div>totem {</div></div><div><div> version: 2</div></div><div><div> cluster_name: node</div></div><div><div> token: 5000</div></div><div><div> token_retransmits_before_loss_const: 10</div></div><div><div> secauth: off</div></div><div><div> threads: 0</div></div><div><div> rrp_mode: passive</div></div><div><div> nodeid: 1</div></div><div><div> interface {</div></div><div><div> ringnumber: 0</div></div><div><div> bindnetaddr: 192.168.0.0</div></div><div><div> #mcastaddr: 226.94.1.1</div></div><div><div> mcastport: 5405</div></div><div><div> broadcast: yes</div></div><div><div> }</div></div><div><div> interface {</div></div><div><div> ringnumber: 1</div></div><div><div> bindnetaddr: 192.168.1.0</div></div><div><div> #mcastaddr: 226.94.1.2</div></div><div><div> mcastport: 5407</div></div><div><div> broadcast: yes</div></div><div><div> }</div></div><div><div>}</div></div><div><div><br></div></div><div><div>logging {</div></div><div><div> fileline: off</div></div><div><div> to_stderr: yes</div></div><div><div> to_syslog: yes</div></div><div><div> to_logfile: yes</div></div><div><div> logfile: /var/log/corosync/corosync.log</div></div><div><div> debug: off</div></div><div><div> timestamp: on</div></div><div><div> logger_subsys {</div></div><div><div> subsys: AMF</div></div><div><div> debug: off</div></div><div><div> }</div></div><div><div>}</div></div><div><div><br></div></div><div><div>amf {</div></div><div><div> mode: disabled</div></div><div><div>}</div></div><div><div><br></div></div><div><div>quorum {</div></div><div><div> provider: corosync_votequorum</div></div><div><div> expected_votes: 2</div></div><div><div>}</div></div><div><div><br></div></div><div><div>nodelist {</div></div><div><div> node {</div></div><div><div> nodeid: 1</div></div><div><div> ring0_addr: 192.168.0.1</div></div><div><div> ring1_addr: 192.168.1.1</div></div><div><div> }</div></div><div><div><br></div></div><div><div> node {</div></div><div><div> nodeid: 2</div></div><div><div> ring0_addr: 192.168.0.2</div></div><div><div> ring1_addr: 192.168.1.2</div></div><div><div> }</div></div><div><div>}</div></div><div><div><br></div></div><div><div>aisexec {</div></div><div><div> user: root</div></div><div><div> group: root</div></div><div><div>}</div></div><div><div><br></div></div><div><div>service {</div></div><div><div> name: pacemaker</div></div><div><div> ver: 1</div></div><div><div>}</div></div></blockquote><div><div><br></div><div><div><br></div><div><b>- /etc/hosts</b></div></div></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div><div><div><br></div></div></div><div><div><div><div>127.0.0.1 localhost</div></div></div></div><div><div><div>10.4.172.5 <a href="http://node1.upc.edu">node1.upc.edu</a> node1</div></div></div><div><div><div>10.4.172.6 <a href="http://node2.upc.edu">node2.upc.edu</a> node2</div></div></div></blockquote><div><div><br></div><div>Thank you for you help in advance!</div><div><br></div>-- <br><div dir="ltr" class="gmail-m_-5172321341401849360gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div dir="ltr" style="font-size:12.8px"><div><div><b><font color="#666666">David Tolosa Martínez</font></b><br></div><span style="color:rgb(136,136,136);font-size:12.8px">Customer Support & Infrastructure</span><br></div><font color="#888888">UPCnet - Edifici Vèrtex</font></div><div dir="ltr" style="font-size:12.8px"><span style="color:rgb(136,136,136);font-size:12.8px">Plaça d'Eusebi Güell, 6, 08034 Barcelona</span><font color="#888888"><br>Tel: 934054555</font><br><br></div><div dir="ltr"><a href="https://www.upcnet.es" target="_blank"><img src="https://www.upcnet.es/ca/img/upcnet.png"></a><br></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
<br>
<br><br><p dir="ltr" style="line-height:1.3090909090909089;margin-top:0pt;margin-bottom:0pt;border-top:solid #eeeeee 0.75pt;background-color:#ffffff;padding:11.25pt 0pt 0pt 0pt"><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap">INFORMACIÓ BÀSICA SOBRE PROTECCIÓ DE DADES:</span></p><p dir="ltr" style="line-height:1.3090909090909089;margin-top:0pt;margin-bottom:0pt;background-color:#ffffff"> </p><p dir="ltr" style="line-height:1.3090909090909089;margin-top:0pt;margin-bottom:0pt;background-color:#ffffff"><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap">Responsable:</span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap"> UPCNET, Serveis d'Accés a Internet de la Universitat Politècnica de Catalunya, SLU | </span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap">Finalitat:</span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap"> gestionar els contactes i les relacions professionals i comercials amb els nostres clients i proveïdors | </span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap">Base legal:</span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap"> consentiment, interès legítim i/o relació contractual | </span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap">Destinataris:</span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap"> no seran comunicades a tercers excepte per obligació legal | </span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap">Drets:</span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap"> pots exercir els teus drets d’accés, rectificació i supressió, així com els altres drets reconeguts a la normativa vigent, enviant-nos un missatge a </span><span style="font-size:8.5pt;font-family:Arial;color:#207ebe;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap"><a href="mailto:privacy@upcnet.es" target="_blank">privacy@upcnet.es</a></span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap"> | </span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap">Més informació</span><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap">: consulta la nostra </span><a href="https://www.upcnet.es/politica-de-privacitat" style="text-decoration:none" target="_blank"><span style="font-size:8.5pt;font-family:Arial;color:#207ebe;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:underline;vertical-align:baseline;white-space:pre;white-space:pre-wrap">política completa de protecció de dades</span></a><span style="font-size:8.5pt;font-family:Arial;color:#999999;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre;white-space:pre-wrap">.</span></p><p dir="ltr" style="line-height:1.3090909090909089;margin-top:0pt;margin-bottom:0pt;background-color:#ffffff"> </p><p dir="ltr" style="line-height:1.3090909090909089;margin-top:0pt;margin-bottom:0pt;background-color:#ffffff"><a href="https://www.upcnet.es/ca/avis-de-confidencialitat" style="text-decoration:none" target="_blank"><span style="font-size:8.5pt;font-family:Arial;color:#207ebe;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:underline;vertical-align:baseline;white-space:pre;white-space:pre-wrap">AVÍS DE CONFIDENCIALITAT</span></a></p>