<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""></div><div class=""><span style="background-color: rgb(255, 255, 255);" class=""><br class=""></span></div><div class=""><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[18019] pg3 corosyncerror [QB ] couldn't create circular mmap on /dev/shm/qb-cfg-event-18020-18028-23-data</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[18019] pg3 corosyncerror [QB ] qb_rb_open:cfg-event-18020-18028-23: Resource temporarily unavailable (11)</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[18019] pg3 corosyncdebug [QB ] Free'ing ringbuffer: /dev/shm/qb-cfg-request-18020-18028-23-header</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[18019] pg3 corosyncdebug [QB ] Free'ing ringbuffer: /dev/shm/qb-cfg-response-18020-18028-23-header</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[18019] pg3 corosyncerror [QB ] shm connection FAILED: Resource temporarily unavailable (11)</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[18019] pg3 corosyncerror [QB ] Error in connection setup (18020-18028-23): Resource temporarily unavailable (11)</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><br class=""></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">I tried to check /dev/shm and I am not sure these are the right commands, however:</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><br class=""></span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">df -h /dev/shm</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Filesystem Size Used Avail Use% Mounted on</span></div><div style="margin: 0px; font-stretch: normal; line-height: normal;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">shm 64M 16M 49M 24% /dev/shm</span></div></span></div><div><br class=""></div><div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">ls /dev/shm</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">qb-cmap-request-18020-18036-25-data qb-corosync-blackbox-data qb-quorum-request-18020-18095-32-data</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">qb-cmap-request-18020-18036-25-header qb-corosync-blackbox-header qb-quorum-request-18020-18095-32-header</span></div></div><div><br class=""></div><div>Is 64 Mb enough for /dev/shm. If no, why it worked with previous corosync release?</div><div><br class=""></div><div><br class=""><blockquote type="cite" class=""><div class="">On 25 Jun 2018, at 09:09, Christine Caulfield <<a href="mailto:ccaulfie@redhat.com" class="">ccaulfie@redhat.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">On 22/06/18 11:23, Salvatore D'angelo wrote:</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">Hi,<br class="">Here the log:<br class=""><br class=""><br class=""><br class=""></blockquote><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">[17323] pg1 corosyncerror [QB ] couldn't create circular mmap on</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">/dev/shm/qb-cfg-event-17324-17334-23-data</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">[17323] pg1 corosyncerror [QB ]</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">qb_rb_open:cfg-event-17324-17334-23: Resource temporarily unavailable (11)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">[17323] pg1 corosyncdebug [QB ] Free'ing ringbuffer:</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">/dev/shm/qb-cfg-request-17324-17334-23-header</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">[17323] pg1 corosyncdebug [QB ] Free'ing ringbuffer:</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">/dev/shm/qb-cfg-response-17324-17334-23-header</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">[17323] pg1 corosyncerror [QB ] shm connection FAILED: Resource</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">temporarily unavailable (11)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">[17323] pg1 corosyncerror [QB ] Error in connection setup</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">(17324-17334-23): Resource temporarily unavailable (11)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">[17323] pg1 corosyncdebug [QB ] qb_ipcs_disconnect(17324-17334-23)</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">state:0</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">is /dev/shm full?</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Chrissie</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class=""><br class=""><br class=""><blockquote type="cite" class="">On 22 Jun 2018, at 12:10, Christine Caulfield <<a href="mailto:ccaulfie@redhat.com" class="">ccaulfie@redhat.com</a>> wrote:<br class=""><br class="">On 22/06/18 10:39, Salvatore D'angelo wrote:<br class=""><blockquote type="cite" class="">Hi,<br class=""><br class="">Can you tell me exactly which log you need. I’ll provide you as soon as possible.<br class=""><br class="">Regarding some settings, I am not the original author of this cluster. People created it left the company I am working with and I inerithed the code and sometime I do not know why some settings are used.<br class="">The old versions of pacemaker, corosync, crash and resource agents were compiled and installed.<br class="">I simply downloaded the new versions compiled and installed them. I didn’t get any compliant during ./configure that usually checks for library compatibility.<br class=""><br class="">To be honest I do not know if this is the right approach. Should I “make unistall" old versions before installing the new one?<br class="">Which is the suggested approach?<br class="">Thank in advance for your help.<br class=""><br class=""></blockquote><br class="">OK fair enough!<br class=""><br class="">To be honest the best approach is almost always to get the latest<br class="">packages from the distributor rather than compile from source. That way<br class="">you can be more sure that upgrades will be more smoothly. Though, to be<br class="">honest, I'm not sure how good the Ubuntu packages are (they might be<br class="">great, they might not, I genuinely don't know)<br class=""><br class="">When building from source and if you don't know the provenance of the<br class="">previous version then I would recommend a 'make uninstall' first - or<br class="">removal of the packages if that's where they came from.<br class=""><br class="">One thing you should do is make sure that all the cluster nodes are<br class="">running the same version. If some are running older versions then nodes<br class="">could drop out for obscure reasons. We try and keep minor versions<br class="">on-wire compatible but it's always best to be cautious.<br class=""><br class="">The tidying of your corosync.conf wan wait for the moment, lets get<br class="">things mostly working first. If you enable debug logging in corosync.conf:<br class=""><br class="">logging {<br class=""> to_syslog: yes<br class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>debug: on<br class="">}<br class=""><br class="">Then see what happens and post the syslog file that has all of the<br class="">corosync messages in it, we'll take it from there.<br class=""><br class="">Chrissie<br class=""><br class=""><blockquote type="cite" class=""><blockquote type="cite" class="">On 22 Jun 2018, at 11:30, Christine Caulfield <<a href="mailto:ccaulfie@redhat.com" class="">ccaulfie@redhat.com</a>> wrote:<br class=""><br class="">On 22/06/18 10:14, Salvatore D'angelo wrote:<br class=""><blockquote type="cite" class="">Hi Christine,<br class=""><br class="">Thanks for reply. Let me add few details. When I run the corosync<br class="">service I se the corosync process running. If I stop it and run:<br class=""><br class="">corosync -f<span class="Apple-converted-space"> </span><br class=""><br class="">I see three warnings:<br class="">warning [MAIN ] interface section bindnetaddr is used together with<br class="">nodelist. Nodelist one is going to be used.<br class="">warning [MAIN ] Please migrate config file to nodelist.<br class="">warning [MAIN ] Could not set SCHED_RR at priority 99: Operation not<br class="">permitted (1)<br class="">warning [MAIN ] Could not set priority -2147483648: Permission denied (13)<br class=""><br class="">but I see node joined.<br class=""><br class=""></blockquote><br class="">Those certainly need fixing but are probably not the cause. Also why do<br class="">you have these values below set?<br class=""><br class="">max_network_delay: 100<br class="">retransmits_before_loss_const: 25<br class="">window_size: 150<br class=""><br class="">I'm not saying they are causing the trouble, but they aren't going to<br class="">help keep a stable cluster.<br class=""><br class="">Without more logs (full logs are always better than just the bits you<br class="">think are meaningful) I still can't be sure. it could easily be just<br class="">that you've overwritten a packaged version of corosync with your own<br class="">compiled one and they have different configure options or that the<br class="">libraries now don't match.<br class=""><br class="">Chrissie<br class=""><br class=""><br class=""><blockquote type="cite" class="">My corosync.conf file is below.<br class=""><br class="">With service corosync up and running I have the following output:<br class="">*corosync-cfgtool -s*<br class="">Printing ring status.<br class="">Local node ID 1<br class="">RING ID 0<br class="">id= 10.0.0.11<br class="">status= ring 0 active with no faults<br class="">RING ID 1<br class="">id= 192.168.0.11<br class="">status= ring 1 active with no faults<br class=""><br class="">*corosync-cmapctl | grep members*<br class="">runtime.totem.pg.mrp.srp.*members*.1.config_version (u64) = 0<br class="">runtime.totem.pg.mrp.srp.*members*.1.ip (str) = r(0) ip(10.0.0.11) r(1)<br class="">ip(192.168.0.11)<span class="Apple-converted-space"> </span><br class="">runtime.totem.pg.mrp.srp.*members*.1.join_count (u32) = 1<br class="">runtime.totem.pg.mrp.srp.*members*.1.status (str) = joined<br class="">runtime.totem.pg.mrp.srp.*members*.2.config_version (u64) = 0<br class="">runtime.totem.pg.mrp.srp.*members*.2.ip (str) = r(0) ip(10.0.0.12) r(1)<br class="">ip(192.168.0.12)<span class="Apple-converted-space"> </span><br class="">runtime.totem.pg.mrp.srp.*members*.2.join_count (u32) = 1<br class="">runtime.totem.pg.mrp.srp.*members*.2.status (str) = joined<br class=""><br class="">For the moment I have two nodes in my cluster (third node and some<br class="">issues and at the moment I did crm node standby on it).<br class=""><br class="">Here the dependency I have installed for corosync (that works fine with<br class="">pacemaker 1.1.14 and corosync 2.3.5):<br class=""> libnspr4-dev_2%253a4.10.10-0ubuntu0.14.04.1_amd64.deb<br class=""> libnspr4_2%253a4.10.10-0ubuntu0.14.04.1_amd64.deb<br class=""> libnss3-dev_2%253a3.19.2.1-0ubuntu0.14.04.2_amd64.deb<br class=""> libnss3-nssdb_2%253a3.19.2.1-0ubuntu0.14.04.2_all.deb<br class=""> libnss3_2%253a3.19.2.1-0ubuntu0.14.04.2_amd64.deb<br class=""> libqb-dev_0.16.0.real-1ubuntu4_amd64.deb<br class=""> libqb0_0.16.0.real-1ubuntu4_amd64.deb<br class=""><br class="">*corosync.conf*<br class="">---------------------<br class="">quorum {<br class=""> provider: corosync_votequorum<br class=""> expected_votes: 3<br class="">}<br class="">totem {<br class=""> version: 2<br class=""> crypto_cipher: none<br class=""> crypto_hash: none<br class=""> rrp_mode: passive<br class=""> interface {<br class=""> ringnumber: 0<br class=""> bindnetaddr: 10.0.0.0<br class=""> mcastport: 5405<br class=""> ttl: 1<br class=""> }<br class=""> interface {<br class=""> ringnumber: 1<br class=""> bindnetaddr: 192.168.0.0<br class=""> mcastport: 5405<br class=""> ttl: 1<br class=""> }<br class=""> transport: udpu<br class=""> max_network_delay: 100<br class=""> retransmits_before_loss_const: 25<br class=""> window_size: 150<br class="">}<br class="">nodelist {<br class=""> node {<br class=""> ring0_addr: pg1<br class=""> ring1_addr: pg1p<br class=""> nodeid: 1<br class=""> }<br class=""> node {<br class=""> ring0_addr: pg2<br class=""> ring1_addr: pg2p<br class=""> nodeid: 2<br class=""> }<br class=""> node {<br class=""> ring0_addr: pg3<br class=""> ring1_addr: pg3p<br class=""> nodeid: 3<br class=""> }<br class="">}<br class="">logging {<br class=""> to_syslog: yes<br class="">}<br class=""><br class=""><br class=""><br class=""><br class=""><blockquote type="cite" class="">On 22 Jun 2018, at 09:24, Christine Caulfield <<a href="mailto:ccaulfie@redhat.com" class="">ccaulfie@redhat.com</a><br class=""><<a href="mailto:ccaulfie@redhat.com" class="">mailto:ccaulfie@redhat.com</a>>> wrote:<br class=""><br class="">On 21/06/18 16:16, Salvatore D'angelo wrote:<br class=""><blockquote type="cite" class="">Hi,<br class=""><br class="">I upgraded my PostgreSQL/Pacemaker cluster with these versions.<br class="">Pacemaker 1.1.14 -> 1.1.18<br class="">Corosync 2.3.5 -> 2.4.4<br class="">Crmsh 2.2.0 -> 3.0.1<br class="">Resource agents 3.9.7 -> 4.1.1<br class=""><br class="">I started on a first node (I am trying one node at a time upgrade).<br class="">On a PostgreSQL slave node I did:<br class=""><br class="">*crm node standby <node>*<br class="">*service pacemaker stop*<br class="">*service corosync stop*<br class=""><br class="">Then I build the tool above as described on their <a href="http://GitHub.com" class="">GitHub.com</a><br class=""><<a href="http://GitHub.com" class="">http://GitHub.com</a>><br class=""><<a href="http://GitHub.com" class="">http://GitHub.com</a> <<a href="http://github.com/" class="">http://github.com/</a>>> page.<span class="Apple-converted-space"> </span><br class=""><br class="">*./autogen.sh (where required)*<br class="">*./configure*<br class="">*make (where required)*<br class="">*make install*<br class=""><br class="">Everything went ok. I expect new file overwrite old one. I left the<br class="">dependency I had with old software because I noticed the .configure<br class="">didn’t complain.<span class="Apple-converted-space"> </span><br class="">I started corosync.<br class=""><br class="">*service corosync start*<br class=""><br class="">To verify corosync work properly I used the following commands:<br class="">*corosync-cfg-tool -s*<br class="">*corosync-cmapctl | grep members*<br class=""><br class="">Everything seemed ok and I verified my node joined the cluster (at least<br class="">this is my impression).<br class=""><br class="">Here I verified a problem. Doing the command:<br class="">corosync-quorumtool -ps<br class=""><br class="">I got the following problem:<br class="">Cannot initialise CFG service<br class=""><br class=""></blockquote>That says that corosync is not running. Have a look in the log files to<br class="">see why it stopped. The pacemaker logs below are showing the same thing,<br class="">but we can't make any more guesses until we see what corosync itself is<br class="">doing. Enabling debug in corosync.conf will also help if more detail is<br class="">needed.<br class=""><br class="">Also starting corosync with 'corosync -pf' on the command-line is often<br class="">a quick way of checking things are starting OK.<br class=""><br class="">Chrissie<br class=""><br class=""><br class=""><blockquote type="cite" class="">If I try to start pacemaker, I only see pacemaker process running and<br class="">pacemaker.log containing the following lines:<br class=""><br class="">/Jun 21 15:09:38 [17115] pg1 pacemakerd: info: crm_log_init:Changed<br class="">active directory to /var/lib/pacemaker/cores/<br class="">/Jun 21 15:09:38 [17115] pg1 pacemakerd: info:<br class="">get_cluster_type:Detected an active 'corosync' cluster/<br class="">/Jun 21 15:09:38 [17115] pg1 pacemakerd: info:<br class="">mcp_read_config:Reading configure for stack: corosync/<br class="">/Jun 21 15:09:38 [17115] pg1 pacemakerd: notice: main:Starting<br class="">Pacemaker 1.1.18 | build=2b07d5c5a9 features: libqb-logging libqb-ipc<br class="">lha-fencing nagios corosync-native atomic-attrd acls/<br class="">/Jun 21 15:09:38 [17115] pg1 pacemakerd: info: main:Maximum core<br class="">file size is: 18446744073709551615/<br class="">/Jun 21 15:09:38 [17115] pg1 pacemakerd: info:<br class="">qb_ipcs_us_publish:server name: pacemakerd/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: warning:<br class="">corosync_node_name:Could not connect to Cluster Configuration Database<br class="">API, error CS_ERR_TRY_AGAIN/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: info:<br class="">corosync_node_name:Unable to get node name for nodeid 1/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: notice: get_node_name:Could<br class="">not obtain a node name for corosync nodeid 1/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: info: crm_get_peer:Created<br class="">entry 1aeef8ac-643b-44f7-8ce3-d82bbf40bbc1/0x557dc7f05d30 for node<br class="">(null)/1 (1 total)/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: info: crm_get_peer:Node 1<br class="">has uuid 1/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: info:<br class="">crm_update_peer_proc:cluster_connect_cpg: Node (null)[1] - corosync-cpg<br class="">is now online/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: error:<br class="">cluster_connect_quorum:Could not connect to the Quorum API: 2/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: info:<br class="">qb_ipcs_us_withdraw:withdrawing server sockets/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: info: main:Exiting<br class="">pacemakerd/<br class="">/Jun 21 15:09:53 [17115] pg1 pacemakerd: info:<br class="">crm_xml_cleanup:Cleaning up memory from libxml2/<br class=""><br class="">*What is wrong in my procedure?*<br class=""><br class=""><br class=""><br class=""></blockquote></blockquote></blockquote></blockquote></blockquote>_______________________________________________<br class="">Users mailing list: <a href="mailto:Users@clusterlabs.org" class="">Users@clusterlabs.org</a><br class=""><a href="https://lists.clusterlabs.org/mailman/listinfo/users" class="">https://lists.clusterlabs.org/mailman/listinfo/users</a><br class=""><br class="">Project Home: http://www.clusterlabs.org<br class="">Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf<br class="">Bugs: http://bugs.clusterlabs.org<br class=""></blockquote><br class=""><br class=""><br class="">_______________________________________________<br class="">Users mailing list:<span class="Apple-converted-space"> </span><a href="mailto:Users@clusterlabs.org" class="">Users@clusterlabs.org</a><br class=""><a href="https://lists.clusterlabs.org/mailman/listinfo/users" class="">https://lists.clusterlabs.org/mailman/listinfo/users</a><br class=""><br class="">Project Home:<span class="Apple-converted-space"> </span><a href="http://www.clusterlabs.org/" class="">http://www.clusterlabs.org</a><br class="">Getting started:<span class="Apple-converted-space"> </span><a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" class="">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br class="">Bugs:<span class="Apple-converted-space"> </span><a href="http://bugs.clusterlabs.org/" class="">http://bugs.clusterlabs.org</a><br class=""><br class=""></blockquote><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Users mailing list:<span class="Apple-converted-space"> </span></span><a href="mailto:Users@clusterlabs.org" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">Users@clusterlabs.org</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="https://lists.clusterlabs.org/mailman/listinfo/users" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">https://lists.clusterlabs.org/mailman/listinfo/users</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Project Home:<span class="Apple-converted-space"> </span></span><a href="http://www.clusterlabs.org/" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">http://www.clusterlabs.org</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Getting started:<span class="Apple-converted-space"> </span></span><a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Bugs:<span class="Apple-converted-space"> </span></span><a href="http://bugs.clusterlabs.org/" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">http://bugs.clusterlabs.org</a></div></blockquote></div><br class=""></div></body></html>