<div dir="ltr"><div>Hello, there are no constraints for node compute-1.<br><br></div>The following is the corosync.log on the cluste node :<br><br>ay 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Forwarding cib_delete operation for section //node_state[@uname='compute-0']//lrm_resource[@id='compute-1'] to all (origin=local/crmd/2856)<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='compute-0']//lrm_resource[@id='compute-1']: OK (rc=0, origin=tst-controller-01/crmd/2856, version=0.555.6)<br>May 12 13:14:47 [7286] tst-controller-01 crmd: info: delete_resource:Removing resource compute-1 for 328a6a8b-e4f1-4b48-9dc5-e418ba0e2850 (root) on tst-controller-01<br>May 12 13:14:47 [7286] tst-controller-01 crmd: info: notify_deleted: Notifying 328a6a8b-e4f1-4b48-9dc5-e418ba0e2850 on tst-controller-01 that compute-1 was deleted<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Forwarding cib_delete operation for section //node_state[@uname='compute-0']//lrm_resource[@id='compute-1'] to all (origin=local/crmd/2857)<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='compute-0']//lrm_resource[@id='compute-1']: OK (rc=0, origin=tst-controller-01/crmd/2857, version=0.555.6)<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Forwarding cib_delete operation for section //node_state[@uname='tst-controller-01']//lrm_resource[@id='compute-1'] to all (origin=local/crmd/2860)<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='tst-controller-01']//lrm_resource[@id='compute-1']: OK (rc=0, origin=tst-controller-01/crmd/2860, version=0.556.0)<br>May 12 13:14:47 [7286] tst-controller-01 crmd: info: delete_resource:Removing resource compute-1 for 328a6a8b-e4f1-4b48-9dc5-e418ba0e2850 (root) on tst-controller-01<br>May 12 13:14:47 [7286] tst-controller-01 crmd: info: notify_deleted: Notifying 328a6a8b-e4f1-4b48-9dc5-e418ba0e2850 on tst-controller-01 that compute-1 was deleted<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='tst-controller-03']//lrm_resource[@id='compute-1']: OK (rc=0, origin=tst-controller-03/crmd/2021, version=0.556.0)<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Forwarding cib_delete operation for section //node_state[@uname='tst-controller-01']//lrm_resource[@id='compute-1'] to all (origin=local/crmd/2861)<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='tst-controller-03']//lrm_resource[@id='compute-1']: OK (rc=0, origin=tst-controller-03/crmd/2022, version=0.556.0)<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='tst-controller-01']//lrm_resource[@id='compute-1']: OK (rc=0, origin=tst-controller-01/crmd/2861, version=0.556.0)<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='tst-controller-02']//lrm_resource[@id='compute-1']: OK (rc=0, origin=tst-controller-02/crmd/4840, version=0.556.0)<br>May 12 13:14:47 [7281] tst-controller-01 cib: info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='tst-controller-02']//lrm_resource[@id='compute-1']: OK (rc=0, origin=tst-controller-02/crmd/4841, version=0.556.0)<br><br><div><div><br><br>On 05/12/2017 12:32 PM, Ignazio Cassano wrote:<br>
> Hello, some updates.<br>
> Now I am not able enable compute-1 like yesterday: removing and<br>
> readding it.<br>
> Must If I remove it and add in the /etc/hosts of the cluster nodes an<br>
> alias like compute1 , removing compute-1 and addiing compute1, it goes<br>
> online .<br>
><br>
><br>
> 2017-05-12 12:08 GMT+02:00 Ignazio Cassano <<a href="mailto:ignaziocassano@gmail.com">ignaziocassano@gmail.com</a><br>
> <mailto:<a href="mailto:ignaziocassano@gmail.com">ignaziocassano@gmail.<wbr>com</a>>>:<br>
><br>
> Hello, I do not know if it is the correct mode to answer in this<br>
> mailing list.<br>
> Anycase, either shutdown the remote node or fencing it with ipmi ,<br>
> it does not retrurn online.<br>
> them pacemaker-remote service is enabled and restart at reboot.<br>
> But I continue to have the following on my cluster:<br>
><br>
> Online: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>
> RemoteOnline: [ compute-0 ]<br>
> RemoteOFFLINE: [ compute-1 ]<br>
><br>
> Full list of resources:<br>
><br>
> Resource Group: vip<br>
> vipmanagement (ocf::heartbeat:IPaddr2): Started<br>
> tst-controller-03<br>
> vipinternalpi (ocf::heartbeat:IPaddr2): Started<br>
> tst-controller-03<br>
> lb-haproxy (systemd:haproxy): Started tst-controller-03<br>
> Clone Set: httpd-clone [httpd]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-glance-api-clone [openstack-glance-api]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-glance-registry-<wbr>clone<br>
> [openstack-glance-registry]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-nova-api-clone [openstack-nova-api]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-nova-consoleauth-<wbr>clone<br>
> [openstack-nova-consoleauth]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-nova-scheduler-clone [openstack-nova-scheduler]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-nova-conductor-clone [openstack-nova-conductor]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-nova-novncproxy-<wbr>clone<br>
> [openstack-nova-novncproxy]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: neutron-server-clone [neutron-server]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: neutron-openvswitch-agent-<wbr>clone<br>
> [neutron-openvswitch-agent]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: neutron-dhcp-agent-clone [neutron-dhcp-agent]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: neutron-metadata-agent-clone [neutron-metadata-agent]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: neutron-l3-agent-clone [neutron-l3-agent]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-cinder-api-clone [openstack-cinder-api]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-cinder-scheduler-<wbr>clone<br>
> [openstack-cinder-scheduler]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> openstack-cinder-volume (systemd:openstack-cinder-<wbr>volume):<br>
> Started tst-controller-02<br>
> Clone Set: openstack-cinder-backup-clone [openstack-cinder-backup]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: cinder-perm-check-clone [cinder-perm-check]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: lbaasv2-clone [lbaasv2]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> lbaas-check (systemd:lbaas-check): Started tst-controller-01<br>
> Clone Set: clean-haproxy-clone [clean-haproxy]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-heat-api-clone [openstack-heat-api]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-heat-api-cfn-clone [openstack-heat-api-cfn]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-heat-engine-clone [openstack-heat-engine]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-ceilometer-<wbr>notification-clone<br>
> [openstack-ceilometer-<wbr>notification]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-ceilometer-central-<wbr>clone<br>
> [openstack-ceilometer-central]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-ceilometer-<wbr>collector-clone<br>
> [openstack-ceilometer-<wbr>collector]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-aodh-evaluator-clone [openstack-aodh-evaluator]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-aodh-notifier-clone [openstack-aodh-notifier]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-aodh-listener-clone [openstack-aodh-listener]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-swift-proxy-clone [openstack-swift-proxy]<br>
> Started: [ tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Stopped: [ compute-0 compute-1 ]<br>
> Clone Set: openstack-nova-compute-clone [openstack-nova-compute]<br>
> Started: [ compute-0 ]<br>
> Stopped: [ compute-1 tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Clone Set: openstack-ceilometer-compute-<wbr>clone<br>
> [openstack-ceilometer-compute]<br>
> Started: [ compute-0 ]<br>
> Stopped: [ compute-1 tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> Clone Set: neutron-openvswitch-agent-<wbr>compute-clone<br>
> [neutron-openvswitch-agent-<wbr>compute]<br>
> Started: [ compute-0 ]<br>
> Stopped: [ compute-1 tst-controller-01 tst-controller-02<br>
> tst-controller-03 ]<br>
> compute-0 (ocf::pacemaker:remote): Started tst-controller-01<br>
> evacuate (systemd:evacuate): Started tst-controller-02<br>
> clean-resources (systemd:clean_resources): Started<br>
> tst-controller-02<br>
> compute-1 (ocf::pacemaker:remote): Stopped<br>
><br>
<br>
What we definitely see here is that the remote-connection-resource is<br>
stopped.<br>
(The part that communicates with pacemaker_remoted on the remote-node)<br>
Do you see any signs in the logs why it is stopped? Is it the target-role?<br>
Is there a constraint forbidding it to start? Does it fail starting?<br>
<br>
Regards,<br>
Klaus</div></div></div>