<div dir="ltr"><div><div><div><div><div>Hello, I do not know if it is the correct mode to answer in this mailing list.<br></div>Anycase, either shutdown the remote node or fencing it with ipmi , it does not retrurn online.<br></div>them pacemaker-remote service is enabled and restart at reboot.<br></div>But I continue to have the following on my cluster:<br><br>Online: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>RemoteOnline: [ compute-0 ]<br>RemoteOFFLINE: [ compute-1 ]<br><br>Full list of resources:<br><br> Resource Group: vip<br>     vipmanagement    (ocf::heartbeat:IPaddr2):    Started tst-controller-03<br>     vipinternalpi    (ocf::heartbeat:IPaddr2):    Started tst-controller-03<br>     lb-haproxy    (systemd:haproxy):    Started tst-controller-03<br> Clone Set: httpd-clone [httpd]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-glance-api-clone [openstack-glance-api]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-glance-registry-clone [openstack-glance-registry]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-nova-api-clone [openstack-nova-api]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-nova-consoleauth-clone [openstack-nova-consoleauth]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-nova-scheduler-clone [openstack-nova-scheduler]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-nova-conductor-clone [openstack-nova-conductor]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-nova-novncproxy-clone [openstack-nova-novncproxy]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: neutron-server-clone [neutron-server]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: neutron-openvswitch-agent-clone [neutron-openvswitch-agent]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: neutron-dhcp-agent-clone [neutron-dhcp-agent]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: neutron-metadata-agent-clone [neutron-metadata-agent]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: neutron-l3-agent-clone [neutron-l3-agent]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-cinder-api-clone [openstack-cinder-api]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-cinder-scheduler-clone [openstack-cinder-scheduler]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> openstack-cinder-volume    (systemd:openstack-cinder-volume):    Started tst-controller-02<br> Clone Set: openstack-cinder-backup-clone [openstack-cinder-backup]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: cinder-perm-check-clone [cinder-perm-check]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: lbaasv2-clone [lbaasv2]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> lbaas-check    (systemd:lbaas-check):    Started tst-controller-01<br> Clone Set: clean-haproxy-clone [clean-haproxy]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-heat-api-clone [openstack-heat-api]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-heat-api-cfn-clone [openstack-heat-api-cfn]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-heat-engine-clone [openstack-heat-engine]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-ceilometer-notification-clone [openstack-ceilometer-notification]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-ceilometer-central-clone [openstack-ceilometer-central]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-ceilometer-collector-clone [openstack-ceilometer-collector]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-aodh-evaluator-clone [openstack-aodh-evaluator]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-aodh-notifier-clone [openstack-aodh-notifier]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-aodh-listener-clone [openstack-aodh-listener]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-swift-proxy-clone [openstack-swift-proxy]<br>     Started: [ tst-controller-01 tst-controller-02 tst-controller-03 ]<br>     Stopped: [ compute-0 compute-1 ]<br> Clone Set: openstack-nova-compute-clone [openstack-nova-compute]<br>     Started: [ compute-0 ]<br>     Stopped: [ compute-1 tst-controller-01 tst-controller-02 tst-controller-03 ]<br> Clone Set: openstack-ceilometer-compute-clone [openstack-ceilometer-compute]<br>     Started: [ compute-0 ]<br>     Stopped: [ compute-1 tst-controller-01 tst-controller-02 tst-controller-03 ]<br> Clone Set: neutron-openvswitch-agent-compute-clone [neutron-openvswitch-agent-compute]<br>     Started: [ compute-0 ]<br>     Stopped: [ compute-1 tst-controller-01 tst-controller-02 tst-controller-03 ]<br> compute-0    (ocf::pacemaker:remote):    Started tst-controller-01<br> evacuate    (systemd:evacuate):    Started tst-controller-02<br> clean-resources    (systemd:clean_resources):    Started tst-controller-02<br> compute-1    (ocf::pacemaker:remote):    Stopped<br><br>Daemon Status:<br>  corosync: active/enabled<br>  pacemaker: active/enabled<br>  pcsd: active/enabled<br><br><br></div>I tried to cleanup resource compute-1 but without luck.<br></div>Regards Ignazio<br></div>