[ClusterLabs] Corosync.log Growing at 1Gb in 15min

Mark Prinsloo markprinsloo126 at gmail.com
Wed Jun 20 07:58:18 EDT 2018


Good Day,

We had a node failure and we had to rebuild the whole server from scratch.
After rebuilding Asterisk01 and rejoining it to the cluster something isn't
working 100%.

It does fail over but the corosync.log file on the second node is growing
at 1Gb every 15min.
I have attached a piece of the log file and you can see the logs get filled
with the same set of messages.

Something isn't working properly but can figure out what exactly.

Should I rather rebuild the cluster?

Thank You in Advance
Mark
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.clusterlabs.org/pipermail/users/attachments/20180620/f60b9573/attachment-0001.html>
-------------- next part --------------
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178295: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178295: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356648)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356648, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178296 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178296 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178296: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178296 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178296: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178296 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178296: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178296 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178296 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178296: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178296: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178296: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356650)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356650, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178297 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178297 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178297: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178297 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178297: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178297 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178297: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178297 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178297 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178297: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178297: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178297: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356652)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356652, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178298 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178298 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178298: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178298 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178298: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178298 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178298: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178298 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178298 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178298: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178298: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178298: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356654)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356654, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178299 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178299 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178299: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178299 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178299: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178299 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178299: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178299 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178299 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178299: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178299: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178299: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356656)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356656, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178300 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178300 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178300: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178300 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178300: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178300 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178300: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178300 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178300 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178300: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178300: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178300: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356658)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356658, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178301 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178301 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178301: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178301 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178301: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178301 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178301: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178301 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178301 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178301: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178301: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178301: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356660)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356660, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178302 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178302 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178302: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178302 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178302: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178302 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178302: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178302 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178302 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178302: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178302: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178302: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356662)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356662, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178303 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178303 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178303: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178303 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178303: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178303 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178303: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178303 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178303 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178303: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178303: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178303: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356664)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356664, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178304 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178304 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178304: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178304 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178304: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178304 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178304: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178304 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178304 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178304: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178304: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178304: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356666)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356666, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178305 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178305 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178305: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178305 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178305: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178305 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178305: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178305 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178305 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178305: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178305: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178305: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356668)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356668, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178306 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178306 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178306: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178306 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178306: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178306 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178306: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178306 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178306 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178306: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178306: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178306: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356670)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356670, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178307 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178307 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178307: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178307 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178307: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178307 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178307: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178307 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178307 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178307: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178307: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178307: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356672)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356672, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178308 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178308 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178308: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178308 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178308: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178308 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178308: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178308 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178308 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178308: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178308: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178308: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356674)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356674, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178309 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178309 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178309: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178309 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178309: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178309 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178309: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178309 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178309 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178309: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178309: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178309: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356676)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356676, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178310 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178310 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178310: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178310 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178310: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178310 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178310: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178310 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178310 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178310: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178310: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178310: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356678)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356678, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178311 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178311 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178311: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178311 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178311: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178311 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178311: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178311 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178311 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178311: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178311: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178311: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356680)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356680, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178312 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178312 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178312: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178312 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178312: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178312 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178312: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178312 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178312 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178312: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178312: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178312: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356682)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356682, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178313 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178313 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178313: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178313 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178313: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178313 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178313: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178313 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178313 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178313: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178313: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178313: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356684)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: __xml_diff_object:	Moved node_state at crmd (3 -> 2)
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_perform_op:	Discarding update with feature set '3.0.14' greater than our own '3.0.10'
Jun 20 13:09:45 [19771] kpasterisk02        cib:    error: cib_process_request:	Completed cib_replace operation for section 'all': Protocol not supported (rc=-93, origin=kpasterisk01-ha/crmd/34356684, version=0.45.44)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:    error: finalize_sync_callback:	Sync from kpasterisk01-ha failed: Protocol not supported
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: register_fsa_error_adv:	Resetting the current action list
Jun 20 13:09:45 [19776] kpasterisk02       crmd:  warning: do_log:	FSA: Input I_ELECTION_DC from finalize_sync_callback() received in state S_FINALIZE_JOIN
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_FINALIZE_JOIN -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=finalize_sync_callback ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk02-ha[2] - join-17178314 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	initialize_join: Node kpasterisk01-ha[1] - join-17178314 phase 2 -> 0
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Unset DC. Was kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178314: Sending offer to kpasterisk02-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk02-ha[2] - join-17178314 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: join_make_offer:	join-17178314: Sending offer to kpasterisk01-ha
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	join_make_offer: Node kpasterisk01-ha[1] - join-17178314 phase 0 -> 1
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_dc_join_offer_all:	join-17178314: Waiting on 2 outstanding join acks
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: update_dc:	Set DC to kpasterisk02-ha (3.0.10)
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk01-ha[1] - join-17178314 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crm_update_peer_join:	do_dc_join_filter_offer: Node kpasterisk02-ha[2] - join-17178314 phase 1 -> 2
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: do_state_transition:	State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178314: kpasterisk02-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:     info: crmd_join_phase_log:	join-17178314: kpasterisk01-ha=integrated
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	join-17178314: Syncing the CIB from kpasterisk01-ha to the rest of the cluster
Jun 20 13:09:45 [19776] kpasterisk02       crmd:   notice: do_dc_join_finalize:	Requested version   <generation_tuple crm_feature_set="3.0.14" validate-with="pacemaker-2.3" epoch="46" num_updates="1" admin_epoch="0" cib-last-written="Tue Jun 19 21:02:12 2018" update-origin="kpasterisk01-ha" update-client="crmd" update-user="hacluster" have-quorum="1"/>
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_request:	Forwarding cib_sync operation for section 'all' to kpasterisk01-ha (origin=local/crmd/34356686)
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Digest matched on replace from kpasterisk01-ha: bea7f8f1c6122da3b43e9bbfd81b6289
Jun 20 13:09:45 [19771] kpasterisk02        cib:     info: cib_process_replace:	Replaced 0.45.44 with 0.46.1 from kpasterisk01-ha


More information about the Users mailing list