Diff hostcache... 1d0
< node1	8247ce26-56e3-4e5c-b0f2-d690a8ae9320	100	
2a2
> node1	8247ce26-56e3-4e5c-b0f2-d690a8ae9320	100	
varies
Diff ccm_tool.txt... OK
Diff cib.xml... OK
Diff crm_mon.txt... OK
Diff ha.cf... 1c1,2
<  # Logging
---
> 
> #Logging
22,23c23,24
< #Enabling CRM
< crm                             yes
---
>  #Enable CRM
>  crm yes 
varies
Diff logd.cf... Diff sysinfo.txt... OK
WARN: crm_verify reported warnings at node1:
crm_verify[27913]: 2009/05/28_12:07:33 WARN: unpack_resources: No STONITH resources have been defined
crm_verify[27913]: 2009/05/28_12:07:33 WARN: unpack_rsc_op: Operation scriptHa_monitor_0 found resource scriptHa active on node2
crm_verify[27913]: 2009/05/28_12:07:33 WARN: unpack_rsc_op: Operation scriptHa_monitor_0 found resource scriptHa active on node1
Warnings found during check: config may not be valid
WARN: crm_verify reported warnings at node2:
crm_verify[29878]: 2009/05/28_12:06:50 WARN: unpack_resources: No STONITH resources have been defined
crm_verify[29878]: 2009/05/28_12:06:50 WARN: unpack_rsc_op: Operation scriptHa_monitor_0 found resource scriptHa active on node2
crm_verify[29878]: 2009/05/28_12:06:50 WARN: unpack_rsc_op: Operation scriptHa_monitor_0 found resource scriptHa active on node1
Warnings found during check: config may not be valid

Log patterns:
May 28 11:02:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797425057s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797425057s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797425056s to complete
May 28 11:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26587 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243519343-15 
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797425055s to complete
May 28 11:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26588 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243519343 
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797409104s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797409104s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797409104s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797409104s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797409101s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797409101s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797409101s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797409101s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797407242s to complete
May 28 11:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26725 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243519523-16 
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797407241s to complete
May 28 11:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26726 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243519523 
May 28 11:08:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797389427s to complete
May 28 11:08:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26865 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:08:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243519703-16 
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797389426s to complete
May 28 11:08:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26866 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:08:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243519703 
May 28 11:11:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797371612s to complete
May 28 11:11:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27003 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:11:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243519883-16 
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797371611s to complete
May 28 11:11:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27004 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:11:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243519883 
May 28 11:14:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797353798s to complete
May 28 11:14:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27141 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:14:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520063-16 
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797353797s to complete
May 28 11:14:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27142 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:14:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520063 
May 28 11:17:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797335983s to complete
May 28 11:17:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27279 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:17:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520243-16 
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797335982s to complete
May 28 11:17:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27280 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:17:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520243 
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797320029s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797320029s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797320029s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797320029s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797320026s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797320026s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797320026s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797320026s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797318168s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797318168s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797318168s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797318168s to complete
May 28 11:20:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27417 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:20:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520423-17 
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797318167s to complete
May 28 11:20:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27418 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:20:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520423 
May 28 11:23:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797300354s to complete
May 28 11:23:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27557 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:23:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520603-17 
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797300353s to complete
May 28 11:23:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27558 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:23:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520603 
May 28 11:26:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797282539s to complete
May 28 11:26:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27695 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:26:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520783-17 
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797282538s to complete
May 28 11:26:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27696 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:26:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520783 
May 28 11:29:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797264724s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797264724s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797264724s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797264724s to complete
May 28 11:29:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27833 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:29:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520963-17 
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797264723s to complete
May 28 11:29:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27834 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:29:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520963 
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797263571s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797263571s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797263571s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797263571s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797263566s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797263566s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797263566s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797263566s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797263566s to complete
May 28 11:29:36 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797263460s to complete
May 28 11:29:36 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797263460s to complete
May 28 11:29:36 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797263460s to complete
May 28 11:29:36 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797263460s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797262481s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797262481s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797262481s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797262481s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797262477s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797262476s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797262476s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797262476s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797262476s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797262463s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797262463s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797262463s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797262463s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797260973s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797260973s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797260972s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797260972s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797260944s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797260944s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797260944s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797260944s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797246910s to complete
May 28 11:32:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27996 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:32:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521143-17 
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797246909s to complete
May 28 11:32:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27997 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:32:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521143 
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797241569s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797241569s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797241569s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797241569s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797241564s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797241563s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797241563s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797241563s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797241563s to complete
May 28 11:33:18 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797241457s to complete
May 28 11:33:18 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797241457s to complete
May 28 11:33:18 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797241457s to complete
May 28 11:33:18 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797241457s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237506s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237506s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237506s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797237506s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797237502s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237502s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237501s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237501s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797237501s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237485s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237485s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237484s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797237484s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797237457s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237457s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237457s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237457s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797229095s to complete
May 28 11:35:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28141 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:35:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521323-18 
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797229094s to complete
May 28 11:35:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28142 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:35:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521323 
May 28 11:38:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797211281s to complete
May 28 11:38:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28281 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:38:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521503-18 
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797211280s to complete
May 28 11:38:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28282 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:38:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521503 
May 28 11:41:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797193466s to complete
May 28 11:41:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28421 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:41:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521683-18 
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797193465s to complete
May 28 11:41:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28422 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:41:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521683 
May 28 11:44:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797175651s to complete
May 28 11:44:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28559 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:44:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521863-18 
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797175650s to complete
May 28 11:44:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28560 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:44:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521863 
May 28 11:47:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797157837s to complete
May 28 11:47:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28717 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:47:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522043-18 
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797157836s to complete
May 28 11:47:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28718 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:47:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522043 
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797148385s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797148385s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797148385s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797148385s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797148383s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797148383s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797148383s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797148383s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797148382s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797148382s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797148382s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797148382s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797148382s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797140022s to complete
May 28 11:50:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28855 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:50:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522223-19 
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797140021s to complete
May 28 11:50:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28856 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:50:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522223 
May 28 11:53:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797122207s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797122207s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797122207s to complete
May 28 11:53:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28995 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:53:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522403-19 
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797122206s to complete
May 28 11:53:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28996 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:53:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522403 
May 28 11:56:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797104393s to complete
May 28 11:56:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29133 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:56:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522583-19 
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797104392s to complete
May 28 11:56:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29134 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:56:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522583 
May 28 11:59:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797086578s to complete
May 28 11:59:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29271 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:59:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522763-19 
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797086577s to complete
May 28 11:59:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29272 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:59:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522763 
May 28 12:02:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797068763s to complete
May 28 12:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29413 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 12:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522943-19 
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797068762s to complete
May 28 12:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29414 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 12:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522943 
May 28 12:03:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797059310s to complete
May 28 12:03:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797059310s to complete
May 28 12:03:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797059310s to complete
May 28 12:03:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797059310s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797059308s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797059308s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797059308s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797059308s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797050949s to complete
May 28 12:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29551 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 12:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243523123-20 
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797050948s to complete
May 28 12:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29552 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 12:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243523123 
May 28 11:02:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797425057s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797425057s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797425056s to complete
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797425056s to complete
May 28 11:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26587 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243519343-15 
May 28 11:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797425055s to complete
May 28 11:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26588 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243519343 
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797409104s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797409104s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797409104s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797409104s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797409102s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797409101s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797409101s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797409101s to complete
May 28 11:05:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797409101s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797407242s to complete
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797407242s to complete
May 28 11:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26725 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243519523-16 
May 28 11:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797407241s to complete
May 28 11:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26726 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243519523 
May 28 11:08:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797389427s to complete
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797389427s to complete
May 28 11:08:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26865 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:08:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243519703-16 
May 28 11:08:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797389426s to complete
May 28 11:08:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 26866 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:08:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243519703 
May 28 11:11:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797371612s to complete
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797371612s to complete
May 28 11:11:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27003 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:11:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243519883-16 
May 28 11:11:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797371611s to complete
May 28 11:11:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27004 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:11:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243519883 
May 28 11:14:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797353798s to complete
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797353798s to complete
May 28 11:14:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27141 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:14:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520063-16 
May 28 11:14:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797353797s to complete
May 28 11:14:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27142 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:14:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520063 
May 28 11:17:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797335983s to complete
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797335983s to complete
May 28 11:17:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27279 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:17:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520243-16 
May 28 11:17:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797335982s to complete
May 28 11:17:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27280 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:17:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520243 
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797320029s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797320029s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797320029s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797320029s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797320027s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797320026s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797320026s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797320026s to complete
May 28 11:20:04 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797320026s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797318169s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797318168s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797318168s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797318168s to complete
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797318168s to complete
May 28 11:20:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27417 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:20:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520423-17 
May 28 11:20:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797318167s to complete
May 28 11:20:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27418 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:20:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520423 
May 28 11:23:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797300354s to complete
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797300354s to complete
May 28 11:23:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27557 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:23:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520603-17 
May 28 11:23:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797300353s to complete
May 28 11:23:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27558 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:23:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520603 
May 28 11:26:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797282539s to complete
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797282539s to complete
May 28 11:26:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27695 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:26:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520783-17 
May 28 11:26:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797282538s to complete
May 28 11:26:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27696 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:26:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520783 
May 28 11:29:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797264725s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797264724s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797264724s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797264724s to complete
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797264724s to complete
May 28 11:29:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27833 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:29:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243520963-17 
May 28 11:29:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797264723s to complete
May 28 11:29:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27834 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:29:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243520963 
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797263571s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797263571s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797263571s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797263571s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797263566s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797263566s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797263566s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797263566s to complete
May 28 11:29:35 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797263566s to complete
May 28 11:29:36 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797263460s to complete
May 28 11:29:36 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797263460s to complete
May 28 11:29:36 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797263460s to complete
May 28 11:29:36 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797263460s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797262481s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797262481s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797262481s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797262481s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797262477s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797262476s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797262476s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797262476s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797262476s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797262463s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797262463s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797262463s to complete
May 28 11:29:46 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797262463s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797260973s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797260973s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797260972s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797260972s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797260970s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797260944s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797260944s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797260944s to complete
May 28 11:30:01 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797260944s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797246910s to complete
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797246910s to complete
May 28 11:32:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27996 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:32:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521143-17 
May 28 11:32:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797246909s to complete
May 28 11:32:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 27997 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:32:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521143 
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797241569s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797241569s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797241569s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797241569s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797241564s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797241563s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797241563s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797241563s to complete
May 28 11:33:17 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797241563s to complete
May 28 11:33:18 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797241457s to complete
May 28 11:33:18 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797241457s to complete
May 28 11:33:18 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797241457s to complete
May 28 11:33:18 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797241457s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237506s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237506s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237506s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797237506s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797237502s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237502s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237501s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237501s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797237501s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237485s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237485s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237484s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797237484s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797237482s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797237457s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797237457s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797237457s to complete
May 28 11:33:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797237457s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797229095s to complete
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797229095s to complete
May 28 11:35:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28141 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:35:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521323-18 
May 28 11:35:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797229094s to complete
May 28 11:35:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28142 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:35:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521323 
May 28 11:38:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797211281s to complete
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797211281s to complete
May 28 11:38:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28281 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:38:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521503-18 
May 28 11:38:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797211280s to complete
May 28 11:38:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28282 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:38:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521503 
May 28 11:41:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797193466s to complete
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797193466s to complete
May 28 11:41:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28421 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:41:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521683-18 
May 28 11:41:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797193465s to complete
May 28 11:41:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28422 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:41:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521683 
May 28 11:44:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797175651s to complete
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797175651s to complete
May 28 11:44:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28559 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:44:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243521863-18 
May 28 11:44:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797175650s to complete
May 28 11:44:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28560 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:44:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243521863 
May 28 11:47:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797157837s to complete
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797157837s to complete
May 28 11:47:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28717 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:47:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522043-18 
May 28 11:47:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797157836s to complete
May 28 11:47:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28718 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:47:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522043 
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797148385s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797148385s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797148385s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797148385s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797148383s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797148383s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797148383s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797148383s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797148382s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797148382s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797148382s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797148382s to complete
May 28 11:48:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797148382s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797140022s to complete
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797140022s to complete
May 28 11:50:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28855 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:50:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522223-19 
May 28 11:50:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797140021s to complete
May 28 11:50:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28856 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:50:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522223 
May 28 11:53:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797122208s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797122207s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797122207s to complete
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797122207s to complete
May 28 11:53:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28995 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:53:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522403-19 
May 28 11:53:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797122206s to complete
May 28 11:53:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 28996 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:53:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522403 
May 28 11:56:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797104393s to complete
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797104393s to complete
May 28 11:56:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29133 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:56:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522583-19 
May 28 11:56:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797104392s to complete
May 28 11:56:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29134 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:56:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522583 
May 28 11:59:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797086578s to complete
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797086578s to complete
May 28 11:59:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29271 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:59:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522763-19 
May 28 11:59:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797086577s to complete
May 28 11:59:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29272 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 11:59:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522763 
May 28 12:02:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797068764s to complete
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797068763s to complete
May 28 12:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29413 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 12:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243522943-19 
May 28 12:02:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797068762s to complete
May 28 12:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29414 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 12:02:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243522943 
May 28 12:03:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797059310s to complete
May 28 12:03:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797059310s to complete
May 28 12:03:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797059310s to complete
May 28 12:03:58 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_PE_INVOKE took 797059310s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_TE_INVOKE took 797059309s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_LOG    took 797059308s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797059308s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797059308s to complete
May 28 12:03:59 node2 crmd: [10635]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797059308s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: crm_timer_popped: Integration Timer (I_INTEGRATED) just popped!
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_START took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_FINALIZE took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_WARN   took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_START took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 797050949s to complete
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_ELECTION_VOTE took 797050949s to complete
May 28 12:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29551 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 12:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="do_election_vote" t="crmd" version="3.0.1" subt="request" reference="vote-crmd-1243523123-20 
May 28 12:05:23 node2 crmd: [10589]: ERROR: do_fsa_action: Action A_DC_JOIN_OFFER_ALL took 797050948s to complete
May 28 12:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Child 29552 spawned to record non-fatal assertion failure line 1375: rc == 0 
May 28 12:05:23 node2 openais[2498]: [crm  ] ERROR: send_cluster_msg_raw: Message not sent (-1): <create_request_adv origin="join_make_offer" t="crmd" version="3.0.1" subt="request" reference="join_offer-dc-1243523123 
