[debug] shm size:8388608; real_size:8388608; rb->word_size:2097152
[debug] read total of: 8388620
Dumping the contents of /var/lib/corosync/fdata
Ringbuffer: 
 ->NORMAL
 ->write_pt [119869]
 ->read_pt [0]
 ->size [2097152 words]
 =>free [7909128 bytes]
 =>used [479476 bytes]
notice  Jun 05 15:30:53 main(1128):2: Corosync Cluster Engine ('2.3.0'): started and ready to provide service.
info    Jun 05 15:30:53 main(1129):2: Corosync built-in features: debug watchdog pie relro bindnow
debug   Jun 05 15:30:53 totempg_waiting_trans_ack_cb(287):13: waiting_trans_ack changed to 1
debug   Jun 05 15:30:53 totemsrp_initialize(851):13: Token Timeout (1000 ms) retransmit timeout (238 ms)
debug   Jun 05 15:30:53 totemsrp_initialize(854):13: token hold (180 ms) retransmits before loss (4 retrans)
debug   Jun 05 15:30:53 totemsrp_initialize(861):13: join (50 ms) send_join (0 ms) consensus (1200 ms) merge (200 ms)
debug   Jun 05 15:30:53 totemsrp_initialize(864):13: downcheck (1000 ms) fail to recv const (2500 msgs)
debug   Jun 05 15:30:53 totemsrp_initialize(866):13: seqno unchanged const (30 rotations) Maximum network MTU 1401
debug   Jun 05 15:30:53 totemsrp_initialize(870):13: window size per rotation (50 messages) maximum messages per rotation (17 messages)
debug   Jun 05 15:30:53 totemsrp_initialize(874):13: missed count const (5 messages)
debug   Jun 05 15:30:53 totemsrp_initialize(877):13: send threads (0 threads)
debug   Jun 05 15:30:53 totemsrp_initialize(880):13: RRP token expired timeout (238 ms)
debug   Jun 05 15:30:53 totemsrp_initialize(883):13: RRP token problem counter (2000 ms)
debug   Jun 05 15:30:53 totemsrp_initialize(886):13: RRP threshold (10 problem count)
debug   Jun 05 15:30:53 totemsrp_initialize(889):13: RRP multicast threshold (100 problem count)
debug   Jun 05 15:30:53 totemsrp_initialize(892):13: RRP automatic recovery check timeout (1000 ms)
debug   Jun 05 15:30:53 totemsrp_initialize(894):13: RRP mode set to active.
debug   Jun 05 15:30:53 totemsrp_initialize(897):13: heartbeat_failures_allowed (0)
debug   Jun 05 15:30:53 totemsrp_initialize(899):13: max_network_delay (50 ms)
debug   Jun 05 15:30:53 totemsrp_initialize(922):13: HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
notice  Jun 05 15:30:53 totemnet_instance_initialize(242):13: Initializing transport (UDP/IP Multicast).
notice  Jun 05 15:30:53 init_nss(579):13: Initializing transmit/receive security (NSS) crypto: none hash: none
notice  Jun 05 15:30:53 totemnet_instance_initialize(242):13: Initializing transport (UDP/IP Multicast).
notice  Jun 05 15:30:53 init_nss(579):13: Initializing transmit/receive security (NSS) crypto: none hash: none
debug   Jun 05 15:30:53 totemudp_build_sockets_ip(905):13: Receive multicast socket recv buffer size (320000 bytes).
debug   Jun 05 15:30:53 totemudp_build_sockets_ip(911):13: Transmit multicast socket send buffer size (320000 bytes).
debug   Jun 05 15:30:53 totemudp_build_sockets_ip(917):13: Local receive multicast loop socket recv buffer size (320000 bytes).
debug   Jun 05 15:30:53 totemudp_build_sockets_ip(923):13: Local transmit multicast loop socket send buffer size (320000 bytes).
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 2 for FD 9
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 3 for FD 10
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 4 for FD 13
notice  Jun 05 15:30:53 timer_function_netif_check_timeout(670):13: The network interface [192.168.101.131] is now up.
debug   Jun 05 15:30:53 main_iface_change_fn(4560):13: Created or loaded sequence id 178.192.168.101.131 for this ring.
notice  Jun 05 15:30:53 corosync_service_link_and_init(174):1: Service engine loaded: corosync configuration map access [0]
debug   Jun 05 15:30:53 cs_ipcs_service_init(855):2: Initializing IPC on cmap [0]
debug   Jun 05 15:30:53 cs_get_ipc_type(811):2: No configured qb.ipc_type. Using native ipc
info    Jun 05 15:30:53 qb_ipcs_us_publish(630):5: server name: cmap
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 5 for FD 14
notice  Jun 05 15:30:53 corosync_service_link_and_init(174):1: Service engine loaded: corosync configuration service [1]
debug   Jun 05 15:30:53 cs_ipcs_service_init(855):2: Initializing IPC on cfg [1]
debug   Jun 05 15:30:53 cs_get_ipc_type(811):2: No configured qb.ipc_type. Using native ipc
info    Jun 05 15:30:53 qb_ipcs_us_publish(630):5: server name: cfg
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 6 for FD 15
notice  Jun 05 15:30:53 corosync_service_link_and_init(174):1: Service engine loaded: corosync cluster closed process group service v1.01 [2]
debug   Jun 05 15:30:53 cs_ipcs_service_init(855):2: Initializing IPC on cpg [2]
debug   Jun 05 15:30:53 cs_get_ipc_type(811):2: No configured qb.ipc_type. Using native ipc
info    Jun 05 15:30:53 qb_ipcs_us_publish(630):5: server name: cpg
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 7 for FD 16
notice  Jun 05 15:30:53 corosync_service_link_and_init(174):1: Service engine loaded: corosync profile loading service [4]
debug   Jun 05 15:30:53 cs_ipcs_service_init(847):2: NOT Initializing IPC on pload [4]
trace   Jun 05 15:30:53 wd_exec_init_fn(710):0: ENTERING wd_exec_init_fn()
trace   Jun 05 15:30:53 watchdog_timeout_get_initial(687):0: ENTERING watchdog_timeout_get_initial()
trace   Jun 05 15:30:53 setup_watchdog(629):0: ENTERING setup_watchdog()
warning Jun 05 15:30:53 setup_watchdog(631):0: No Watchdog, try modprobe <a watchdog>
trace   Jun 05 15:30:53 wd_scan_resources(554):0: ENTERING wd_scan_resources()
info    Jun 05 15:30:53 wd_scan_resources(580):0: no resources configured.
notice  Jun 05 15:30:53 corosync_service_link_and_init(174):1: Service engine loaded: corosync watchdog service [7]
debug   Jun 05 15:30:53 cs_ipcs_service_init(847):2: NOT Initializing IPC on wd [7]
notice  Jun 05 15:30:53 quorum_exec_init_fn(274):3: Using quorum provider corosync_votequorum
trace   Jun 05 15:30:53 votequorum_init(1911):6: ENTERING votequorum_init()
trace   Jun 05 15:30:53 votequorum_exec_init_fn(1767):6: ENTERING votequorum_exec_init_fn()
trace   Jun 05 15:30:53 allocate_node(439):6: ENTERING allocate_node()
trace   Jun 05 15:30:53 allocate_node(468):6: LEAVING allocate_node()
trace   Jun 05 15:30:53 allocate_node(439):6: ENTERING allocate_node()
trace   Jun 05 15:30:53 node_add_ordered(413):6: ENTERING node_add_ordered()
trace   Jun 05 15:30:53 node_add_ordered(431):6: LEAVING node_add_ordered()
trace   Jun 05 15:30:53 allocate_node(468):6: LEAVING allocate_node()
trace   Jun 05 15:30:53 votequorum_readconfig(952):6: ENTERING votequorum_readconfig()
debug   Jun 05 15:30:53 votequorum_readconfig(954):6: Reading configuration (runtime: 0)
trace   Jun 05 15:30:53 votequorum_read_nodelist_configuration(872):6: ENTERING votequorum_read_nodelist_configuration()
debug   Jun 05 15:30:53 votequorum_read_nodelist_configuration(876):6: No nodelist defined or our node is not in the nodelist
trace   Jun 05 15:30:53 votequorum_qdevice_is_configured(921):6: ENTERING votequorum_qdevice_is_configured()
trace   Jun 05 15:30:53 votequorum_qdevice_is_configured(936):6: LEAVING votequorum_qdevice_is_configured()
trace   Jun 05 15:30:53 update_ev_barrier(610):6: ENTERING update_ev_barrier()
trace   Jun 05 15:30:53 update_ev_barrier(615):6: LEAVING update_ev_barrier()
trace   Jun 05 15:30:53 update_two_node(601):6: ENTERING update_two_node()
trace   Jun 05 15:30:53 update_two_node(605):6: LEAVING update_two_node()
trace   Jun 05 15:30:53 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:30:53 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:30:53 votequorum_readconfig(1166):6: LEAVING votequorum_readconfig()
trace   Jun 05 15:30:53 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:30:53 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:30:53 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:30:53 recalculate_quorum(841):6: total_votes=1, expected_votes=2
trace   Jun 05 15:30:53 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
trace   Jun 05 15:30:53 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:30:53 are_we_quorate(724):6: ENTERING are_we_quorate()
notice  Jun 05 15:30:53 are_we_quorate(735):6: Waiting for all cluster members. Current votes: 1 expected_votes: 2
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:30:53 votequorum_exec_add_config_notification(1211):6: ENTERING votequorum_exec_add_config_notification()
trace   Jun 05 15:30:53 votequorum_exec_add_config_notification(1225):6: LEAVING votequorum_exec_add_config_notification()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 votequorum_exec_init_fn(1820):6: LEAVING votequorum_exec_init_fn()
notice  Jun 05 15:30:53 corosync_service_link_and_init(174):1: Service engine loaded: corosync vote quorum service v1.0 [5]
debug   Jun 05 15:30:53 cs_ipcs_service_init(855):2: Initializing IPC on votequorum [5]
debug   Jun 05 15:30:53 cs_get_ipc_type(811):2: No configured qb.ipc_type. Using native ipc
info    Jun 05 15:30:53 qb_ipcs_us_publish(630):5: server name: votequorum
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 8 for FD 17
trace   Jun 05 15:30:53 votequorum_init(1926):6: LEAVING votequorum_init()
notice  Jun 05 15:30:53 corosync_service_link_and_init(174):1: Service engine loaded: corosync cluster quorum service v0.1 [3]
debug   Jun 05 15:30:53 cs_ipcs_service_init(855):2: Initializing IPC on quorum [3]
debug   Jun 05 15:30:53 cs_get_ipc_type(811):2: No configured qb.ipc_type. Using native ipc
info    Jun 05 15:30:53 qb_ipcs_us_publish(630):5: server name: quorum
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 9 for FD 18
debug   Jun 05 15:30:53 totemudp_build_sockets_ip(905):13: Receive multicast socket recv buffer size (320000 bytes).
debug   Jun 05 15:30:53 totemudp_build_sockets_ip(911):13: Transmit multicast socket send buffer size (320000 bytes).
debug   Jun 05 15:30:53 totemudp_build_sockets_ip(917):13: Local receive multicast loop socket recv buffer size (320000 bytes).
debug   Jun 05 15:30:53 totemudp_build_sockets_ip(923):13: Local transmit multicast loop socket send buffer size (320000 bytes).
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 10 for FD 19
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 11 for FD 20
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 12 for FD 23
notice  Jun 05 15:30:53 timer_function_netif_check_timeout(670):13: The network interface [192.168.102.131] is now up.
debug   Jun 05 15:30:53 memb_state_gather_enter(2010):13: entering GATHER state from 15.
debug   Jun 05 15:30:53 memb_state_commit_token_create(3061):13: Creating commit token because I am the rep.
debug   Jun 05 15:30:53 old_ring_state_save(1500):13: Saving state aru 0 high seq received 0
debug   Jun 05 15:30:53 memb_ring_id_set_and_store(3306):13: Storing new sequence id for ring 17c
debug   Jun 05 15:30:53 memb_state_commit_enter(2058):13: entering COMMIT state.
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 memb_state_recovery_enter(2095):13: entering RECOVERY state.
debug   Jun 05 15:30:53 memb_state_recovery_enter(2141):13: position [0] member 192.168.101.131:
debug   Jun 05 15:30:53 memb_state_recovery_enter(2145):13: previous ring seq 178 rep 192.168.101.131
debug   Jun 05 15:30:53 memb_state_recovery_enter(2151):13: aru 0 high delivered 0 received flag 1
debug   Jun 05 15:30:53 memb_state_recovery_enter(2249):13: Did not need to originate any messages in recovery.
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4460):13: Sending initial ORF token
trace   Jun 05 15:30:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
debug   Jun 05 15:30:53 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 0, aru 0
debug   Jun 05 15:30:53 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
warning Jun 05 15:30:53 timer_function_active_token_expired(1362):13: Incrementing problem counter for seqid 1 iface 192.168.102.131 to [1 of 10]
debug   Jun 05 15:30:53 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 1, aru 0
debug   Jun 05 15:30:53 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:30:53 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 2, aru 0
debug   Jun 05 15:30:53 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:30:53 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 3, aru 0
debug   Jun 05 15:30:53 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:30:53 message_handler_orf_token(3752):13: retrans flag count 4 token aru 0 install seq 0 aru 0 0
debug   Jun 05 15:30:53 old_ring_state_reset(1516):13: Resetting old ring state
debug   Jun 05 15:30:53 deliver_messages_from_recovery_to_regular(1722):13: recovery to regular 1-0
trace   Jun 05 15:30:53 memb_state_operational_enter(1808):13: Delivering to app 1 to 0
trace   Jun 05 15:30:53 votequorum_confchg_fn(1851):6: ENTERING votequorum_confchg_fn()
trace   Jun 05 15:30:53 votequorum_confchg_fn(1902):6: LEAVING votequorum_confchg_fn()
trace   Jun 05 15:30:53 sync_abort(604):11: ENTERING sync_abort()
trace   Jun 05 15:30:53 sync_save_transitional(596):11: ENTERING sync_save_transitional()
debug   Jun 05 15:30:53 totempg_waiting_trans_ack_cb(287):13: waiting_trans_ack changed to 1
debug   Jun 05 15:30:53 member_object_joined(332):2: Member joined: r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) 
trace   Jun 05 15:30:53 votequorum_confchg_fn(1851):6: ENTERING votequorum_confchg_fn()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
notice  Jun 05 15:30:53 log_view_list(132):3: Members[1]: -2090489664
debug   Jun 05 15:30:53 send_library_notification(359):3: sending quorum notification to (nil), length = 52
trace   Jun 05 15:30:53 votequorum_confchg_fn(1902):6: LEAVING votequorum_confchg_fn()
trace   Jun 05 15:30:53 sync_abort(604):11: ENTERING sync_abort()
trace   Jun 05 15:30:53 sync_start(578):11: ENTERING sync_start()
debug   Jun 05 15:30:53 memb_state_operational_enter(1936):13: entering OPERATIONAL state.
notice  Jun 05 15:30:53 memb_state_operational_enter(1940):13: A processor joined or left the membership and a new membership (192.168.101.131:380) was formed.
trace   Jun 05 15:30:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 0 to 2
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1 to pending delivery queue
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[2204477632]: votes: 1, expected: 2 flags: 12
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:30:53 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:30:53 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:30:53 recalculate_quorum(841):6: total_votes=1, expected_votes=2
trace   Jun 05 15:30:53 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
trace   Jun 05 15:30:53 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:30:53 are_we_quorate(724):6: ENTERING are_we_quorate()
notice  Jun 05 15:30:53 are_we_quorate(735):6: Waiting for all cluster members. Current votes: 1 expected_votes: 2
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2 to pending delivery queue
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[2204477632]: votes: 1, expected: 2 flags: 12
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:30:53 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:30:53 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:30:53 recalculate_quorum(841):6: total_votes=1, expected_votes=2
trace   Jun 05 15:30:53 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
trace   Jun 05 15:30:53 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:30:53 are_we_quorate(724):6: ENTERING are_we_quorate()
notice  Jun 05 15:30:53 are_we_quorate(735):6: Waiting for all cluster members. Current votes: 1 expected_votes: 2
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[0]: votes: 0, expected: 0 flags: 0
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 cmap_mcast_send(815):9: ENTERING cmap_mcast_send()
trace   Jun 05 15:30:53 cmap_mcast_send(857):9: Item 0 - type 0, len end()zu
trace   Jun 05 15:30:53 cmap_mcast_send(869):9: Sending 1 items (2 iovec) for reason 0
trace   Jun 05 15:30:53 cmap_mcast_send(879):9: LEAVING cmap_mcast_send()
trace   Jun 05 15:30:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 2 to 3
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3 to pending delivery queue
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast(954):9: ENTERING message_handler_req_exec_cmap_mcast()
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast_reason_sync_nv(919):9: ENTERING message_handler_req_exec_cmap_mcast_reason_sync_nv()
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast_reason_sync_nv(934):9: Received config version 0 from node 8365a8c0
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast_reason_sync_nv(945):9: LEAVING message_handler_req_exec_cmap_mcast_reason_sync_nv()
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast(971):9: LEAVING message_handler_req_exec_cmap_mcast()
debug   Jun 05 15:30:53 sync_barrier_handler(232):11: Committing synchronization for corosync configuration map access
debug   Jun 05 15:30:53 cmap_sync_activate(386):9: Single node sync -> no action
trace   Jun 05 15:30:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:53 messages_free(2463):13: releasing messages up to and including 2
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 3 to 5
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4 to pending delivery queue
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5 to pending delivery queue
debug   Jun 05 15:30:53 downlist_log(776):8: comparing: sender r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ; members(old:0 left:0)
debug   Jun 05 15:30:53 downlist_log(776):8: chosen downlist: sender r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ; members(old:0 left:0)
debug   Jun 05 15:30:53 sync_barrier_handler(232):11: Committing synchronization for corosync cluster closed process group service v1.01
notice  Jun 05 15:30:53 corosync_sync_completed(275):2: Completed service synchronization, ready to provide service.
debug   Jun 05 15:30:53 totempg_waiting_trans_ack_cb(287):13: waiting_trans_ack changed to 0
trace   Jun 05 15:30:53 messages_free(2463):13: releasing messages up to and including 3
trace   Jun 05 15:30:53 messages_free(2463):13: releasing messages up to and including 5
debug   Jun 05 15:30:53 handle_new_connection(735):5: IPC credentials authenticated (4555-4559-24)
debug   Jun 05 15:30:53 qb_ipcs_shm_connect(282):5: connecting to client [4559]
debug   Jun 05 15:30:53 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:53 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:53 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
trace   Jun 05 15:30:53 qb_loop_poll_add(357):5: grown poll array to 13 for FD 24
debug   Jun 05 15:30:53 cs_ipcs_connection_created(269):2: connection created
trace   Jun 05 15:30:53 cfg_lib_init_fn(449):10: ENTERING cfg_lib_init_fn()
trace   Jun 05 15:30:53 cfg_lib_init_fn(451):10: LEAVING cfg_lib_init_fn()
trace   Jun 05 15:30:53 message_handler_req_lib_cfg_ringstatusget(543):10: ENTERING message_handler_req_lib_cfg_ringstatusget()
trace   Jun 05 15:30:53 message_handler_req_lib_cfg_ringstatusget(571):10: LEAVING message_handler_req_lib_cfg_ringstatusget()
debug   Jun 05 15:30:53 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4559-24)
debug   Jun 05 15:30:53 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4559-24) state:2
trace   Jun 05 15:30:53 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:53 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:53 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
trace   Jun 05 15:30:53 cfg_lib_exit_fn(439):10: ENTERING cfg_lib_exit_fn()
trace   Jun 05 15:30:53 remove_ci_from_shutdown(398):10: ENTERING remove_ci_from_shutdown()
trace   Jun 05 15:30:53 remove_ci_from_shutdown(431):10: LEAVING remove_ci_from_shutdown()
trace   Jun 05 15:30:53 cfg_lib_exit_fn(441):10: LEAVING cfg_lib_exit_fn()
debug   Jun 05 15:30:53 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:53 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cfg-response-4555-4559-24-header
debug   Jun 05 15:30:53 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cfg-event-4555-4559-24-header
debug   Jun 05 15:30:53 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cfg-request-4555-4559-24-header
debug   Jun 05 15:30:53 memb_state_gather_enter(2010):13: entering GATHER state from 9.
debug   Jun 05 15:30:53 memb_state_commit_token_create(3061):13: Creating commit token because I am the rep.
debug   Jun 05 15:30:53 old_ring_state_save(1500):13: Saving state aru 5 high seq received 5
debug   Jun 05 15:30:53 memb_ring_id_set_and_store(3306):13: Storing new sequence id for ring 180
debug   Jun 05 15:30:53 memb_state_commit_enter(2058):13: entering COMMIT state.
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 memb_state_recovery_enter(2095):13: entering RECOVERY state.
debug   Jun 05 15:30:53 memb_state_recovery_enter(2137):13: TRANS [0] member 192.168.101.131:
debug   Jun 05 15:30:53 memb_state_recovery_enter(2141):13: position [0] member 192.168.101.131:
debug   Jun 05 15:30:53 memb_state_recovery_enter(2145):13: previous ring seq 17c rep 192.168.101.131
debug   Jun 05 15:30:53 memb_state_recovery_enter(2151):13: aru 5 high delivered 5 received flag 1
debug   Jun 05 15:30:53 memb_state_recovery_enter(2141):13: position [1] member 192.168.101.132:
debug   Jun 05 15:30:53 memb_state_recovery_enter(2145):13: previous ring seq 178 rep 192.168.101.132
debug   Jun 05 15:30:53 memb_state_recovery_enter(2151):13: aru 5 high delivered 5 received flag 1
debug   Jun 05 15:30:53 memb_state_recovery_enter(2249):13: Did not need to originate any messages in recovery.
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:30:53 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:30:53 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 0, aru 0
debug   Jun 05 15:30:53 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:30:53 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 1, aru 0
debug   Jun 05 15:30:53 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:30:53 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 2, aru 0
debug   Jun 05 15:30:53 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:30:53 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 3, aru 0
debug   Jun 05 15:30:53 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:30:53 message_handler_orf_token(3752):13: retrans flag count 4 token aru 0 install seq 0 aru 0 0
debug   Jun 05 15:30:53 old_ring_state_reset(1516):13: Resetting old ring state
debug   Jun 05 15:30:53 deliver_messages_from_recovery_to_regular(1722):13: recovery to regular 1-0
trace   Jun 05 15:30:53 memb_state_operational_enter(1808):13: Delivering to app 6 to 5
trace   Jun 05 15:30:53 votequorum_confchg_fn(1851):6: ENTERING votequorum_confchg_fn()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 votequorum_confchg_fn(1902):6: LEAVING votequorum_confchg_fn()
trace   Jun 05 15:30:53 sync_save_transitional(596):11: ENTERING sync_save_transitional()
debug   Jun 05 15:30:53 totempg_waiting_trans_ack_cb(287):13: waiting_trans_ack changed to 1
debug   Jun 05 15:30:53 member_object_joined(332):2: Member joined: r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) 
trace   Jun 05 15:30:53 votequorum_confchg_fn(1851):6: ENTERING votequorum_confchg_fn()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
notice  Jun 05 15:30:53 log_view_list(132):3: Members[2]: -2090489664 -2073712448
debug   Jun 05 15:30:53 send_library_notification(359):3: sending quorum notification to (nil), length = 56
trace   Jun 05 15:30:53 votequorum_confchg_fn(1902):6: LEAVING votequorum_confchg_fn()
trace   Jun 05 15:30:53 sync_abort(604):11: ENTERING sync_abort()
trace   Jun 05 15:30:53 sync_start(578):11: ENTERING sync_start()
debug   Jun 05 15:30:53 memb_state_operational_enter(1936):13: entering OPERATIONAL state.
notice  Jun 05 15:30:53 memb_state_operational_enter(1940):13: A processor joined or left the membership and a new membership (192.168.101.131:384) was formed.
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 0 to 1
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1 to pending delivery queue
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2221254848
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[2221254848]: votes: 1, expected: 2 flags: 12
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(498):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 allocate_node(439):6: ENTERING allocate_node()
trace   Jun 05 15:30:53 node_add_ordered(413):6: ENTERING node_add_ordered()
trace   Jun 05 15:30:53 node_add_ordered(431):6: LEAVING node_add_ordered()
trace   Jun 05 15:30:53 allocate_node(468):6: LEAVING allocate_node()
trace   Jun 05 15:30:53 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:30:53 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:30:53 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:30:53 recalculate_quorum(841):6: total_votes=2, expected_votes=2
trace   Jun 05 15:30:53 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2221254848 state=1, votes=1, expected=2
trace   Jun 05 15:30:53 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:30:53 are_we_quorate(724):6: ENTERING are_we_quorate()
trace   Jun 05 15:30:53 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:30:53 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:30:53 get_lowest_node_id(507):6: ENTERING get_lowest_node_id()
debug   Jun 05 15:30:53 get_lowest_node_id(518):6: lowest node id: -2090489664 us: -2090489664
trace   Jun 05 15:30:53 get_lowest_node_id(521):6: LEAVING get_lowest_node_id()
debug   Jun 05 15:30:53 are_we_quorate(768):6: quorum regained, resuming activity
trace   Jun 05 15:30:53 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:30:53 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
notice  Jun 05 15:30:53 quorum_api_set_quorum(148):3: This node is within the primary component and will provide service.
notice  Jun 05 15:30:53 log_view_list(132):3: Members[2]: -2090489664 -2073712448
debug   Jun 05 15:30:53 send_library_notification(359):3: sending quorum notification to (nil), length = 56
trace   Jun 05 15:30:53 are_we_quorate(791):6: LEAVING are_we_quorate()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2221254848
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[0]: votes: 0, expected: 0 flags: 0
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(493):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2221254848
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[2221254848]: votes: 1, expected: 2 flags: 4
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(493):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:30:53 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:30:53 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:30:53 recalculate_quorum(841):6: total_votes=2, expected_votes=2
trace   Jun 05 15:30:53 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2221254848 state=1, votes=1, expected=2
trace   Jun 05 15:30:53 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:30:53 are_we_quorate(724):6: ENTERING are_we_quorate()
trace   Jun 05 15:30:53 get_lowest_node_id(507):6: ENTERING get_lowest_node_id()
debug   Jun 05 15:30:53 get_lowest_node_id(518):6: lowest node id: -2090489664 us: -2090489664
trace   Jun 05 15:30:53 get_lowest_node_id(521):6: LEAVING get_lowest_node_id()
trace   Jun 05 15:30:53 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:30:53 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:30:53 are_we_quorate(791):6: LEAVING are_we_quorate()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2221254848
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[0]: votes: 0, expected: 0 flags: 0
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(493):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1
trace   Jun 05 15:30:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 1 to 2
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2 to pending delivery queue
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[2204477632]: votes: 1, expected: 2 flags: 12
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:30:53 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:30:53 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:30:53 recalculate_quorum(841):6: total_votes=2, expected_votes=2
trace   Jun 05 15:30:53 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2221254848 state=1, votes=1, expected=2
trace   Jun 05 15:30:53 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:30:53 are_we_quorate(724):6: ENTERING are_we_quorate()
trace   Jun 05 15:30:53 get_lowest_node_id(507):6: ENTERING get_lowest_node_id()
debug   Jun 05 15:30:53 get_lowest_node_id(518):6: lowest node id: -2090489664 us: -2090489664
trace   Jun 05 15:30:53 get_lowest_node_id(521):6: LEAVING get_lowest_node_id()
trace   Jun 05 15:30:53 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:30:53 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:30:53 are_we_quorate(791):6: LEAVING are_we_quorate()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:30:53 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:30:53 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[0]: votes: 0, expected: 0 flags: 0
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[2204477632]: votes: 1, expected: 2 flags: 4
trace   Jun 05 15:30:53 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:30:53 decode_flags(578):6: flags: quorate: No Leaving: No WFA Status: Yes First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:30:53 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:30:53 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:30:53 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:30:53 recalculate_quorum(841):6: total_votes=2, expected_votes=2
trace   Jun 05 15:30:53 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
debug   Jun 05 15:30:53 calculate_quorum(661):6: node 2221254848 state=1, votes=1, expected=2
trace   Jun 05 15:30:53 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:30:53 are_we_quorate(724):6: ENTERING are_we_quorate()
trace   Jun 05 15:30:53 get_lowest_node_id(507):6: ENTERING get_lowest_node_id()
debug   Jun 05 15:30:53 get_lowest_node_id(518):6: lowest node id: -2090489664 us: -2090489664
trace   Jun 05 15:30:53 get_lowest_node_id(521):6: LEAVING get_lowest_node_id()
trace   Jun 05 15:30:53 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:30:53 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:30:53 are_we_quorate(791):6: LEAVING are_we_quorate()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:30:53 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:30:53 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:30:53 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[0]: votes: 0, expected: 0 flags: 0
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:30:53 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:30:53 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:30:53 cmap_mcast_send(815):9: ENTERING cmap_mcast_send()
trace   Jun 05 15:30:53 cmap_mcast_send(857):9: Item 0 - type 0, len end()zu
trace   Jun 05 15:30:53 cmap_mcast_send(869):9: Sending 1 items (2 iovec) for reason 0
trace   Jun 05 15:30:53 cmap_mcast_send(879):9: LEAVING cmap_mcast_send()
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2
trace   Jun 05 15:30:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:53 messages_free(2463):13: releasing messages up to and including 1
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 2 to 3
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3 to pending delivery queue
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast(954):9: ENTERING message_handler_req_exec_cmap_mcast()
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast_reason_sync_nv(919):9: ENTERING message_handler_req_exec_cmap_mcast_reason_sync_nv()
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast_reason_sync_nv(934):9: Received config version 0 from node 8365a8c0
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast_reason_sync_nv(945):9: LEAVING message_handler_req_exec_cmap_mcast_reason_sync_nv()
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast(971):9: LEAVING message_handler_req_exec_cmap_mcast()
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 3 to 4
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4 to pending delivery queue
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast(954):9: ENTERING message_handler_req_exec_cmap_mcast()
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast_reason_sync_nv(919):9: ENTERING message_handler_req_exec_cmap_mcast_reason_sync_nv()
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast_reason_sync_nv(934):9: Received config version 0 from node 8465a8c0
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast_reason_sync_nv(945):9: LEAVING message_handler_req_exec_cmap_mcast_reason_sync_nv()
trace   Jun 05 15:30:53 message_handler_req_exec_cmap_mcast(971):9: LEAVING message_handler_req_exec_cmap_mcast()
debug   Jun 05 15:30:53 sync_barrier_handler(232):11: Committing synchronization for corosync configuration map access
debug   Jun 05 15:30:53 cmap_sync_activate(400):9: My config version is 0 -> no action
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4
trace   Jun 05 15:30:53 messages_free(2463):13: releasing messages up to and including 2
trace   Jun 05 15:30:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 4 to 5
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5 to pending delivery queue
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 5 to 6
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6 to pending delivery queue
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6
trace   Jun 05 15:30:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:53 messages_free(2463):13: releasing messages up to and including 4
trace   Jun 05 15:30:53 messages_deliver_to_app(3824):13: Delivering 6 to 8
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7 to pending delivery queue
trace   Jun 05 15:30:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 8 to pending delivery queue
debug   Jun 05 15:30:53 downlist_log(776):8: comparing: sender r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ; members(old:1 left:0)
debug   Jun 05 15:30:53 downlist_log(776):8: comparing: sender r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) ; members(old:1 left:0)
debug   Jun 05 15:30:53 downlist_log(776):8: chosen downlist: sender r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ; members(old:1 left:0)
debug   Jun 05 15:30:53 sync_barrier_handler(232):11: Committing synchronization for corosync cluster closed process group service v1.01
notice  Jun 05 15:30:53 corosync_sync_completed(275):2: Completed service synchronization, ready to provide service.
debug   Jun 05 15:30:53 totempg_waiting_trans_ack_cb(287):13: waiting_trans_ack changed to 0
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 8
trace   Jun 05 15:30:53 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 8
trace   Jun 05 15:30:53 messages_free(2463):13: releasing messages up to and including 6
trace   Jun 05 15:30:53 messages_free(2463):13: releasing messages up to and including 8
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4574-24)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4574]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5f770ed0
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4574-25)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4574]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
trace   Jun 05 15:30:54 qb_loop_poll_add(357):5: grown poll array to 14 for FD 25
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5f76b9a0
debug   Jun 05 15:30:54 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4574-25)
debug   Jun 05 15:30:54 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4574-25) state:2
trace   Jun 05 15:30:54 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:54 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:54 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:54 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5f76b9a0
debug   Jun 05 15:30:54 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4574-25-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4574-25-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4574-25-header
debug   Jun 05 15:30:54 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4574-24)
debug   Jun 05 15:30:54 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4574-24) state:2
trace   Jun 05 15:30:54 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:54 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:54 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:54 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5f770ed0
debug   Jun 05 15:30:54 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4574-24-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4574-24-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4574-24-header
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4574-24)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4574]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
trace   Jun 05 15:30:54 cfg_lib_init_fn(449):10: ENTERING cfg_lib_init_fn()
trace   Jun 05 15:30:54 cfg_lib_init_fn(451):10: LEAVING cfg_lib_init_fn()
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4574-25)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4574]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5f76d400, cpd=0x7fab5f771674
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4574-26)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4574]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
trace   Jun 05 15:30:54 qb_loop_poll_add(357):5: grown poll array to 15 for FD 26
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5f76c5c0, cpd=0x7fab5f76cc94
trace   Jun 05 15:30:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering 8 to 9
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 9 to pending delivery queue
debug   Jun 05 15:30:54 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4574
debug   Jun 05 15:30:54 message_handler_req_lib_cpg_finalize(1582):8: cpg finalize for conn=0x7fab5f76c5c0
debug   Jun 05 15:30:54 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4574-26)
debug   Jun 05 15:30:54 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4574-26) state:2
trace   Jun 05 15:30:54 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:54 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:54 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:54 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5f76c5c0
debug   Jun 05 15:30:54 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4574-26-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4574-26-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4574-26-header
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 9
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 9
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4574-26)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4574]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
trace   Jun 05 15:30:54 qb_loop_poll_add(357):5: grown poll array to 16 for FD 26
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5f76c5c0
debug   Jun 05 15:30:54 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4574-26)
debug   Jun 05 15:30:54 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4574-26) state:2
trace   Jun 05 15:30:54 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:54 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:54 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:54 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5f76c5c0
debug   Jun 05 15:30:54 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4574-26-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4574-26-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4574-26-header
trace   Jun 05 15:30:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:30:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:30:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:30:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:30:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:30:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:30:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:30:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq a
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering 9 to a
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a to pending delivery queue
debug   Jun 05 15:30:54 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2073712448 (r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) ) for pid 2467
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq a
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq a
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq a
trace   Jun 05 15:30:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including 9
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering a to c
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b to pending delivery queue
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq b
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq b
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq c
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq c
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq d
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering c to d
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq d
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq d
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq d
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including a
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including d
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq e
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering d to e
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq e
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq e
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq e
trace   Jun 05 15:30:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq f
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering e to f
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq f
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq f
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq f
trace   Jun 05 15:30:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including e
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering f to 10
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 10 to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 10
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 10
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including f
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including 10
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 11
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering 10 to 11
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 11 to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 11
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 11
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 11
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including 11
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 12
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering 11 to 12
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 12 to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 12
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 12
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 12
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including 12
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 13
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering 12 to 13
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 13 to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 13
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 13
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 13
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including 13
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 14
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering 13 to 14
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 14 to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 14
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 14
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 14
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including 14
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 15
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering 14 to 15
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 15 to pending delivery queue
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 15
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 15
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 15
trace   Jun 05 15:30:54 messages_free(2463):13: releasing messages up to and including 15
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4579-26)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4579]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5f76c5c0, cpd=0x7fab5f76cb34
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4577-27)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4577]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fb73090, cpd=0x7fab5fb73764
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4579-28)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4579]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
trace   Jun 05 15:30:54 qb_loop_poll_add(357):5: grown poll array to 17 for FD 28
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fb74a70
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4577-29)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4577]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
trace   Jun 05 15:30:54 qb_loop_poll_add(357):5: grown poll array to 18 for FD 29
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd76f50
debug   Jun 05 15:30:54 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4579-28)
debug   Jun 05 15:30:54 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4579-28) state:2
trace   Jun 05 15:30:54 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:54 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:54 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:54 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fb74a70
debug   Jun 05 15:30:54 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4579-28-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4579-28-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4579-28-header
debug   Jun 05 15:30:54 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4577-29)
debug   Jun 05 15:30:54 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4577-29) state:2
trace   Jun 05 15:30:54 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:54 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:54 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:54 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd76f50
debug   Jun 05 15:30:54 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4577-29-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4577-29-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4577-29-header
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4576-28)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4576]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fb74a70, cpd=0x7fab5fe776f4
debug   Jun 05 15:30:54 handle_new_connection(735):5: IPC credentials authenticated (4555-4576-29)
debug   Jun 05 15:30:54 qb_ipcs_shm_connect(282):5: connecting to client [4576]
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:54 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:54 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd75d70
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 16
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering 15 to 16
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 16 to pending delivery queue
debug   Jun 05 15:30:54 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2073712448 (r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) ) for pid 2472
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 16
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 16
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 16
trace   Jun 05 15:30:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:54 messages_deliver_to_app(3824):13: Delivering 16 to 17
trace   Jun 05 15:30:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 17 to pending delivery queue
debug   Jun 05 15:30:54 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4579
debug   Jun 05 15:30:54 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4577
debug   Jun 05 15:30:54 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4576
debug   Jun 05 15:30:54 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4576-29)
debug   Jun 05 15:30:54 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4576-29) state:2
trace   Jun 05 15:30:54 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:54 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:54 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:54 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd75d70
debug   Jun 05 15:30:54 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4576-29-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4576-29-header
debug   Jun 05 15:30:54 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4576-29-header
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 17
trace   Jun 05 15:30:54 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 17
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 18
trace   Jun 05 15:30:55 messages_deliver_to_app(3824):13: Delivering 17 to 18
trace   Jun 05 15:30:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 18 to pending delivery queue
debug   Jun 05 15:30:55 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2073712448 (r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) ) for pid 2470
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 19
trace   Jun 05 15:30:55 messages_deliver_to_app(3824):13: Delivering 18 to 19
trace   Jun 05 15:30:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 19 to pending delivery queue
debug   Jun 05 15:30:55 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2073712448 (r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) ) for pid 2469
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 18
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 19
trace   Jun 05 15:30:55 messages_free(2463):13: releasing messages up to and including 16
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 18
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 18
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 19
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 19
trace   Jun 05 15:30:55 messages_free(2463):13: releasing messages up to and including 19
warning Jun 05 15:30:55 timer_function_active_problem_decrementer(1330):13: ring 1 active with no faults
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1a
trace   Jun 05 15:30:55 messages_deliver_to_app(3824):13: Delivering 19 to 1a
trace   Jun 05 15:30:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1a to pending delivery queue
debug   Jun 05 15:30:55 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2073712448 (r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) ) for pid 2474
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1a
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1a
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1a
trace   Jun 05 15:30:55 messages_free(2463):13: releasing messages up to and including 1a
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1b
trace   Jun 05 15:30:55 messages_deliver_to_app(3824):13: Delivering 1a to 1b
trace   Jun 05 15:30:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1b to pending delivery queue
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1b
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1b
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1b
trace   Jun 05 15:30:55 messages_free(2463):13: releasing messages up to and including 1b
debug   Jun 05 15:30:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4581-29)
debug   Jun 05 15:30:55 qb_ipcs_shm_connect(282):5: connecting to client [4581]
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:55 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe78e40, cpd=0x7fab5fe79464
trace   Jun 05 15:30:55 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb73090
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1c
trace   Jun 05 15:30:55 messages_deliver_to_app(3824):13: Delivering 1b to 1c
trace   Jun 05 15:30:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1c to pending delivery queue
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1c
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1c
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1c
trace   Jun 05 15:30:55 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:55 messages_deliver_to_app(3824):13: Delivering 1c to 1d
trace   Jun 05 15:30:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1d to pending delivery queue
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1d
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1d
debug   Jun 05 15:30:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4581-30)
debug   Jun 05 15:30:55 qb_ipcs_shm_connect(282):5: connecting to client [4581]
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
trace   Jun 05 15:30:55 qb_loop_poll_add(357):5: grown poll array to 19 for FD 30
debug   Jun 05 15:30:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:55 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7a700
trace   Jun 05 15:30:55 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:55 messages_free(2463):13: releasing messages up to and including 1c
trace   Jun 05 15:30:55 messages_deliver_to_app(3824):13: Delivering 1d to 1e
trace   Jun 05 15:30:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1e to pending delivery queue
debug   Jun 05 15:30:55 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4581
debug   Jun 05 15:30:55 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4581-30)
debug   Jun 05 15:30:55 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4581-30) state:2
trace   Jun 05 15:30:55 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:55 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:55 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:55 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7a700
debug   Jun 05 15:30:55 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4581-30-header
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4581-30-header
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4581-30-header
debug   Jun 05 15:30:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4581-30)
debug   Jun 05 15:30:55 qb_ipcs_shm_connect(282):5: connecting to client [4581]
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:55 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fe7a700
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1e
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1e
debug   Jun 05 15:30:55 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fe7a700
trace   Jun 05 15:30:55 messages_free(2463):13: releasing messages up to and including 1d
debug   Jun 05 15:30:55 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fe7a700
debug   Jun 05 15:30:55 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fe7a700
debug   Jun 05 15:30:55 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fe7a700
debug   Jun 05 15:30:55 send_library_notification(359):3: sending quorum notification to 0x7fab5fe7a700, length = 56
trace   Jun 05 15:30:55 messages_free(2463):13: releasing messages up to and including 1e
debug   Jun 05 15:30:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4581-31)
debug   Jun 05 15:30:55 qb_ipcs_shm_connect(282):5: connecting to client [4581]
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
trace   Jun 05 15:30:55 qb_loop_poll_add(357):5: grown poll array to 20 for FD 31
debug   Jun 05 15:30:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:55 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd797b0
debug   Jun 05 15:30:55 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4581-31)
debug   Jun 05 15:30:55 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4581-31) state:2
trace   Jun 05 15:30:55 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:55 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:55 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:55 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd797b0
debug   Jun 05 15:30:55 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4581-31-header
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4581-31-header
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4581-31-header
debug   Jun 05 15:30:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4581-31)
debug   Jun 05 15:30:55 qb_ipcs_shm_connect(282):5: connecting to client [4581]
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
trace   Jun 05 15:30:55 qb_loop_poll_add(357):5: grown poll array to 21 for FD 31
debug   Jun 05 15:30:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:55 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd797b0
debug   Jun 05 15:30:55 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4581-31)
debug   Jun 05 15:30:55 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4581-31) state:2
trace   Jun 05 15:30:55 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:55 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:55 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:55 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd797b0
debug   Jun 05 15:30:55 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4581-31-header
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4581-31-header
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4581-31-header
debug   Jun 05 15:30:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4581-31)
debug   Jun 05 15:30:55 qb_ipcs_shm_connect(282):5: connecting to client [4581]
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:30:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:30:55 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd797b0
debug   Jun 05 15:30:55 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4581-31)
debug   Jun 05 15:30:55 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4581-31) state:2
trace   Jun 05 15:30:55 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:30:55 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:30:55 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:30:55 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd797b0
debug   Jun 05 15:30:55 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4581-31-header
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4581-31-header
debug   Jun 05 15:30:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4581-31-header
trace   Jun 05 15:30:55 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:30:55 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:55 messages_deliver_to_app(3824):13: Delivering 1e to 1f
trace   Jun 05 15:30:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1f to pending delivery queue
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1f
trace   Jun 05 15:30:55 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 1f
trace   Jun 05 15:30:55 messages_free(2463):13: releasing messages up to and including 1f
trace   Jun 05 15:30:56 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 20
trace   Jun 05 15:30:56 messages_deliver_to_app(3824):13: Delivering 1f to 20
trace   Jun 05 15:30:56 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 20 to pending delivery queue
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 20
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 20
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 20
trace   Jun 05 15:30:56 messages_free(2463):13: releasing messages up to and including 20
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 21
trace   Jun 05 15:30:56 messages_deliver_to_app(3824):13: Delivering 20 to 21
trace   Jun 05 15:30:56 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 21 to pending delivery queue
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 21
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 21
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 21
trace   Jun 05 15:30:56 messages_free(2463):13: releasing messages up to and including 21
trace   Jun 05 15:30:56 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb73090
trace   Jun 05 15:30:56 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:56 messages_deliver_to_app(3824):13: Delivering 21 to 22
trace   Jun 05 15:30:56 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 22 to pending delivery queue
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 22
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 22
trace   Jun 05 15:30:56 messages_free(2463):13: releasing messages up to and including 22
trace   Jun 05 15:30:56 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:30:56 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:30:56 messages_deliver_to_app(3824):13: Delivering 22 to 23
trace   Jun 05 15:30:56 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 23 to pending delivery queue
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 23
trace   Jun 05 15:30:56 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 23
trace   Jun 05 15:30:56 messages_free(2463):13: releasing messages up to and including 23
trace   Jun 05 15:30:59 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:02 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:05 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:08 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:11 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:14 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 24
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 23 to 24
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 24 to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 24
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 24
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 24
trace   Jun 05 15:31:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 24
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 24 to 25
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 25 to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 25
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 25
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 26
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 25 to 26
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 26 to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 26
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 26
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 26
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 25
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 26
trace   Jun 05 15:31:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 26 to 28
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 27 to pending delivery queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 28 to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 27
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 27
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 28
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 28
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 29
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 28 to 29
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 29 to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 29
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 29
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 29
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 28
trace   Jun 05 15:31:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 29
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 29 to 2a
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2a to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2a
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2a
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 2a
trace   Jun 05 15:31:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 2a to 2e
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2b to pending delivery queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2c to pending delivery queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2d to pending delivery queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2e to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2b
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2b
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2c
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2c
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2d
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2d
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2e
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2e
trace   Jun 05 15:31:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 2e to 30
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2f to pending delivery queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 30 to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2f
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 2f
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 30
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 30
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 2e
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 30
trace   Jun 05 15:31:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 30 to 32
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 31 to pending delivery queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 32 to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 31
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 31
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 32
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 32
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 32
trace   Jun 05 15:31:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 32 to 34
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 33 to pending delivery queue
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 34 to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 33
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 33
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 34
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 34
trace   Jun 05 15:31:16 messages_free(2463):13: releasing messages up to and including 34
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 35
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 34 to 35
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 35 to pending delivery queue
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 35
trace   Jun 05 15:31:16 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 36
trace   Jun 05 15:31:16 messages_deliver_to_app(3824):13: Delivering 35 to 36
trace   Jun 05 15:31:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 36 to pending delivery queue
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 36
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 35
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 35
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 36
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 36
trace   Jun 05 15:31:17 messages_free(2463):13: releasing messages up to and including 36
trace   Jun 05 15:31:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3824):13: Delivering 36 to 38
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 37 to pending delivery queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 38 to pending delivery queue
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 37
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 37
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 38
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 38
trace   Jun 05 15:31:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3824):13: Delivering 38 to 39
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 39 to pending delivery queue
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 39
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 39
trace   Jun 05 15:31:17 messages_free(2463):13: releasing messages up to and including 38
trace   Jun 05 15:31:17 messages_free(2463):13: releasing messages up to and including 39
trace   Jun 05 15:31:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3824):13: Delivering 39 to 3b
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3a to pending delivery queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3b to pending delivery queue
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3a
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3a
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3b
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3b
trace   Jun 05 15:31:17 messages_free(2463):13: releasing messages up to and including 3b
trace   Jun 05 15:31:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3824):13: Delivering 3b to 3e
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3c to pending delivery queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3d to pending delivery queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3e to pending delivery queue
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3c
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3c
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3d
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3d
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3e
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3e
trace   Jun 05 15:31:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3824):13: Delivering 3e to 40
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3f to pending delivery queue
trace   Jun 05 15:31:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 40 to pending delivery queue
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3f
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 3f
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 40
trace   Jun 05 15:31:17 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 40
trace   Jun 05 15:31:17 messages_free(2463):13: releasing messages up to and including 3e
trace   Jun 05 15:31:17 messages_free(2463):13: releasing messages up to and including 40
trace   Jun 05 15:31:17 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 41
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 40 to 41
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 41 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 41
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 42
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 41 to 42
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 42 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 41
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 42
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 42
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 41
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 42
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 42 to 45
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 43 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 44 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 45 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 43
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 43
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 44
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 44
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 45
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 45
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 42
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 45 to 48
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 46 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 47 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 48 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 46
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 46
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 47
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 47
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 48
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 48
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 45
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 48
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 48 to 4b
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 49 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4a to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4b to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 49
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 49
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4a
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4a
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4b
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4b
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 4b
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 4b to 4e
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4c to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4d to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4e to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4c
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4c
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4d
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4d
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4e
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4e
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 4e
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 4e to 4f
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4f to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4f
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 4f
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 4f
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 4f to 51
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 50 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 51 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 50
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 50
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 51
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 51
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 51
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 52
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 51 to 52
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 52 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 52
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 53
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 52 to 53
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 53 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 53
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 52
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 52
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 53
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 53
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 53 to 56
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 54 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 55 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 56 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 54
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 54
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 55
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 55
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 56
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 56
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 53
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 56
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 57
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 56 to 57
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 57 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 57
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 58
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 57 to 58
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 58 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 58
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 57
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 58
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 57
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 58
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 58
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 58 to 5d
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 59 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5a to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5b to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5c to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5d to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 59
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 59
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5a
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5a
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5b
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5b
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5c
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5c
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5d
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5d
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 5d
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5e
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 5d to 5e
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5e to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5e
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5f
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 5e to 5f
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5f to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5e
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5f
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5f
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5e
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 5f
trace   Jun 05 15:31:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 5f
trace   Jun 05 15:31:18 messages_deliver_to_app(3824):13: Delivering 5f to 61
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 60 to pending delivery queue
trace   Jun 05 15:31:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 61 to pending delivery queue
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 60
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 60
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 61
trace   Jun 05 15:31:18 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 61
trace   Jun 05 15:31:18 messages_free(2463):13: releasing messages up to and including 61
trace   Jun 05 15:31:19 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:19 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:19 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:19 messages_deliver_to_app(3824):13: Delivering 61 to 63
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 62 to pending delivery queue
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 63 to pending delivery queue
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 62
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 62
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 63
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 63
trace   Jun 05 15:31:19 messages_free(2463):13: releasing messages up to and including 63
trace   Jun 05 15:31:19 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:19 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:19 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 64
trace   Jun 05 15:31:19 messages_deliver_to_app(3824):13: Delivering 63 to 64
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 64 to pending delivery queue
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 64
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 65
trace   Jun 05 15:31:19 messages_deliver_to_app(3824):13: Delivering 64 to 65
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 65 to pending delivery queue
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 64
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 65
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 65
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 64
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 65
trace   Jun 05 15:31:19 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:19 messages_deliver_to_app(3824):13: Delivering 65 to 68
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 66 to pending delivery queue
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 67 to pending delivery queue
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 68 to pending delivery queue
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 66
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 66
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 67
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 67
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 68
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 68
trace   Jun 05 15:31:19 messages_free(2463):13: releasing messages up to and including 65
trace   Jun 05 15:31:19 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:19 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:19 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:19 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:19 messages_free(2463):13: releasing messages up to and including 68
trace   Jun 05 15:31:19 messages_deliver_to_app(3824):13: Delivering 68 to 6b
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 69 to pending delivery queue
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6a to pending delivery queue
trace   Jun 05 15:31:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6b to pending delivery queue
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 69
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 69
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6a
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6a
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6b
trace   Jun 05 15:31:19 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6b
trace   Jun 05 15:31:19 messages_free(2463):13: releasing messages up to and including 6b
trace   Jun 05 15:31:20 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:21 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:21 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:21 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:21 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:21 messages_deliver_to_app(3824):13: Delivering 6b to 6e
trace   Jun 05 15:31:21 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6c to pending delivery queue
trace   Jun 05 15:31:21 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6d to pending delivery queue
trace   Jun 05 15:31:21 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6e to pending delivery queue
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6c
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6c
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6d
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6d
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6e
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6e
trace   Jun 05 15:31:21 messages_free(2463):13: releasing messages up to and including 6e
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6f
trace   Jun 05 15:31:21 messages_deliver_to_app(3824):13: Delivering 6e to 6f
trace   Jun 05 15:31:21 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6f to pending delivery queue
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6f
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 70
trace   Jun 05 15:31:21 messages_deliver_to_app(3824):13: Delivering 6f to 70
trace   Jun 05 15:31:21 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 70 to pending delivery queue
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 70
trace   Jun 05 15:31:21 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:21 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:21 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:21 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:21 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6f
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 6f
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 70
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 70
trace   Jun 05 15:31:21 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:21 messages_deliver_to_app(3824):13: Delivering 70 to 74
trace   Jun 05 15:31:21 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 71 to pending delivery queue
trace   Jun 05 15:31:21 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 72 to pending delivery queue
trace   Jun 05 15:31:21 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 73 to pending delivery queue
trace   Jun 05 15:31:21 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 74 to pending delivery queue
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 71
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 71
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 72
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 73
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 72
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 74
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 73
trace   Jun 05 15:31:21 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 74
trace   Jun 05 15:31:21 messages_free(2463):13: releasing messages up to and including 70
trace   Jun 05 15:31:21 messages_free(2463):13: releasing messages up to and including 74
trace   Jun 05 15:31:23 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:23 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:23 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:23 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:23 messages_deliver_to_app(3824):13: Delivering 74 to 77
trace   Jun 05 15:31:23 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 75 to pending delivery queue
trace   Jun 05 15:31:23 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 76 to pending delivery queue
trace   Jun 05 15:31:23 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 77 to pending delivery queue
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 75
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 75
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 76
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 76
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 77
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 77
trace   Jun 05 15:31:23 messages_free(2463):13: releasing messages up to and including 77
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 78
trace   Jun 05 15:31:23 messages_deliver_to_app(3824):13: Delivering 77 to 78
trace   Jun 05 15:31:23 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 78 to pending delivery queue
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 78
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 79
trace   Jun 05 15:31:23 messages_deliver_to_app(3824):13: Delivering 78 to 79
trace   Jun 05 15:31:23 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 79 to pending delivery queue
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 78
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 79
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 79
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 78
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 79
trace   Jun 05 15:31:23 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:23 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:23 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:23 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:23 messages_free(2463):13: releasing messages up to and including 79
trace   Jun 05 15:31:23 messages_deliver_to_app(3824):13: Delivering 79 to 7c
trace   Jun 05 15:31:23 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7a to pending delivery queue
trace   Jun 05 15:31:23 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7b to pending delivery queue
trace   Jun 05 15:31:23 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7c to pending delivery queue
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7a
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7a
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7b
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7b
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7c
trace   Jun 05 15:31:23 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7c
trace   Jun 05 15:31:23 messages_free(2463):13: releasing messages up to and including 7c
trace   Jun 05 15:31:23 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:26 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3824):13: Delivering 7c to 7d
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7d to pending delivery queue
trace   Jun 05 15:31:26 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7d
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7d
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3824):13: Delivering 7d to 7f
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7e to pending delivery queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7f to pending delivery queue
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7e
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7e
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7f
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 7f
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 80
trace   Jun 05 15:31:26 messages_deliver_to_app(3824):13: Delivering 7f to 80
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 80 to pending delivery queue
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 80
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 81
trace   Jun 05 15:31:26 messages_deliver_to_app(3824):13: Delivering 80 to 81
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 81 to pending delivery queue
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 80
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 81
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 81
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 80
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 81
trace   Jun 05 15:31:26 messages_free(2463):13: releasing messages up to and including 7d
trace   Jun 05 15:31:26 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 messages_free(2463):13: releasing messages up to and including 81
trace   Jun 05 15:31:26 messages_deliver_to_app(3824):13: Delivering 81 to 83
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 82 to pending delivery queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 83 to pending delivery queue
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 82
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 82
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 83
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 83
trace   Jun 05 15:31:26 messages_free(2463):13: releasing messages up to and including 83
trace   Jun 05 15:31:26 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3824):13: Delivering 83 to 86
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 84 to pending delivery queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 85 to pending delivery queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 86 to pending delivery queue
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 84
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 84
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 85
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 85
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 86
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 86
trace   Jun 05 15:31:26 messages_free(2463):13: releasing messages up to and including 86
trace   Jun 05 15:31:26 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3824):13: Delivering 86 to 89
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 87 to pending delivery queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 88 to pending delivery queue
trace   Jun 05 15:31:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 89 to pending delivery queue
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 87
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 87
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 88
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 88
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 89
trace   Jun 05 15:31:26 message_handler_mcast(3985):13: Received ringid(192.168.101.131:384) seq 89
trace   Jun 05 15:31:26 messages_free(2463):13: releasing messages up to and including 89
trace   Jun 05 15:31:26 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:29 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:32 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:35 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:38 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:41 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:31:42 timer_function_orf_token_timeout(1637):13: The token was lost in the OPERATIONAL state.
notice  Jun 05 15:31:42 timer_function_orf_token_timeout(1639):13: A processor failed, forming new configuration.
debug   Jun 05 15:31:42 totemudp_build_sockets_ip(905):13: Receive multicast socket recv buffer size (320000 bytes).
debug   Jun 05 15:31:42 totemudp_build_sockets_ip(911):13: Transmit multicast socket send buffer size (320000 bytes).
debug   Jun 05 15:31:42 totemudp_build_sockets_ip(917):13: Local receive multicast loop socket recv buffer size (320000 bytes).
debug   Jun 05 15:31:42 totemudp_build_sockets_ip(923):13: Local transmit multicast loop socket send buffer size (320000 bytes).
trace   Jun 05 15:31:42 qb_loop_poll_add(357):5: grown poll array to 22 for FD 13
debug   Jun 05 15:31:42 totemudp_build_sockets_ip(905):13: Receive multicast socket recv buffer size (320000 bytes).
debug   Jun 05 15:31:42 totemudp_build_sockets_ip(911):13: Transmit multicast socket send buffer size (320000 bytes).
debug   Jun 05 15:31:42 totemudp_build_sockets_ip(917):13: Local receive multicast loop socket recv buffer size (320000 bytes).
debug   Jun 05 15:31:42 totemudp_build_sockets_ip(923):13: Local transmit multicast loop socket send buffer size (320000 bytes).
trace   Jun 05 15:31:42 qb_loop_poll_add(357):5: grown poll array to 23 for FD 19
trace   Jun 05 15:31:42 qb_loop_poll_add(357):5: grown poll array to 24 for FD 20
trace   Jun 05 15:31:42 qb_loop_poll_add(357):5: grown poll array to 25 for FD 23
debug   Jun 05 15:31:42 memb_state_gather_enter(2010):13: entering GATHER state from 2.
debug   Jun 05 15:31:43 memb_state_gather_enter(2010):13: entering GATHER state from 0.
debug   Jun 05 15:31:43 memb_state_commit_token_create(3061):13: Creating commit token because I am the rep.
debug   Jun 05 15:31:43 old_ring_state_save(1500):13: Saving state aru 89 high seq received 89
debug   Jun 05 15:31:43 memb_ring_id_set_and_store(3306):13: Storing new sequence id for ring 184
debug   Jun 05 15:31:43 memb_state_commit_enter(2058):13: entering COMMIT state.
debug   Jun 05 15:31:43 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:31:43 memb_state_recovery_enter(2095):13: entering RECOVERY state.
debug   Jun 05 15:31:43 memb_state_recovery_enter(2137):13: TRANS [0] member 192.168.101.131:
debug   Jun 05 15:31:43 memb_state_recovery_enter(2141):13: position [0] member 192.168.101.131:
debug   Jun 05 15:31:43 memb_state_recovery_enter(2145):13: previous ring seq 180 rep 192.168.101.131
debug   Jun 05 15:31:43 memb_state_recovery_enter(2151):13: aru 89 high delivered 89 received flag 1
debug   Jun 05 15:31:43 memb_state_recovery_enter(2249):13: Did not need to originate any messages in recovery.
debug   Jun 05 15:31:43 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:31:43 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:31:43 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:31:43 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:31:43 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:31:43 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:31:43 message_handler_memb_commit_token(4407):13: got commit token
debug   Jun 05 15:31:43 message_handler_memb_commit_token(4460):13: Sending initial ORF token
debug   Jun 05 15:31:43 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 0, aru 0
debug   Jun 05 15:31:43 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:31:43 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 1, aru 0
debug   Jun 05 15:31:43 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:31:43 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 2, aru 0
debug   Jun 05 15:31:43 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:31:43 message_handler_orf_token(3722):13: token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 3, aru 0
debug   Jun 05 15:31:43 message_handler_orf_token(3733):13: install seq 0 aru 0 high seq received 0
debug   Jun 05 15:31:43 message_handler_orf_token(3752):13: retrans flag count 4 token aru 0 install seq 0 aru 0 0
debug   Jun 05 15:31:43 old_ring_state_reset(1516):13: Resetting old ring state
debug   Jun 05 15:31:43 deliver_messages_from_recovery_to_regular(1722):13: recovery to regular 1-0
trace   Jun 05 15:31:43 memb_state_operational_enter(1808):13: Delivering to app 8a to 89
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 2
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 2
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 2
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 2
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 2
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 2
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 2
debug   Jun 05 15:31:43 member_object_left(344):2: Member left: r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) 
trace   Jun 05 15:31:43 votequorum_confchg_fn(1851):6: ENTERING votequorum_confchg_fn()
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(493):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:31:43 decode_flags(578):6: flags: quorate: Yes Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:31:43 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:31:43 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:31:43 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:31:43 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:31:43 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:31:43 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:31:43 recalculate_quorum(841):6: total_votes=1, expected_votes=2
trace   Jun 05 15:31:43 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:31:43 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
debug   Jun 05 15:31:43 calculate_quorum(661):6: node 2221254848 state=2, votes=1, expected=2
trace   Jun 05 15:31:43 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:31:43 are_we_quorate(724):6: ENTERING are_we_quorate()
trace   Jun 05 15:31:43 get_lowest_node_id(507):6: ENTERING get_lowest_node_id()
debug   Jun 05 15:31:43 get_lowest_node_id(518):6: lowest node id: -2090489664 us: -2090489664
trace   Jun 05 15:31:43 get_lowest_node_id(521):6: LEAVING get_lowest_node_id()
trace   Jun 05 15:31:43 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:31:43 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:31:43 are_we_quorate(791):6: LEAVING are_we_quorate()
trace   Jun 05 15:31:43 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:31:43 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:31:43 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:31:43 votequorum_confchg_fn(1902):6: LEAVING votequorum_confchg_fn()
trace   Jun 05 15:31:43 sync_save_transitional(596):11: ENTERING sync_save_transitional()
debug   Jun 05 15:31:43 totempg_waiting_trans_ack_cb(287):13: waiting_trans_ack changed to 1
trace   Jun 05 15:31:43 votequorum_confchg_fn(1851):6: ENTERING votequorum_confchg_fn()
trace   Jun 05 15:31:43 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:31:43 decode_flags(578):6: flags: quorate: Yes Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:31:43 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:31:43 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:31:43 votequorum_exec_send_nodeinfo(1266):6: ENTERING votequorum_exec_send_nodeinfo()
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 votequorum_exec_send_nodeinfo(1289):6: LEAVING votequorum_exec_send_nodeinfo()
notice  Jun 05 15:31:43 log_view_list(132):3: Members[1]: -2090489664
debug   Jun 05 15:31:43 send_library_notification(359):3: sending quorum notification to (nil), length = 52
trace   Jun 05 15:31:43 votequorum_confchg_fn(1902):6: LEAVING votequorum_confchg_fn()
trace   Jun 05 15:31:43 sync_abort(604):11: ENTERING sync_abort()
trace   Jun 05 15:31:43 sync_start(578):11: ENTERING sync_start()
debug   Jun 05 15:31:43 memb_state_operational_enter(1936):13: entering OPERATIONAL state.
notice  Jun 05 15:31:43 memb_state_operational_enter(1940):13: A processor joined or left the membership and a new membership (192.168.101.131:388) was formed.
trace   Jun 05 15:31:43 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:43 messages_deliver_to_app(3824):13: Delivering 0 to 1
trace   Jun 05 15:31:43 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1 to pending delivery queue
trace   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[2204477632]: votes: 1, expected: 2 flags: 1
trace   Jun 05 15:31:43 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:31:43 decode_flags(578):6: flags: quorate: Yes Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:31:43 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:31:43 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:31:43 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:31:43 recalculate_quorum(841):6: total_votes=1, expected_votes=2
trace   Jun 05 15:31:43 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:31:43 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
debug   Jun 05 15:31:43 calculate_quorum(661):6: node 2221254848 state=2, votes=1, expected=2
trace   Jun 05 15:31:43 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:31:43 are_we_quorate(724):6: ENTERING are_we_quorate()
trace   Jun 05 15:31:43 get_lowest_node_id(507):6: ENTERING get_lowest_node_id()
debug   Jun 05 15:31:43 get_lowest_node_id(518):6: lowest node id: -2090489664 us: -2090489664
trace   Jun 05 15:31:43 get_lowest_node_id(521):6: LEAVING get_lowest_node_id()
trace   Jun 05 15:31:43 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:31:43 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:31:43 are_we_quorate(791):6: LEAVING are_we_quorate()
trace   Jun 05 15:31:43 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:31:43 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:31:43 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:31:43 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:31:43 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[0]: votes: 0, expected: 0 flags: 0
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[2204477632]: votes: 1, expected: 2 flags: 1
trace   Jun 05 15:31:43 decode_flags(567):6: ENTERING decode_flags()
debug   Jun 05 15:31:43 decode_flags(578):6: flags: quorate: Yes Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
trace   Jun 05 15:31:43 decode_flags(580):6: LEAVING decode_flags()
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 recalculate_quorum(830):6: ENTERING recalculate_quorum()
trace   Jun 05 15:31:43 get_total_votes(801):6: ENTERING get_total_votes()
trace   Jun 05 15:31:43 get_total_votes(819):6: LEAVING get_total_votes()
debug   Jun 05 15:31:43 recalculate_quorum(841):6: total_votes=1, expected_votes=2
trace   Jun 05 15:31:43 calculate_quorum(651):6: ENTERING calculate_quorum()
debug   Jun 05 15:31:43 calculate_quorum(661):6: node 2204477632 state=1, votes=1, expected=2
debug   Jun 05 15:31:43 calculate_quorum(661):6: node 2221254848 state=2, votes=1, expected=2
trace   Jun 05 15:31:43 calculate_quorum(715):6: LEAVING calculate_quorum()
trace   Jun 05 15:31:43 are_we_quorate(724):6: ENTERING are_we_quorate()
trace   Jun 05 15:31:43 get_lowest_node_id(507):6: ENTERING get_lowest_node_id()
debug   Jun 05 15:31:43 get_lowest_node_id(518):6: lowest node id: -2090489664 us: -2090489664
trace   Jun 05 15:31:43 get_lowest_node_id(521):6: LEAVING get_lowest_node_id()
trace   Jun 05 15:31:43 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:31:43 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:31:43 are_we_quorate(791):6: LEAVING are_we_quorate()
trace   Jun 05 15:31:43 votequorum_exec_send_quorum_notification(1347):6: ENTERING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:31:43 votequorum_exec_send_quorum_notification(1391):6: LEAVING votequorum_exec_send_quorum_notification()
trace   Jun 05 15:31:43 recalculate_quorum(852):6: LEAVING recalculate_quorum()
trace   Jun 05 15:31:43 update_wait_for_all_status(585):6: ENTERING update_wait_for_all_status()
trace   Jun 05 15:31:43 update_wait_for_all_status(596):6: LEAVING update_wait_for_all_status()
trace   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1589):6: ENTERING message_handler_req_exec_votequorum_nodeinfo()
debug   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1591):6: got nodeinfo message from cluster node 2204477632
debug   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1596):6: nodeinfo message[0]: votes: 0, expected: 0 flags: 0
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(486):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(478):6: ENTERING find_node_by_nodeid()
trace   Jun 05 15:31:43 find_node_by_nodeid(481):6: LEAVING find_node_by_nodeid()
trace   Jun 05 15:31:43 message_handler_req_exec_votequorum_nodeinfo(1687):6: LEAVING message_handler_req_exec_votequorum_nodeinfo()
trace   Jun 05 15:31:43 cmap_mcast_send(815):9: ENTERING cmap_mcast_send()
trace   Jun 05 15:31:43 cmap_mcast_send(857):9: Item 0 - type 0, len end()zu
trace   Jun 05 15:31:43 cmap_mcast_send(869):9: Sending 1 items (2 iovec) for reason 0
trace   Jun 05 15:31:43 cmap_mcast_send(879):9: LEAVING cmap_mcast_send()
trace   Jun 05 15:31:43 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:43 messages_deliver_to_app(3824):13: Delivering 1 to 2
trace   Jun 05 15:31:43 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2 to pending delivery queue
trace   Jun 05 15:31:43 message_handler_req_exec_cmap_mcast(954):9: ENTERING message_handler_req_exec_cmap_mcast()
trace   Jun 05 15:31:43 message_handler_req_exec_cmap_mcast_reason_sync_nv(919):9: ENTERING message_handler_req_exec_cmap_mcast_reason_sync_nv()
trace   Jun 05 15:31:43 message_handler_req_exec_cmap_mcast_reason_sync_nv(934):9: Received config version 0 from node 8365a8c0
trace   Jun 05 15:31:43 message_handler_req_exec_cmap_mcast_reason_sync_nv(945):9: LEAVING message_handler_req_exec_cmap_mcast_reason_sync_nv()
trace   Jun 05 15:31:43 message_handler_req_exec_cmap_mcast(971):9: LEAVING message_handler_req_exec_cmap_mcast()
debug   Jun 05 15:31:43 sync_barrier_handler(232):11: Committing synchronization for corosync configuration map access
debug   Jun 05 15:31:43 cmap_sync_activate(394):9: Not first sync -> no action
trace   Jun 05 15:31:43 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:43 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:43 messages_free(2463):13: releasing messages up to and including 1
trace   Jun 05 15:31:43 messages_deliver_to_app(3824):13: Delivering 2 to 4
trace   Jun 05 15:31:43 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3 to pending delivery queue
trace   Jun 05 15:31:43 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4 to pending delivery queue
debug   Jun 05 15:31:43 downlist_log(776):8: comparing: sender r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ; members(old:2 left:1)
debug   Jun 05 15:31:43 downlist_log(776):8: chosen downlist: sender r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ; members(old:2 left:1)
debug   Jun 05 15:31:43 downlist_master_choose_and_send(907):8: left_list_entries:1
debug   Jun 05 15:31:43 downlist_master_choose_and_send(912):8: left_list[0] group:attrd\x00, ip:r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) , pid:2472
debug   Jun 05 15:31:43 downlist_master_choose_and_send(907):8: left_list_entries:1
debug   Jun 05 15:31:43 downlist_master_choose_and_send(912):8: left_list[0] group:cib\x00, ip:r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) , pid:2469
debug   Jun 05 15:31:43 downlist_master_choose_and_send(907):8: left_list_entries:1
debug   Jun 05 15:31:43 downlist_master_choose_and_send(912):8: left_list[0] group:crmd\x00, ip:r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) , pid:2474
debug   Jun 05 15:31:43 downlist_master_choose_and_send(907):8: left_list_entries:1
debug   Jun 05 15:31:43 downlist_master_choose_and_send(912):8: left_list[0] group:pcmk\x00, ip:r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) , pid:2467
debug   Jun 05 15:31:43 downlist_master_choose_and_send(907):8: left_list_entries:1
debug   Jun 05 15:31:43 downlist_master_choose_and_send(912):8: left_list[0] group:stonith-ng\x00, ip:r(0) ip(192.168.101.132) r(1) ip(192.168.102.132) , pid:2470
debug   Jun 05 15:31:43 message_handler_req_exec_cpg_joinlist(1311):8: got joinlist message from node 8365a8c0
debug   Jun 05 15:31:43 sync_barrier_handler(232):11: Committing synchronization for corosync cluster closed process group service v1.01
debug   Jun 05 15:31:43 joinlist_inform_clients(944):8: joinlist_messages[0] group:crmd\x00, ip:r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) , pid:4581
debug   Jun 05 15:31:43 joinlist_inform_clients(944):8: joinlist_messages[1] group:attrd\x00, ip:r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) , pid:4579
debug   Jun 05 15:31:43 joinlist_inform_clients(944):8: joinlist_messages[2] group:stonith-ng\x00, ip:r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) , pid:4577
debug   Jun 05 15:31:43 joinlist_inform_clients(944):8: joinlist_messages[3] group:cib\x00, ip:r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) , pid:4576
debug   Jun 05 15:31:43 joinlist_inform_clients(944):8: joinlist_messages[4] group:pcmk\x00, ip:r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) , pid:4574
notice  Jun 05 15:31:43 corosync_sync_completed(275):2: Completed service synchronization, ready to provide service.
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 0
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 0
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 0
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 0
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 0
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 0
trace   Jun 05 15:31:43 qb_ipc_shm_fc_set(133):5: setting fc to 0
debug   Jun 05 15:31:43 totempg_waiting_trans_ack_cb(287):13: waiting_trans_ack changed to 0
trace   Jun 05 15:31:43 messages_free(2463):13: releasing messages up to and including 2
trace   Jun 05 15:31:43 messages_free(2463):13: releasing messages up to and including 4
trace   Jun 05 15:31:43 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:43 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:43 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:43 messages_deliver_to_app(3824):13: Delivering 4 to 6
trace   Jun 05 15:31:43 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5 to pending delivery queue
trace   Jun 05 15:31:43 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6 to pending delivery queue
trace   Jun 05 15:31:43 messages_free(2463):13: releasing messages up to and including 6
trace   Jun 05 15:31:43 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb73090
trace   Jun 05 15:31:43 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:43 messages_deliver_to_app(3824):13: Delivering 6 to 7
trace   Jun 05 15:31:43 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7 to pending delivery queue
trace   Jun 05 15:31:43 messages_free(2463):13: releasing messages up to and including 7
trace   Jun 05 15:31:44 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78e40
trace   Jun 05 15:31:44 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:31:44 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:44 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:44 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:44 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:31:44 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:44 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:31:44 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:44 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:44 messages_deliver_to_app(3824):13: Delivering 7 to c
trace   Jun 05 15:31:44 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 8 to pending delivery queue
trace   Jun 05 15:31:44 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 9 to pending delivery queue
trace   Jun 05 15:31:44 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a to pending delivery queue
trace   Jun 05 15:31:44 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b to pending delivery queue
trace   Jun 05 15:31:44 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c to pending delivery queue
trace   Jun 05 15:31:44 messages_free(2463):13: releasing messages up to and including c
trace   Jun 05 15:31:44 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:31:44 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:44 messages_deliver_to_app(3824):13: Delivering c to d
trace   Jun 05 15:31:44 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d to pending delivery queue
trace   Jun 05 15:31:44 messages_free(2463):13: releasing messages up to and including d
trace   Jun 05 15:31:44 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:31:47 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4581-29)
debug   Jun 05 15:31:47 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4581-29) state:2
trace   Jun 05 15:31:47 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:31:47 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:31:47 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:31:47 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe78e40
debug   Jun 05 15:31:47 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4581-29-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4581-29-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4581-29-header
debug   Jun 05 15:31:47 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4581-30)
debug   Jun 05 15:31:47 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4581-30) state:2
trace   Jun 05 15:31:47 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:31:47 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:31:47 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:31:47 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fe7a700
debug   Jun 05 15:31:47 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4581-30-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4581-30-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4581-30-header
trace   Jun 05 15:31:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:47 messages_deliver_to_app(3824):13: Delivering d to e
trace   Jun 05 15:31:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e to pending delivery queue
debug   Jun 05 15:31:47 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:31:47 messages_free(2463):13: releasing messages up to and including e
trace   Jun 05 15:31:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:31:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:31:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:47 messages_deliver_to_app(3824):13: Delivering e to f
trace   Jun 05 15:31:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f to pending delivery queue
trace   Jun 05 15:31:47 messages_free(2463):13: releasing messages up to and including f
debug   Jun 05 15:31:47 handle_new_connection(735):5: IPC credentials authenticated (4555-4753-29)
debug   Jun 05 15:31:47 qb_ipcs_shm_connect(282):5: connecting to client [4753]
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:31:47 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe79ab0, cpd=0x7fab5fd796b4
debug   Jun 05 15:31:47 handle_new_connection(735):5: IPC credentials authenticated (4555-4753-30)
debug   Jun 05 15:31:47 qb_ipcs_shm_connect(282):5: connecting to client [4753]
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:31:47 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
trace   Jun 05 15:31:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:47 messages_deliver_to_app(3824):13: Delivering f to 10
trace   Jun 05 15:31:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 10 to pending delivery queue
debug   Jun 05 15:31:47 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4753
debug   Jun 05 15:31:47 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4753-30)
debug   Jun 05 15:31:47 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4753-30) state:2
trace   Jun 05 15:31:47 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:31:47 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:31:47 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:31:47 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:31:47 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4753-30-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4753-30-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4753-30-header
debug   Jun 05 15:31:47 handle_new_connection(735):5: IPC credentials authenticated (4555-4753-30)
debug   Jun 05 15:31:47 qb_ipcs_shm_connect(282):5: connecting to client [4753]
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:31:47 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:31:47 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fe78d10
debug   Jun 05 15:31:47 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fe78d10
debug   Jun 05 15:31:47 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fe78d10
debug   Jun 05 15:31:47 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fe78d10
debug   Jun 05 15:31:47 send_library_notification(359):3: sending quorum notification to 0x7fab5fe78d10, length = 52
trace   Jun 05 15:31:47 messages_free(2463):13: releasing messages up to and including 10
debug   Jun 05 15:31:47 handle_new_connection(735):5: IPC credentials authenticated (4555-4753-31)
debug   Jun 05 15:31:47 qb_ipcs_shm_connect(282):5: connecting to client [4753]
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:31:47 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7b6d0
debug   Jun 05 15:31:47 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4753-31)
debug   Jun 05 15:31:47 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4753-31) state:2
trace   Jun 05 15:31:47 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:31:47 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:31:47 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:31:47 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7b6d0
debug   Jun 05 15:31:47 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4753-31-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4753-31-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4753-31-header
debug   Jun 05 15:31:47 handle_new_connection(735):5: IPC credentials authenticated (4555-4753-31)
debug   Jun 05 15:31:47 qb_ipcs_shm_connect(282):5: connecting to client [4753]
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:31:47 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:31:47 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7cce0
debug   Jun 05 15:31:47 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4753-31)
debug   Jun 05 15:31:47 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4753-31) state:2
trace   Jun 05 15:31:47 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:31:47 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:31:47 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:31:47 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7cce0
debug   Jun 05 15:31:47 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4753-31-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4753-31-header
debug   Jun 05 15:31:47 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4753-31-header
trace   Jun 05 15:31:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:31:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:47 messages_deliver_to_app(3824):13: Delivering 10 to 11
trace   Jun 05 15:31:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 11 to pending delivery queue
trace   Jun 05 15:31:47 messages_free(2463):13: releasing messages up to and including 11
trace   Jun 05 15:31:47 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:48 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:31:48 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:31:48 messages_deliver_to_app(3824):13: Delivering 11 to 12
trace   Jun 05 15:31:48 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 12 to pending delivery queue
trace   Jun 05 15:31:48 messages_free(2463):13: releasing messages up to and including 12
trace   Jun 05 15:31:50 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:53 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:56 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:31:59 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:02 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:05 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 12 to 13
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 13 to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 13
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 13 to 14
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 14 to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 14
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 14 to 15
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 15 to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 15
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 15 to 1d
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 16 to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 17 to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 18 to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 19 to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1a to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1b to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1c to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1d to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 1d
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 1d to 1e
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1e to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 1e
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 1e to 20
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 1f to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 20 to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 20
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 20 to 22
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 21 to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 22 to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 22
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 22 to 26
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 23 to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 24 to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 25 to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 26 to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 26
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 26 to 28
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 27 to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 28 to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 28
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 28 to 29
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 29 to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 29
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 29 to 2a
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2a to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 2a
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 2a to 2c
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2b to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2c to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 2c
trace   Jun 05 15:32:08 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3824):13: Delivering 2c to 2e
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2d to pending delivery queue
trace   Jun 05 15:32:08 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2e to pending delivery queue
trace   Jun 05 15:32:08 messages_free(2463):13: releasing messages up to and including 2e
trace   Jun 05 15:32:08 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:32:09 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4753-29)
debug   Jun 05 15:32:09 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4753-29) state:2
trace   Jun 05 15:32:09 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:09 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:09 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:09 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe79ab0
debug   Jun 05 15:32:09 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4753-29-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4753-29-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4753-29-header
debug   Jun 05 15:32:09 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4753-30)
debug   Jun 05 15:32:09 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4753-30) state:2
trace   Jun 05 15:32:09 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:09 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:09 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:09 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:32:09 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4753-30-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4753-30-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4753-30-header
trace   Jun 05 15:32:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:32:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:32:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:09 messages_deliver_to_app(3824):13: Delivering 2e to 2f
trace   Jun 05 15:32:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 2f to pending delivery queue
debug   Jun 05 15:32:09 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:32:09 messages_free(2463):13: releasing messages up to and including 2f
debug   Jun 05 15:32:09 handle_new_connection(735):5: IPC credentials authenticated (4555-4764-29)
debug   Jun 05 15:32:09 qb_ipcs_shm_connect(282):5: connecting to client [4764]
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:09 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe79ab0, cpd=0x7fab5fd78584
debug   Jun 05 15:32:09 handle_new_connection(735):5: IPC credentials authenticated (4555-4764-30)
debug   Jun 05 15:32:09 qb_ipcs_shm_connect(282):5: connecting to client [4764]
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:09 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
trace   Jun 05 15:32:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:09 messages_deliver_to_app(3824):13: Delivering 2f to 30
trace   Jun 05 15:32:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 30 to pending delivery queue
debug   Jun 05 15:32:09 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4764
debug   Jun 05 15:32:09 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4764-30)
debug   Jun 05 15:32:09 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4764-30) state:2
trace   Jun 05 15:32:09 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:09 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:09 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:09 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:32:09 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4764-30-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4764-30-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4764-30-header
debug   Jun 05 15:32:09 handle_new_connection(735):5: IPC credentials authenticated (4555-4764-30)
debug   Jun 05 15:32:09 qb_ipcs_shm_connect(282):5: connecting to client [4764]
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:09 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:32:09 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fe78d10
debug   Jun 05 15:32:09 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fe78d10
debug   Jun 05 15:32:09 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fe78d10
debug   Jun 05 15:32:09 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fe78d10
debug   Jun 05 15:32:09 send_library_notification(359):3: sending quorum notification to 0x7fab5fe78d10, length = 52
trace   Jun 05 15:32:09 messages_free(2463):13: releasing messages up to and including 30
debug   Jun 05 15:32:09 handle_new_connection(735):5: IPC credentials authenticated (4555-4764-31)
debug   Jun 05 15:32:09 qb_ipcs_shm_connect(282):5: connecting to client [4764]
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:09 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7b420
debug   Jun 05 15:32:09 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4764-31)
debug   Jun 05 15:32:09 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4764-31) state:2
trace   Jun 05 15:32:09 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:09 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:09 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:09 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7b420
debug   Jun 05 15:32:09 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4764-31-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4764-31-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4764-31-header
debug   Jun 05 15:32:09 handle_new_connection(735):5: IPC credentials authenticated (4555-4764-31)
debug   Jun 05 15:32:09 qb_ipcs_shm_connect(282):5: connecting to client [4764]
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:09 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:09 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7cc20
debug   Jun 05 15:32:09 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4764-31)
debug   Jun 05 15:32:09 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4764-31) state:2
trace   Jun 05 15:32:09 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:09 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:09 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:09 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7cc20
debug   Jun 05 15:32:09 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4764-31-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4764-31-header
debug   Jun 05 15:32:09 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4764-31-header
trace   Jun 05 15:32:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:09 messages_deliver_to_app(3824):13: Delivering 30 to 31
trace   Jun 05 15:32:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 31 to pending delivery queue
trace   Jun 05 15:32:09 messages_free(2463):13: releasing messages up to and including 31
trace   Jun 05 15:32:10 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:10 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:10 messages_deliver_to_app(3824):13: Delivering 31 to 32
trace   Jun 05 15:32:10 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 32 to pending delivery queue
trace   Jun 05 15:32:10 messages_free(2463):13: releasing messages up to and including 32
trace   Jun 05 15:32:12 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:15 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:18 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:21 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:24 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:27 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:30 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 32 to 33
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 33 to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 33
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 33 to 34
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 34 to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 34
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 34 to 35
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 35 to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 35
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 35 to 3b
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 36 to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 37 to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 38 to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 39 to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3a to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3b to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 3b
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 3b to 3c
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3c to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 3c
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 3c to 3e
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3d to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3e to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 3e
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 3e to 40
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 3f to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 40 to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 40
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 40 to 42
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 41 to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 42 to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 42
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 42 to 44
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 43 to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 44 to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 44
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 44 to 45
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 45 to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 45
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 45 to 46
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 46 to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 46
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 46 to 48
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 47 to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 48 to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 48
trace   Jun 05 15:32:30 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3824):13: Delivering 48 to 4a
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 49 to pending delivery queue
trace   Jun 05 15:32:30 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4a to pending delivery queue
trace   Jun 05 15:32:30 messages_free(2463):13: releasing messages up to and including 4a
debug   Jun 05 15:32:32 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4764-29)
debug   Jun 05 15:32:32 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4764-29) state:2
trace   Jun 05 15:32:32 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:32 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:32 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:32 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe79ab0
debug   Jun 05 15:32:32 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4764-29-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4764-29-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4764-29-header
debug   Jun 05 15:32:32 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4764-30)
debug   Jun 05 15:32:32 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4764-30) state:2
trace   Jun 05 15:32:32 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:32 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:32 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:32 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:32:32 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4764-30-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4764-30-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4764-30-header
trace   Jun 05 15:32:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:32:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:32:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:32 messages_deliver_to_app(3824):13: Delivering 4a to 4b
trace   Jun 05 15:32:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4b to pending delivery queue
debug   Jun 05 15:32:32 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:32:32 messages_free(2463):13: releasing messages up to and including 4b
debug   Jun 05 15:32:32 handle_new_connection(735):5: IPC credentials authenticated (4555-4770-29)
debug   Jun 05 15:32:32 qb_ipcs_shm_connect(282):5: connecting to client [4770]
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:32 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe79ab0, cpd=0x7fab5fe79844
debug   Jun 05 15:32:32 handle_new_connection(735):5: IPC credentials authenticated (4555-4770-30)
debug   Jun 05 15:32:32 qb_ipcs_shm_connect(282):5: connecting to client [4770]
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:32 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7a530
debug   Jun 05 15:32:32 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4770-30)
debug   Jun 05 15:32:32 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4770-30) state:2
trace   Jun 05 15:32:32 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:32 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:32 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:32 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7a530
debug   Jun 05 15:32:32 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4770-30-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4770-30-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4770-30-header
trace   Jun 05 15:32:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:32 messages_deliver_to_app(3824):13: Delivering 4b to 4c
trace   Jun 05 15:32:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4c to pending delivery queue
debug   Jun 05 15:32:32 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4770
debug   Jun 05 15:32:32 handle_new_connection(735):5: IPC credentials authenticated (4555-4770-30)
debug   Jun 05 15:32:32 qb_ipcs_shm_connect(282):5: connecting to client [4770]
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:32 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fe79210
debug   Jun 05 15:32:32 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fe79210
debug   Jun 05 15:32:32 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fe79210
debug   Jun 05 15:32:32 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fe79210
debug   Jun 05 15:32:32 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fe79210
debug   Jun 05 15:32:32 send_library_notification(359):3: sending quorum notification to 0x7fab5fe79210, length = 52
trace   Jun 05 15:32:32 messages_free(2463):13: releasing messages up to and including 4c
debug   Jun 05 15:32:32 handle_new_connection(735):5: IPC credentials authenticated (4555-4770-31)
debug   Jun 05 15:32:32 qb_ipcs_shm_connect(282):5: connecting to client [4770]
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:32 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7b730
debug   Jun 05 15:32:32 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4770-31)
debug   Jun 05 15:32:32 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4770-31) state:2
trace   Jun 05 15:32:32 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:32 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:32 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:32 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7b730
debug   Jun 05 15:32:32 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4770-31-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4770-31-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4770-31-header
debug   Jun 05 15:32:32 handle_new_connection(735):5: IPC credentials authenticated (4555-4770-31)
debug   Jun 05 15:32:32 qb_ipcs_shm_connect(282):5: connecting to client [4770]
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:32 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:32 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7d060
debug   Jun 05 15:32:32 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4770-31)
debug   Jun 05 15:32:32 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4770-31) state:2
trace   Jun 05 15:32:32 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:32 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:32 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:32 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7d060
debug   Jun 05 15:32:32 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4770-31-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4770-31-header
debug   Jun 05 15:32:32 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4770-31-header
trace   Jun 05 15:32:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:32 messages_deliver_to_app(3824):13: Delivering 4c to 4d
trace   Jun 05 15:32:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4d to pending delivery queue
trace   Jun 05 15:32:32 messages_free(2463):13: releasing messages up to and including 4d
trace   Jun 05 15:32:33 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:33 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:33 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:33 messages_deliver_to_app(3824):13: Delivering 4d to 4e
trace   Jun 05 15:32:33 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4e to pending delivery queue
trace   Jun 05 15:32:33 messages_free(2463):13: releasing messages up to and including 4e
trace   Jun 05 15:32:36 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:39 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:42 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:45 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:48 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:51 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 4e to 4f
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 4f to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 4f
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 4f to 50
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 50 to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 50
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 50 to 51
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 51 to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 51
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 51 to 57
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 52 to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 53 to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 54 to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 55 to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 56 to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 57 to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 57
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 57 to 58
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 58 to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 58
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 58 to 5a
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 59 to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5a to pending delivery queue
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 5a to 5c
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5b to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5c to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 5a
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 5c
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 5c to 5e
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5d to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5e to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 5e
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 5e to 60
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 5f to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 60 to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 60
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 60 to 61
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 61 to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 61
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 61 to 62
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 62 to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 62
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 62 to 64
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 63 to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 64 to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 64
trace   Jun 05 15:32:53 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3824):13: Delivering 64 to 66
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 65 to pending delivery queue
trace   Jun 05 15:32:53 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 66 to pending delivery queue
trace   Jun 05 15:32:53 messages_free(2463):13: releasing messages up to and including 66
trace   Jun 05 15:32:54 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:32:55 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4770-29)
debug   Jun 05 15:32:55 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4770-29) state:2
trace   Jun 05 15:32:55 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:55 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:55 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:55 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe79ab0
debug   Jun 05 15:32:55 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4770-29-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4770-29-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4770-29-header
debug   Jun 05 15:32:55 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4770-30)
debug   Jun 05 15:32:55 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4770-30) state:2
trace   Jun 05 15:32:55 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:55 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:55 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:55 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fe79210
debug   Jun 05 15:32:55 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4770-30-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4770-30-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4770-30-header
trace   Jun 05 15:32:55 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:32:55 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:32:55 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:55 messages_deliver_to_app(3824):13: Delivering 66 to 67
trace   Jun 05 15:32:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 67 to pending delivery queue
debug   Jun 05 15:32:55 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:32:55 messages_free(2463):13: releasing messages up to and including 67
debug   Jun 05 15:32:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4774-29)
debug   Jun 05 15:32:55 qb_ipcs_shm_connect(282):5: connecting to client [4774]
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:55 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe79ab0, cpd=0x7fab5fe7aac4
debug   Jun 05 15:32:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4774-30)
debug   Jun 05 15:32:55 qb_ipcs_shm_connect(282):5: connecting to client [4774]
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:55 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7d4d0
debug   Jun 05 15:32:55 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4774-30)
debug   Jun 05 15:32:55 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4774-30) state:2
trace   Jun 05 15:32:55 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:55 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:55 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:55 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7d4d0
debug   Jun 05 15:32:55 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4774-30-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4774-30-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4774-30-header
trace   Jun 05 15:32:55 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:55 messages_deliver_to_app(3824):13: Delivering 67 to 68
trace   Jun 05 15:32:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 68 to pending delivery queue
debug   Jun 05 15:32:55 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4774
debug   Jun 05 15:32:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4774-30)
debug   Jun 05 15:32:55 qb_ipcs_shm_connect(282):5: connecting to client [4774]
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:55 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fe7d4d0
debug   Jun 05 15:32:55 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fe7d4d0
debug   Jun 05 15:32:55 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fe7d4d0
debug   Jun 05 15:32:55 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fe7d4d0
debug   Jun 05 15:32:55 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fe7d4d0
debug   Jun 05 15:32:55 send_library_notification(359):3: sending quorum notification to 0x7fab5fe7d4d0, length = 52
trace   Jun 05 15:32:55 messages_free(2463):13: releasing messages up to and including 68
debug   Jun 05 15:32:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4774-31)
debug   Jun 05 15:32:55 qb_ipcs_shm_connect(282):5: connecting to client [4774]
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:55 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe79050
debug   Jun 05 15:32:55 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4774-31)
debug   Jun 05 15:32:55 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4774-31) state:2
trace   Jun 05 15:32:55 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:55 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:55 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:55 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe79050
debug   Jun 05 15:32:55 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4774-31-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4774-31-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4774-31-header
debug   Jun 05 15:32:55 handle_new_connection(735):5: IPC credentials authenticated (4555-4774-31)
debug   Jun 05 15:32:55 qb_ipcs_shm_connect(282):5: connecting to client [4774]
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:32:55 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:32:55 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe79050
debug   Jun 05 15:32:55 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4774-31)
debug   Jun 05 15:32:55 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4774-31) state:2
trace   Jun 05 15:32:55 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:32:55 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:32:55 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:32:55 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe79050
debug   Jun 05 15:32:55 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4774-31-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4774-31-header
debug   Jun 05 15:32:55 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4774-31-header
trace   Jun 05 15:32:55 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:55 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:55 messages_deliver_to_app(3824):13: Delivering 68 to 69
trace   Jun 05 15:32:55 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 69 to pending delivery queue
trace   Jun 05 15:32:55 messages_free(2463):13: releasing messages up to and including 69
trace   Jun 05 15:32:56 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:32:56 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:32:56 messages_deliver_to_app(3824):13: Delivering 69 to 6a
trace   Jun 05 15:32:56 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6a to pending delivery queue
trace   Jun 05 15:32:56 messages_free(2463):13: releasing messages up to and including 6a
trace   Jun 05 15:32:57 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:00 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:03 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:06 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:09 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:12 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:15 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 6a to 6b
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6b to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 6b
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 6b to 6c
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6c to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 6c
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 6c to 6d
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6d to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 6d
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 6d to 73
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6e to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 6f to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 70 to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 71 to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 72 to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 73 to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 73
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 73 to 74
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 74 to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 74
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe79ab0
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 74 to 76
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 75 to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 76 to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 76
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 76 to 78
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 77 to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 78 to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 78
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 78 to 7a
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 79 to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7a to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 7a
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 7a to 7c
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7b to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7c to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 7c
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 7c to 7d
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7d to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 7d
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 7d to 7e
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7e to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 7e
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 7e to 80
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 7f to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 80 to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 80
trace   Jun 05 15:33:16 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3824):13: Delivering 80 to 82
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 81 to pending delivery queue
trace   Jun 05 15:33:16 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 82 to pending delivery queue
trace   Jun 05 15:33:16 messages_free(2463):13: releasing messages up to and including 82
trace   Jun 05 15:33:18 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:33:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4774-29)
debug   Jun 05 15:33:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4774-29) state:2
trace   Jun 05 15:33:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:18 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe79ab0
debug   Jun 05 15:33:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4774-29-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4774-29-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4774-29-header
debug   Jun 05 15:33:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4774-30)
debug   Jun 05 15:33:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4774-30) state:2
trace   Jun 05 15:33:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:18 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fe7d4d0
debug   Jun 05 15:33:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4774-30-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4774-30-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4774-30-header
trace   Jun 05 15:33:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:33:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:33:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:18 messages_deliver_to_app(3824):13: Delivering 82 to 83
trace   Jun 05 15:33:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 83 to pending delivery queue
debug   Jun 05 15:33:18 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:33:18 messages_free(2463):13: releasing messages up to and including 83
debug   Jun 05 15:33:18 handle_new_connection(735):5: IPC credentials authenticated (4555-4784-29)
debug   Jun 05 15:33:18 qb_ipcs_shm_connect(282):5: connecting to client [4784]
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:18 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe7b730, cpd=0x7fab5fe7b394
debug   Jun 05 15:33:18 handle_new_connection(735):5: IPC credentials authenticated (4555-4784-30)
debug   Jun 05 15:33:18 qb_ipcs_shm_connect(282):5: connecting to client [4784]
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:18 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:33:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4784-30)
debug   Jun 05 15:33:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4784-30) state:2
trace   Jun 05 15:33:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:18 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd78a30
debug   Jun 05 15:33:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4784-30-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4784-30-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4784-30-header
trace   Jun 05 15:33:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:18 messages_deliver_to_app(3824):13: Delivering 83 to 84
trace   Jun 05 15:33:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 84 to pending delivery queue
debug   Jun 05 15:33:18 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4784
debug   Jun 05 15:33:18 handle_new_connection(735):5: IPC credentials authenticated (4555-4784-30)
debug   Jun 05 15:33:18 qb_ipcs_shm_connect(282):5: connecting to client [4784]
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:18 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:33:18 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fd78a30
debug   Jun 05 15:33:18 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fd78a30
debug   Jun 05 15:33:18 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fd78a30
debug   Jun 05 15:33:18 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fd78a30
debug   Jun 05 15:33:18 send_library_notification(359):3: sending quorum notification to 0x7fab5fd78a30, length = 52
trace   Jun 05 15:33:18 messages_free(2463):13: releasing messages up to and including 84
debug   Jun 05 15:33:18 handle_new_connection(735):5: IPC credentials authenticated (4555-4784-31)
debug   Jun 05 15:33:18 qb_ipcs_shm_connect(282):5: connecting to client [4784]
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:18 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78ea0
debug   Jun 05 15:33:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4784-31)
debug   Jun 05 15:33:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4784-31) state:2
trace   Jun 05 15:33:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:18 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78ea0
debug   Jun 05 15:33:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4784-31-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4784-31-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4784-31-header
debug   Jun 05 15:33:18 handle_new_connection(735):5: IPC credentials authenticated (4555-4784-31)
debug   Jun 05 15:33:18 qb_ipcs_shm_connect(282):5: connecting to client [4784]
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:18 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:18 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78ea0
debug   Jun 05 15:33:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4784-31)
debug   Jun 05 15:33:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4784-31) state:2
trace   Jun 05 15:33:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:18 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78ea0
debug   Jun 05 15:33:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4784-31-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4784-31-header
debug   Jun 05 15:33:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4784-31-header
trace   Jun 05 15:33:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b730
trace   Jun 05 15:33:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:18 messages_deliver_to_app(3824):13: Delivering 84 to 85
trace   Jun 05 15:33:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 85 to pending delivery queue
trace   Jun 05 15:33:18 messages_free(2463):13: releasing messages up to and including 85
trace   Jun 05 15:33:19 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b730
trace   Jun 05 15:33:19 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:19 messages_deliver_to_app(3824):13: Delivering 85 to 86
trace   Jun 05 15:33:19 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 86 to pending delivery queue
trace   Jun 05 15:33:19 messages_free(2463):13: releasing messages up to and including 86
trace   Jun 05 15:33:21 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:24 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:27 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:30 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:33 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:36 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:39 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b730
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 86 to 87
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 87 to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 87
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b730
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 87 to 88
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 88 to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 88
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b730
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 88 to 89
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 89 to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 89
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 89 to 8f
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 8a to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 8b to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 8c to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 8d to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 8e to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 8f to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 8f
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b730
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 8f to 90
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 90 to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 90
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b730
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 90 to 92
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 91 to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 92 to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 92
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 92 to 94
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 93 to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 94 to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 94
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 94 to 96
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 95 to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 96 to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 96
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 96 to 98
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 97 to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 98 to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 98
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 98 to 99
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 99 to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 99
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 99 to 9a
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 9a to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 9a
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 9a to 9c
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 9b to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 9c to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 9c
trace   Jun 05 15:33:39 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3824):13: Delivering 9c to 9e
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 9d to pending delivery queue
trace   Jun 05 15:33:39 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 9e to pending delivery queue
trace   Jun 05 15:33:39 messages_free(2463):13: releasing messages up to and including 9e
debug   Jun 05 15:33:40 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4784-29)
debug   Jun 05 15:33:40 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4784-29) state:2
trace   Jun 05 15:33:40 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:40 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:40 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:40 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe7b730
debug   Jun 05 15:33:40 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4784-29-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4784-29-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4784-29-header
debug   Jun 05 15:33:40 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4784-30)
debug   Jun 05 15:33:40 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4784-30) state:2
trace   Jun 05 15:33:40 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:40 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:40 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:40 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:33:40 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4784-30-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4784-30-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4784-30-header
trace   Jun 05 15:33:40 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:33:40 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:33:40 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:40 messages_deliver_to_app(3824):13: Delivering 9e to 9f
trace   Jun 05 15:33:40 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 9f to pending delivery queue
debug   Jun 05 15:33:40 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:33:40 messages_free(2463):13: releasing messages up to and including 9f
debug   Jun 05 15:33:40 handle_new_connection(735):5: IPC credentials authenticated (4555-4790-29)
debug   Jun 05 15:33:40 qb_ipcs_shm_connect(282):5: connecting to client [4790]
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:40 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe7b360, cpd=0x7fab5fe79ec4
debug   Jun 05 15:33:40 handle_new_connection(735):5: IPC credentials authenticated (4555-4790-30)
debug   Jun 05 15:33:40 qb_ipcs_shm_connect(282):5: connecting to client [4790]
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:40 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd78a30
trace   Jun 05 15:33:40 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:40 messages_deliver_to_app(3824):13: Delivering 9f to a0
trace   Jun 05 15:33:40 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a0 to pending delivery queue
debug   Jun 05 15:33:40 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4790
debug   Jun 05 15:33:40 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4790-30)
debug   Jun 05 15:33:40 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4790-30) state:2
trace   Jun 05 15:33:40 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:40 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:40 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:40 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd78a30
debug   Jun 05 15:33:40 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4790-30-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4790-30-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4790-30-header
debug   Jun 05 15:33:40 handle_new_connection(735):5: IPC credentials authenticated (4555-4790-30)
debug   Jun 05 15:33:40 qb_ipcs_shm_connect(282):5: connecting to client [4790]
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:40 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:33:40 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fd78a30
debug   Jun 05 15:33:40 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fd78a30
debug   Jun 05 15:33:40 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fd78a30
debug   Jun 05 15:33:40 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fd78a30
debug   Jun 05 15:33:40 send_library_notification(359):3: sending quorum notification to 0x7fab5fd78a30, length = 52
trace   Jun 05 15:33:40 messages_free(2463):13: releasing messages up to and including a0
debug   Jun 05 15:33:40 handle_new_connection(735):5: IPC credentials authenticated (4555-4790-31)
debug   Jun 05 15:33:40 qb_ipcs_shm_connect(282):5: connecting to client [4790]
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:40 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78e80
debug   Jun 05 15:33:40 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4790-31)
debug   Jun 05 15:33:40 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4790-31) state:2
trace   Jun 05 15:33:40 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:40 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:40 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:40 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78e80
debug   Jun 05 15:33:40 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4790-31-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4790-31-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4790-31-header
debug   Jun 05 15:33:40 handle_new_connection(735):5: IPC credentials authenticated (4555-4790-31)
debug   Jun 05 15:33:40 qb_ipcs_shm_connect(282):5: connecting to client [4790]
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:33:40 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:33:40 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78e80
debug   Jun 05 15:33:40 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4790-31)
debug   Jun 05 15:33:40 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4790-31) state:2
trace   Jun 05 15:33:40 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:33:40 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:33:40 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:33:40 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78e80
debug   Jun 05 15:33:40 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4790-31-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4790-31-header
debug   Jun 05 15:33:40 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4790-31-header
trace   Jun 05 15:33:40 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:33:40 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:40 messages_deliver_to_app(3824):13: Delivering a0 to a1
trace   Jun 05 15:33:40 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a1 to pending delivery queue
trace   Jun 05 15:33:40 messages_free(2463):13: releasing messages up to and including a1
trace   Jun 05 15:33:41 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:33:41 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:33:41 messages_deliver_to_app(3824):13: Delivering a1 to a2
trace   Jun 05 15:33:41 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a2 to pending delivery queue
trace   Jun 05 15:33:41 messages_free(2463):13: releasing messages up to and including a2
trace   Jun 05 15:33:42 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:45 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:48 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:51 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:54 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:33:57 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:00 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering a2 to a3
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a3 to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including a3
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering a3 to a4
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a4 to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including a4
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering a4 to a5
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a5 to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including a5
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering a5 to ab
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a6 to pending delivery queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a7 to pending delivery queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a8 to pending delivery queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq a9 to pending delivery queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq aa to pending delivery queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ab to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including ab
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering ab to ac
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ac to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including ac
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering ac to ae
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ad to pending delivery queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ae to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including ae
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering ae to b0
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq af to pending delivery queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b0 to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including b0
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering b0 to b2
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b1 to pending delivery queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b2 to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including b2
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering b2 to b4
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b3 to pending delivery queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b4 to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including b4
trace   Jun 05 15:34:01 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:34:01 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:01 messages_deliver_to_app(3824):13: Delivering b4 to b5
trace   Jun 05 15:34:01 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b5 to pending delivery queue
trace   Jun 05 15:34:01 messages_free(2463):13: releasing messages up to and including b5
trace   Jun 05 15:34:02 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:34:02 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:02 messages_deliver_to_app(3824):13: Delivering b5 to b6
trace   Jun 05 15:34:02 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b6 to pending delivery queue
trace   Jun 05 15:34:02 messages_free(2463):13: releasing messages up to and including b6
trace   Jun 05 15:34:02 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:02 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:02 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:02 messages_deliver_to_app(3824):13: Delivering b6 to b8
trace   Jun 05 15:34:02 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b7 to pending delivery queue
trace   Jun 05 15:34:02 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b8 to pending delivery queue
trace   Jun 05 15:34:02 messages_free(2463):13: releasing messages up to and including b8
trace   Jun 05 15:34:02 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:02 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:02 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:02 messages_deliver_to_app(3824):13: Delivering b8 to ba
trace   Jun 05 15:34:02 messages_deliver_to_app(3893):13: Delivering MCAST message with seq b9 to pending delivery queue
trace   Jun 05 15:34:02 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ba to pending delivery queue
trace   Jun 05 15:34:02 messages_free(2463):13: releasing messages up to and including ba
trace   Jun 05 15:34:03 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:34:03 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4790-29)
debug   Jun 05 15:34:03 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4790-29) state:2
trace   Jun 05 15:34:03 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:03 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:03 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:03 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe7b360
debug   Jun 05 15:34:03 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4790-29-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4790-29-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4790-29-header
debug   Jun 05 15:34:03 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4790-30)
debug   Jun 05 15:34:03 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4790-30) state:2
trace   Jun 05 15:34:03 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:03 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:03 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:03 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:34:03 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4790-30-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4790-30-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4790-30-header
trace   Jun 05 15:34:03 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:34:03 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:34:03 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:03 messages_deliver_to_app(3824):13: Delivering ba to bb
trace   Jun 05 15:34:03 messages_deliver_to_app(3893):13: Delivering MCAST message with seq bb to pending delivery queue
debug   Jun 05 15:34:03 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:34:03 messages_free(2463):13: releasing messages up to and including bb
debug   Jun 05 15:34:03 handle_new_connection(735):5: IPC credentials authenticated (4555-4800-29)
debug   Jun 05 15:34:03 qb_ipcs_shm_connect(282):5: connecting to client [4800]
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:03 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe7b360, cpd=0x7fab5fe79ec4
debug   Jun 05 15:34:03 handle_new_connection(735):5: IPC credentials authenticated (4555-4800-30)
debug   Jun 05 15:34:03 qb_ipcs_shm_connect(282):5: connecting to client [4800]
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:03 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:34:03 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4800-30)
debug   Jun 05 15:34:03 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4800-30) state:2
trace   Jun 05 15:34:03 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:03 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:03 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:03 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd78a30
debug   Jun 05 15:34:03 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4800-30-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4800-30-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4800-30-header
trace   Jun 05 15:34:03 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:03 messages_deliver_to_app(3824):13: Delivering bb to bc
trace   Jun 05 15:34:03 messages_deliver_to_app(3893):13: Delivering MCAST message with seq bc to pending delivery queue
debug   Jun 05 15:34:03 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4800
debug   Jun 05 15:34:03 handle_new_connection(735):5: IPC credentials authenticated (4555-4800-30)
debug   Jun 05 15:34:03 qb_ipcs_shm_connect(282):5: connecting to client [4800]
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:03 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:34:03 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fd78a30
debug   Jun 05 15:34:03 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fd78a30
debug   Jun 05 15:34:03 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fd78a30
debug   Jun 05 15:34:03 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fd78a30
debug   Jun 05 15:34:03 send_library_notification(359):3: sending quorum notification to 0x7fab5fd78a30, length = 52
trace   Jun 05 15:34:03 messages_free(2463):13: releasing messages up to and including bc
debug   Jun 05 15:34:03 handle_new_connection(735):5: IPC credentials authenticated (4555-4800-31)
debug   Jun 05 15:34:03 qb_ipcs_shm_connect(282):5: connecting to client [4800]
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:03 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7a350
debug   Jun 05 15:34:03 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4800-31)
debug   Jun 05 15:34:03 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4800-31) state:2
trace   Jun 05 15:34:03 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:03 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:03 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:03 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7a350
debug   Jun 05 15:34:03 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4800-31-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4800-31-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4800-31-header
debug   Jun 05 15:34:03 handle_new_connection(735):5: IPC credentials authenticated (4555-4800-31)
debug   Jun 05 15:34:03 qb_ipcs_shm_connect(282):5: connecting to client [4800]
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:03 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:03 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7aca0
debug   Jun 05 15:34:03 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4800-31)
debug   Jun 05 15:34:03 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4800-31) state:2
trace   Jun 05 15:34:03 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:03 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:03 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:03 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7aca0
debug   Jun 05 15:34:03 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4800-31-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4800-31-header
debug   Jun 05 15:34:03 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4800-31-header
trace   Jun 05 15:34:03 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:03 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:03 messages_deliver_to_app(3824):13: Delivering bc to bd
trace   Jun 05 15:34:03 messages_deliver_to_app(3893):13: Delivering MCAST message with seq bd to pending delivery queue
trace   Jun 05 15:34:03 messages_free(2463):13: releasing messages up to and including bd
trace   Jun 05 15:34:04 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:04 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:04 messages_deliver_to_app(3824):13: Delivering bd to be
trace   Jun 05 15:34:04 messages_deliver_to_app(3893):13: Delivering MCAST message with seq be to pending delivery queue
trace   Jun 05 15:34:04 messages_free(2463):13: releasing messages up to and including be
trace   Jun 05 15:34:06 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:09 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:12 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:15 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:18 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:21 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:24 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering be to bf
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq bf to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including bf
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering bf to c0
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c0 to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including c0
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering c0 to c1
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c1 to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including c1
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering c1 to c7
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c2 to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c3 to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c4 to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c5 to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c6 to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c7 to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including c7
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering c7 to c8
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c8 to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including c8
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering c8 to ca
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq c9 to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ca to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including ca
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering ca to cc
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq cb to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq cc to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including cc
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering cc to ce
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq cd to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ce to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including ce
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering ce to d0
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq cf to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d0 to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including d0
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering d0 to d1
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d1 to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including d1
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering d1 to d2
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d2 to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including d2
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering d2 to d4
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d3 to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d4 to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including d4
trace   Jun 05 15:34:24 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3824):13: Delivering d4 to d6
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d5 to pending delivery queue
trace   Jun 05 15:34:24 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d6 to pending delivery queue
trace   Jun 05 15:34:24 messages_free(2463):13: releasing messages up to and including d6
debug   Jun 05 15:34:26 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4800-29)
debug   Jun 05 15:34:26 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4800-29) state:2
trace   Jun 05 15:34:26 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:26 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:26 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:26 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe7b360
debug   Jun 05 15:34:26 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4800-29-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4800-29-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4800-29-header
debug   Jun 05 15:34:26 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4800-30)
debug   Jun 05 15:34:26 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4800-30) state:2
trace   Jun 05 15:34:26 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:26 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:26 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:26 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:34:26 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4800-30-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4800-30-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4800-30-header
trace   Jun 05 15:34:26 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:34:26 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:34:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:26 messages_deliver_to_app(3824):13: Delivering d6 to d7
trace   Jun 05 15:34:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d7 to pending delivery queue
debug   Jun 05 15:34:26 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:34:26 messages_free(2463):13: releasing messages up to and including d7
debug   Jun 05 15:34:26 handle_new_connection(735):5: IPC credentials authenticated (4555-4804-29)
debug   Jun 05 15:34:26 qb_ipcs_shm_connect(282):5: connecting to client [4804]
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:26 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fd78a30, cpd=0x7fab5fe79ec4
debug   Jun 05 15:34:26 handle_new_connection(735):5: IPC credentials authenticated (4555-4804-30)
debug   Jun 05 15:34:26 qb_ipcs_shm_connect(282):5: connecting to client [4804]
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:26 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7b360
debug   Jun 05 15:34:26 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4804-30)
debug   Jun 05 15:34:26 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4804-30) state:2
trace   Jun 05 15:34:26 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:26 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:26 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:26 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7b360
debug   Jun 05 15:34:26 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4804-30-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4804-30-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4804-30-header
trace   Jun 05 15:34:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:26 messages_deliver_to_app(3824):13: Delivering d7 to d8
trace   Jun 05 15:34:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d8 to pending delivery queue
debug   Jun 05 15:34:26 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4804
debug   Jun 05 15:34:26 handle_new_connection(735):5: IPC credentials authenticated (4555-4804-30)
debug   Jun 05 15:34:26 qb_ipcs_shm_connect(282):5: connecting to client [4804]
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:26 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fe7b360
debug   Jun 05 15:34:26 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fe7b360
debug   Jun 05 15:34:26 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fe7b360
debug   Jun 05 15:34:26 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fe7b360
debug   Jun 05 15:34:26 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fe7b360
debug   Jun 05 15:34:26 send_library_notification(359):3: sending quorum notification to 0x7fab5fe7b360, length = 52
trace   Jun 05 15:34:26 messages_free(2463):13: releasing messages up to and including d8
debug   Jun 05 15:34:26 handle_new_connection(735):5: IPC credentials authenticated (4555-4804-31)
debug   Jun 05 15:34:26 qb_ipcs_shm_connect(282):5: connecting to client [4804]
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:26 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7a370
debug   Jun 05 15:34:26 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4804-31)
debug   Jun 05 15:34:26 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4804-31) state:2
trace   Jun 05 15:34:26 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:26 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:26 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:26 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7a370
debug   Jun 05 15:34:26 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4804-31-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4804-31-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4804-31-header
debug   Jun 05 15:34:26 handle_new_connection(735):5: IPC credentials authenticated (4555-4804-31)
debug   Jun 05 15:34:26 qb_ipcs_shm_connect(282):5: connecting to client [4804]
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:26 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:26 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7ac60
debug   Jun 05 15:34:26 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4804-31)
debug   Jun 05 15:34:26 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4804-31) state:2
trace   Jun 05 15:34:26 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:26 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:26 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:26 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7ac60
debug   Jun 05 15:34:26 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4804-31-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4804-31-header
debug   Jun 05 15:34:26 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4804-31-header
trace   Jun 05 15:34:26 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fd78a30
trace   Jun 05 15:34:26 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:26 messages_deliver_to_app(3824):13: Delivering d8 to d9
trace   Jun 05 15:34:26 messages_deliver_to_app(3893):13: Delivering MCAST message with seq d9 to pending delivery queue
trace   Jun 05 15:34:26 messages_free(2463):13: releasing messages up to and including d9
trace   Jun 05 15:34:27 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fd78a30
trace   Jun 05 15:34:27 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:27 messages_deliver_to_app(3824):13: Delivering d9 to da
trace   Jun 05 15:34:27 messages_deliver_to_app(3893):13: Delivering MCAST message with seq da to pending delivery queue
trace   Jun 05 15:34:27 messages_free(2463):13: releasing messages up to and including da
trace   Jun 05 15:34:27 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:30 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:33 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:36 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:39 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:42 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:45 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fd78a30
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering da to db
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq db to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including db
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fd78a30
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering db to dc
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq dc to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including dc
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fd78a30
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering dc to dd
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq dd to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including dd
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering dd to e3
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq de to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq df to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e0 to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e1 to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e2 to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e3 to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including e3
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fd78a30
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering e3 to e4
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e4 to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including e4
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering e4 to e6
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e5 to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e6 to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including e6
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fd78a30
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering e6 to e8
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e7 to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e8 to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including e8
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering e8 to ea
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq e9 to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ea to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including ea
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering ea to ec
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq eb to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ec to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including ec
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering ec to ed
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ed to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including ed
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering ed to ee
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ee to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including ee
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering ee to f0
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ef to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f0 to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including f0
trace   Jun 05 15:34:47 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3824):13: Delivering f0 to f2
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f1 to pending delivery queue
trace   Jun 05 15:34:47 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f2 to pending delivery queue
trace   Jun 05 15:34:47 messages_free(2463):13: releasing messages up to and including f2
trace   Jun 05 15:34:48 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:34:48 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4804-29)
debug   Jun 05 15:34:48 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4804-29) state:2
trace   Jun 05 15:34:48 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:48 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:48 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:48 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fd78a30
debug   Jun 05 15:34:48 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4804-29-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4804-29-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4804-29-header
debug   Jun 05 15:34:48 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4804-30)
debug   Jun 05 15:34:48 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4804-30) state:2
trace   Jun 05 15:34:48 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:48 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:48 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:48 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fe7b360
debug   Jun 05 15:34:48 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4804-30-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4804-30-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4804-30-header
trace   Jun 05 15:34:48 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:34:48 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:34:48 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:48 messages_deliver_to_app(3824):13: Delivering f2 to f3
trace   Jun 05 15:34:48 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f3 to pending delivery queue
debug   Jun 05 15:34:48 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:34:48 messages_free(2463):13: releasing messages up to and including f3
debug   Jun 05 15:34:48 handle_new_connection(735):5: IPC credentials authenticated (4555-4810-29)
debug   Jun 05 15:34:48 qb_ipcs_shm_connect(282):5: connecting to client [4810]
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:48 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe7b360, cpd=0x7fab5fe798b4
debug   Jun 05 15:34:48 handle_new_connection(735):5: IPC credentials authenticated (4555-4810-30)
debug   Jun 05 15:34:48 qb_ipcs_shm_connect(282):5: connecting to client [4810]
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:48 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:34:48 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4810-30)
debug   Jun 05 15:34:48 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4810-30) state:2
trace   Jun 05 15:34:48 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:48 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:48 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:48 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd78a30
debug   Jun 05 15:34:48 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4810-30-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4810-30-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4810-30-header
trace   Jun 05 15:34:48 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:48 messages_deliver_to_app(3824):13: Delivering f3 to f4
trace   Jun 05 15:34:48 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f4 to pending delivery queue
debug   Jun 05 15:34:48 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4810
debug   Jun 05 15:34:48 handle_new_connection(735):5: IPC credentials authenticated (4555-4810-30)
debug   Jun 05 15:34:48 qb_ipcs_shm_connect(282):5: connecting to client [4810]
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:48 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:34:48 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fd78a30
debug   Jun 05 15:34:48 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fd78a30
debug   Jun 05 15:34:48 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fd78a30
debug   Jun 05 15:34:48 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fd78a30
debug   Jun 05 15:34:48 send_library_notification(359):3: sending quorum notification to 0x7fab5fd78a30, length = 52
trace   Jun 05 15:34:48 messages_free(2463):13: releasing messages up to and including f4
debug   Jun 05 15:34:48 handle_new_connection(735):5: IPC credentials authenticated (4555-4810-31)
debug   Jun 05 15:34:48 qb_ipcs_shm_connect(282):5: connecting to client [4810]
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:48 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7a1f0
debug   Jun 05 15:34:48 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4810-31)
debug   Jun 05 15:34:48 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4810-31) state:2
trace   Jun 05 15:34:48 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:48 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:48 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:48 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7a1f0
debug   Jun 05 15:34:48 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4810-31-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4810-31-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4810-31-header
debug   Jun 05 15:34:48 handle_new_connection(735):5: IPC credentials authenticated (4555-4810-31)
debug   Jun 05 15:34:48 qb_ipcs_shm_connect(282):5: connecting to client [4810]
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:34:48 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:34:48 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7a970
debug   Jun 05 15:34:48 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4810-31)
debug   Jun 05 15:34:48 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4810-31) state:2
trace   Jun 05 15:34:48 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:34:48 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:34:48 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:34:48 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7a970
debug   Jun 05 15:34:48 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4810-31-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4810-31-header
debug   Jun 05 15:34:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4810-31-header
trace   Jun 05 15:34:48 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:48 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:48 messages_deliver_to_app(3824):13: Delivering f4 to f5
trace   Jun 05 15:34:48 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f5 to pending delivery queue
trace   Jun 05 15:34:48 messages_free(2463):13: releasing messages up to and including f5
trace   Jun 05 15:34:49 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:34:49 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:34:49 messages_deliver_to_app(3824):13: Delivering f5 to f6
trace   Jun 05 15:34:49 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f6 to pending delivery queue
trace   Jun 05 15:34:49 messages_free(2463):13: releasing messages up to and including f6
trace   Jun 05 15:34:51 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:54 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:34:57 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:00 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:03 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:06 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:09 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering f6 to f7
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f7 to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including f7
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering f7 to f8
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f8 to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including f8
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering f8 to f9
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq f9 to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including f9
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering f9 to ff
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq fa to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq fb to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq fc to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq fd to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq fe to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq ff to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including ff
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering ff to 100
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 100 to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including 100
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering 100 to 102
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 101 to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 102 to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including 102
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering 102 to 104
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 103 to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 104 to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including 104
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering 104 to 106
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 105 to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 106 to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including 106
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering 106 to 108
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 107 to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 108 to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including 108
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering 108 to 109
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 109 to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including 109
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering 109 to 10a
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 10a to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including 10a
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering 10a to 10c
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 10b to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 10c to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including 10c
trace   Jun 05 15:35:09 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3824):13: Delivering 10c to 10e
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 10d to pending delivery queue
trace   Jun 05 15:35:09 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 10e to pending delivery queue
trace   Jun 05 15:35:09 messages_free(2463):13: releasing messages up to and including 10e
debug   Jun 05 15:35:11 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4810-29)
debug   Jun 05 15:35:11 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4810-29) state:2
trace   Jun 05 15:35:11 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:11 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:11 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:11 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe7b360
debug   Jun 05 15:35:11 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4810-29-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4810-29-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4810-29-header
debug   Jun 05 15:35:11 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4810-30)
debug   Jun 05 15:35:11 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4810-30) state:2
trace   Jun 05 15:35:11 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:11 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:11 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:11 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:35:11 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4810-30-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4810-30-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4810-30-header
trace   Jun 05 15:35:11 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:35:11 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:35:11 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:11 messages_deliver_to_app(3824):13: Delivering 10e to 10f
trace   Jun 05 15:35:11 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 10f to pending delivery queue
debug   Jun 05 15:35:11 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:35:11 messages_free(2463):13: releasing messages up to and including 10f
debug   Jun 05 15:35:11 handle_new_connection(735):5: IPC credentials authenticated (4555-4822-29)
debug   Jun 05 15:35:11 qb_ipcs_shm_connect(282):5: connecting to client [4822]
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:11 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe78d10, cpd=0x7fab5fe7bbe4
debug   Jun 05 15:35:11 handle_new_connection(735):5: IPC credentials authenticated (4555-4822-30)
debug   Jun 05 15:35:11 qb_ipcs_shm_connect(282):5: connecting to client [4822]
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:11 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fd78a30
debug   Jun 05 15:35:11 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4822-30)
debug   Jun 05 15:35:11 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4822-30) state:2
trace   Jun 05 15:35:11 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:11 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:11 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:11 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fd78a30
debug   Jun 05 15:35:11 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4822-30-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4822-30-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4822-30-header
trace   Jun 05 15:35:11 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:11 messages_deliver_to_app(3824):13: Delivering 10f to 110
trace   Jun 05 15:35:11 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 110 to pending delivery queue
debug   Jun 05 15:35:11 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4822
debug   Jun 05 15:35:11 handle_new_connection(735):5: IPC credentials authenticated (4555-4822-30)
debug   Jun 05 15:35:11 qb_ipcs_shm_connect(282):5: connecting to client [4822]
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:11 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fe7b360
debug   Jun 05 15:35:11 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fe7b360
debug   Jun 05 15:35:11 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fe7b360
debug   Jun 05 15:35:11 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fe7b360
debug   Jun 05 15:35:11 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fe7b360
debug   Jun 05 15:35:11 send_library_notification(359):3: sending quorum notification to 0x7fab5fe7b360, length = 52
trace   Jun 05 15:35:11 messages_free(2463):13: releasing messages up to and including 110
debug   Jun 05 15:35:11 handle_new_connection(735):5: IPC credentials authenticated (4555-4822-31)
debug   Jun 05 15:35:11 qb_ipcs_shm_connect(282):5: connecting to client [4822]
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:11 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7a670
debug   Jun 05 15:35:11 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4822-31)
debug   Jun 05 15:35:11 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4822-31) state:2
trace   Jun 05 15:35:11 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:11 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:11 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:11 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7a670
debug   Jun 05 15:35:11 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4822-31-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4822-31-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4822-31-header
debug   Jun 05 15:35:11 handle_new_connection(735):5: IPC credentials authenticated (4555-4822-31)
debug   Jun 05 15:35:11 qb_ipcs_shm_connect(282):5: connecting to client [4822]
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:11 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:11 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7cf90
debug   Jun 05 15:35:11 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4822-31)
debug   Jun 05 15:35:11 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4822-31) state:2
trace   Jun 05 15:35:11 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:11 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:11 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:11 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7cf90
debug   Jun 05 15:35:11 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4822-31-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4822-31-header
debug   Jun 05 15:35:11 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4822-31-header
trace   Jun 05 15:35:11 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78d10
trace   Jun 05 15:35:11 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:11 messages_deliver_to_app(3824):13: Delivering 110 to 111
trace   Jun 05 15:35:11 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 111 to pending delivery queue
trace   Jun 05 15:35:11 messages_free(2463):13: releasing messages up to and including 111
trace   Jun 05 15:35:12 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78d10
trace   Jun 05 15:35:12 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:12 messages_deliver_to_app(3824):13: Delivering 111 to 112
trace   Jun 05 15:35:12 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 112 to pending delivery queue
trace   Jun 05 15:35:12 messages_free(2463):13: releasing messages up to and including 112
trace   Jun 05 15:35:12 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:15 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:18 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:21 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:24 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:27 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:30 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78d10
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 112 to 113
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 113 to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 113
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78d10
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 113 to 114
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 114 to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 114
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78d10
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 114 to 115
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 115 to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 115
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 115 to 11b
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 116 to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 117 to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 118 to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 119 to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 11a to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 11b to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 11b
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78d10
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 11b to 11c
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 11c to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 11c
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe78d10
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 11c to 11e
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 11d to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 11e to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 11e
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 11e to 120
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 11f to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 120 to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 120
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 120 to 122
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 121 to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 122 to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 122
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 122 to 124
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 123 to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 124 to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 124
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 124 to 125
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 125 to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 125
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 125 to 126
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 126 to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 126
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 126 to 128
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 127 to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 128 to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 128
trace   Jun 05 15:35:32 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3824):13: Delivering 128 to 12a
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 129 to pending delivery queue
trace   Jun 05 15:35:32 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 12a to pending delivery queue
trace   Jun 05 15:35:32 messages_free(2463):13: releasing messages up to and including 12a
trace   Jun 05 15:35:33 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:35:33 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4822-29)
debug   Jun 05 15:35:33 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4822-29) state:2
trace   Jun 05 15:35:33 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:33 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:33 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:33 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:35:33 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4822-29-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4822-29-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4822-29-header
debug   Jun 05 15:35:33 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4822-30)
debug   Jun 05 15:35:33 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4822-30) state:2
trace   Jun 05 15:35:33 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:33 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:33 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:33 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fe7b360
debug   Jun 05 15:35:33 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4822-30-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4822-30-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4822-30-header
trace   Jun 05 15:35:33 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:35:33 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:35:33 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:33 messages_deliver_to_app(3824):13: Delivering 12a to 12b
trace   Jun 05 15:35:33 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 12b to pending delivery queue
debug   Jun 05 15:35:33 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:35:33 messages_free(2463):13: releasing messages up to and including 12b
debug   Jun 05 15:35:33 handle_new_connection(735):5: IPC credentials authenticated (4555-4829-29)
debug   Jun 05 15:35:33 qb_ipcs_shm_connect(282):5: connecting to client [4829]
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:33 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe7b360, cpd=0x7fab5fe7a224
debug   Jun 05 15:35:33 handle_new_connection(735):5: IPC credentials authenticated (4555-4829-30)
debug   Jun 05 15:35:33 qb_ipcs_shm_connect(282):5: connecting to client [4829]
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:33 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
trace   Jun 05 15:35:33 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:33 messages_deliver_to_app(3824):13: Delivering 12b to 12c
trace   Jun 05 15:35:33 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 12c to pending delivery queue
debug   Jun 05 15:35:33 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4829
debug   Jun 05 15:35:33 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4829-30)
debug   Jun 05 15:35:33 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4829-30) state:2
trace   Jun 05 15:35:33 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:33 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:33 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:33 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:35:33 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4829-30-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4829-30-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4829-30-header
debug   Jun 05 15:35:33 handle_new_connection(735):5: IPC credentials authenticated (4555-4829-30)
debug   Jun 05 15:35:33 qb_ipcs_shm_connect(282):5: connecting to client [4829]
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:33 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:35:33 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fe78d10
debug   Jun 05 15:35:33 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fe78d10
debug   Jun 05 15:35:33 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fe78d10
debug   Jun 05 15:35:33 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fe78d10
debug   Jun 05 15:35:33 send_library_notification(359):3: sending quorum notification to 0x7fab5fe78d10, length = 52
trace   Jun 05 15:35:33 messages_free(2463):13: releasing messages up to and including 12c
debug   Jun 05 15:35:33 handle_new_connection(735):5: IPC credentials authenticated (4555-4829-31)
debug   Jun 05 15:35:33 qb_ipcs_shm_connect(282):5: connecting to client [4829]
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:33 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7a640
debug   Jun 05 15:35:33 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4829-31)
debug   Jun 05 15:35:33 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4829-31) state:2
trace   Jun 05 15:35:33 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:33 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:33 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:33 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7a640
debug   Jun 05 15:35:33 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4829-31-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4829-31-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4829-31-header
debug   Jun 05 15:35:33 handle_new_connection(735):5: IPC credentials authenticated (4555-4829-31)
debug   Jun 05 15:35:33 qb_ipcs_shm_connect(282):5: connecting to client [4829]
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:33 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:33 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7c220
debug   Jun 05 15:35:33 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4829-31)
debug   Jun 05 15:35:33 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4829-31) state:2
trace   Jun 05 15:35:33 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:33 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:33 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:33 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7c220
debug   Jun 05 15:35:33 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4829-31-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4829-31-header
debug   Jun 05 15:35:33 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4829-31-header
trace   Jun 05 15:35:33 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:33 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:33 messages_deliver_to_app(3824):13: Delivering 12c to 12d
trace   Jun 05 15:35:33 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 12d to pending delivery queue
trace   Jun 05 15:35:33 messages_free(2463):13: releasing messages up to and including 12d
trace   Jun 05 15:35:34 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:34 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:34 messages_deliver_to_app(3824):13: Delivering 12d to 12e
trace   Jun 05 15:35:34 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 12e to pending delivery queue
trace   Jun 05 15:35:34 messages_free(2463):13: releasing messages up to and including 12e
trace   Jun 05 15:35:36 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:39 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:42 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:45 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:48 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:51 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:54 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 12e to 12f
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 12f to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 12f
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 12f to 130
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 130 to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 130
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 130 to 131
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 131 to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 131
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 131 to 137
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 132 to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 133 to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 134 to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 135 to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 136 to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 137 to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 137
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 137 to 138
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 138 to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 138
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 138 to 13a
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 139 to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 13a to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 13a
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 13a to 13c
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 13b to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 13c to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 13c
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 13c to 13e
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 13d to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 13e to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 13e
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 13e to 140
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 13f to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 140 to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 140
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 140 to 141
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 141 to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 141
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 141 to 142
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 142 to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 142
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 142 to 144
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 143 to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 144 to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 144
trace   Jun 05 15:35:54 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3824):13: Delivering 144 to 146
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 145 to pending delivery queue
trace   Jun 05 15:35:54 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 146 to pending delivery queue
trace   Jun 05 15:35:54 messages_free(2463):13: releasing messages up to and including 146
debug   Jun 05 15:35:56 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4829-29)
debug   Jun 05 15:35:56 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4829-29) state:2
trace   Jun 05 15:35:56 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:56 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:56 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:56 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe7b360
debug   Jun 05 15:35:56 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4829-29-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4829-29-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4829-29-header
debug   Jun 05 15:35:56 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4829-30)
debug   Jun 05 15:35:56 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4829-30) state:2
trace   Jun 05 15:35:56 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:56 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:56 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:56 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:35:56 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4829-30-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4829-30-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4829-30-header
trace   Jun 05 15:35:56 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:35:56 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:35:56 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:56 messages_deliver_to_app(3824):13: Delivering 146 to 147
trace   Jun 05 15:35:56 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 147 to pending delivery queue
debug   Jun 05 15:35:56 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:35:56 messages_free(2463):13: releasing messages up to and including 147
debug   Jun 05 15:35:56 handle_new_connection(735):5: IPC credentials authenticated (4555-4839-29)
debug   Jun 05 15:35:56 qb_ipcs_shm_connect(282):5: connecting to client [4839]
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:56 cpg_lib_init_fn(1459):8: lib_init_fn: conn=0x7fab5fe7b360, cpd=0x7fab5fe7a224
debug   Jun 05 15:35:56 handle_new_connection(735):5: IPC credentials authenticated (4555-4839-30)
debug   Jun 05 15:35:56 qb_ipcs_shm_connect(282):5: connecting to client [4839]
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:56 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:35:56 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4839-30)
debug   Jun 05 15:35:56 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4839-30) state:2
trace   Jun 05 15:35:56 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:56 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:56 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:56 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:35:56 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4839-30-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4839-30-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4839-30-header
trace   Jun 05 15:35:56 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:56 messages_deliver_to_app(3824):13: Delivering 147 to 148
trace   Jun 05 15:35:56 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 148 to pending delivery queue
debug   Jun 05 15:35:56 message_handler_req_exec_cpg_procjoin(1260):8: got procjoin message from cluster node -2090489664 (r(0) ip(192.168.101.131) r(1) ip(192.168.102.131) ) for pid 4839
debug   Jun 05 15:35:56 handle_new_connection(735):5: IPC credentials authenticated (4555-4839-30)
debug   Jun 05 15:35:56 qb_ipcs_shm_connect(282):5: connecting to client [4839]
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:56 quorum_lib_init_fn(316):3: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:35:56 message_handler_req_lib_quorum_gettype(471):3: got quorum_type request on 0x7fab5fe78d10
debug   Jun 05 15:35:56 message_handler_req_lib_quorum_getquorate(395):3: got quorate request on 0x7fab5fe78d10
debug   Jun 05 15:35:56 message_handler_req_lib_quorum_trackstart(412):3: got trackstart request on 0x7fab5fe78d10
debug   Jun 05 15:35:56 message_handler_req_lib_quorum_trackstart(420):3: sending initial status to 0x7fab5fe78d10
debug   Jun 05 15:35:56 send_library_notification(359):3: sending quorum notification to 0x7fab5fe78d10, length = 52
trace   Jun 05 15:35:56 messages_free(2463):13: releasing messages up to and including 148
debug   Jun 05 15:35:56 handle_new_connection(735):5: IPC credentials authenticated (4555-4839-31)
debug   Jun 05 15:35:56 qb_ipcs_shm_connect(282):5: connecting to client [4839]
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:56 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7a580
debug   Jun 05 15:35:56 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4839-31)
debug   Jun 05 15:35:56 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4839-31) state:2
trace   Jun 05 15:35:56 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:56 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:56 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:56 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7a580
debug   Jun 05 15:35:56 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4839-31-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4839-31-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4839-31-header
debug   Jun 05 15:35:56 handle_new_connection(735):5: IPC credentials authenticated (4555-4839-31)
debug   Jun 05 15:35:56 qb_ipcs_shm_connect(282):5: connecting to client [4839]
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:35:56 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:35:56 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe7c220
debug   Jun 05 15:35:56 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4839-31)
debug   Jun 05 15:35:56 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4839-31) state:2
trace   Jun 05 15:35:56 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:35:56 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:35:56 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:35:56 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe7c220
debug   Jun 05 15:35:56 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-4839-31-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-4839-31-header
debug   Jun 05 15:35:56 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-4839-31-header
trace   Jun 05 15:35:56 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:56 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:56 messages_deliver_to_app(3824):13: Delivering 148 to 149
trace   Jun 05 15:35:56 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 149 to pending delivery queue
trace   Jun 05 15:35:56 messages_free(2463):13: releasing messages up to and including 149
trace   Jun 05 15:35:57 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:35:57 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:35:57 messages_deliver_to_app(3824):13: Delivering 149 to 14a
trace   Jun 05 15:35:57 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 14a to pending delivery queue
trace   Jun 05 15:35:57 messages_free(2463):13: releasing messages up to and including 14a
trace   Jun 05 15:35:57 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:00 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:36:00 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:00 messages_deliver_to_app(3824):13: Delivering 14a to 14b
trace   Jun 05 15:36:00 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 14b to pending delivery queue
trace   Jun 05 15:36:00 messages_free(2463):13: releasing messages up to and including 14b
trace   Jun 05 15:36:00 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:03 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:06 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:09 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:12 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:15 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 14b to 14c
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 14c to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 14c
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 14c to 14d
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 14d to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 14d
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 14d to 14e
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 14e to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 14e
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 14e to 154
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 14f to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 150 to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 151 to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 152 to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 153 to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 154 to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 154
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 154 to 155
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 155 to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 155
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fe7b360
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 155 to 157
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 156 to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 157 to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 157
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 157 to 159
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 158 to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 159 to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 159
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 159 to 15b
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 15a to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 15b to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 15b
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 15b to 15d
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 15c to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 15d to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 15d
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 15d to 15e
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 15e to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 15e
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76c5c0
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 15e to 15f
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 15f to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 15f
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 15f to 161
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 160 to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 161 to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 161
trace   Jun 05 15:36:17 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5fb74a70
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3824):13: Delivering 161 to 163
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 162 to pending delivery queue
trace   Jun 05 15:36:17 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 163 to pending delivery queue
trace   Jun 05 15:36:17 messages_free(2463):13: releasing messages up to and including 163
debug   Jun 05 15:36:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4839-29)
debug   Jun 05 15:36:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4839-29) state:2
trace   Jun 05 15:36:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:36:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:36:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:36:18 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fe7b360
debug   Jun 05 15:36:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4839-29-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4839-29-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4839-29-header
debug   Jun 05 15:36:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4839-30)
debug   Jun 05 15:36:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4839-30) state:2
trace   Jun 05 15:36:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:36:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:36:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:36:18 quorum_lib_exit_fn(328):3: lib_exit_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:36:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-response-4555-4839-30-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-event-4555-4839-30-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-quorum-request-4555-4839-30-header
trace   Jun 05 15:36:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:36:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:36:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:36:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
trace   Jun 05 15:36:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
debug   Jun 05 15:36:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4579-26)
debug   Jun 05 15:36:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4579-26) state:2
trace   Jun 05 15:36:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:36:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:36:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:36:18 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5f76c5c0
trace   Jun 05 15:36:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
debug   Jun 05 15:36:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4579-26-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4579-26-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4579-26-header
debug   Jun 05 15:36:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4577-27)
debug   Jun 05 15:36:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4577-27) state:2
trace   Jun 05 15:36:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:36:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:36:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:36:18 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fb73090
debug   Jun 05 15:36:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4577-27-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4577-27-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4577-27-header
debug   Jun 05 15:36:18 message_handler_req_lib_cpg_leave(1544):8: got leave request on 0x7fab5fb74a70
debug   Jun 05 15:36:18 message_handler_req_lib_cpg_finalize(1582):8: cpg finalize for conn=0x7fab5fb74a70
debug   Jun 05 15:36:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4576-28)
debug   Jun 05 15:36:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4576-28) state:2
trace   Jun 05 15:36:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:36:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:36:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:36:18 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5fb74a70
debug   Jun 05 15:36:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4576-28-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4576-28-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4576-28-header
trace   Jun 05 15:36:18 message_handler_req_lib_cpg_mcast(1816):8: got mcast request on 0x7fab5f76d400
debug   Jun 05 15:36:18 message_handler_req_lib_cpg_finalize(1582):8: cpg finalize for conn=0x7fab5f76d400
trace   Jun 05 15:36:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:18 messages_deliver_to_app(3824):13: Delivering 163 to 165
trace   Jun 05 15:36:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 164 to pending delivery queue
debug   Jun 05 15:36:18 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:36:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 165 to pending delivery queue
debug   Jun 05 15:36:18 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
debug   Jun 05 15:36:18 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
debug   Jun 05 15:36:18 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
debug   Jun 05 15:36:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4574-25)
debug   Jun 05 15:36:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4574-25) state:2
trace   Jun 05 15:36:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:36:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:36:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:36:18 cpg_lib_exit_fn(1043):8: exit_fn for conn=0x7fab5f76d400
debug   Jun 05 15:36:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-response-4555-4574-25-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-event-4555-4574-25-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cpg-request-4555-4574-25-header
debug   Jun 05 15:36:18 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-4574-24)
debug   Jun 05 15:36:18 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-4574-24) state:2
trace   Jun 05 15:36:18 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:36:18 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:36:18 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
trace   Jun 05 15:36:18 cfg_lib_exit_fn(439):10: ENTERING cfg_lib_exit_fn()
trace   Jun 05 15:36:18 remove_ci_from_shutdown(398):10: ENTERING remove_ci_from_shutdown()
trace   Jun 05 15:36:18 remove_ci_from_shutdown(431):10: LEAVING remove_ci_from_shutdown()
trace   Jun 05 15:36:18 cfg_lib_exit_fn(441):10: LEAVING cfg_lib_exit_fn()
debug   Jun 05 15:36:18 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cfg-response-4555-4574-24-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cfg-event-4555-4574-24-header
debug   Jun 05 15:36:18 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cfg-request-4555-4574-24-header
trace   Jun 05 15:36:18 totemsrp_mcast(2334):13: mcasted message added to pending queue
trace   Jun 05 15:36:18 messages_deliver_to_app(3824):13: Delivering 165 to 166
trace   Jun 05 15:36:18 messages_deliver_to_app(3893):13: Delivering MCAST message with seq 166 to pending delivery queue
debug   Jun 05 15:36:18 message_handler_req_exec_cpg_procleave(1276):8: got procleave message from cluster node -2090489664
trace   Jun 05 15:36:18 messages_free(2463):13: releasing messages up to and including 165
trace   Jun 05 15:36:18 messages_free(2463):13: releasing messages up to and including 166
trace   Jun 05 15:36:18 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:22 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:25 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:28 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:31 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:34 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:37 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:40 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:43 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:46 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:49 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:52 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:55 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:36:58 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:01 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:04 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:07 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:10 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:13 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:16 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:19 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:22 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:25 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:28 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:31 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:34 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:37 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:40 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:43 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:46 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:49 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:52 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:55 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:37:58 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:01 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:04 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:07 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:10 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:13 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:16 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:19 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:22 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:25 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:28 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:31 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:34 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:37 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:40 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:43 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:46 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:38:48 handle_new_connection(735):5: IPC credentials authenticated (4555-5609-24)
debug   Jun 05 15:38:48 qb_ipcs_shm_connect(282):5: connecting to client [5609]
debug   Jun 05 15:38:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:38:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:38:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:38:48 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:38:48 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:38:48 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-5609-24)
debug   Jun 05 15:38:48 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-5609-24) state:2
trace   Jun 05 15:38:48 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:38:48 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:38:48 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:38:48 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:38:48 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:38:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-5609-24-header
debug   Jun 05 15:38:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-5609-24-header
debug   Jun 05 15:38:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-5609-24-header
debug   Jun 05 15:38:48 handle_new_connection(735):5: IPC credentials authenticated (4555-5611-24)
debug   Jun 05 15:38:48 qb_ipcs_shm_connect(282):5: connecting to client [5611]
debug   Jun 05 15:38:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:38:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:38:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:38:48 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:38:48 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:38:48 qb_rb_write_to_file(710):5:  writing total of: x7fab5fe78d10zd
debug   Jun 05 15:38:48 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-5611-24)
debug   Jun 05 15:38:48 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-5611-24) state:2
trace   Jun 05 15:38:48 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:38:48 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:38:48 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:38:48 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:38:48 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:38:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-5611-24-header
debug   Jun 05 15:38:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-5611-24-header
debug   Jun 05 15:38:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-5611-24-header
debug   Jun 05 15:38:48 handle_new_connection(735):5: IPC credentials authenticated (4555-5616-24)
debug   Jun 05 15:38:48 qb_ipcs_shm_connect(282):5: connecting to client [5616]
debug   Jun 05 15:38:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:38:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:38:48 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:38:48 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:38:48 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:38:48 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-5616-24)
debug   Jun 05 15:38:48 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-5616-24) state:2
trace   Jun 05 15:38:48 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:38:48 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:38:48 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:38:48 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:38:48 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:38:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-5616-24-header
debug   Jun 05 15:38:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-5616-24-header
debug   Jun 05 15:38:48 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-5616-24-header
trace   Jun 05 15:38:49 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:52 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:55 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:38:58 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:01 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:05 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:08 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:11 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:14 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:17 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:20 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:23 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:26 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:29 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:32 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:35 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:39:37 handle_new_connection(735):5: IPC credentials authenticated (4555-7601-24)
debug   Jun 05 15:39:37 qb_ipcs_shm_connect(282):5: connecting to client [7601]
debug   Jun 05 15:39:37 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:39:37 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:39:37 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:39:37 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:39:37 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:39:37 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-7601-24)
debug   Jun 05 15:39:37 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-7601-24) state:2
trace   Jun 05 15:39:37 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:39:37 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:39:37 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:39:37 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:39:37 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:39:37 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-7601-24-header
debug   Jun 05 15:39:37 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-7601-24-header
debug   Jun 05 15:39:37 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-7601-24-header
debug   Jun 05 15:39:37 handle_new_connection(735):5: IPC credentials authenticated (4555-7603-24)
debug   Jun 05 15:39:37 qb_ipcs_shm_connect(282):5: connecting to client [7603]
debug   Jun 05 15:39:37 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:39:37 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:39:37 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:39:37 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:39:37 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:39:37 qb_rb_write_to_file(710):5:  writing total of: x7fab5fe78d10zd
debug   Jun 05 15:39:37 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-7603-24)
debug   Jun 05 15:39:37 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-7603-24) state:2
trace   Jun 05 15:39:37 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:39:37 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:39:37 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:39:37 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:39:37 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:39:37 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-7603-24-header
debug   Jun 05 15:39:37 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-7603-24-header
debug   Jun 05 15:39:37 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-7603-24-header
debug   Jun 05 15:39:37 handle_new_connection(735):5: IPC credentials authenticated (4555-7608-24)
debug   Jun 05 15:39:37 qb_ipcs_shm_connect(282):5: connecting to client [7608]
debug   Jun 05 15:39:37 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:39:37 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:39:37 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:39:37 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:39:37 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:39:37 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-7608-24)
debug   Jun 05 15:39:37 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-7608-24) state:2
trace   Jun 05 15:39:37 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:39:37 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:39:37 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:39:37 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:39:37 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:39:37 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-7608-24-header
debug   Jun 05 15:39:37 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-7608-24-header
debug   Jun 05 15:39:37 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-7608-24-header
trace   Jun 05 15:39:38 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:41 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:44 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:47 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:50 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:53 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:56 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:39:59 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:02 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:05 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:08 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:11 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:14 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:17 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:20 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:23 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:26 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:29 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:32 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:35 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:38 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:41 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:44 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:47 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:50 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:53 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:56 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:40:59 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:02 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:05 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:08 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:11 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:14 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:18 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:21 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:23 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:27 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:30 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:33 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:36 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:39 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:42 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:45 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:48 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:51 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:54 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:41:57 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:00 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:03 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:06 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:09 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:12 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:15 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:18 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:21 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:24 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:27 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:30 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:33 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:36 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:39 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:42 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:45 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:48 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:51 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:54 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:42:57 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:00 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:03 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:06 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:09 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:12 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:15 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:18 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:21 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:24 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:27 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:30 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:33 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:36 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:39 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:42 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:45 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:48 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
trace   Jun 05 15:43:51 wd_tickle_fn(499):0: ENTERING wd_tickle_fn()
debug   Jun 05 15:43:53 handle_new_connection(735):5: IPC credentials authenticated (4555-10255-24)
debug   Jun 05 15:43:53 qb_ipcs_shm_connect(282):5: connecting to client [10255]
debug   Jun 05 15:43:53 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:43:53 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:43:53 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:43:53 cs_ipcs_connection_created(269):2: connection created
debug   Jun 05 15:43:53 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
debug   Jun 05 15:43:53 qb_ipcs_dispatch_connection_request(711):5: HUP conn (4555-10255-24)
debug   Jun 05 15:43:53 qb_ipcs_disconnect(550):5: qb_ipcs_disconnect(4555-10255-24) state:2
trace   Jun 05 15:43:53 qb_ipcs_sockets_disconnect(1143):5: ENTERING qb_ipcs_sockets_disconnect()
debug   Jun 05 15:43:53 _del(117):5: epoll_ctl(del): Bad file descriptor (9)
debug   Jun 05 15:43:53 cs_ipcs_connection_closed(414):2: cs_ipcs_connection_closed() 
debug   Jun 05 15:43:53 cmap_lib_exit_fn(325):9: exit_fn for conn=0x7fab5fe78d10
debug   Jun 05 15:43:53 cs_ipcs_connection_destroyed(387):2: cs_ipcs_connection_destroyed() 
debug   Jun 05 15:43:53 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-response-4555-10255-24-header
debug   Jun 05 15:43:53 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-event-4555-10255-24-header
debug   Jun 05 15:43:53 qb_rb_close(272):5: Free'ing ringbuffer: /dev/shm/qb-cmap-request-4555-10255-24-header
debug   Jun 05 15:43:53 handle_new_connection(735):5: IPC credentials authenticated (4555-10257-24)
debug   Jun 05 15:43:53 qb_ipcs_shm_connect(282):5: connecting to client [10257]
debug   Jun 05 15:43:53 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:43:53 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:43:53 qb_rb_open(210):5: shm size:zd; real_size:zd; rb->word_size:1048576
debug   Jun 05 15:43:53 cs_ipcs_connection_created(269):2: co[debug] Free'ing ringbuffer: /dev/shm/qb-create_from_file-header
nnection created
debug   Jun 05 15:43:53 cmap_lib_init_fn(306):9: lib_init_fn: conn=0x7fab5fe78d10
