Oct 21 11:19:18 bl460g1n6 corosync[7663]:   [MAIN  ] main.c:main:1171 Corosync Cluster Engine ('2.3.2.4-805b3'): started and ready to provide service.
Oct 21 11:19:18 bl460g1n6 corosync[7663]:   [MAIN  ] main.c:main:1172 Corosync built-in features: watchdog upstart snmp pie relro bindnow
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [TOTEM ] totemnet.c:totemnet_instance_initialize:242 Initializing transport (UDP/IP Multicast).
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [TOTEM ] totemcrypto.c:init_nss:579 Initializing transmit/receive security (NSS) crypto: aes256 hash: sha1
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [TOTEM ] totemnet.c:totemnet_instance_initialize:242 Initializing transport (UDP/IP Multicast).
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [TOTEM ] totemcrypto.c:init_nss:579 Initializing transmit/receive security (NSS) crypto: aes256 hash: sha1
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [TOTEM ] totemudp.c:timer_function_netif_check_timeout:670 The network interface [192.168.101.216] is now up.
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync configuration map access [0]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_service_init:865 Initializing IPC on cmap [0]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_get_ipc_type:811 No configured qb.ipc_type. Using native ipc
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: cmap
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync configuration service [1]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_service_init:865 Initializing IPC on cfg [1]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_get_ipc_type:811 No configured qb.ipc_type. Using native ipc
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: cfg
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync cluster closed process group service v1.01 [2]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_service_init:865 Initializing IPC on cpg [2]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_get_ipc_type:811 No configured qb.ipc_type. Using native ipc
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: cpg
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync profile loading service [4]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_service_init:851 NOT Initializing IPC on pload [4]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [WD    ] wd.c:setup_watchdog:651 Watchdog is now been tickled by corosync.
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [WD    ] wd.c:setup_watchdog:652 HP iLO2+ HW Watchdog Timer
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [WD    ] wd.c:wd_scan_resources:580 no resources configured.
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync watchdog service [7]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_service_init:851 NOT Initializing IPC on wd [7]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:quorum_exec_init_fn:274 Using quorum provider corosync_votequorum
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:votequorum_readconfig:967 Reading configuration (runtime: 0)
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:votequorum_read_nodelist_configuration:886 No nodelist defined or our node is not in the nodelist
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:recalculate_quorum:851 total_votes=1, expected_votes=3
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261592 state=1, votes=1, expected=3
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:decode_flags:587 flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync vote quorum service v1.0 [5]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_service_init:865 Initializing IPC on votequorum [5]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_get_ipc_type:811 No configured qb.ipc_type. Using native ipc
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: votequorum
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [SERV  ] service.c:corosync_service_link_and_init:174 Service engine loaded: corosync cluster quorum service v0.1 [3]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_service_init:865 Initializing IPC on quorum [3]
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_get_ipc_type:811 No configured qb.ipc_type. Using native ipc
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [QB    ] ipc_setup.c:qb_ipcs_us_publish:374 server name: quorum
Oct 21 11:19:18 bl460g1n6 corosync[7666]:   [TOTEM ] totemudp.c:timer_function_netif_check_timeout:670 The network interface [192.168.102.216] is now up.
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [MAIN  ] main.c:member_object_joined:333 Member joined: r(0) ip(192.168.101.216) r(1) ip(192.168.102.216) 
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [TOTEM ] totemsrp.c:memb_state_operational_enter:1966 A new membership (192.168.101.216:4) was formed. Members joined: -1062705704
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1604 got nodeinfo message from cluster node 3232261592
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1609 nodeinfo message[3232261592]: votes: 1, expected: 3 flags: 8
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:decode_flags:587 flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:recalculate_quorum:851 total_votes=1, expected_votes=3
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261592 state=1, votes=1, expected=3
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [SYNC  ] sync.c:sync_barrier_handler:232 Committing synchronization for corosync configuration map access
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_sync_activate:386 Single node sync -> no action
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:downlist_log:776 comparing: sender r(0) ip(192.168.101.216) r(1) ip(192.168.102.216) ; members(old:0 left:0)
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:downlist_log:776 chosen downlist: sender r(0) ip(192.168.101.216) r(1) ip(192.168.102.216) ; members(old:0 left:0)
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [SYNC  ] sync.c:sync_barrier_handler:232 Committing synchronization for corosync cluster closed process group service v1.01
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:decode_flags:587 flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1604 got nodeinfo message from cluster node 3232261592
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1609 nodeinfo message[3232261592]: votes: 1, expected: 3 flags: 8
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:decode_flags:587 flags: quorate: No Leaving: No WFA Status: No First: Yes Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:recalculate_quorum:851 total_votes=1, expected_votes=3
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261592 state=1, votes=1, expected=3
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1604 got nodeinfo message from cluster node 3232261592
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1609 nodeinfo message[0]: votes: 0, expected: 0 flags: 0
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [SYNC  ] sync.c:sync_barrier_handler:232 Committing synchronization for corosync vote quorum service v1.0
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:recalculate_quorum:851 total_votes=1, expected_votes=3
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261592 state=1, votes=1, expected=3
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:log_view_list:132 Members[1]: -1062705704
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:send_library_notification:359 sending quorum notification to (nil), length = 52
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [MAIN  ] main.c:corosync_sync_completed:276 Completed service synchronization, ready to provide service.
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7672]
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-7672-26)
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-7672-26) state:2
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cfg-response-7666-7672-26-header
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cfg-event-7666-7672-26-header
Oct 21 11:19:19 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cfg-request-7666-7672-26-header
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_ipc_connect: Could not establish pacemakerd connection: Connection refused (111)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7676]
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb148dc33b0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7676]
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb148ec9a10
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: get_cluster_type: Detected an active 'corosync' cluster
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: mcp_read_config: Reading configure for stack: corosync
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-7676-27)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-7676-27) state:2
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb148ec9a10
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-7676-27-header
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-7676-27-header
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-7676-27-header
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: mcp_read_config: Configured corosync to accept connections from group 189: OK (1)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-7676-26)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-7676-26) state:2
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb148dc33b0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-7676-26-header
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: main: Starting Pacemaker 1.1.11-0.302.b6d42ed.git.el6 (Build: b6d42ed):  generated-manpages agent-manpages ascii-docs ncurses libqb-logging libqb-ipc lha-fencing nagios  corosync-native snmp
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-7676-26-header
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: main: Maximum core file size is: 18446744073709551615
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-7676-26-header
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: qb_ipcs_us_publish: server name: pacemakerd
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7676]
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7676]
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:cpg_lib_init_fn:1459 lib_init_fn: conn=0x7fb148fcac40, cpd=0x7fb148fcb394
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] main.c:member_object_joined:333 Member joined: r(0) ip(192.168.101.217) r(1) ip(192.168.102.217) 
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] main.c:member_object_joined:333 Member joined: r(0) ip(192.168.101.218) r(1) ip(192.168.102.218) 
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [TOTEM ] totemsrp.c:memb_state_operational_enter:1966 A new membership (192.168.101.216:16) was formed. Members joined: -1062705703 -1062705702
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [SYNC  ] sync.c:sync_barrier_handler:232 Committing synchronization for corosync configuration map access
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_sync_activate:400 My config version is 0 -> no action
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:downlist_log:776 comparing: sender r(0) ip(192.168.101.217) r(1) ip(192.168.102.217) ; members(old:1 left:0)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:downlist_log:776 comparing: sender r(0) ip(192.168.101.216) r(1) ip(192.168.102.216) ; members(old:1 left:0)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:downlist_log:776 comparing: sender r(0) ip(192.168.101.218) r(1) ip(192.168.102.218) ; members(old:1 left:0)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:downlist_log:776 chosen downlist: sender r(0) ip(192.168.101.216) r(1) ip(192.168.102.216) ; members(old:1 left:0)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [SYNC  ] sync.c:sync_barrier_handler:232 Committing synchronization for corosync cluster closed process group service v1.01
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:decode_flags:587 flags: quorate: No Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1604 got nodeinfo message from cluster node 3232261593
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1609 nodeinfo message[3232261593]: votes: 1, expected: 3 flags: 0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:decode_flags:587 flags: quorate: No Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:recalculate_quorum:851 total_votes=2, expected_votes=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261592 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261593 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:get_lowest_node_id:527 lowest node id: -1062705704 us: -1062705704
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:are_we_quorate:777 quorum regained, resuming activity
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1604 got nodeinfo message from cluster node 3232261593
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_get_peer: Created entry 12edc4e5-0d77-4352-9cad-832b5ed0646f/0x27050b0 for node (null)/3232261592 (1 total)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1609 nodeinfo message[0]: votes: 0, expected: 0 flags: 0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1604 got nodeinfo message from cluster node 3232261594
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1609 nodeinfo message[3232261594]: votes: 1, expected: 3 flags: 0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:decode_flags:587 flags: quorate: No Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:recalculate_quorum:851 total_votes=3, expected_votes=3
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_get_peer: Node 3232261592 has uuid 3232261592
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261592 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261593 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261592] - corosync-cpg is now online
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261594 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:get_lowest_node_id:527 lowest node id: -1062705704 us: -1062705704
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1604 got nodeinfo message from cluster node 3232261594
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1609 nodeinfo message[0]: votes: 0, expected: 0 flags: 0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1604 got nodeinfo message from cluster node 3232261592
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1609 nodeinfo message[3232261592]: votes: 1, expected: 3 flags: 0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:decode_flags:587 flags: quorate: No Leaving: No WFA Status: No First: No Qdevice: No QdeviceAlive: No QdeviceCastVote: No QdeviceMasterWins: No
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:recalculate_quorum:851 total_votes=3, expected_votes=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261592 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261593 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261594 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:get_lowest_node_id:527 lowest node id: -1062705704 us: -1062705704
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1604 got nodeinfo message from cluster node 3232261592
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_exec_votequorum_nodeinfo:1609 nodeinfo message[0]: votes: 0, expected: 0 flags: 0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [SYNC  ] sync.c:sync_barrier_handler:232 Committing synchronization for corosync vote quorum service v1.0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:recalculate_quorum:851 total_votes=3, expected_votes=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261592 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261593 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:calculate_quorum:670 node 3232261594 state=1, votes=1, expected=3
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:get_lowest_node_id:527 lowest node id: -1062705704 us: -1062705704
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:quorum_api_set_quorum:148 This node is within the primary component and will provide service.
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:log_view_list:132 Members[3]: -1062705704 -1062705703 -1062705702
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:send_library_notification:359 sending quorum notification to (nil), length = 60
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] main.c:corosync_sync_completed:276 Completed service synchronization, ready to provide service.
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:message_handler_req_exec_cpg_procjoin:1260 got procjoin message from cluster node -1062705704 (r(0) ip(192.168.101.216) r(1) ip(192.168.102.216) ) for pid 7676
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7676]
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:quorum_lib_init_fn:316 lib_init_fn: conn=0x7fb148fcd7d0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:message_handler_req_lib_quorum_gettype:471 got quorum_type request on 0x7fb148fcd7d0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:message_handler_req_lib_quorum_getquorate:395 got quorate request on 0x7fb148fcd7d0
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: cluster_connect_quorum: Quorum acquired
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:message_handler_req_lib_quorum_trackstart:412 got trackstart request on 0x7fb148fcd7d0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:message_handler_req_lib_quorum_trackstart:420 sending initial status to 0x7fb148fcd7d0
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:send_library_notification:359 sending quorum notification to 0x7fb148fcd7d0, length = 60
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7676]
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb148fcdf20
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-7676-29)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-7676-29) state:2
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb148fcdf20
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-7676-29-header
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-7676-29-header
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-7676-29-header
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7676]
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261592
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_get_peer: Node 3232261592 is now known as bl460g1n6
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Using uid=189 and group=189 for process cib
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Forked child 7680 for process cib
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Forked child 7681 for process stonith-ng
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Forked child 7682 for process lrmd
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Using uid=189 and group=189 for process attrd
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Forked child 7683 for process attrd
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Using uid=189 and group=189 for process pengine
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Forked child 7684 for process pengine
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Using uid=189 and group=189 for process crmd
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: start_child: Forked child 7685 for process crmd
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: main: Starting mainloop
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: pcmk_quorum_notification: Membership 16: quorum retained (3)
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node bl460g1n6[3232261592] - state is now member (was (null))
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_get_peer: Created entry 617a50e0-e67d-4d8b-8840-23db550a42c3/0x2806dd0 for node (null)/3232261593 (2 total)
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_get_peer: Node 3232261593 has uuid 3232261593
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: pcmk_quorum_notification: Obtaining name for new node 3232261593
Oct 21 11:19:21 bl460g1n6 cib[7680]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:19:21 bl460g1n6 cib[7680]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Oct 21 11:19:21 bl460g1n6 cib[7680]:   notice: main: Using new config location: /var/lib/pacemaker/cib
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: get_cluster_type: Verifying cluster type: 'corosync'
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: get_cluster_type: Assuming an active 'corosync' cluster
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.xml (digest: /var/lib/pacemaker/cib/cib.xml.sig)
Oct 21 11:19:21 bl460g1n6 cib[7680]:  warning: retrieveCib: Cluster configuration not found: /var/lib/pacemaker/cib/cib.xml
Oct 21 11:19:21 bl460g1n6 cib[7680]:  warning: readCibXmlFile: Primary configuration corrupt or unusable, trying backups in /var/lib/pacemaker/cib
Oct 21 11:19:21 bl460g1n6 cib[7680]:  warning: readCibXmlFile: Continuing with an empty configuration.
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: validate_with_relaxng: Creating RNG parser context
Oct 21 11:19:21 bl460g1n6 attrd[7683]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:19:21 bl460g1n6 attrd[7683]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: main: Starting up
Oct 21 11:19:21 bl460g1n6 lrmd[7682]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:19:21 bl460g1n6 lrmd[7682]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: get_cluster_type: Verifying cluster type: 'corosync'
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: get_cluster_type: Assuming an active 'corosync' cluster
Oct 21 11:19:21 bl460g1n6 attrd[7683]:   notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
Oct 21 11:19:21 bl460g1n6 lrmd[7682]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Oct 21 11:19:21 bl460g1n6 lrmd[7682]:     info: qb_ipcs_us_publish: server name: lrmd
Oct 21 11:19:21 bl460g1n6 pengine[7684]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:19:21 bl460g1n6 pengine[7684]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:19:21 bl460g1n6 lrmd[7682]:     info: main: Starting
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:19:21 bl460g1n6 pengine[7684]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root
Oct 21 11:19:21 bl460g1n6 pengine[7684]:     info: qb_ipcs_us_publish: server name: pengine
Oct 21 11:19:21 bl460g1n6 pengine[7684]:     info: main: Starting pengine
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:     info: get_cluster_type: Verifying cluster type: 'corosync'
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:     info: get_cluster_type: Assuming an active 'corosync' cluster
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:   notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
Oct 21 11:19:21 bl460g1n6 crmd[7685]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:19:21 bl460g1n6 crmd[7685]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:19:21 bl460g1n6 crmd[7685]:     info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/hacluster
Oct 21 11:19:21 bl460g1n6 crmd[7685]:   notice: main: CRM Git Version: b6d42ed
Oct 21 11:19:21 bl460g1n6 crmd[7685]:     info: do_log: FSA: Input I_STARTUP from crmd_init() received in state S_STARTING
Oct 21 11:19:21 bl460g1n6 crmd[7685]:     info: get_cluster_type: Verifying cluster type: 'corosync'
Oct 21 11:19:21 bl460g1n6 crmd[7685]:     info: get_cluster_type: Assuming an active 'corosync' cluster
Oct 21 11:19:21 bl460g1n6 crmd[7685]:     info: crm_ipc_connect: Could not establish cib_shm connection: Connection refused (111)
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: startCib: CIB Initialization completed successfully
Oct 21 11:19:21 bl460g1n6 cib[7680]:   notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261593
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node (null)[3232261593] - state is now member (was (null))
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_get_peer: Created entry 07ba0450-e6db-4bac-b6c8-19517f3be316/0x2806b40 for node (null)/3232261594 (3 total)
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_get_peer: Node 3232261594 has uuid 3232261594
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: pcmk_quorum_notification: Obtaining name for new node 3232261594
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: crm_get_peer: Created entry 8c9db8f7-1eda-496b-b58d-681d03932c25/0x14dd120 for node (null)/3232261592 (1 total)
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: crm_get_peer: Node 3232261592 has uuid 3232261592
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261592] - corosync-cpg is now online
Oct 21 11:19:21 bl460g1n6 attrd[7683]:   notice: crm_update_peer_state: attrd_peer_change_cb: Node (null)[3232261592] - state is now member (was (null))
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: init_cs_connection_once: Connection to 'corosync': established
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:     info: crm_get_peer: Created entry fc0668eb-0b02-442e-babc-17e8d7a5f995/0x1dd8660 for node (null)/3232261592 (1 total)
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:     info: crm_get_peer: Node 3232261592 has uuid 3232261592
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261592] - corosync-cpg is now online
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:     info: init_cs_connection_once: Connection to 'corosync': established
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261594
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node (null)[3232261594] - state is now member (was (null))
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: crm_get_peer: Created entry 7f72d0e1-a812-47e8-a2d4-a4ae433f79a8/0xb4bfd0 for node (null)/3232261592 (1 total)
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: crm_get_peer: Node 3232261592 has uuid 3232261592
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261592] - corosync-cpg is now online
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: init_cs_connection_once: Connection to 'corosync': established
Oct 21 11:19:21 bl460g1n6 attrd[7683]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261592
Oct 21 11:19:21 bl460g1n6 attrd[7683]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: crm_get_peer: Node 3232261592 is now known as bl460g1n6
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: main: Cluster connection active
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: qb_ipcs_us_publish: server name: attrd
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: main: Accepting attribute updates
Oct 21 11:19:21 bl460g1n6 attrd[7683]:     info: crm_ipc_connect: Could not establish cib_rw connection: Connection refused (111)
Oct 21 11:19:21 bl460g1n6 pacemakerd[7676]:     info: crm_get_peer: Node 3232261594 is now known as bl460g1n8
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261592
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:     info: crm_get_peer: Node 3232261592 is now known as bl460g1n6
Oct 21 11:19:21 bl460g1n6 stonith-ng[7681]:     info: crm_ipc_connect: Could not establish cib_rw connection: Connection refused (111)
Oct 21 11:19:21 bl460g1n6 cib[7680]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261592
Oct 21 11:19:21 bl460g1n6 cib[7680]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: crm_get_peer: Node 3232261592 is now known as bl460g1n6
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: qb_ipcs_us_publish: server name: cib_ro
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: qb_ipcs_us_publish: server name: cib_rw
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: qb_ipcs_us_publish: server name: cib_shm
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: cib_init: Starting cib mainloop
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: pcmk_cpg_membership: Joined[0.0] cib.3232261592 
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: pcmk_cpg_membership: Member[0.0] cib.3232261592 
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: pcmk_cpg_membership: Joined[1.0] cib.3232261594 
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: pcmk_cpg_membership: Member[1.0] cib.3232261592 
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: crm_get_peer: Created entry 46185373-3066-4128-887a-8c25d4103e1e/0xb4e8e0 for node (null)/3232261594 (2 total)
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: crm_get_peer: Node 3232261594 has uuid 3232261594
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: pcmk_cpg_membership: Member[1.1] cib.3232261594 
Oct 21 11:19:21 bl460g1n6 cib[7680]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261594] - corosync-cpg is now online
Oct 21 11:19:21 bl460g1n6 cib[7686]:     info: write_cib_contents: Wrote version 0.0.0 of the CIB to disk (digest: 38e2a365180d27f2831950bf8df46420)
Oct 21 11:19:21 bl460g1n6 cib[7686]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.TfyIjn (digest: /var/lib/pacemaker/cib/cib.KYJvj6)
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xb4ef70 for uid=189 gid=189 pid=7685 id=11403f73-2fb1-433c-b6cb-5b581b7e190d
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: do_cib_control: CIB connection established
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: crm_cluster_connect: Connecting to cluster infrastructure: corosync
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/2, version=0.0.0)
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: crm_get_peer: Created entry 6e66452b-3f17-4424-abab-2a1a7c2eb7b0/0x1da9ec0 for node (null)/3232261592 (1 total)
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: crm_get_peer: Node 3232261592 has uuid 3232261592
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: crm_update_peer_proc: cluster_connect_cpg: Node (null)[3232261592] - corosync-cpg is now online
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: init_cs_connection_once: Connection to 'corosync': established
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261592
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: crm_get_peer: Node 3232261592 is now known as bl460g1n6
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: peer_update_callback: bl460g1n6 is now (null)
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: cluster_connect_quorum: Quorum acquired
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: do_ha_control: Connected to the cluster
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: lrmd_ipc_connect: Connecting to lrmd
Oct 21 11:19:22 bl460g1n6 lrmd[7682]:     info: crm_client_new: Connecting 0x1d8fd10 for uid=189 gid=189 pid=7685 id=666c66a8-da92-4298-beea-12fd671d2b0d
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/3, version=0.0.0)
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: do_lrm_control: LRM connection established
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: do_started: Delaying start, no membership data (0000000000100000)
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0x99dbe0 for uid=189 gid=189 pid=7683 id=c9763361-9f68-4c1a-a43e-90d67258e704
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: pcmk_quorum_notification: Membership 16: quorum retained (3)
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node bl460g1n6[3232261592] - state is now member (was (null))
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: peer_update_callback: bl460g1n6 is now member (was (null))
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: crm_get_peer: Created entry da1f328d-b11b-40fc-bd69-75a8f1488e52/0x1eefaa0 for node (null)/3232261593 (2 total)
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: crm_get_peer: Node 3232261593 has uuid 3232261593
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: pcmk_quorum_notification: Obtaining name for new node 3232261593
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section crm_config: OK (rc=0, origin=local/crmd/4, version=0.0.0)
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: attrd_cib_connect: Connected to the CIB after 2 attempts
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: main: CIB connection active
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: pcmk_cpg_membership: Joined[0.0] attrd.3232261592 
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: pcmk_cpg_membership: Member[0.0] attrd.3232261592 
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: pcmk_cpg_membership: Joined[1.0] attrd.3232261594 
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: pcmk_cpg_membership: Member[1.0] attrd.3232261592 
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: crm_get_peer: Created entry 1fa5dc9b-db68-48a8-bab2-700e86b5cfd9/0x14e3070 for node (null)/3232261594 (2 total)
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: crm_get_peer: Node 3232261594 has uuid 3232261594
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: pcmk_cpg_membership: Member[1.1] attrd.3232261594 
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261594] - corosync-cpg is now online
Oct 21 11:19:22 bl460g1n6 attrd[7683]:   notice: crm_update_peer_state: attrd_peer_change_cb: Node (null)[3232261594] - state is now member (was (null))
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261593
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node (null)[3232261593] - state is now member (was (null))
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: crm_get_peer: Created entry 1ca3e7b6-c791-45f6-94d4-788142ea7703/0x1eef990 for node (null)/3232261594 (3 total)
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: crm_get_peer: Node 3232261594 has uuid 3232261594
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: pcmk_quorum_notification: Obtaining name for new node 3232261594
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xb70000 for uid=0 gid=0 pid=7681 id=4adfbc39-bfd1-48d5-8128-03ba3eff38a3
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:   notice: setup_cib: Watching for stonith topology changes
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: qb_ipcs_us_publish: server name: stonith-ng
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: main: Starting stonith-ng mainloop
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: pcmk_cpg_membership: Joined[0.0] stonith-ng.3232261592 
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: pcmk_cpg_membership: Member[0.0] stonith-ng.3232261592 
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: pcmk_cpg_membership: Joined[1.0] stonith-ng.3232261594 
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: pcmk_cpg_membership: Member[1.0] stonith-ng.3232261592 
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: crm_get_peer: Created entry 8483663e-93ed-4df0-b2a6-07e7aacb90ba/0x1dda8e0 for node (null)/3232261594 (2 total)
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: crm_get_peer: Node 3232261594 has uuid 3232261594
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: pcmk_cpg_membership: Member[1.1] stonith-ng.3232261594 
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261594] - corosync-cpg is now online
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/2, version=0.0.0)
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261594
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: crm_update_peer_state: pcmk_quorum_notification: Node (null)[3232261594] - state is now member (was (null))
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261592
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: init_cib_cache_cb: Updating device list from the cib: init
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: unpack_nodes: Creating a fake local node
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261592
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: do_started: Delaying start, Config not read (0000000000000040)
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: qb_ipcs_us_publish: server name: crmd
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: do_started: The local CRM is operational
Oct 21 11:19:22 bl460g1n6 crmd[7685]:     info: do_log: FSA: Input I_PENDING from do_started() received in state S_STARTING
Oct 21 11:19:22 bl460g1n6 crmd[7685]:   notice: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_slave operation for section 'all': OK (rc=0, origin=local/crmd/5, version=0.0.0)
Oct 21 11:19:22 bl460g1n6 pacemakerd[7676]:     info: crm_get_peer: Node 3232261593 is now known as bl460g1n7
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: pcmk_cpg_membership: Joined[2.0] stonith-ng.3232261593 
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: pcmk_cpg_membership: Member[2.0] stonith-ng.3232261592 
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: crm_get_peer: Created entry 42dd69a2-315c-49f3-8195-04f4452be23f/0x1de3ea0 for node (null)/3232261593 (3 total)
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: crm_get_peer: Node 3232261593 has uuid 3232261593
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: pcmk_cpg_membership: Member[2.1] stonith-ng.3232261593 
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261593] - corosync-cpg is now online
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: pcmk_cpg_membership: Member[2.2] stonith-ng.3232261594 
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: pcmk_cpg_membership: Joined[2.0] attrd.3232261593 
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: pcmk_cpg_membership: Member[2.0] attrd.3232261592 
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: pcmk_cpg_membership: Joined[2.0] cib.3232261593 
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: pcmk_cpg_membership: Member[2.0] cib.3232261592 
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: crm_get_peer: Created entry eea9a1a5-713e-4ea8-ba06-01a6f9829bef/0xbb6840 for node (null)/3232261593 (3 total)
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: crm_get_peer: Created entry bcb66211-3e6b-4e14-9472-757e22ab0e6e/0x14e30e0 for node (null)/3232261593 (3 total)
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: crm_get_peer: Node 3232261593 has uuid 3232261593
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: pcmk_cpg_membership: Member[2.1] cib.3232261593 
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261593] - corosync-cpg is now online
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: pcmk_cpg_membership: Member[2.2] cib.3232261594 
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: crm_get_peer: Node 3232261593 has uuid 3232261593
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: pcmk_cpg_membership: Member[2.1] attrd.3232261593 
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261593] - corosync-cpg is now online
Oct 21 11:19:22 bl460g1n6 attrd[7683]:   notice: crm_update_peer_state: attrd_peer_change_cb: Node (null)[3232261593] - state is now member (was (null))
Oct 21 11:19:22 bl460g1n6 attrd[7683]:     info: pcmk_cpg_membership: Member[2.2] attrd.3232261594 
Oct 21 11:19:22 bl460g1n6 stonith-ng[7681]:     info: crm_get_peer: Node 3232261594 is now known as bl460g1n8
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xb70560 for uid=0 gid=0 pid=30979 id=9976496d-abc5-4df0-b696-4cf03d0e8ce2
Oct 21 11:19:22 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/5, version=0.0.0)
Oct 21 11:19:23 bl460g1n6 stonith-ng[7681]:     info: crm_get_peer: Node 3232261593 is now known as bl460g1n7
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Joined[0.0] crmd.3232261592 
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[0.0] crmd.3232261592 
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[0.1] crmd.3232261594 
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261594] - corosync-cpg is now online
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Joined[1.0] crmd.3232261593 
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[1.0] crmd.3232261592 
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[1.1] crmd.3232261593 
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node (null)[3232261593] - corosync-cpg is now online
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[1.2] crmd.3232261594 
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: crm_get_peer: Node 3232261593 is now known as bl460g1n7
Oct 21 11:19:23 bl460g1n6 crmd[7685]:     info: peer_update_callback: bl460g1n7 is now member
Oct 21 11:19:24 bl460g1n6 stonith-ng[7681]:     info: crm_client_new: Connecting 0x1ddfee0 for uid=189 gid=189 pid=7685 id=84785fd7-02d0-4985-849e-ce75461ab298
Oct 21 11:19:24 bl460g1n6 stonith-ng[7681]:     info: stonith_command: Processed register from crmd.7685: OK (0)
Oct 21 11:19:24 bl460g1n6 stonith-ng[7681]:     info: stonith_command: Processed st_notify from crmd.7685: OK (0)
Oct 21 11:19:24 bl460g1n6 stonith-ng[7681]:     info: stonith_command: Processed st_notify from crmd.7685: OK (0)
Oct 21 11:19:24 bl460g1n6 crmd[7685]:     info: crm_get_peer: Node 3232261594 is now known as bl460g1n8
Oct 21 11:19:24 bl460g1n6 crmd[7685]:     info: peer_update_callback: bl460g1n8 is now member
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped (20000ms)
Oct 21 11:19:43 bl460g1n6 crmd[7685]:  warning: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: election_timer_cb: Election election-0 complete
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: election_timeout_popped: Election failed: Declaring ourselves the winner
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_log: FSA: Input I_ELECTION_DC from election_timeout_popped() received in state S_ELECTION
Oct 21 11:19:43 bl460g1n6 crmd[7685]:   notice: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_TIMER_POPPED origin=election_timeout_popped ]
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_te_control: Registering TE UUID: 38db9a68-056c-4e65-8658-75f0c3cc91e5
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: set_graph_functions: Setting custom graph functions
Oct 21 11:19:43 bl460g1n6 pengine[7684]:     info: crm_client_new: Connecting 0x255a700 for uid=189 gid=189 pid=7685 id=58012edf-f8de-4855-9af0-0667eb45afd9
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_dc_takeover: Taking over DC status for this partition
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_readwrite: We are now in R/W mode
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_master operation for section 'all': OK (rc=0, origin=local/crmd/6, version=0.0.0)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section cib: OK (rc=0, origin=local/crmd/7, version=0.0.1)
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7680]
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb1490da9a0
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-7680-34)
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-7680-34) state:2
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261592
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb1490da9a0
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-7680-34-header
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-7680-34-header
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section //cib/configuration/crm_config//cluster_property_set//nvpair[@name='dc-version']: No such device or address (rc=-6, origin=local/crmd/8, version=0.0.1)
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-7680-34-header
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: log_cib_diff: cib:diff: Local-only Change: 0.1.1
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: -- <cib admin_epoch="0" epoch="0" num_updates="1"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <cluster_property_set id="cib-bootstrap-options">
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.1.11-0.302.b6d42ed.git.el6-b6d42ed"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: ++       </cluster_property_set>
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section crm_config: OK (rc=0, origin=local/crmd/9, version=0.1.1)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section //cib/configuration/crm_config//cluster_property_set//nvpair[@name='cluster-infrastructure']: No such device or address (rc=-6, origin=local/crmd/10, version=0.1.1)
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: join_make_offer: Making join offers based on membership 16
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: join_make_offer: join-1: Sending offer to bl460g1n7
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n7[3232261593] - join-1 phase 0 -> 1
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: join_make_offer: join-1: Sending offer to bl460g1n8
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n8[3232261594] - join-1 phase 0 -> 1
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: join_make_offer: join-1: Sending offer to bl460g1n6
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n6[3232261592] - join-1 phase 0 -> 1
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_dc_join_offer_all: join-1: Waiting on 3 outstanding join acks
Oct 21 11:19:43 bl460g1n6 crmd[7685]:  warning: do_log: FSA: Input I_ELECTION_DC from do_election_check() received in state S_INTEGRATION
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: initialize_join: Node bl460g1n7[3232261593] - join-2 phase 1 -> 0
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: initialize_join: Node bl460g1n8[3232261594] - join-2 phase 1 -> 0
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: initialize_join: Node bl460g1n6[3232261592] - join-2 phase 1 -> 0
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: join_make_offer: join-2: Sending offer to bl460g1n7
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n7[3232261593] - join-2 phase 0 -> 1
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: join_make_offer: join-2: Sending offer to bl460g1n8
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n8[3232261594] - join-2 phase 0 -> 1
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: join_make_offer: join-2: Sending offer to bl460g1n6
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n6[3232261592] - join-2 phase 0 -> 1
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_dc_join_offer_all: join-2: Waiting on 3 outstanding join acks
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: log_cib_diff: cib:diff: Local-only Change: 0.2.1
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: -- <cib admin_epoch="0" epoch="1" num_updates="1"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="corosync"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section crm_config: OK (rc=0, origin=local/crmd/11, version=0.2.1)
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: update_dc: Set DC to bl460g1n6 (3.0.7)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section crm_config: OK (rc=0, origin=local/crmd/12, version=0.2.1)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section crm_config: OK (rc=0, origin=local/crmd/13, version=0.2.1)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/14, version=0.2.1)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/15, version=0.2.1)
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n6[3232261592] - join-2 phase 1 -> 2
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_expected: do_dc_join_filter_offer: Node bl460g1n6[3232261592] - expected state is now member
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n7[3232261593] - join-2 phase 1 -> 2
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_expected: do_dc_join_filter_offer: Node bl460g1n7[3232261593] - expected state is now member
Oct 21 11:19:43 bl460g1n6 cib[7706]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-0.raw
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n8[3232261594] - join-2 phase 1 -> 2
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_expected: do_dc_join_filter_offer: Node bl460g1n8[3232261594] - expected state is now member
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crmd_join_phase_log: join-2: bl460g1n7=integrated
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crmd_join_phase_log: join-2: bl460g1n8=integrated
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crmd_join_phase_log: join-2: bl460g1n6=integrated
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_dc_join_finalize: join-2: Syncing our CIB to the rest of the cluster
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_sync operation for section 'all': OK (rc=0, origin=local/crmd/16, version=0.2.1)
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: finalize_join_for: Node bl460g1n7[3232261593] - join-2 phase 2 -> 3
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: finalize_join_for: Node bl460g1n8[3232261594] - join-2 phase 2 -> 3
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: finalize_join_for: Node bl460g1n6[3232261592] - join-2 phase 2 -> 3
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: log_cib_diff: cib:diff: Local-only Change: 0.3.1
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: -- <cib admin_epoch="0" epoch="2" num_updates="1"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <node id="3232261593" uname="bl460g1n7"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/17, version=0.3.1)
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: erase_status_tag: Deleting xpath: //node_state[@uname='bl460g1n6']/transient_attributes
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: update_attrd_helper: Connecting to attrd... 5 retries remaining
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: crm_client_new: Connecting 0x14e0460 for uid=189 gid=189 pid=7685 id=8867b5f3-c85c-4336-be21-852b967b540d
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: log_cib_diff: cib:diff: Local-only Change: 0.4.1
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: -- <cib admin_epoch="0" epoch="3" num_updates="1"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <node id="3232261594" uname="bl460g1n8"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/18, version=0.4.1)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: attrd_client_message: Starting an election to determine the writer
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [7683]
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: log_cib_diff: cib:diff: Local-only Change: 0.5.1
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: -- <cib admin_epoch="0" epoch="4" num_updates="1"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <node id="3232261592" uname="bl460g1n6"/>
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/19, version=0.5.1)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: crm_get_peer: Node 3232261594 is now known as bl460g1n8
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n8']/transient_attributes: OK (rc=0, origin=bl460g1n8/crmd/10, version=0.5.1)
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n6']/transient_attributes: OK (rc=0, origin=local/crmd/20, version=0.5.1)
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb1490da8f0
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_ack: Node bl460g1n8[3232261594] - join-2 phase 3 -> 4
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_dc_join_ack: join-2: Updating node state to member for bl460g1n8
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: erase_status_tag: Deleting xpath: //node_state[@uname='bl460g1n8']/lrm
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n8']/lrm: OK (rc=0, origin=local/crmd/21, version=0.5.1)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: corosync_node_name: Unable to get node name for nodeid 3232261592
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: get_node_name: Defaulting to uname -n for the local corosync node name
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-7683-34)
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-7683-34) state:2
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: attrd_client_message: Broadcasting terminate[bl460g1n6] = (null)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: attrd_client_message: Broadcasting shutdown[bl460g1n6] = (null)
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb1490da8f0
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-7683-34-header
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_ack: Node bl460g1n6[3232261592] - join-2 phase 3 -> 4
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_dc_join_ack: join-2: Updating node state to member for bl460g1n6
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: erase_status_tag: Deleting xpath: //node_state[@uname='bl460g1n6']/lrm
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-7683-34-header
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/22, version=0.5.2)
Oct 21 11:19:43 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-7683-34-header
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n6']/lrm: OK (rc=0, origin=local/crmd/23, version=0.5.2)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: crm_get_peer: Node 3232261594 is now known as bl460g1n8
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/24, version=0.5.3)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: election_count_vote: Election 1 (owner: 3232261594) pass: vote from bl460g1n8 (Uptime)
Oct 21 11:19:43 bl460g1n6 cib[7706]:     info: write_cib_contents: Wrote version 0.1.0 of the CIB to disk (digest: 2b5d37bb9a92bb6b3485bb82e926f2e5)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: crm_get_peer: Node 3232261593 is now known as bl460g1n7
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n7']/transient_attributes: OK (rc=0, origin=bl460g1n7/crmd/10, version=0.5.3)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: crm_get_peer: Node 3232261593 is now known as bl460g1n7
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_ack: Node bl460g1n7[3232261593] - join-2 phase 3 -> 4
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_dc_join_ack: join-2: Updating node state to member for bl460g1n7
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: erase_status_tag: Deleting xpath: //node_state[@uname='bl460g1n7']/lrm
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n7']/lrm: OK (rc=0, origin=local/crmd/25, version=0.5.3)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/26, version=0.5.4)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: election_timer_cb: Election election-attrd complete
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 2 with 3 changes for shutdown, id=<n/a>, set=(null)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 3 with 3 changes for terminate, id=<n/a>, set=(null)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/2, version=0.5.5)
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/3, version=0.5.5)
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: abort_transition_graph: do_te_invoke:151 - Triggered transition abort (complete=1) : Peer Cancelled
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 3 for terminate: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 3 for terminate[bl460g1n6]=(null): OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 3 for terminate[bl460g1n7]=(null): OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 3 for terminate[bl460g1n8]=(null): OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 2 for shutdown: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 2 for shutdown[bl460g1n6]=(null): OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 2 for shutdown[bl460g1n7]=(null): OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 2 for shutdown[bl460g1n8]=(null): OK (0)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/27, version=0.5.5)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/28, version=0.5.5)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section cib: OK (rc=0, origin=local/crmd/29, version=0.5.6)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/30, version=0.5.6)
Oct 21 11:19:43 bl460g1n6 pengine[7684]:    error: unpack_resources: Resource start-up disabled since no STONITH resources have been defined
Oct 21 11:19:43 bl460g1n6 pengine[7684]:    error: unpack_resources: Either configure some or disable STONITH with the stonith-enabled option
Oct 21 11:19:43 bl460g1n6 pengine[7684]:    error: unpack_resources: NOTE: Clusters with shared data need STONITH to ensure data integrity
Oct 21 11:19:43 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n8 is active
Oct 21 11:19:43 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n8 is online
Oct 21 11:19:43 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n6 is active
Oct 21 11:19:43 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n6 is online
Oct 21 11:19:43 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n7 is active
Oct 21 11:19:43 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n7 is online
Oct 21 11:19:43 bl460g1n6 pengine[7684]:   notice: stage6: Delaying fencing operations until there are resources to manage
Oct 21 11:19:43 bl460g1n6 pengine[7684]:   notice: process_pe_message: Calculated Transition 0: /var/lib/pacemaker/pengine/pe-input-0.bz2
Oct 21 11:19:43 bl460g1n6 pengine[7684]:   notice: process_pe_message: Configuration ERRORs found during PE processing.  Please run "crm_verify -L" to identify issues.
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_te_invoke: Processing graph 0 (ref=pe_calc-dc-1382321983-15) derived from /var/lib/pacemaker/pengine/pe-input-0.bz2
Oct 21 11:19:43 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 4: probe_complete probe_complete on bl460g1n8 - no waiting
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: te_rsc_command: Action 4 confirmed - no wait
Oct 21 11:19:43 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 3: probe_complete probe_complete on bl460g1n7 - no waiting
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: te_rsc_command: Action 3 confirmed - no wait
Oct 21 11:19:43 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 2: probe_complete probe_complete on bl460g1n6 (local) - no waiting
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: te_rsc_command: Action 2 confirmed - no wait
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: attrd_client_message: Broadcasting probe_complete[bl460g1n6] = true (writer)
Oct 21 11:19:43 bl460g1n6 crmd[7685]:   notice: run_graph: Transition 0 (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-0.bz2): Complete
Oct 21 11:19:43 bl460g1n6 crmd[7685]:     info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE
Oct 21 11:19:43 bl460g1n6 crmd[7685]:   notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 4 with 1 changes for probe_complete, id=<n/a>, set=(null)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: write_attribute: Write out of probe_complete delayed: update 4 in progress
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/4, version=0.5.7)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 4 for probe_complete: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 4 for probe_complete[bl460g1n6]=true: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 4 for probe_complete[bl460g1n7]=(null): OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 5 with 2 changes for probe_complete, id=<n/a>, set=(null)
Oct 21 11:19:43 bl460g1n6 cib[7706]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.EtbOxm (digest: /var/lib/pacemaker/cib/cib.GRANI3)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/5, version=0.5.8)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: write_attribute: Write out of probe_complete delayed: update 5 in progress
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 5 for probe_complete: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 5 for probe_complete[bl460g1n6]=true: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 5 for probe_complete[bl460g1n7]=true: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 5 for probe_complete[bl460g1n8]=(null): OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 6 with 3 changes for probe_complete, id=<n/a>, set=(null)
Oct 21 11:19:43 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/6, version=0.5.9)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 6 for probe_complete: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 6 for probe_complete[bl460g1n6]=true: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 6 for probe_complete[bl460g1n7]=true: OK (0)
Oct 21 11:19:43 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 6 for probe_complete[bl460g1n8]=true: OK (0)
Oct 21 11:19:43 bl460g1n6 cib[7708]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-1.raw
Oct 21 11:19:43 bl460g1n6 cib[7708]:     info: write_cib_contents: Wrote version 0.5.0 of the CIB to disk (digest: fd1c17f0935512546ae5c2e678df50ae)
Oct 21 11:19:43 bl460g1n6 cib[7708]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.FGLj8y (digest: /var/lib/pacemaker/cib/cib.Ud9hGg)
Oct 21 11:20:18 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbe7fc0 for uid=0 gid=0 pid=7733 id=1704fd54-88ef-40a9-a06d-66bcdaa4dcbb
Oct 21 11:20:18 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.5.9)
Oct 21 11:20:18 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:20:18 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbe7fc0 for uid=0 gid=0 pid=7734 id=a76e8b6f-82be-442c-84bc-1e258f429409
Oct 21 11:20:18 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.5.9)
Oct 21 11:20:18 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:20:18 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbe7fc0 for uid=0 gid=0 pid=7782 id=81d456dc-8fc6-4d67-a104-7752b929a454
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=1, node=, tag=diff, id=(null), magic=NA, cib=0.6.1) : Non-status change
Oct 21 11:20:18 bl460g1n6 crmd[7685]:   notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_level_remove: Node bl460g1n6 not found (0 active entries)
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_level_register: Node bl460g1n6 has 1 active fencing levels
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_level_register: Node bl460g1n6 has 2 active fencing levels
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_level_remove: Node bl460g1n7 not found (1 active entries)
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_level_register: Node bl460g1n7 has 1 active fencing levels
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_level_register: Node bl460g1n7 has 2 active fencing levels
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_level_remove: Node bl460g1n8 not found (2 active entries)
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_level_register: Node bl460g1n8 has 1 active fencing levels
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_level_register: Node bl460g1n8 has 2 active fencing levels
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: update_cib_stonith_devices: Updating device list from the cib: new resource
Oct 21 11:20:18 bl460g1n6 cib[7680]:     info: cib_replace_notify: Replaced: 0.5.9 -> 0.6.1 from bl460g1n6
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:  warning: handle_startup_fencing: Blind faith: not fencing unseen nodes
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: Diff: --- 0.5.9
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: Diff: +++ 0.6.1 65395a06b7ce78fecc54a58606f6d0f6
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: --         <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.1.11-0.302.b6d42ed.git.el6-b6d42ed"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: --         <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="corosync"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <nvpair name="no-quorum-policy" value="freeze" id="cib-bootstrap-options-no-quorum-policy"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <nvpair name="stonith-enabled" value="true" id="cib-bootstrap-options-stonith-enabled"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <nvpair name="startup-fencing" value="false" id="cib-bootstrap-options-startup-fencing"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <nvpair name="crmd-transition-delay" value="2s" id="cib-bootstrap-options-crmd-transition-delay"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <primitive id="prmVM1" class="ocf" provider="heartbeat" type="VirtualDomain">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <instance_attributes id="prmVM1-instance_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="config" value="/etc/libvirt/qemu/vm1.xml" id="prmVM1-instance_attributes-config"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="hypervisor" value="qemu:///system" id="prmVM1-instance_attributes-hypervisor"/>
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_replaced_cb: Updating all attributes after cib_refresh_notify event
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="migration_transport" value="ssh" id="prmVM1-instance_attributes-migration_transport"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <meta_attributes id="prmVM1-meta_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="allow-migrate" value="true" id="prmVM1-meta_attributes-allow-migrate"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </meta_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="start" interval="0s" timeout="120s" on-fail="restart" id="prmVM1-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="monitor" interval="10s" timeout="30s" on-fail="restart" id="prmVM1-monitor-10s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="stop" interval="0s" timeout="120s" on-fail="fence" id="prmVM1-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="migrate_to" interval="0s" timeout="120s" on-fail="restart" id="prmVM1-migrate_to-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="migrate_from" interval="0s" timeout="120s" on-fail="restart" id="prmVM1-migrate_from-0s"/>
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 7 with 3 changes for shutdown, id=<n/a>, set=(null)
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <primitive id="prmVM2" class="ocf" provider="heartbeat" type="VirtualDomain">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <instance_attributes id="prmVM2-instance_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="config" value="/etc/libvirt/qemu/vm2.xml" id="prmVM2-instance_attributes-config"/>
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 8 with 3 changes for terminate, id=<n/a>, set=(null)
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="hypervisor" value="qemu:///system" id="prmVM2-instance_attributes-hypervisor"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="migration_transport" value="ssh" id="prmVM2-instance_attributes-migration_transport"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <meta_attributes id="prmVM2-meta_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="allow-migrate" value="true" id="prmVM2-meta_attributes-allow-migrate"/>
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 9 with 3 changes for probe_complete, id=<n/a>, set=(null)
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-1 has been disabled on bl460g1n6: score=-INFINITY
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </meta_attributes>
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="start" interval="0s" timeout="120s" on-fail="restart" id="prmVM2-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="monitor" interval="10s" timeout="30s" on-fail="restart" id="prmVM2-monitor-10s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="stop" interval="0s" timeout="120s" on-fail="fence" id="prmVM2-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="migrate_to" interval="0s" timeout="120s" on-fail="restart" id="prmVM2-migrate_to-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="migrate_from" interval="0s" timeout="120s" on-fail="restart" id="prmVM2-migrate_from-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <primitive id="prmVM3" class="ocf" provider="heartbeat" type="VirtualDomain">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <instance_attributes id="prmVM3-instance_attributes">
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_POLICY_ENGINE -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_cib_replaced ]
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="config" value="/etc/libvirt/qemu/vm3.xml" id="prmVM3-instance_attributes-config"/>
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: update_dc: Unset DC. Was bl460g1n6
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="hypervisor" value="qemu:///system" id="prmVM3-instance_attributes-hypervisor"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="migration_transport" value="ssh" id="prmVM3-instance_attributes-migration_transport"/>
Oct 21 11:20:18 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <meta_attributes id="prmVM3-meta_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <nvpair name="allow-migrate" value="true" id="prmVM3-meta_attributes-allow-migrate"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </meta_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="start" interval="0s" timeout="120s" on-fail="restart" id="prmVM3-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="monitor" interval="10s" timeout="30s" on-fail="restart" id="prmVM3-monitor-10s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="stop" interval="0s" timeout="120s" on-fail="fence" id="prmVM3-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="migrate_to" interval="0s" timeout="120s" on-fail="restart" id="prmVM3-migrate_to-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <op name="migrate_from" interval="0s" timeout="120s" on-fail="restart" id="prmVM3-migrate_from-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <group id="grpStonith6">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <primitive id="prmStonith6-1" class="stonith" type="external/ipmi">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <instance_attributes id="prmStonith6-1-instance_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_retries" value="1" id="prmStonith6-1-instance_attributes-pcmk_reboot_retries"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_timeout" value="60s" id="prmStonith6-1-instance_attributes-pcmk_reboot_timeout"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="hostname" value="bl460g1n6" id="prmStonith6-1-instance_attributes-hostname"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="ipaddr" value="192.168.133.236" id="prmStonith6-1-instance_attributes-ipaddr"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="userid" value="USERID" id="prmStonith6-1-instance_attributes-userid"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="passwd" value="PASSW0RD" id="prmStonith6-1-instance_attributes-passwd"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="interface" value="lanplus" id="prmStonith6-1-instance_attributes-interface"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="start" interval="0s" timeout="60s" id="prmStonith6-1-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="monitor" interval="360s" timeout="60s" id="prmStonith6-1-monitor-360s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="stop" interval="0s" timeout="60s" id="prmStonith6-1-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <primitive id="prmStonith6-2" class="stonith" type="external/ssh">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <instance_attributes id="prmStonith6-2-instance_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_retries" value="1" id="prmStonith6-2-instance_attributes-pcmk_reboot_retries"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_timeout" value="40s" id="prmStonith6-2-instance_attributes-pcmk_reboot_timeout"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="hostlist" value="bl460g1n6" id="prmStonith6-2-instance_attributes-hostlist"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="start" interval="0s" timeout="60s" id="prmStonith6-2-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="monitor" interval="10s" timeout="60s" id="prmStonith6-2-monitor-10s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="stop" interval="0s" timeout="60s" id="prmStonith6-2-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       </group>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <group id="grpStonith7">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <primitive id="prmStonith7-1" class="stonith" type="external/ipmi">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <instance_attributes id="prmStonith7-1-instance_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_retries" value="1" id="prmStonith7-1-instance_attributes-pcmk_reboot_retries"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_timeout" value="60s" id="prmStonith7-1-instance_attributes-pcmk_reboot_timeout"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="hostname" value="bl460g1n7" id="prmStonith7-1-instance_attributes-hostname"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="ipaddr" value="192.168.133.237" id="prmStonith7-1-instance_attributes-ipaddr"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="userid" value="USERID" id="prmStonith7-1-instance_attributes-userid"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="passwd" value="PASSW0RD" id="prmStonith7-1-instance_attributes-passwd"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="interface" value="lanplus" id="prmStonith7-1-instance_attributes-interface"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="start" interval="0s" timeout="60s" id="prmStonith7-1-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="monitor" interval="360s" timeout="60s" id="prmStonith7-1-monitor-360s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="stop" interval="0s" timeout="60s" id="prmStonith7-1-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <primitive id="prmStonith7-2" class="stonith" type="external/ssh">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <instance_attributes id="prmStonith7-2-instance_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_retries" value="1" id="prmStonith7-2-instance_attributes-pcmk_reboot_retries"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_timeout" value="40s" id="prmStonith7-2-instance_attributes-pcmk_reboot_timeout"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="hostlist" value="bl460g1n7" id="prmStonith7-2-instance_attributes-hostlist"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="start" interval="0s" timeout="60s" id="prmStonith7-2-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="monitor" interval="10s" timeout="60s" id="prmStonith7-2-monitor-10s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="stop" interval="0s" timeout="60s" id="prmStonith7-2-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       </group>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <group id="grpStonith8">
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: election_timer_cb: Election election-0 complete
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <primitive id="prmStonith8-1" class="stonith" type="external/ipmi">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <instance_attributes id="prmStonith8-1-instance_attributes">
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: election_timeout_popped: Election failed: Declaring ourselves the winner
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_retries" value="1" id="prmStonith8-1-instance_attributes-pcmk_reboot_retries"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_timeout" value="60s" id="prmStonith8-1-instance_attributes-pcmk_reboot_timeout"/>
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_log: FSA: Input I_ELECTION_DC from election_timeout_popped() received in state S_ELECTION
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="hostname" value="bl460g1n8" id="prmStonith8-1-instance_attributes-hostname"/>
Oct 21 11:20:18 bl460g1n6 crmd[7685]:   notice: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_TIMER_POPPED origin=election_timeout_popped ]
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="ipaddr" value="192.168.133.238" id="prmStonith8-1-instance_attributes-ipaddr"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="userid" value="USERID" id="prmStonith8-1-instance_attributes-userid"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="passwd" value="PASSW0RD" id="prmStonith8-1-instance_attributes-passwd"/>
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_dc_takeover: Taking over DC status for this partition
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="interface" value="lanplus" id="prmStonith8-1-instance_attributes-interface"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="start" interval="0s" timeout="60s" id="prmStonith8-1-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="monitor" interval="360s" timeout="60s" id="prmStonith8-1-monitor-360s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="stop" interval="0s" timeout="60s" id="prmStonith8-1-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <primitive id="prmStonith8-2" class="stonith" type="external/ssh">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <instance_attributes id="prmStonith8-2-instance_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_retries" value="1" id="prmStonith8-2-instance_attributes-pcmk_reboot_retries"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="pcmk_reboot_timeout" value="40s" id="prmStonith8-2-instance_attributes-pcmk_reboot_timeout"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="hostlist" value="bl460g1n8" id="prmStonith8-2-instance_attributes-hostlist"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="start" interval="0s" timeout="60s" id="prmStonith8-2-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="monitor" interval="10s" timeout="60s" id="prmStonith8-2-monitor-10s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="stop" interval="0s" timeout="60s" id="prmStonith8-2-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       </group>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <clone id="clnPing">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <primitive id="prmPing" class="ocf" provider="pacemaker" type="ping">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <instance_attributes id="prmPing-instance_attributes">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="name" value="default_ping_set" id="prmPing-instance_attributes-name"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="host_list" value="192.168.201.254" id="prmPing-instance_attributes-host_list"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="multiplier" value="100" id="prmPing-instance_attributes-multiplier"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="attempts" value="2" id="prmPing-instance_attributes-attempts"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <nvpair name="timeout" value="2" id="prmPing-instance_attributes-timeout"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </instance_attributes>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="start" interval="0s" timeout="60s" on-fail="restart" id="prmPing-start-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="monitor" interval="10s" timeout="60s" on-fail="restart" id="prmPing-monitor-10s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++             <op name="stop" interval="0s" timeout="60s" on-fail="ignore" id="prmPing-stop-0s"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           </operations>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </primitive>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       </clone>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <rsc_location id="l1" rsc="prmVM1">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <!--#  rule -inf: not_defined default_ping_set or default_ping_set lt 100-->/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <rule score="300" id="l1-rule">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <expression attribute="#uname" operation="eq" value="bl460g1n6" id="l1-expression"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </rule>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <rule score="200" id="l1-rule-0">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <expression attribute="#uname" operation="eq" value="bl460g1n7" id="l1-expression-0"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </rule>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <rule score="100" id="l1-rule-1">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <expression attribute="#uname" operation="eq" value="bl460g1n8" id="l1-expression-1"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </rule>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <rule score="-INFINITY" id="l1-rule-2">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <expression attribute="default_ping_set" operation="lt" value="100" id="l1-expression-2"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </rule>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       </rsc_location>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++       <rsc_location id="l2" rsc="prmVM2">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <rule score="300" id="l2-rule">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <expression attribute="#uname" operation="eq" value="bl460g1n6" id="l2-expression"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </rule>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <rule score="200" id="l2-rule-0">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <expression attribute="#uname" operation="eq" value="bl460g1n7" id="l2-expression-0"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </rule>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <rule score="100" id="l2-rule-1">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <expression attribute="#uname" operation="eq" value="bl460g1n8" id="l2-expression-1"/>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         </rule>
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++         <rule score="-INFINITY" id="l2-rule-2">
Oct 21 11:20:18 bl460g1n6 cib[7680]:   notice: cib:diff: ++           <expression attribute="default_ping_set" operation="lt" value="100" id="l2-expression-2"/>
Oct 21 11:20:18 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 7 for shutdown: OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 7 for shutdown[bl460g1n6]=(null): OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 7 for shutdown[bl460g1n7]=(null): OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 7 for shutdown[bl460g1n8]=(null): OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 8 for terminate: OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 8 for terminate[bl460g1n6]=(null): OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 8 for terminate[bl460g1n7]=(null): OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 8 for terminate[bl460g1n8]=(null): OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 9 for probe_complete: OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 9 for probe_complete[bl460g1n6]=true: OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 9 for probe_complete[bl460g1n7]=true: OK (0)
Oct 21 11:20:18 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 9 for probe_complete[bl460g1n8]=true: OK (0)
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: initialize_join: Node bl460g1n7[3232261593] - join-3 phase 4 -> 0
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: initialize_join: Node bl460g1n8[3232261594] - join-3 phase 4 -> 0
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: initialize_join: Node bl460g1n6[3232261592] - join-3 phase 4 -> 0
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: join_make_offer: join-3: Sending offer to bl460g1n7
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n7[3232261593] - join-3 phase 0 -> 1
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: join_make_offer: join-3: Sending offer to bl460g1n8
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n8[3232261594] - join-3 phase 0 -> 1
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: join_make_offer: join-3: Sending offer to bl460g1n6
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n6[3232261592] - join-3 phase 0 -> 1
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_dc_join_offer_all: join-3: Waiting on 3 outstanding join acks
Oct 21 11:20:18 bl460g1n6 crmd[7685]:  warning: do_log: FSA: Input I_ELECTION_DC from do_election_check() received in state S_INTEGRATION
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: initialize_join: Node bl460g1n7[3232261593] - join-4 phase 1 -> 0
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: initialize_join: Node bl460g1n8[3232261594] - join-4 phase 1 -> 0
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: initialize_join: Node bl460g1n6[3232261592] - join-4 phase 1 -> 0
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: join_make_offer: join-4: Sending offer to bl460g1n7
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n7[3232261593] - join-4 phase 0 -> 1
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: join_make_offer: join-4: Sending offer to bl460g1n8
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n8[3232261594] - join-4 phase 0 -> 1
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: join_make_offer: join-4: Sending offer to bl460g1n6
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n6[3232261592] - join-4 phase 0 -> 1
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_dc_join_offer_all: join-4: Waiting on 3 outstanding join acks
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: update_dc: Set DC to bl460g1n6 (3.0.7)
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n8[3232261594] - join-4 phase 1 -> 2
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n6[3232261592] - join-4 phase 1 -> 2
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n7[3232261593] - join-4 phase 1 -> 2
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crmd_join_phase_log: join-4: bl460g1n7=integrated
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crmd_join_phase_log: join-4: bl460g1n8=integrated
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crmd_join_phase_log: join-4: bl460g1n6=integrated
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_dc_join_finalize: join-4: Syncing our CIB to the rest of the cluster
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: finalize_join_for: Node bl460g1n7[3232261593] - join-4 phase 2 -> 3
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: finalize_join_for: Node bl460g1n8[3232261594] - join-4 phase 2 -> 3
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: finalize_join_for: Node bl460g1n6[3232261592] - join-4 phase 2 -> 3
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_ack: Node bl460g1n7[3232261593] - join-4 phase 3 -> 4
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_dc_join_ack: join-4: Updating node state to member for bl460g1n7
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: erase_status_tag: Deleting xpath: //node_state[@uname='bl460g1n7']/lrm
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_ack: Node bl460g1n8[3232261594] - join-4 phase 3 -> 4
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_dc_join_ack: join-4: Updating node state to member for bl460g1n8
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: erase_status_tag: Deleting xpath: //node_state[@uname='bl460g1n8']/lrm
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_ack: Node bl460g1n6[3232261592] - join-4 phase 3 -> 4
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_dc_join_ack: join-4: Updating node state to member for bl460g1n6
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: erase_status_tag: Deleting xpath: //node_state[@uname='bl460g1n6']/lrm
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
Oct 21 11:20:18 bl460g1n6 crmd[7685]:     info: abort_transition_graph: do_te_invoke:151 - Triggered transition abort (complete=1) : Peer Cancelled
Oct 21 11:20:18 bl460g1n6 cib[7785]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-2.raw
Oct 21 11:20:18 bl460g1n6 cib[7785]:     info: write_cib_contents: Wrote version 0.7.0 of the CIB to disk (digest: a7e604e59f9a2dfc32eb6b09eaaef938)
Oct 21 11:20:18 bl460g1n6 cib[7785]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.9Jg1Lh (digest: /var/lib/pacemaker/cib/cib.I8guix)
Oct 21 11:20:18 bl460g1n6 cib[7786]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-3.raw
Oct 21 11:20:18 bl460g1n6 cib[7786]:     info: write_cib_contents: Wrote version 0.8.0 of the CIB to disk (digest: 691cb7e31283f65808b970435c0d8e48)
Oct 21 11:20:18 bl460g1n6 cib[7786]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.t2Px4s (digest: /var/lib/pacemaker/cib/cib.ecvwWI)
Oct 21 11:20:19 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith6-2' to the device list (1 active devices)
Oct 21 11:20:19 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:19 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:20 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-1' to the device list (2 active devices)
Oct 21 11:20:20 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:20 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:20 bl460g1n6 crmd[7685]:     info: crm_timer_popped: New Transition Timer (I_PE_CALC) just popped (2000ms)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n8 is active
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n8 is online
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n6 is active
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n6 is online
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n7 is active
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n7 is online
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: native_print: prmVM1	(ocf::heartbeat:VirtualDomain):	Stopped 
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: native_print: prmVM2	(ocf::heartbeat:VirtualDomain):	Stopped 
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: native_print: prmVM3	(ocf::heartbeat:VirtualDomain):	Stopped 
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: group_print:  Resource Group: grpStonith6
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith6-1	(stonith:external/ipmi):	Stopped 
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith6-2	(stonith:external/ssh):	Stopped 
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: group_print:  Resource Group: grpStonith7
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith7-1	(stonith:external/ipmi):	Stopped 
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith7-2	(stonith:external/ssh):	Stopped 
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: group_print:  Resource Group: grpStonith8
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith8-1	(stonith:external/ipmi):	Stopped 
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith8-2	(stonith:external/ssh):	Stopped 
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: clone_print:  Clone Set: clnPing [prmPing]
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: short_print:      Stopped: [ bl460g1n6 bl460g1n7 bl460g1n8 ]
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmVM1 on bl460g1n6
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmVM2 on bl460g1n6
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmVM3 on bl460g1n6
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (360s) for prmStonith6-1 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmStonith6-2 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (360s) for prmStonith7-1 on bl460g1n8
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmStonith7-2 on bl460g1n8
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (360s) for prmStonith8-1 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmStonith8-2 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmPing:0 on bl460g1n6
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmPing:1 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmPing:2 on bl460g1n8
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmVM1	(bl460g1n6)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmVM2	(bl460g1n6)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmVM3	(bl460g1n6)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith6-1	(bl460g1n7)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith6-2	(bl460g1n7)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith7-1	(bl460g1n8)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith7-2	(bl460g1n8)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith8-1	(bl460g1n7)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith8-2	(bl460g1n7)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmPing:0	(bl460g1n6)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmPing:1	(bl460g1n7)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmPing:2	(bl460g1n8)
Oct 21 11:20:20 bl460g1n6 pengine[7684]:   notice: process_pe_message: Calculated Transition 1: /var/lib/pacemaker/pengine/pe-input-1.bz2
Oct 21 11:20:20 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 21 11:20:20 bl460g1n6 crmd[7685]:     info: do_te_invoke: Processing graph 1 (ref=pe_calc-dc-1382322020-32) derived from /var/lib/pacemaker/pengine/pe-input-1.bz2
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 26: monitor prmVM1_monitor_0 on bl460g1n8
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 15: monitor prmVM1_monitor_0 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 4: monitor prmVM1_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:20 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmVM1' not found (0 active resources)
Oct 21 11:20:20 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmVM1' to the rsc list (1 active resources)
Oct 21 11:20:20 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=4:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmVM1_monitor_0
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 27: monitor prmVM2_monitor_0 on bl460g1n8
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 16: monitor prmVM2_monitor_0 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 5: monitor prmVM2_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:20 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmVM2' not found (1 active resources)
Oct 21 11:20:20 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmVM2' to the rsc list (2 active resources)
Oct 21 11:20:20 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=5:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmVM2_monitor_0
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 28: monitor prmVM3_monitor_0 on bl460g1n8
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 17: monitor prmVM3_monitor_0 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 6: monitor prmVM3_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:20 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmVM3' not found (2 active resources)
Oct 21 11:20:20 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmVM3' to the rsc list (3 active resources)
Oct 21 11:20:20 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=6:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmVM3_monitor_0
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 29: monitor prmStonith6-1_monitor_0 on bl460g1n8
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 18: monitor prmStonith6-1_monitor_0 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 7: monitor prmStonith6-1_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:20 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmStonith6-1' not found (3 active resources)
Oct 21 11:20:20 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmStonith6-1' to the rsc list (4 active resources)
Oct 21 11:20:20 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=7:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmStonith6-1_monitor_0
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 30: monitor prmStonith6-2_monitor_0 on bl460g1n8
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 19: monitor prmStonith6-2_monitor_0 on bl460g1n7
Oct 21 11:20:20 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 8: monitor prmStonith6-2_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:20 bl460g1n6 VirtualDomain(prmVM1)[7789]: DEBUG: Virtual domain vm1 is currently running.
Oct 21 11:20:20 bl460g1n6 VirtualDomain(prmVM2)[7790]: DEBUG: Virtual domain vm2 is currently running.
Oct 21 11:20:20 bl460g1n6 VirtualDomain(prmVM3)[7791]: DEBUG: Virtual domain vm3 is currently running.
Oct 21 11:20:21 bl460g1n6 cib[7880]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-4.raw
Oct 21 11:20:21 bl460g1n6 crm_resource[7884]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:21 bl460g1n6 crm_resource[7884]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:21 bl460g1n6 crm_resource[7888]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:21 bl460g1n6 crm_resource[7888]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:21 bl460g1n6 crm_resource[7886]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:21 bl460g1n6 crm_resource[7886]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:21 bl460g1n6 cib[7880]:     info: write_cib_contents: Wrote version 0.11.0 of the CIB to disk (digest: 386307e745636a0ab3808ef7dcbad794)
Oct 21 11:20:21 bl460g1n6 cib[7880]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.vdhi3v (digest: /var/lib/pacemaker/cib/cib.QWxpGR)
Oct 21 11:20:21 bl460g1n6 crm_resource[7894]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:21 bl460g1n6 crm_resource[7894]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:21 bl460g1n6 cib[7901]:     info: write_cib_contents: Archived previous version as /var/lib/pacemaker/cib/cib-5.raw
Oct 21 11:20:21 bl460g1n6 crm_resource[7905]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:21 bl460g1n6 crm_resource[7905]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:21 bl460g1n6 crm_resource[7907]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:21 bl460g1n6 crm_resource[7907]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:21 bl460g1n6 cib[7901]:     info: write_cib_contents: Wrote version 0.14.0 of the CIB to disk (digest: d03db20616fa0f9347c494c5a518bf99)
Oct 21 11:20:21 bl460g1n6 cib[7901]:     info: retrieveCib: Reading cluster configuration from: /var/lib/pacemaker/cib/cib.QkJPGH (digest: /var/lib/pacemaker/cib/cib.2KqzF3)
Oct 21 11:20:21 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-2' to the device list (3 active devices)
Oct 21 11:20:21 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:21 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:22 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-1' to the device list (4 active devices)
Oct 21 11:20:22 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:22 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:23 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-2' to the device list (5 active devices)
Oct 21 11:20:23 bl460g1n6 stonith-ng[7681]:     info: update_cib_stonith_devices: Updating device list from the cib: new resource
Oct 21 11:20:23 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-1 has been disabled on bl460g1n6: score=-INFINITY
Oct 21 11:20:23 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith6-2' from the device list (4 active devices)
Oct 21 11:20:23 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:23 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:24 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith6-2' to the device list (5 active devices)
Oct 21 11:20:24 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-1' from the device list (4 active devices)
Oct 21 11:20:24 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:24 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:25 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-1' to the device list (5 active devices)
Oct 21 11:20:25 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-2' from the device list (4 active devices)
Oct 21 11:20:25 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:25 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:26 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-2' to the device list (5 active devices)
Oct 21 11:20:26 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-1' from the device list (4 active devices)
Oct 21 11:20:26 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:26 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:27 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-1' to the device list (5 active devices)
Oct 21 11:20:27 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-2' from the device list (4 active devices)
Oct 21 11:20:27 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:27 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:28 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-2' to the device list (5 active devices)
Oct 21 11:20:28 bl460g1n6 stonith-ng[7681]:     info: update_cib_stonith_devices: Updating device list from the cib: new resource
Oct 21 11:20:28 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-1 has been disabled on bl460g1n6: score=-INFINITY
Oct 21 11:20:28 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith6-2' from the device list (4 active devices)
Oct 21 11:20:28 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:28 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:29 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith6-2' to the device list (5 active devices)
Oct 21 11:20:29 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-1' from the device list (4 active devices)
Oct 21 11:20:29 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:29 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:30 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-1' to the device list (5 active devices)
Oct 21 11:20:30 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-2' from the device list (4 active devices)
Oct 21 11:20:30 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:30 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:31 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-2' to the device list (5 active devices)
Oct 21 11:20:31 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-1' from the device list (4 active devices)
Oct 21 11:20:31 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:31 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:32 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-1' to the device list (5 active devices)
Oct 21 11:20:32 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-2' from the device list (4 active devices)
Oct 21 11:20:32 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:32 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:33 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-2' to the device list (5 active devices)
Oct 21 11:20:33 bl460g1n6 stonith-ng[7681]:     info: update_cib_stonith_devices: Updating device list from the cib: new resource
Oct 21 11:20:33 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-1 has been disabled on bl460g1n6: score=-INFINITY
Oct 21 11:20:33 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith6-2' from the device list (4 active devices)
Oct 21 11:20:33 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:33 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:34 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith6-2' to the device list (5 active devices)
Oct 21 11:20:34 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-1' from the device list (4 active devices)
Oct 21 11:20:34 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:34 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:35 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-1' to the device list (5 active devices)
Oct 21 11:20:35 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-2' from the device list (4 active devices)
Oct 21 11:20:35 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:35 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:36 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-2' to the device list (5 active devices)
Oct 21 11:20:36 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-1' from the device list (4 active devices)
Oct 21 11:20:36 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:36 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:37 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-1' to the device list (5 active devices)
Oct 21 11:20:37 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-2' from the device list (4 active devices)
Oct 21 11:20:37 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:37 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:38 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-2' to the device list (5 active devices)
Oct 21 11:20:38 bl460g1n6 stonith-ng[7681]:     info: update_cib_stonith_devices: Updating device list from the cib: new resource
Oct 21 11:20:38 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-1 has been disabled on bl460g1n6: score=-INFINITY
Oct 21 11:20:38 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith6-2' from the device list (4 active devices)
Oct 21 11:20:38 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:38 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:39 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith6-2' to the device list (5 active devices)
Oct 21 11:20:39 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-1' from the device list (4 active devices)
Oct 21 11:20:39 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:39 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:40 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-1' to the device list (5 active devices)
Oct 21 11:20:40 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-2' from the device list (4 active devices)
Oct 21 11:20:40 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:40 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:41 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-2' to the device list (5 active devices)
Oct 21 11:20:41 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-1' from the device list (4 active devices)
Oct 21 11:20:41 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:41 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:42 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-1' to the device list (5 active devices)
Oct 21 11:20:42 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-2' from the device list (4 active devices)
Oct 21 11:20:42 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:42 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:43 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-2' to the device list (5 active devices)
Oct 21 11:20:43 bl460g1n6 stonith-ng[7681]:     info: update_cib_stonith_devices: Updating device list from the cib: new resource
Oct 21 11:20:43 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-1 has been disabled on bl460g1n6: score=-INFINITY
Oct 21 11:20:43 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith6-2' from the device list (4 active devices)
Oct 21 11:20:43 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:43 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:44 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith6-2' to the device list (5 active devices)
Oct 21 11:20:44 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-1' from the device list (4 active devices)
Oct 21 11:20:44 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:44 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:45 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-1' to the device list (5 active devices)
Oct 21 11:20:45 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-2' from the device list (4 active devices)
Oct 21 11:20:45 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:45 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:46 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-2' to the device list (5 active devices)
Oct 21 11:20:46 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-1' from the device list (4 active devices)
Oct 21 11:20:46 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:46 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:47 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-1' to the device list (5 active devices)
Oct 21 11:20:47 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-2' from the device list (4 active devices)
Oct 21 11:20:47 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:47 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:48 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-2' to the device list (5 active devices)
Oct 21 11:20:48 bl460g1n6 stonith-ng[7681]:     info: update_cib_stonith_devices: Updating device list from the cib: new resource
Oct 21 11:20:48 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-1 has been disabled on bl460g1n6: score=-INFINITY
Oct 21 11:20:48 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith6-2' from the device list (4 active devices)
Oct 21 11:20:48 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith6-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:48 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:49 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith6-2' to the device list (5 active devices)
Oct 21 11:20:49 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-1' from the device list (4 active devices)
Oct 21 11:20:49 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:49 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:50 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-1' to the device list (5 active devices)
Oct 21 11:20:50 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith7-2' from the device list (4 active devices)
Oct 21 11:20:50 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith7-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:50 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:51 bl460g1n6 crmd[7685]:  warning: crm_ipc_send: Request 90 to lrmd (0x1eacdd0) failed: OK (0)
Oct 21 11:20:51 bl460g1n6 crmd[7685]:    error: crm_element_value: Couldn't find lrmd_callid in NULL
Oct 21 11:20:51 bl460g1n6 crmd[7685]:    error: crm_abort: crm_element_value: Triggered assert at xml.c:3336 : data != NULL
Oct 21 11:20:51 bl460g1n6 crmd[7685]:    error: crm_element_value: Couldn't find lrmd_rc in NULL
Oct 21 11:20:51 bl460g1n6 crmd[7685]:    error: crm_abort: crm_element_value: Triggered assert at xml.c:3336 : data != NULL
Oct 21 11:20:51 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith7-2' to the device list (5 active devices)
Oct 21 11:20:51 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-1' from the device list (4 active devices)
Oct 21 11:20:51 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-1 is allowed on bl460g1n6: score=0
Oct 21 11:20:51 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:52 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:message_handler_req_exec_cpg_procleave:1276 got procleave message from cluster node -1062705702
Oct 21 11:20:52 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:message_handler_req_exec_cpg_procleave:1276 got procleave message from cluster node -1062705703
Oct 21 11:20:52 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:message_handler_req_exec_cpg_procjoin:1260 got procjoin message from cluster node -1062705702 (r(0) ip(192.168.101.218) r(1) ip(192.168.102.218) ) for pid 1841
Oct 21 11:20:52 bl460g1n6 corosync[7666]:   [CPG   ] cpg.c:message_handler_req_exec_cpg_procjoin:1260 got procjoin message from cluster node -1062705703 (r(0) ip(192.168.101.217) r(1) ip(192.168.102.217) ) for pid 12703
Oct 21 11:20:52 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-1' to the device list (5 active devices)
Oct 21 11:20:52 bl460g1n6 stonith-ng[7681]:     info: stonith_device_remove: Removed 'prmStonith8-2' from the device list (4 active devices)
Oct 21 11:20:52 bl460g1n6 stonith-ng[7681]:     info: cib_device_update: Device prmStonith8-2 is allowed on bl460g1n6: score=0
Oct 21 11:20:52 bl460g1n6 stonith-ng[7681]:     info: stonith_action_create: Initiating action metadata for agent fence_legacy (target=(null))
Oct 21 11:20:53 bl460g1n6 stonith-ng[7681]:   notice: stonith_device_register: Added 'prmStonith8-2' to the device list (5 active devices)
Oct 21 11:20:53 bl460g1n6 stonith-ng[7681]:     info: crm_client_new: Connecting 0x1ea7c30 for uid=0 gid=0 pid=7682 id=85093e05-8bcc-40ba-adfe-1cdbcb846770
Oct 21 11:20:53 bl460g1n6 stonith-ng[7681]:     info: stonith_command: Processed register from lrmd.7682: OK (0)
Oct 21 11:20:53 bl460g1n6 stonith-ng[7681]:     info: stonith_command: Processed st_notify from lrmd.7682: OK (0)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmStonith6-2' not found (4 active resources)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmStonith6-2' to the rsc list (5 active resources)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:    error: internal_ipc_get_reply: Discarding old reply 90 (need 91)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: internal_ipc_get_reply: OldIpcReply   <lrmd_reply lrmd_origin="process_lrmd_get_rsc_info" lrmd_rc="-19" lrmd_callid="18"/>
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=8:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmStonith6-2_monitor_0
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 31: monitor prmStonith7-1_monitor_0 on bl460g1n8
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 20: monitor prmStonith7-1_monitor_0 on bl460g1n7
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 9: monitor prmStonith7-1_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmStonith7-1' not found (5 active resources)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmStonith7-1' to the rsc list (6 active resources)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=9:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmStonith7-1_monitor_0
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 32: monitor prmStonith7-2_monitor_0 on bl460g1n8
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 21: monitor prmStonith7-2_monitor_0 on bl460g1n7
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 10: monitor prmStonith7-2_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmStonith7-2' not found (6 active resources)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmStonith7-2' to the rsc list (7 active resources)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=10:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmStonith7-2_monitor_0
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 33: monitor prmStonith8-1_monitor_0 on bl460g1n8
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 22: monitor prmStonith8-1_monitor_0 on bl460g1n7
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 11: monitor prmStonith8-1_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmStonith8-1' not found (7 active resources)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmStonith8-1' to the rsc list (8 active resources)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=11:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmStonith8-1_monitor_0
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 34: monitor prmStonith8-2_monitor_0 on bl460g1n8
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 23: monitor prmStonith8-2_monitor_0 on bl460g1n7
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 12: monitor prmStonith8-2_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmStonith8-2' not found (8 active resources)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmStonith8-2' to the rsc list (9 active resources)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=12:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmStonith8-2_monitor_0
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 13: monitor prmPing:0_monitor_0 on bl460g1n6 (local)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmPing' not found (9 active resources)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_get_rsc_info: Resource 'prmPing:0' not found (9 active resources)
Oct 21 11:20:53 bl460g1n6 lrmd[7682]:     info: process_lrmd_rsc_register: Added 'prmPing' to the rsc list (10 active resources)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=13:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmPing_monitor_0
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 24: monitor prmPing:1_monitor_0 on bl460g1n7
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 35: monitor prmPing:2_monitor_0 on bl460g1n8
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.9.1) : Non-status change
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.10.1) : Non-status change
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.11.1) : Non-status change
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.12.1) : Non-status change
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.13.1) : Non-status change
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:126 - Triggered transition abort (complete=0, node=, tag=diff, id=(null), magic=NA, cib=0.14.1) : Non-status change
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: process_lrm_event: LRM operation prmStonith6-1_monitor_0 (call=17, rc=7, cib-update=60, confirmed=true) not running
Oct 21 11:20:53 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/60, version=0.14.2)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: services_os_action_execute: Managed VirtualDomain_meta-data_0 process 7977 exited with rc=0
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: process_lrm_event: LRM operation prmVM1_monitor_0 (call=5, rc=0, cib-update=61, confirmed=true) ok
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: process_lrm_event: LRM operation prmVM2_monitor_0 (call=9, rc=0, cib-update=62, confirmed=true) ok
Oct 21 11:20:53 bl460g1n6 crmd[7685]:   notice: process_lrm_event: LRM operation prmVM3_monitor_0 (call=13, rc=0, cib-update=63, confirmed=true) ok
Oct 21 11:20:53 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/61, version=0.14.3)
Oct 21 11:20:53 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/62, version=0.14.4)
Oct 21 11:20:53 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/63, version=0.14.5)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: process_lrm_event: LRM operation prmStonith6-2_monitor_0 (call=21, rc=7, cib-update=64, confirmed=true) not running
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-1_monitor_0 (7) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:  warning: status_from_rc: Action 4 (prmVM1_monitor_0) on bl460g1n6 failed (target: 7 vs. rc: 0): Error
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: abort_transition_graph: match_graph_event:369 - Triggered transition abort (complete=0, node=bl460g1n6, tag=lrm_rsc_op, id=prmVM1_last_failure_0, magic=0:0;4:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5, cib=0.14.3) : Event failed
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM1_monitor_0 (4) confirmed on bl460g1n6 (rc=4)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.4) prmVM1_monitor_0.5=ok: failed
Oct 21 11:20:53 bl460g1n6 crmd[7685]:  warning: status_from_rc: Action 5 (prmVM2_monitor_0) on bl460g1n6 failed (target: 7 vs. rc: 0): Error
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: abort_transition_graph: match_graph_event:369 - Triggered transition abort (complete=0, node=bl460g1n6, tag=lrm_rsc_op, id=prmVM2_last_failure_0, magic=0:0;5:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5, cib=0.14.4) : Event failed
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM2_monitor_0 (5) confirmed on bl460g1n6 (rc=4)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.5) prmVM2_monitor_0.9=ok: failed
Oct 21 11:20:53 bl460g1n6 crmd[7685]:  warning: status_from_rc: Action 6 (prmVM3_monitor_0) on bl460g1n6 failed (target: 7 vs. rc: 0): Error
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: abort_transition_graph: match_graph_event:369 - Triggered transition abort (complete=0, node=bl460g1n6, tag=lrm_rsc_op, id=prmVM3_last_failure_0, magic=0:0;6:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5, cib=0.14.5) : Event failed
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM3_monitor_0 (6) confirmed on bl460g1n6 (rc=4)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.6) prmVM3_monitor_0.13=ok: failed
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-2_monitor_0 (8) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:53 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/64, version=0.14.6)
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: process_lrm_event: LRM operation prmStonith7-1_monitor_0 (call=25, rc=7, cib-update=65, confirmed=true) not running
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: process_lrm_event: LRM operation prmStonith7-2_monitor_0 (call=29, rc=7, cib-update=66, confirmed=true) not running
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: process_lrm_event: LRM operation prmStonith8-1_monitor_0 (call=33, rc=7, cib-update=67, confirmed=true) not running
Oct 21 11:20:53 bl460g1n6 crmd[7685]:     info: process_lrm_event: LRM operation prmStonith8-2_monitor_0 (call=37, rc=7, cib-update=68, confirmed=true) not running
Oct 21 11:20:53 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/65, version=0.14.7)
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/66, version=0.14.8)
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/67, version=0.14.9)
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/68, version=0.14.10)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: services_os_action_execute: Managed ping_meta-data_0 process 7996 exited with rc=0
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: process_lrm_event: LRM operation prmPing_monitor_0 (call=42, rc=7, cib-update=69, confirmed=true) not running
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-1_monitor_0 (9) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-2_monitor_0 (10) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-1_monitor_0 (11) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-2_monitor_0 (12) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Left[2.0] crmd.3232261594 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node bl460g1n8[3232261594] - corosync-cpg is now offline
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: peer_update_callback: Client bl460g1n8/peer now has status [offline] (DC=true)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:  warning: match_down_event: No match for shutdown action on 3232261594
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: peer_update_callback: Stonith/shutdown of bl460g1n8 not matched
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: peer_update_callback: Node bl460g1n8[3232261594] - join-4 phase 4 -> 0
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: peer_update_callback:217 - Triggered transition abort (complete=0) : Node failure
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 26 (26) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 27 (27) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 28 (28) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 29 (29) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 30 (30) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 51 (51) is scheduled for 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 50 (50) is scheduled for 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 31 (31) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 53 (53) is scheduled for 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 52 (52) is scheduled for 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 32 (32) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 33 (33) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 34 (34) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 71 (71) is scheduled for 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 70 (70) is scheduled for 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 35 (35) was pending on 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 25 (25) is scheduled for 3232261594 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:  warning: fail_incompletable_actions: Node 3232261594 shutdown resulted in un-runnable actions
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: fail_incompletable_actions:93 - Triggered transition abort (complete=0, node=, tag=rsc_op, id=25, magic=NA) : Node failure
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[2.0] crmd.3232261592 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[2.1] crmd.3232261593 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Left[3.0] crmd.3232261593 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node bl460g1n7[3232261593] - corosync-cpg is now offline
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: peer_update_callback: Client bl460g1n7/peer now has status [offline] (DC=true)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:  warning: match_down_event: No match for shutdown action on 3232261593
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: peer_update_callback: Stonith/shutdown of bl460g1n7 not matched
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: peer_update_callback: Node bl460g1n7[3232261593] - join-4 phase 4 -> 0
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: peer_update_callback:217 - Triggered transition abort (complete=0) : Node failure
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 15 (15) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 16 (16) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 17 (17) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 43 (43) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 42 (42) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 18 (18) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 45 (45) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/69, version=0.14.11)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 44 (44) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 19 (19) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 20 (20) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 21 (21) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 59 (59) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 58 (58) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 22 (22) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 61 (61) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 60 (60) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 23 (23) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 69 (69) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 68 (68) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 24 (24) was pending on 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: fail_incompletable_actions: Action 14 (14) is scheduled for 3232261593 (offline)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:  warning: fail_incompletable_actions: Node 3232261593 shutdown resulted in un-runnable actions
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: fail_incompletable_actions:93 - Triggered transition abort (complete=0, node=, tag=rsc_op, id=14, magic=NA) : Node failure
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[3.0] crmd.3232261592 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Joined[4.0] crmd.3232261594 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[4.0] crmd.3232261592 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[4.1] crmd.3232261594 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node bl460g1n8[3232261594] - corosync-cpg is now online
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: peer_update_callback: Client bl460g1n8/peer now has status [online] (DC=true)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Joined[5.0] crmd.3232261593 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[5.0] crmd.3232261592 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[5.1] crmd.3232261593 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_proc: pcmk_cpg_membership: Node bl460g1n7[3232261593] - corosync-cpg is now online
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: peer_update_callback: Client bl460g1n7/peer now has status [online] (DC=true)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: pcmk_cpg_membership: Member[5.2] crmd.3232261594 
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_FSA_INTERNAL origin=peer_update_callback ]
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: do_dc_join_offer_one: An unknown node joined - (re-)offer to any unconfirmed nodes
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: join-4: Sending offer to bl460g1n7
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n7[3232261593] - join-4 phase 0 -> 1
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: join-4: Sending offer to bl460g1n8
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n8[3232261594] - join-4 phase 0 -> 1
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: Skipping bl460g1n6: already known 4
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: do_te_invoke:158 - Triggered transition abort (complete=0) : Peer Halt
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmPing_monitor_0 (13) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 3: probe_complete probe_complete on bl460g1n6 (local) - no waiting
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: te_rsc_command: Action 3 confirmed - no wait
Oct 21 11:20:54 bl460g1n6 attrd[7683]:     info: attrd_client_message: Broadcasting probe_complete[bl460g1n6] = true (writer)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:   notice: run_graph: Transition 1 (Complete=14, Pending=0, Fired=0, Skipped=51, Incomplete=1, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Stopped
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: do_dc_join_offer_one: An unknown node joined - (re-)offer to any unconfirmed nodes
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: Skipping bl460g1n7: already known 1
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: Skipping bl460g1n8: already known 1
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: Skipping bl460g1n6: already known 4
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: do_te_invoke:158 - Triggered transition abort (complete=1) : Peer Halt
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/70, version=0.14.12)
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/71, version=0.14.13)
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/72, version=0.14.14)
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/73, version=0.14.15)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: do_dc_join_offer_one: join-4: Processing join_announce request from bl460g1n8 in state S_INTEGRATION
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_offer_one: Node bl460g1n8[3232261594] - join-4 phase 1 -> 0
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: join-4: Sending offer to bl460g1n8
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n8[3232261594] - join-4 phase 0 -> 1
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n6[3232261592] - join-4 phase 4 -> 0
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: join-4: Sending offer to bl460g1n6
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n6[3232261592] - join-4 phase 0 -> 1
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: do_dc_join_offer_one:242 - Triggered transition abort (complete=1) : Node join
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/74, version=0.14.15)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n6[3232261592] - join-4 phase 1 -> 2
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n8, tag=lrm_rsc_op, id=prmStonith7-1_last_failure_0, magic=4:99;31:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.31) prmStonith7-1_monitor_0.0=unknown: arrived late
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n8, tag=lrm_rsc_op, id=prmStonith7-2_last_failure_0, magic=4:99;32:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.32) prmStonith7-2_monitor_0.0=unknown: arrived late
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n8, tag=lrm_rsc_op, id=prmStonith8-1_last_failure_0, magic=4:99;33:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.33) prmStonith8-1_monitor_0.0=unknown: arrived late
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: do_dc_join_offer_one: join-4: Processing join_announce request from bl460g1n7 in state S_INTEGRATION
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_offer_one: Node bl460g1n7[3232261593] - join-4 phase 1 -> 0
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: join-4: Sending offer to bl460g1n7
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n7[3232261593] - join-4 phase 0 -> 1
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n6[3232261592] - join-4 phase 2 -> 0
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: join_make_offer: join-4: Sending offer to bl460g1n6
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: join_make_offer: Node bl460g1n6[3232261592] - join-4 phase 0 -> 1
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: do_dc_join_offer_one:242 - Triggered transition abort (complete=1) : Node join
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n8, tag=lrm_rsc_op, id=prmStonith8-2_last_failure_0, magic=4:99;34:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.34) prmStonith8-2_monitor_0.0=unknown: arrived late
Oct 21 11:20:54 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/75, version=0.14.15)
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n6[3232261592] - join-4 phase 1 -> 2
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n8, tag=lrm_rsc_op, id=prmPing_last_failure_0, magic=4:99;35:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.35) prmPing_monitor_0.0=unknown: arrived late
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n7, tag=lrm_rsc_op, id=prmStonith7-1_last_failure_0, magic=4:99;20:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.20) prmStonith7-1_monitor_0.0=unknown: arrived late
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n7, tag=lrm_rsc_op, id=prmStonith7-2_last_failure_0, magic=4:99;21:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.21) prmStonith7-2_monitor_0.0=unknown: arrived late
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n7, tag=lrm_rsc_op, id=prmStonith8-1_last_failure_0, magic=4:99;22:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.22) prmStonith8-1_monitor_0.0=unknown: arrived late
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n7, tag=lrm_rsc_op, id=prmStonith8-2_last_failure_0, magic=4:99;23:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.23) prmStonith8-2_monitor_0.0=unknown: arrived late
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: abort_transition_graph: process_graph_event:583 - Triggered transition abort (complete=1, node=bl460g1n7, tag=lrm_rsc_op, id=prmPing_last_failure_0, magic=4:99;24:1:7:38db9a68-056c-4e65-8658-75f0c3cc91e5) : Inactive graph
Oct 21 11:20:54 bl460g1n6 crmd[7685]:     info: process_graph_event: Detected action (1.24) prmPing_monitor_0.0=unknown: arrived late
Oct 21 11:20:55 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n8[3232261594] - join-4 phase 1 -> 2
Oct 21 11:20:55 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_filter_offer: Node bl460g1n7[3232261593] - join-4 phase 1 -> 2
Oct 21 11:20:55 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Oct 21 11:20:55 bl460g1n6 crmd[7685]:     info: crmd_join_phase_log: join-4: bl460g1n7=integrated
Oct 21 11:20:55 bl460g1n6 crmd[7685]:     info: crmd_join_phase_log: join-4: bl460g1n8=integrated
Oct 21 11:20:55 bl460g1n6 crmd[7685]:     info: crmd_join_phase_log: join-4: bl460g1n6=integrated
Oct 21 11:20:55 bl460g1n6 crmd[7685]:     info: do_dc_join_finalize: join-4: Syncing our CIB to the rest of the cluster
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_sync operation for section 'all': OK (rc=0, origin=local/crmd/76, version=0.14.15)
Oct 21 11:20:56 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: finalize_join_for: Node bl460g1n7[3232261593] - join-4 phase 2 -> 3
Oct 21 11:20:56 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: finalize_join_for: Node bl460g1n8[3232261594] - join-4 phase 2 -> 3
Oct 21 11:20:56 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: finalize_join_for: Node bl460g1n6[3232261592] - join-4 phase 2 -> 3
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/77, version=0.14.15)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/78, version=0.14.15)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/79, version=0.14.15)
Oct 21 11:20:56 bl460g1n6 crmd[7685]:     info: crm_update_peer_join: do_dc_join_ack: Node bl460g1n6[3232261592] - join-4 phase 3 -> 4
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n6']/lrm: OK (rc=0, origin=local/crmd/80, version=0.14.16)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n7']/transient_attributes: OK (rc=0, origin=bl460g1n7/crmd/8, version=0.14.17)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n8']/transient_attributes: OK (rc=0, origin=bl460g1n8/crmd/8, version=0.14.18)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/81, version=0.14.19)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n7']/lrm: OK (rc=0, origin=local/crmd/82, version=0.14.20)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/83, version=0.14.21)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_delete operation for section //node_state[@uname='bl460g1n8']/lrm: OK (rc=0, origin=local/crmd/84, version=0.14.22)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/85, version=0.14.23)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section nodes: OK (rc=0, origin=local/crmd/86, version=0.14.23)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/87, version=0.14.24)
Oct 21 11:20:56 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section cib: OK (rc=0, origin=local/crmd/88, version=0.14.24)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: crm_timer_popped: New Transition Timer (I_PE_CALC) just popped (2000ms)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/89, version=0.14.24)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n8 is active
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n8 is online
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n6 is active
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n6 is online
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n7 is active
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n7 is online
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: determine_op_status: Operation monitor found resource prmVM1 active on bl460g1n6
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: determine_op_status: Operation monitor found resource prmVM2 active on bl460g1n6
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: determine_op_status: Operation monitor found resource prmVM3 active on bl460g1n6
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: native_print: prmVM1	(ocf::heartbeat:VirtualDomain):	Started bl460g1n6 
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: native_print: prmVM2	(ocf::heartbeat:VirtualDomain):	Started bl460g1n6 
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: native_print: prmVM3	(ocf::heartbeat:VirtualDomain):	Started bl460g1n6 
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: group_print:  Resource Group: grpStonith6
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith6-1	(stonith:external/ipmi):	Stopped 
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith6-2	(stonith:external/ssh):	Stopped 
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: group_print:  Resource Group: grpStonith7
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith7-1	(stonith:external/ipmi):	Stopped 
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith7-2	(stonith:external/ssh):	Stopped 
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: group_print:  Resource Group: grpStonith8
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith8-1	(stonith:external/ipmi):	Stopped 
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith8-2	(stonith:external/ssh):	Stopped 
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: clone_print:  Clone Set: clnPing [prmPing]
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: short_print:      Stopped: [ bl460g1n6 bl460g1n7 bl460g1n8 ]
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmVM1 on bl460g1n6
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmVM2 on bl460g1n6
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmVM3 on bl460g1n6
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (360s) for prmStonith6-1 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmStonith6-2 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (360s) for prmStonith7-1 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmStonith7-2 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (360s) for prmStonith8-1 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmStonith8-2 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmPing:0 on bl460g1n6
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmPing:1 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmPing:2 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmVM1	(Started bl460g1n6)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmVM2	(Started bl460g1n6)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmVM3	(Started bl460g1n6)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith6-1	(bl460g1n7)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith6-2	(bl460g1n7)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith7-1	(bl460g1n8)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith7-2	(bl460g1n8)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith8-1	(bl460g1n7)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith8-2	(bl460g1n7)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmPing:0	(bl460g1n6)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmPing:1	(bl460g1n7)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmPing:2	(bl460g1n8)
Oct 21 11:20:58 bl460g1n6 pengine[7684]:   notice: process_pe_message: Calculated Transition 2: /var/lib/pacemaker/pengine/pe-input-2.bz2
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: do_te_invoke: Processing graph 2 (ref=pe_calc-dc-1382322058-76) derived from /var/lib/pacemaker/pengine/pe-input-2.bz2
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 28: monitor prmVM1_monitor_10000 on bl460g1n6 (local)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=28:2:0:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmVM1_monitor_10000
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 16: monitor prmVM1_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 5: monitor prmVM1_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 31: monitor prmVM2_monitor_10000 on bl460g1n6 (local)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=31:2:0:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmVM2_monitor_10000
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 17: monitor prmVM2_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 6: monitor prmVM2_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 34: monitor prmVM3_monitor_10000 on bl460g1n6 (local)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=34:2:0:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmVM3_monitor_10000
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 18: monitor prmVM3_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 7: monitor prmVM3_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 19: monitor prmStonith6-1_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 8: monitor prmStonith6-1_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 20: monitor prmStonith6-2_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 9: monitor prmStonith6-2_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 21: monitor prmStonith7-1_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 10: monitor prmStonith7-1_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 22: monitor prmStonith7-2_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 11: monitor prmStonith7-2_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 23: monitor prmStonith8-1_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 12: monitor prmStonith8-1_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 24: monitor prmStonith8-2_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 13: monitor prmStonith8-2_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 14: monitor prmPing:1_monitor_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 25: monitor prmPing:2_monitor_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/9, version=0.14.25)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-1_monitor_0 (8) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/10, version=0.14.26)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-2_monitor_0 (9) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-1_monitor_0 (10) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/11, version=0.14.27)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/12, version=0.14.28)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-2_monitor_0 (11) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-1_monitor_0 (19) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/9, version=0.14.29)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-2_monitor_0 (20) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/10, version=0.14.30)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-1_monitor_0 (21) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/11, version=0.14.31)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-2_monitor_0 (22) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/12, version=0.14.32)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-1_monitor_0 (23) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/13, version=0.14.33)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-2_monitor_0 (24) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/14, version=0.14.34)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/13, version=0.14.35)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-1_monitor_0 (12) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-2_monitor_0 (13) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/14, version=0.14.36)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmPing_monitor_0 (14) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/15, version=0.14.37)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/15, version=0.14.38)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmPing_monitor_0 (25) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 VirtualDomain(prmVM2)[8008]: DEBUG: Virtual domain vm2 is currently running.
Oct 21 11:20:58 bl460g1n6 VirtualDomain(prmVM1)[8007]: DEBUG: Virtual domain vm1 is currently running.
Oct 21 11:20:58 bl460g1n6 VirtualDomain(prmVM3)[8009]: DEBUG: Virtual domain vm3 is currently running.
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM1_monitor_0 (16) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/16, version=0.14.39)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM2_monitor_0 (17) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/17, version=0.14.40)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM3_monitor_0 (18) confirmed on bl460g1n8 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/18, version=0.14.41)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 15: probe_complete probe_complete on bl460g1n8 - no waiting
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: te_rsc_command: Action 15 confirmed - no wait
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM2_monitor_0 (6) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/16, version=0.14.42)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM1_monitor_0 (5) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/17, version=0.14.43)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/18, version=0.14.44)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM3_monitor_0 (7) confirmed on bl460g1n7 (rc=0)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 4: probe_complete probe_complete on bl460g1n7 - no waiting
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: te_rsc_command: Action 4 confirmed - no wait
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 35: start prmStonith6-1_start_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 43: start prmStonith7-1_start_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 51: start prmStonith8-1_start_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 59: start prmPing_start_0 on bl460g1n6 (local)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=59:2:0:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmPing_start_0
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 61: start prmPing:1_start_0 on bl460g1n7
Oct 21 11:20:58 bl460g1n6 lrmd[7682]:     info: log_execute: executing - rsc:prmPing action:start call_id:46
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 63: start prmPing:2_start_0 on bl460g1n8
Oct 21 11:20:58 bl460g1n6 crm_resource[8101]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:58 bl460g1n6 crm_resource[8101]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc52380 for uid=0 gid=0 pid=8101 id=49e5cb57-216e-483d-8a31-a21a1fb73427
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.44)
Oct 21 11:20:58 bl460g1n6 crm_resource[8104]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:58 bl460g1n6 crm_resource[8104]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc070f0 for uid=0 gid=0 pid=8104 id=a0b0bcb3-6534-4a6b-b171-e8f0e3239af9
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.44)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:20:58 bl460g1n6 crm_resource[8108]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:58 bl460g1n6 crm_resource[8108]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc07650 for uid=0 gid=0 pid=8108 id=da3290c2-8a0e-415c-a856-75762ee66e39
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.44)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:20:58 bl460g1n6 crm_resource[8134]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:58 bl460g1n6 crm_resource[8134]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc52380 for uid=0 gid=0 pid=8134 id=6cfb264d-e486-446b-9dcc-058d12f07ea2
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.44)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:20:58 bl460g1n6 crm_resource[8136]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:58 bl460g1n6 crm_resource[8136]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: process_lrm_event: LRM operation prmVM2_monitor_10000 (call=44, rc=0, cib-update=90, confirmed=false) ok
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc52380 for uid=0 gid=0 pid=8136 id=a097d97f-e6b4-4d46-b611-fff2be8848b0
Oct 21 11:20:58 bl460g1n6 crm_resource[8138]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:58 bl460g1n6 crm_resource[8138]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM2_monitor_10000 (31) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/90, version=0.14.45)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbf9300 for uid=0 gid=0 pid=8138 id=fecab1ed-a7f9-42c6-8169-1ade3d33f909
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.45)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.45)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: process_lrm_event: LRM operation prmVM1_monitor_10000 (call=43, rc=0, cib-update=91, confirmed=false) ok
Oct 21 11:20:58 bl460g1n6 crmd[7685]:   notice: process_lrm_event: LRM operation prmVM3_monitor_10000 (call=45, rc=0, cib-update=92, confirmed=false) ok
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/91, version=0.14.46)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM1_monitor_10000 (28) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:58 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/92, version=0.14.47)
Oct 21 11:20:58 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmVM3_monitor_10000 (34) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:59 bl460g1n6 attrd_updater[8143]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:20:59 bl460g1n6 attrd_updater[8143]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:20:59 bl460g1n6 attrd[7683]:     info: crm_client_new: Connecting 0x14e3150 for uid=0 gid=0 pid=8143 id=fbcdad55-6e3a-4e6a-a180-c2c9facba772
Oct 21 11:20:59 bl460g1n6 attrd[7683]:     info: attrd_client_message: Broadcasting default_ping_set[bl460g1n6] = 100 (writer)
Oct 21 11:20:59 bl460g1n6 attrd[7683]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:20:59 bl460g1n6 lrmd[7682]:     info: log_finished: finished - rsc:prmPing action:start call_id:46 pid:8102 exit-code:0 exec-time:1072ms queue-time:1ms
Oct 21 11:20:59 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 10 with 1 changes for default_ping_set, id=<n/a>, set=(null)
Oct 21 11:20:59 bl460g1n6 crmd[7685]:   notice: process_lrm_event: LRM operation prmPing_start_0 (call=46, rc=0, cib-update=93, confirmed=true) ok
Oct 21 11:20:59 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/10, version=0.14.48)
Oct 21 11:20:59 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=0, node=bl460g1n6, tag=nvpair, id=status-3232261592-default_ping_set, name=default_ping_set, value=100, magic=NA, cib=0.14.48) : Transient attribute: update
Oct 21 11:20:59 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/93, version=0.14.49)
Oct 21 11:20:59 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmPing_start_0 (59) confirmed on bl460g1n6 (rc=0)
Oct 21 11:20:59 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 10 for default_ping_set: OK (0)
Oct 21 11:20:59 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 10 for default_ping_set[bl460g1n6]=100: OK (0)
Oct 21 11:21:00 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 11 with 2 changes for default_ping_set, id=<n/a>, set=(null)
Oct 21 11:21:00 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/11, version=0.14.50)
Oct 21 11:21:00 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=0, node=bl460g1n8, tag=nvpair, id=status-3232261594-default_ping_set, name=default_ping_set, value=100, magic=NA, cib=0.14.50) : Transient attribute: update
Oct 21 11:21:00 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmPing_start_0 (63) confirmed on bl460g1n8 (rc=0)
Oct 21 11:21:00 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/19, version=0.14.51)
Oct 21 11:21:00 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 11 for default_ping_set: OK (0)
Oct 21 11:21:00 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 11 for default_ping_set[bl460g1n6]=100: OK (0)
Oct 21 11:21:00 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 11 for default_ping_set[bl460g1n8]=100: OK (0)
Oct 21 11:21:00 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/20, version=0.14.52)
Oct 21 11:21:00 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-1_start_0 (43) confirmed on bl460g1n8 (rc=0)
Oct 21 11:21:01 bl460g1n6 attrd[7683]:   notice: write_attribute: Sent update 12 with 3 changes for default_ping_set, id=<n/a>, set=(null)
Oct 21 11:21:01 bl460g1n6 crmd[7685]:     info: abort_transition_graph: te_update_diff:172 - Triggered transition abort (complete=0, node=bl460g1n7, tag=nvpair, id=status-3232261593-default_ping_set, name=default_ping_set, value=100, magic=NA, cib=0.14.53) : Transient attribute: update
Oct 21 11:21:01 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/attrd/12, version=0.14.53)
Oct 21 11:21:01 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/19, version=0.14.54)
Oct 21 11:21:01 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmPing_start_0 (61) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:01 bl460g1n6 attrd[7683]:     info: attrd_cib_callback: Update 12 for default_ping_set: OK (0)
Oct 21 11:21:01 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 12 for default_ping_set[bl460g1n6]=100: OK (0)
Oct 21 11:21:01 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 12 for default_ping_set[bl460g1n7]=100: OK (0)
Oct 21 11:21:01 bl460g1n6 attrd[7683]:   notice: attrd_cib_callback: Update 12 for default_ping_set[bl460g1n8]=100: OK (0)
Oct 21 11:21:01 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/20, version=0.14.55)
Oct 21 11:21:01 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-1_start_0 (51) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:01 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-1_start_0 (35) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:01 bl460g1n6 crmd[7685]:   notice: run_graph: Transition 2 (Complete=37, Pending=0, Fired=0, Skipped=15, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-2.bz2): Stopped
Oct 21 11:21:01 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/21, version=0.14.56)
Oct 21 11:21:03 bl460g1n6 crmd[7685]:     info: crm_timer_popped: New Transition Timer (I_PE_CALC) just popped (2000ms)
Oct 21 11:21:03 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Oct 21 11:21:03 bl460g1n6 crmd[7685]:     info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
Oct 21 11:21:03 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crmd/94, version=0.14.56)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n8 is active
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n8 is online
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n6 is active
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n6 is online
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: determine_online_status_fencing: Node bl460g1n7 is active
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: determine_online_status: Node bl460g1n7 is online
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: determine_op_status: Operation monitor found resource prmVM1 active on bl460g1n6
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: determine_op_status: Operation monitor found resource prmVM2 active on bl460g1n6
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: determine_op_status: Operation monitor found resource prmVM3 active on bl460g1n6
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: native_print: prmVM1	(ocf::heartbeat:VirtualDomain):	Started bl460g1n6 
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: native_print: prmVM2	(ocf::heartbeat:VirtualDomain):	Started bl460g1n6 
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: native_print: prmVM3	(ocf::heartbeat:VirtualDomain):	Started bl460g1n6 
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: group_print:  Resource Group: grpStonith6
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith6-1	(stonith:external/ipmi):	Started bl460g1n7 
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith6-2	(stonith:external/ssh):	Stopped 
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: group_print:  Resource Group: grpStonith7
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith7-1	(stonith:external/ipmi):	Started bl460g1n8 
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith7-2	(stonith:external/ssh):	Stopped 
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: group_print:  Resource Group: grpStonith8
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith8-1	(stonith:external/ipmi):	Started bl460g1n7 
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: native_print:      prmStonith8-2	(stonith:external/ssh):	Stopped 
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: clone_print:  Clone Set: clnPing [prmPing]
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: short_print:      Started: [ bl460g1n6 bl460g1n7 bl460g1n8 ]
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (360s) for prmStonith6-1 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmStonith6-2 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (360s) for prmStonith7-1 on bl460g1n8
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmStonith7-2 on bl460g1n8
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (360s) for prmStonith8-1 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmStonith8-2 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmPing:0 on bl460g1n8
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmPing:1 on bl460g1n6
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: RecurringOp:  Start recurring monitor (10s) for prmPing:2 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmVM1	(Started bl460g1n6)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmVM2	(Started bl460g1n6)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmVM3	(Started bl460g1n6)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmStonith6-1	(Started bl460g1n7)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith6-2	(bl460g1n7)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmStonith7-1	(Started bl460g1n8)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith7-2	(bl460g1n8)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmStonith8-1	(Started bl460g1n7)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:   notice: LogActions: Start   prmStonith8-2	(bl460g1n7)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmPing:0	(Started bl460g1n8)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmPing:1	(Started bl460g1n6)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:     info: LogActions: Leave   prmPing:2	(Started bl460g1n7)
Oct 21 11:21:03 bl460g1n6 pengine[7684]:   notice: process_pe_message: Calculated Transition 3: /var/lib/pacemaker/pengine/pe-input-3.bz2
Oct 21 11:21:03 bl460g1n6 crmd[7685]:     info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 21 11:21:03 bl460g1n6 crmd[7685]:     info: do_te_invoke: Processing graph 3 (ref=pe_calc-dc-1382322063-108) derived from /var/lib/pacemaker/pengine/pe-input-3.bz2
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 17: monitor prmStonith6-1_monitor_360000 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 18: start prmStonith6-2_start_0 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 26: monitor prmStonith7-1_monitor_360000 on bl460g1n8
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 27: start prmStonith7-2_start_0 on bl460g1n8
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 35: monitor prmStonith8-1_monitor_360000 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 36: start prmStonith8-2_start_0 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 44: monitor prmPing_monitor_10000 on bl460g1n8
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 47: monitor prmPing_monitor_10000 on bl460g1n6 (local)
Oct 21 11:21:03 bl460g1n6 crmd[7685]:     info: do_lrm_rsc_op: Performing key=47:3:0:38db9a68-056c-4e65-8658-75f0c3cc91e5 op=prmPing_monitor_10000
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 50: monitor prmPing_monitor_10000 on bl460g1n7
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 8: probe_complete probe_complete on bl460g1n8 - no waiting
Oct 21 11:21:03 bl460g1n6 crmd[7685]:     info: te_rsc_command: Action 8 confirmed - no wait
Oct 21 11:21:03 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 7: probe_complete probe_complete on bl460g1n7 - no waiting
Oct 21 11:21:03 bl460g1n6 crmd[7685]:     info: te_rsc_command: Action 7 confirmed - no wait
Oct 21 11:21:04 bl460g1n6 attrd_updater[8183]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:04 bl460g1n6 attrd_updater[8183]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:04 bl460g1n6 attrd[7683]:     info: crm_client_new: Connecting 0x14f9260 for uid=0 gid=0 pid=8183 id=f08e8248-29ef-4230-8f79-3ec0514cf24e
Oct 21 11:21:04 bl460g1n6 attrd[7683]:     info: attrd_client_message: Broadcasting default_ping_set[bl460g1n6] = 100 (writer)
Oct 21 11:21:04 bl460g1n6 attrd[7683]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:04 bl460g1n6 crmd[7685]:   notice: process_lrm_event: LRM operation prmPing_monitor_10000 (call=47, rc=0, cib-update=95, confirmed=false) ok
Oct 21 11:21:04 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=local/crmd/95, version=0.14.57)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmPing_monitor_10000 (47) confirmed on bl460g1n6 (rc=0)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmPing_monitor_10000 (44) confirmed on bl460g1n8 (rc=0)
Oct 21 11:21:04 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/21, version=0.14.58)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-2_start_0 (27) confirmed on bl460g1n8 (rc=0)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 28: monitor prmStonith7-2_monitor_10000 on bl460g1n8
Oct 21 11:21:04 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/22, version=0.14.59)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-1_monitor_360000 (26) confirmed on bl460g1n8 (rc=0)
Oct 21 11:21:04 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/23, version=0.14.60)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-2_start_0 (18) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 19: monitor prmStonith6-2_monitor_10000 on bl460g1n7
Oct 21 11:21:04 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/22, version=0.14.61)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmPing_monitor_10000 (50) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:04 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/23, version=0.14.62)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-1_monitor_360000 (17) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:04 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/24, version=0.14.63)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-2_start_0 (36) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:   notice: te_rsc_command: Initiating action 37: monitor prmStonith8-2_monitor_10000 on bl460g1n7
Oct 21 11:21:04 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/25, version=0.14.64)
Oct 21 11:21:04 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/26, version=0.14.65)
Oct 21 11:21:04 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-1_monitor_360000 (35) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:05 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n8/crmd/24, version=0.14.66)
Oct 21 11:21:05 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith7-2_monitor_10000 (28) confirmed on bl460g1n8 (rc=0)
Oct 21 11:21:05 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/27, version=0.14.67)
Oct 21 11:21:05 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith6-2_monitor_10000 (19) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:05 bl460g1n6 crmd[7685]:     info: match_graph_event: Action prmStonith8-2_monitor_10000 (37) confirmed on bl460g1n7 (rc=0)
Oct 21 11:21:05 bl460g1n6 crmd[7685]:   notice: run_graph: Transition 3 (Complete=20, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-3.bz2): Complete
Oct 21 11:21:05 bl460g1n6 crmd[7685]:     info: do_log: FSA: Input I_TE_SUCCESS from notify_crmd() received in state S_TRANSITION_ENGINE
Oct 21 11:21:05 bl460g1n6 crmd[7685]:   notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Oct 21 11:21:05 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=bl460g1n7/crmd/28, version=0.14.68)
Oct 21 11:21:08 bl460g1n6 VirtualDomain(prmVM2)[8185]: DEBUG: Virtual domain vm2 is currently running.
Oct 21 11:21:08 bl460g1n6 VirtualDomain(prmVM1)[8192]: DEBUG: Virtual domain vm1 is currently running.
Oct 21 11:21:08 bl460g1n6 VirtualDomain(prmVM3)[8194]: DEBUG: Virtual domain vm3 is currently running.
Oct 21 11:21:08 bl460g1n6 crm_resource[8278]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:08 bl460g1n6 crm_resource[8278]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=8278 id=84fab12f-c463-4189-ab24-7c2d86f5c413
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:08 bl460g1n6 crm_resource[8281]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:08 bl460g1n6 crm_resource[8281]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=8281 id=ed857302-7a88-4ab0-8e23-8ea0eb4f45fa
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:08 bl460g1n6 crm_resource[8286]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:08 bl460g1n6 crm_resource[8286]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc786d0 for uid=0 gid=0 pid=8286 id=f50cae61-433c-4b10-9ae9-66d9fa64c6af
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:08 bl460g1n6 crm_resource[8296]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:08 bl460g1n6 crm_resource[8296]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=8296 id=d6215469-b29a-4596-b41b-aebf4b94f787
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:08 bl460g1n6 crm_resource[8299]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:08 bl460g1n6 crm_resource[8299]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=8299 id=32efd4cf-f703-42b0-bd66-8bf9a801d4f3
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:08 bl460g1n6 crm_resource[8301]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:08 bl460g1n6 crm_resource[8301]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc786d0 for uid=0 gid=0 pid=8301 id=76e37dfc-4369-4a25-a322-caf38dbf3c27
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:08 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:15 bl460g1n6 attrd_updater[8323]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:15 bl460g1n6 attrd_updater[8323]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:15 bl460g1n6 attrd[7683]:     info: crm_client_new: Connecting 0x14f9260 for uid=0 gid=0 pid=8323 id=1ea5402f-cbec-4946-a603-375953cd33d0
Oct 21 11:21:15 bl460g1n6 attrd[7683]:     info: attrd_client_message: Broadcasting default_ping_set[bl460g1n6] = 100 (writer)
Oct 21 11:21:15 bl460g1n6 attrd[7683]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:18 bl460g1n6 VirtualDomain(prmVM2)[8327]: DEBUG: Virtual domain vm2 is currently running.
Oct 21 11:21:18 bl460g1n6 VirtualDomain(prmVM1)[8334]: DEBUG: Virtual domain vm1 is currently running.
Oct 21 11:21:18 bl460g1n6 VirtualDomain(prmVM3)[8337]: DEBUG: Virtual domain vm3 is currently running.
Oct 21 11:21:18 bl460g1n6 crm_resource[8420]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:18 bl460g1n6 crm_resource[8420]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:18 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=8420 id=4ab5e28f-13a0-4ab5-9cdc-011989fa7c2b
Oct 21 11:21:18 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:18 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:18 bl460g1n6 crm_resource[8425]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:18 bl460g1n6 crm_resource[8425]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:18 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=8425 id=f2606a0e-b577-43eb-add3-35ad5cc27014
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:19 bl460g1n6 crm_resource[8428]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:19 bl460g1n6 crm_resource[8428]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc786d0 for uid=0 gid=0 pid=8428 id=8e000ca2-f0fa-4d81-961a-c35b2a3c92d3
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:19 bl460g1n6 crm_resource[8438]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:19 bl460g1n6 crm_resource[8438]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=8438 id=55650f56-bcac-4c55-bb62-14ab8cfa59df
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:19 bl460g1n6 crm_resource[8441]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:19 bl460g1n6 crm_resource[8441]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=8441 id=5d443c75-1372-4bd8-a734-78cb08343a15
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:19 bl460g1n6 crm_resource[8443]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:19 bl460g1n6 crm_resource[8443]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc786d0 for uid=0 gid=0 pid=8443 id=e1ef0a2d-7e36-4ae4-8139-d238e0f63529
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:19 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [8498]
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb1490da8f0
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-8498-34)
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-8498-34) state:2
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb1490da8f0
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-8498-34-header
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-8498-34-header
Oct 21 11:21:24 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-8498-34-header
Oct 21 11:21:24 bl460g1n6 root: Mark:pcmk:1382322084
Oct 21 11:21:26 bl460g1n6 attrd_updater[8554]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:26 bl460g1n6 attrd_updater[8554]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:26 bl460g1n6 attrd[7683]:     info: crm_client_new: Connecting 0x14f9260 for uid=0 gid=0 pid=8554 id=36f9e788-857b-4183-90f2-285b5c5de022
Oct 21 11:21:26 bl460g1n6 attrd[7683]:     info: attrd_client_message: Broadcasting default_ping_set[bl460g1n6] = 100 (writer)
Oct 21 11:21:26 bl460g1n6 attrd[7683]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:29 bl460g1n6 VirtualDomain(prmVM2)[9252]: DEBUG: Virtual domain vm2 is currently running.
Oct 21 11:21:29 bl460g1n6 VirtualDomain(prmVM1)[9259]: DEBUG: Virtual domain vm1 is currently running.
Oct 21 11:21:29 bl460g1n6 VirtualDomain(prmVM3)[9262]: DEBUG: Virtual domain vm3 is currently running.
Oct 21 11:21:29 bl460g1n6 crm_resource[9345]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:29 bl460g1n6 crm_resource[9345]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=9345 id=a7a789aa-6ecd-46a3-9e2f-58eb66c80b89
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:29 bl460g1n6 crm_resource[9348]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:29 bl460g1n6 crm_resource[9348]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=9348 id=d853ddf8-ae86-4c7f-8076-70687d699fce
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:29 bl460g1n6 crm_resource[9353]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:29 bl460g1n6 crm_resource[9353]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=9353 id=81a84fe0-ece1-4850-a3c0-11440bdc6206
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:29 bl460g1n6 crm_resource[9379]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:29 bl460g1n6 crm_resource[9379]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=9379 id=310c2e90-de5c-42d1-ac36-c0ac9747e5cd
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:29 bl460g1n6 crm_resource[9400]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:29 bl460g1n6 crm_resource[9400]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=9400 id=e27c64a3-e2fc-4756-b874-db765916d0c4
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:29 bl460g1n6 crm_resource[9402]:   notice: crm_add_logfile: Additional logging available in /var/log/ha-debug
Oct 21 11:21:29 bl460g1n6 crm_resource[9402]:    debug: crm_update_callsites: Enabling callsites based on priority=7, files=(null), functions=(null), formats=(null), tags=(null)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xc786d0 for uid=0 gid=0 pid=9402 id=7ddda0af-fe57-4cf5-bd68-8e72d9873240
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_resource/2, version=0.14.68)
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:29 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:30 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=9623 id=9eb0bd0b-b3fb-4e25-9ad0-6b269633c254
Oct 21 11:21:30 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.14.68)
Oct 21 11:21:30 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:30 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=9625 id=d38f7941-ec36-42e6-955f-62091d695378
Oct 21 11:21:30 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/cibadmin/2, version=0.14.68)
Oct 21 11:21:30 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [9700]
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb1490da8f0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-9700-34)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-9700-34) state:2
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb1490da8f0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-9700-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-9700-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-9700-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [9702]
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb1490da8f0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_write_to_file:808  writing total of: 8392724
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-9702-34)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-9702-34) state:2
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb1490da8f0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-9702-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-9702-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-9702-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [9708]
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb1490da8f0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-9708-34)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-9708-34) state:2
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb1490da8f0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-9708-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-9708-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-9708-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [9709]
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_init_fn:306 lib_init_fn: conn=0x7fb1490da8f0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [9709]
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:quorum_lib_init_fn:316 lib_init_fn: conn=0x7fb1490d70c0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:message_handler_req_lib_quorum_gettype:471 got quorum_type request on 0x7fb1490d70c0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [9709]
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipc_shm.c:qb_ipcs_shm_connect:295 connecting to client [9709]
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_open_2:236 shm size:1048589; real_size:1052672; rb->word_size:263168
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_created:272 connection created
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:message_handler_req_lib_quorum_getquorate:395 got quorate request on 0x7fb1490d70c0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:message_handler_req_lib_quorum_trackstart:412 got trackstart request on 0x7fb1490d70c0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:message_handler_req_lib_quorum_trackstart:420 sending initial status to 0x7fb1490d70c0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:send_library_notification:359 sending quorum notification to 0x7fb1490d70c0, length = 60
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:message_handler_req_lib_quorum_trackstop:448 got trackstop request on 0x7fb1490d70c0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_lib_votequorum_getinfo:2041 got getinfo request on 0x7fb1494dc2f0 for node 3232261592
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_lib_votequorum_getinfo:2133 getinfo response error: 1
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_lib_votequorum_getinfo:2041 got getinfo request on 0x7fb1494dc2f0 for node 3232261592
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_lib_votequorum_getinfo:2133 getinfo response error: 1
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_lib_votequorum_getinfo:2041 got getinfo request on 0x7fb1494dc2f0 for node 3232261593
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_lib_votequorum_getinfo:2133 getinfo response error: 1
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_lib_votequorum_getinfo:2041 got getinfo request on 0x7fb1494dc2f0 for node 3232261594
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [VOTEQ ] votequorum.c:message_handler_req_lib_votequorum_getinfo:2133 getinfo response error: 1
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-9709-34)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-9709-34) state:2
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [CMAP  ] cmap.c:cmap_lib_exit_fn:325 exit_fn for conn=0x7fb1490da8f0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-response-7666-9709-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-event-7666-9709-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cmap-request-7666-9709-34-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-9709-35)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-9709-35) state:2
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QUORUM] vsf_quorum.c:quorum_lib_exit_fn:328 lib_exit_fn: conn=0x7fb1490d70c0
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-quorum-response-7666-9709-35-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-quorum-event-7666-9709-35-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-quorum-request-7666-9709-35-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-9709-36)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-9709-36) state:2
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cfg-response-7666-9709-36-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cfg-event-7666-9709-36-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-cfg-request-7666-9709-36-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_dispatch_connection_request:757 HUP conn (7666-9709-37)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ipcs.c:qb_ipcs_disconnect:605 qb_ipcs_disconnect(7666-9709-37) state:2
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] loop_poll_epoll.c:_del:117 epoll_ctl(del): Bad file descriptor (9)
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_closed:417 cs_ipcs_connection_closed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [MAIN  ] ipc_glue.c:cs_ipcs_connection_destroyed:390 cs_ipcs_connection_destroyed() 
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-votequorum-response-7666-9709-37-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-votequorum-event-7666-9709-37-header
Oct 21 11:21:31 bl460g1n6 corosync[7666]:   [QB    ] ringbuffer.c:qb_rb_close:299 Free'ing ringbuffer: /dev/shm/qb-votequorum-request-7666-9709-37-header
Oct 21 11:21:31 bl460g1n6 cib[7680]:     info: crm_client_new: Connecting 0xbde1f0 for uid=0 gid=0 pid=9711 id=a08a479f-faca-4878-9238-cacd5fa9bfa5
Oct 21 11:21:31 bl460g1n6 cib[7680]:     info: cib_process_request: Completed cib_query operation for section 'all': OK (rc=0, origin=local/crm_mon/2, version=0.14.68)
Oct 21 11:21:31 bl460g1n6 cib[7680]:     info: crm_client_destroy: Destroying 0 events
