Apr 12 13:57:21 node1 corosync[2461]:   [MAIN  ] Corosync Cluster Engine ('1.2.1'): started and ready to provide service.
Apr 12 13:57:21 node1 corosync[2461]:   [MAIN  ] Corosync built-in features: nss rdma
Apr 12 13:57:21 node1 corosync[2461]:   [MAIN  ] Successfully read main configuration file '/etc/corosync/corosync.conf'.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Token Timeout (1000 ms) retransmit timeout (238 ms)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] token hold (180 ms) retransmits before loss (4 retrans)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] join (50 ms) send_join (0 ms) consensus (1200 ms) merge (200 ms)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] downcheck (1000 ms) fail to recv const (50 msgs)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] seqno unchanged const (30 rotations) Maximum network MTU 1402
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] window size per rotation (50 messages) maximum messages per rotation (17 messages)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] send threads (0 threads)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] RRP token expired timeout (238 ms)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] RRP token problem counter (2000 ms)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] RRP threshold (10 problem count)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] RRP mode set to none.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] heartbeat_failures_allowed (0)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] max_network_delay (50 ms)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Initializing transport (UDP/IP).
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
Apr 12 13:57:21 node1 corosync[2461]:   [IPC   ] you are using ipc api v2
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Receive multicast socket recv buffer size (262142 bytes).
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Transmit multicast socket send buffer size (262142 bytes).
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] The network interface [192.168.1.106] is now up.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Created or loaded sequence id 744.192.168.1.106 for this ring.
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: process_ais_conf: Reading configure
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: config_find_init: Local handle: 4730966301143465986 for logging
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: config_find_next: Processing additional logging options...
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: get_config_opt: Found 'on' for option: debug
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: get_config_opt: Defaulting to 'off' for option: to_file
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: get_config_opt: Found 'yes' for option: to_syslog
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: get_config_opt: Defaulting to 'daemon' for option: syslog_facility
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: config_find_init: Local handle: 7739444317642555395 for service
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: config_find_next: Processing additional service options...
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: get_config_opt: Defaulting to 'pcmk' for option: clustername
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: get_config_opt: Defaulting to 'no' for option: use_logd
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: get_config_opt: Found 'yes' for option: use_mgmtd
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_startup: CRM: Initialized
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] Logging: Initialized pcmk_startup
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_startup: Maximum core file size is: 18446744073709551615
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_startup: Service: 9
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_startup: Local hostname: node1
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_update_nodeid: Local node id: 1778493632
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: update_member: Creating entry for node 1778493632 born on 0
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: update_member: 0x66f3d0 Node 1778493632 now known as node1 (was: (null))
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: update_member: Node node1 now has 1 quorum votes (was 0)
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: update_member: Node 1778493632/node1 is now: member
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: spawn_child: Forked child 2468 for process stonithd
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: spawn_child: Forked child 2469 for process cib
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: spawn_child: Forked child 2470 for process lrmd
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: spawn_child: Forked child 2471 for process attrd
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: spawn_child: Forked child 2472 for process pengine
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: spawn_child: Forked child 2473 for process crmd
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: spawn_child: Forked child 2474 for process mgmtd
Apr 12 13:57:21 node1 corosync[2461]:   [SERV  ] Service engine loaded: Pacemaker Cluster Manager 1.0.8
Apr 12 13:57:21 node1 lrmd: [2470]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Apr 12 13:57:21 node1 corosync[2461]:   [SERV  ] Service engine loaded: corosync extended virtual synchrony service
Apr 12 13:57:21 node1 corosync[2461]:   [SERV  ] Service engine loaded: corosync configuration service
Apr 12 13:57:21 node1 corosync[2461]:   [SERV  ] Service engine loaded: corosync cluster closed process group service v1.01
Apr 12 13:57:21 node1 corosync[2461]:   [SERV  ] Service engine loaded: corosync cluster config database access v1.01
Apr 12 13:57:21 node1 corosync[2461]:   [SERV  ] Service engine loaded: corosync profile loading service
Apr 12 13:57:21 node1 corosync[2461]:   [SERV  ] Service engine loaded: corosync cluster quorum service v0.1
Apr 12 13:57:21 node1 corosync[2461]:   [MAIN  ] Compatibility mode set to whitetank.  Using V1 and V2 of the synchronization engine.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] entering GATHER state from 15.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Process pause detected for 570 ms, flushing membership messages.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Creating commit token because I am the rep.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Saving state aru 0 high seq received 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Storing new sequence id for ring 2ec
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] entering COMMIT state.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] got commit token
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] entering RECOVERY state.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] position [0] member 192.168.1.106:
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] previous ring seq 0 rep (null)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] aru 0 high delivered 0 received flag 1
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Did not need to originate any messages in recovery.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] got commit token
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Sending initial ORF token
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 0, aru 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] install seq 0 aru 0 high seq received 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 1, aru 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] install seq 0 aru 0 high seq received 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 2, aru 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] install seq 0 aru 0 high seq received 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 3, aru 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] install seq 0 aru 0 high seq received 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] retrans flag count 4 token aru 0 install seq 0 aru 0 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] recovery to regular 1-0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering to app 1 to 0
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 748: memb=0, new=0, lost=0
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 748: memb=1, new=1, lost=0
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: NEW:  node1 1778493632
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] debug: pcmk_peer_update: Node 1778493632 has address r(0) ip(192.168.1.106) 
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: MEMB: node1 1778493632
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] debug: send_cluster_id: Local update: id=1778493632, born=0, seq=748
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: update_member: Node node1 now has process list: 00000000000000000000000000053312 (340754)
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] This node is within the primary component and will provide service.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] entering OPERATIONAL state.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering 0 to 1
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 1 to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] debug: pcmk_cluster_id_callback: Node update: node1 (1.0.8)
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] confchg entries 1
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (dummy CLM service)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering 1 to 2
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 2 to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 1
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering 2 to 3
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 3 to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] confchg entries 1
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (dummy CLM service)
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (dummy AMF service)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 2
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 3
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering 3 to 4
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 4 to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] confchg entries 1
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (dummy AMF service)
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (dummy CKPT service)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 4
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering 4 to 5
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 5 to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] confchg entries 1
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (dummy CKPT service)
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (dummy EVT service)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering 5 to 6
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 6 to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 5
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering 6 to 7
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 7 to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 6
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 7
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering 7 to 8
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 8 to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] confchg entries 1
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (dummy EVT service)
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (corosync cluster closed process group service v1.01)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering 8 to a
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 9 to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [CPG   ] downlist left_list: 0
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 8
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering a to b
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] confchg entries 1
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:21 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (corosync cluster closed process group service v1.01)
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering b to c
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c to pending delivery queue
Apr 12 13:57:21 node1 corosync[2461]:   [MAIN  ] Completed service synchronization, ready to provide service.
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including b
Apr 12 13:57:21 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including c
Apr 12 13:57:21 node1 mgmtd: [2474]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Apr 12 13:57:21 node1 mgmtd: [2474]: debug: Enabling coredumps
Apr 12 13:57:21 node1 mgmtd: [2474]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Apr 12 13:57:21 node1 mgmtd: [2474]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Apr 12 13:57:21 node1 mgmtd: [2474]: WARN: lrm_signon: can not initiate connection
Apr 12 13:57:21 node1 mgmtd: [2474]: info: login to lrm: 0, ret:0
Apr 12 13:57:21 node1 pengine: [2472]: info: Invoked: /usr/lib64/heartbeat/pengine 
Apr 12 13:57:21 node1 cib: [2469]: info: Invoked: /usr/lib64/heartbeat/cib 
Apr 12 13:57:21 node1 attrd: [2471]: info: Invoked: /usr/lib64/heartbeat/attrd 
Apr 12 13:57:21 node1 attrd: [2471]: info: main: Starting up
Apr 12 13:57:21 node1 attrd: [2471]: info: crm_cluster_connect: Connecting to OpenAIS
Apr 12 13:57:21 node1 cib: [2469]: info: G_main_add_TriggerHandler: Added signal manual handler
Apr 12 13:57:21 node1 attrd: [2471]: info: init_ais_connection: Creating connection to our AIS plugin
Apr 12 13:57:21 node1 cib: [2469]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Apr 12 13:57:21 node1 attrd: [2471]: info: init_ais_connection: AIS connection established
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_ipc: Recorded connection 0x678150 for attrd/2471
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] debug: process_ais_message: Msg[0] (dest=local:ais, from=node1:attrd.2471, remote=true, size=5): 2471
Apr 12 13:57:21 node1 attrd: [2471]: info: get_ais_nodeid: Server details: id=1778493632 uname=node1 cname=pcmk
Apr 12 13:57:21 node1 attrd: [2471]: debug: crm_new_peer: Creating entry for node node1/1778493632
Apr 12 13:57:21 node1 attrd: [2471]: info: crm_new_peer: Node node1 now has id: 1778493632
Apr 12 13:57:21 node1 attrd: [2471]: info: crm_new_peer: Node 1778493632 is now known as node1
Apr 12 13:57:21 node1 attrd: [2471]: info: main: Cluster connection active
Apr 12 13:57:21 node1 attrd: [2471]: info: main: Accepting attribute updates
Apr 12 13:57:21 node1 attrd: [2471]: info: main: Starting mainloop...
Apr 12 13:57:21 node1 pengine: [2472]: debug: main: Checking for old instances of pengine
Apr 12 13:57:21 node1 pengine: [2472]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/pengine
Apr 12 13:57:21 node1 pengine: [2472]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/pengine
Apr 12 13:57:21 node1 pengine: [2472]: debug: main: Init server comms
Apr 12 13:57:21 node1 pengine: [2472]: info: main: Starting pengine
Apr 12 13:57:21 node1 stonithd: [2468]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Apr 12 13:57:21 node1 stonithd: [2468]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Apr 12 13:57:21 node1 stonithd: [2468]: info: Stack hogger failed 0xffffffff
Apr 12 13:57:21 node1 crmd: [2473]: info: Invoked: /usr/lib64/heartbeat/crmd 
Apr 12 13:57:21 node1 crmd: [2473]: info: main: CRM Hg Version: 9881a7350d6182bae9e8e557cf20a3cc5dac3ee7
Apr 12 13:57:21 node1 stonithd: [2468]: debug: pid 2468 locked in memory.
Apr 12 13:57:21 node1 stonithd: [2468]: info: crm_cluster_connect: Connecting to OpenAIS
Apr 12 13:57:21 node1 stonithd: [2468]: info: init_ais_connection: Creating connection to our AIS plugin
Apr 12 13:57:21 node1 stonithd: [2468]: info: init_ais_connection: AIS connection established
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_ipc: Recorded connection 0x678bb0 for stonithd/2468
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] debug: process_ais_message: Msg[0] (dest=local:ais, from=node1:stonithd.2468, remote=true, size=5): 2468
Apr 12 13:57:21 node1 stonithd: [2468]: info: get_ais_nodeid: Server details: id=1778493632 uname=node1 cname=pcmk
Apr 12 13:57:21 node1 stonithd: [2468]: info: crm_new_peer: Node node1 now has id: 1778493632
Apr 12 13:57:21 node1 stonithd: [2468]: info: crm_new_peer: Node 1778493632 is now known as node1
Apr 12 13:57:21 node1 stonithd: [2468]: debug: apichan=0x6197a0
Apr 12 13:57:21 node1 stonithd: [2468]: debug: callback_chan=0x619df0
Apr 12 13:57:21 node1 stonithd: [2468]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
Apr 12 13:57:21 node1 stonithd: [2468]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Apr 12 13:57:21 node1 crmd: [2473]: info: crmd_init: Starting crmd
Apr 12 13:57:21 node1 crmd: [2473]: debug: s_crmd_fsa: Processing I_STARTUP: [ state=S_STARTING cause=C_STARTUP origin=crmd_init ]
Apr 12 13:57:21 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_LOG   
Apr 12 13:57:21 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_STARTUP
Apr 12 13:57:21 node1 crmd: [2473]: debug: do_startup: Registering Signal Handlers
Apr 12 13:57:21 node1 crmd: [2473]: debug: do_startup: Creating CIB and LRM objects
Apr 12 13:57:21 node1 crmd: [2473]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Apr 12 13:57:21 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_CIB_START
Apr 12 13:57:21 node1 crmd: [2473]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Apr 12 13:57:21 node1 crmd: [2473]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_rw
Apr 12 13:57:21 node1 crmd: [2473]: debug: cib_native_signon_raw: Connection to command channel failed
Apr 12 13:57:21 node1 crmd: [2473]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Apr 12 13:57:21 node1 crmd: [2473]: debug: init_client_ipc_comms_nodispatch: Could not init comms on: /var/run/crm/cib_callback
Apr 12 13:57:21 node1 crmd: [2473]: debug: cib_native_signon_raw: Connection to callback channel failed
Apr 12 13:57:21 node1 crmd: [2473]: debug: cib_native_signon_raw: Connection to CIB failed: connection failed
Apr 12 13:57:21 node1 crmd: [2473]: debug: cib_native_signoff: Signing out of the CIB Service
Apr 12 13:57:21 node1 cib: [2469]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Apr 12 13:57:21 node1 lrmd: [2470]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Apr 12 13:57:21 node1 lrmd: [2470]: debug: Enabling coredumps
Apr 12 13:57:21 node1 lrmd: [2470]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Apr 12 13:57:21 node1 lrmd: [2470]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Apr 12 13:57:21 node1 lrmd: [2470]: debug: main: run the loop...
Apr 12 13:57:21 node1 lrmd: [2470]: info: Started.
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk] <cib validate-with="pacemaker-1.0" crm_feature_set="3.0.1" have-quorum="1" admin_epoch="0" epoch="245" num_updates="0" cib-last-written="Mon Apr 12 13:52:26 2010" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]   <configuration >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     <crm_config >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <cluster_property_set id="cib-bootstrap-options" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.0.8-9881a7350d6182bae9e8e557cf20a3cc5dac3ee7" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="openais" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <nvpair id="cib-bootstrap-options-expected-quorum-votes" name="expected-quorum-votes" value="4" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <nvpair id="nvpair-2c777244-5613-4220-95bb-b1fcb861f961" name="node-health-red" value="0" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <nvpair id="nvpair-32d1de32-4963-41c1-b590-ea4045e1640c" name="stonith-enabled" value="false" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <nvpair name="last-lrm-refresh" id="cib-bootstrap-options-last-lrm-refresh" value="1271073063" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       </cluster_property_set>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     </crm_config>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     <nodes >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <node id="node1" type="normal" uname="node1" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <instance_attributes id="nodes-node1" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="standby-node1" name="standby" value="false" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </instance_attributes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       </node>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <node id="node2" uname="node2" type="normal" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <node id="node3" uname="node3" type="normal" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <node id="node4" uname="node4" type="normal" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     </nodes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     <resources >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <clone id="dlm-clone" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <meta_attributes id="dlm-clone-meta_attributes" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="dlm-clone-meta_attributes-interleave" name="interleave" value="true" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair name="target-role" id="dlm-clone-meta_attributes-target-role" value="stopped" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </meta_attributes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <primitive class="ocf" provider="pacemaker" type="controld" id="dlm" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <operations >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]             <op id="dlm-monitor-120s" interval="120s" name="monitor" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           </operations>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <meta_attributes id="dlm-meta_attributes" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </primitive>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       </clone>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <clone id="o2cb-clone" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <meta_attributes id="o2cb-clone-meta_attributes" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="o2cb-clone-meta_attributes-interleave" name="interleave" value="trueonfigure" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="o2cb-clone-meta_attributes-clone" name="clone" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="o2cb-clone-meta_attributes-o2cb-clone" name="o2cb-clone" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="o2cb-clone-meta_attributes-o2cb" name="o2cb" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </meta_attributes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <meta_attributes id="o2cb-clone-meta_attributes-0" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="o2cb-clone-meta_attributes-0-interleave" name="interleave" value="true" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </meta_attributes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <primitive class="ocf" id="o2cb" provider="ocfs2" type="o2cb" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <operations >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]             <op id="o2cb-monitor-120s" interval="120s" name="monitor" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           </operations>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </primitive>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       </clone>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <primitive class="stonith" id="rsa-fencing-1" type="external/ibmrsa-telnet" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <instance_attributes id="rsa-fencing-1-instance_attributes" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-1-instance_attributes-nodename" name="nodename" value="nodo1" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-1-instance_attributes-ip_address" name="ip_address" value="192.168.1.12" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-1-instance_attributes-username" name="username" value="hacluster" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-1-instance_attributes-password" name="password" value="xxxxxxxx" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </instance_attributes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       </primitive>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <primitive class="stonith" id="rsa-fencing-2" type="external/ibmrsa-telnet" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <instance_attributes id="rsa-fencing-2-instance_attributes" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-2-instance_attributes-nodename" name="nodename" value="nodo2" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-2-instance_attributes-ip_address" name="ip_address" value="192.168.1.13" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-2-instance_attributes-username" name="username" value="hacluster" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-2-instance_attributes-password" name="password" value="xxxxxxx" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </instance_attributes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       </primitive>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <primitive class="stonith" id="rsa-fencing-3" type="external/ibmrsa-telnet" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <instance_attributes id="rsa-fencing-3-instance_attributes" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-3-instance_attributes-nodename" name="nodename" value="nodo3" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-3-instance_attributes-ip_address" name="ip_address" value="192.168.1.14" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-3-instance_attributes-username" name="username" value="hacluster" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-3-instance_attributes-password" name="password" value="xxxxxxx" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </instance_attributes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       </primitive>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <primitive class="stonith" id="rsa-fencing-4" type="external/ibmrsa-telnet" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <instance_attributes id="rsa-fencing-4-instance_attributes" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-4-instance_attributes-nodename" name="nodename" value="nodo4" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-4-instance_attributes-ip_address" name="ip_address" value="192.168.1.15" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-4-instance_attributes-username" name="username" value="hacluster" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="rsa-fencing-4-instance_attributes-password" name="password" value="xxxxxxx" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         </instance_attributes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       </primitive>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     </resources>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     <constraints >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <rsc_colocation id="o2cb-with-dlm" rsc="o2cb-clone" score="INFINITY" with-rsc="dlm-clone" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <rsc_order first="dlm-clone" id="start-o2cb-after-dlm" score="INFINITY" then="o2cb-clone" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     </constraints>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     <rsc_defaults >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       <meta_attributes id="rsc-options" >
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]         <nvpair id="rsc-options-resource-stickiness" name="resource-stickiness" value="100" />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]       </meta_attributes>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     </rsc_defaults>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]     <op_defaults />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]   </configuration>
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk]   <status />
Apr 12 13:57:21 node1 cib: [2469]: debug: log_data_element: readCibXmlFile: [on-disk] </cib>
Apr 12 13:57:21 node1 cib: [2469]: debug: activateCibXml: Triggering CIB write for start op
Apr 12 13:57:21 node1 cib: [2469]: info: startCib: CIB Initialization completed successfully
Apr 12 13:57:21 node1 cib: [2469]: info: crm_cluster_connect: Connecting to OpenAIS
Apr 12 13:57:21 node1 cib: [2469]: info: init_ais_connection: Creating connection to our AIS plugin
Apr 12 13:57:21 node1 cib: [2469]: info: init_ais_connection: AIS connection established
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_ipc: Recorded connection 0x67ab50 for cib/2469
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] info: pcmk_ipc: Sending membership update 748 to cib
Apr 12 13:57:21 node1 corosync[2461]:   [pcmk  ] debug: process_ais_message: Msg[0] (dest=local:ais, from=node1:cib.2469, remote=true, size=5): 2469
Apr 12 13:57:21 node1 cib: [2469]: info: get_ais_nodeid: Server details: id=1778493632 uname=node1 cname=pcmk
Apr 12 13:57:21 node1 cib: [2469]: debug: crm_new_peer: Creating entry for node node1/1778493632
Apr 12 13:57:21 node1 cib: [2469]: info: crm_new_peer: Node node1 now has id: 1778493632
Apr 12 13:57:21 node1 cib: [2469]: info: crm_new_peer: Node 1778493632 is now known as node1
Apr 12 13:57:21 node1 cib: [2469]: info: cib_init: Starting cib mainloop
Apr 12 13:57:21 node1 cib: [2469]: info: ais_dispatch: Membership 748: quorum still lost
Apr 12 13:57:21 node1 cib: [2469]: info: crm_update_peer: Node node1: id=1778493632 state=member (new) addr=r(0) ip(192.168.1.106)  (new) votes=1 (new) born=0 seen=748 proc=00000000000000000000000000053312 (new)
Apr 12 13:57:21 node1 cib: [2469]: debug: Forking temp process write_cib_contents
Apr 12 13:57:21 node1 cib: [2478]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-9.raw
Apr 12 13:57:21 node1 cib: [2478]: info: write_cib_contents: Wrote version 0.245.0 of the CIB to disk (digest: ca939d02a640316275d219b8132e171c)
Apr 12 13:57:21 node1 cib: [2478]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.sLYpBx (digest: /var/lib/heartbeat/crm/cib.1nKZ5e)
Apr 12 13:57:21 node1 cib: [2469]: info: Managed write_cib_contents process 2478 exited with return code 0.
Apr 12 13:57:22 node1 lrmd: [2470]: debug: on_msg_register:client mgmtd [2474] registered
Apr 12 13:57:22 node1 mgmtd: [2474]: info: init_crm
Apr 12 13:57:22 node1 cib: [2469]: debug: cib_common_callback_worker: Setting cib_diff_notify callbacks for 2474 (b37a7ee8-ef19-42b3-b1ab-40cc0a8aa5f3): on
Apr 12 13:57:22 node1 crmd: [2473]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Apr 12 13:57:22 node1 crmd: [2473]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Apr 12 13:57:22 node1 crmd: [2473]: debug: cib_native_signon_raw: Connection to CIB successful
Apr 12 13:57:22 node1 crmd: [2473]: info: do_cib_control: CIB connection established
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_HA_CONNECT
Apr 12 13:57:22 node1 crmd: [2473]: info: crm_cluster_connect: Connecting to OpenAIS
Apr 12 13:57:22 node1 crmd: [2473]: info: init_ais_connection: Creating connection to our AIS plugin
Apr 12 13:57:22 node1 crmd: [2473]: info: init_ais_connection: AIS connection established
Apr 12 13:57:22 node1 cib: [2469]: debug: cib_common_callback_worker: Setting cib_refresh_notify callbacks for 2473 (abe1e4d7-c3c0-4e38-9d90-5a3bbb18e418): on
Apr 12 13:57:22 node1 corosync[2461]:   [pcmk  ] info: pcmk_ipc: Recorded connection 0x67b9c0 for crmd/2473
Apr 12 13:57:22 node1 corosync[2461]:   [pcmk  ] info: pcmk_ipc: Sending membership update 748 to crmd
Apr 12 13:57:22 node1 corosync[2461]:   [pcmk  ] debug: process_ais_message: Msg[0] (dest=local:ais, from=node1:crmd.2473, remote=true, size=5): 2473
Apr 12 13:57:22 node1 crmd: [2473]: info: get_ais_nodeid: Server details: id=1778493632 uname=node1 cname=pcmk
Apr 12 13:57:22 node1 crmd: [2473]: debug: crm_new_peer: Creating entry for node node1/1778493632
Apr 12 13:57:22 node1 crmd: [2473]: info: crm_new_peer: Node node1 now has id: 1778493632
Apr 12 13:57:22 node1 crmd: [2473]: info: crm_new_peer: Node 1778493632 is now known as node1
Apr 12 13:57:22 node1 crmd: [2473]: info: do_ha_control: Connected to the cluster
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_READCONFIG
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_LRM_CONNECT
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_lrm_control: Connecting to the LRM
Apr 12 13:57:22 node1 lrmd: [2470]: debug: on_msg_register:client crmd [2473] registered
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_lrm_control: LRM connection established
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_CCM_CONNECT
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_STARTED
Apr 12 13:57:22 node1 crmd: [2473]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Apr 12 13:57:22 node1 crmd: [2473]: debug: register_fsa_input_adv: Stalling the FSA pending further input: cause=C_FSA_INTERNAL
Apr 12 13:57:22 node1 crmd: [2473]: debug: s_crmd_fsa: Exiting the FSA: queue=0, fsa_actions=0x2, stalled=true
Apr 12 13:57:22 node1 crmd: [2473]: debug: fsa_dump_inputs: Added input: 0000000000000100 (R_CIB_CONNECTED)
Apr 12 13:57:22 node1 crmd: [2473]: debug: fsa_dump_inputs: Added input: 0000000000000800 (R_LRM_CONNECTED)
Apr 12 13:57:22 node1 crmd: [2473]: info: crmd_init: Starting crmd's mainloop
Apr 12 13:57:22 node1 crmd: [2473]: debug: config_query_callback: Call 3 : Parsing CIB options
Apr 12 13:57:22 node1 crmd: [2473]: debug: cluster_option: Using default value '60s' for cluster option 'dc-deadtime'
Apr 12 13:57:22 node1 crmd: [2473]: debug: cluster_option: Using default value '15min' for cluster option 'cluster-recheck-interval'
Apr 12 13:57:22 node1 crmd: [2473]: debug: cluster_option: Using default value '2min' for cluster option 'election-timeout'
Apr 12 13:57:22 node1 crmd: [2473]: debug: cluster_option: Using default value '20min' for cluster option 'shutdown-escalation'
Apr 12 13:57:22 node1 crmd: [2473]: debug: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout'
Apr 12 13:57:22 node1 crmd: [2473]: debug: cluster_option: Using default value '30min' for cluster option 'crmd-finalization-timeout'
Apr 12 13:57:22 node1 crmd: [2473]: info: config_query_callback: Checking for expired actions every 900000ms
Apr 12 13:57:22 node1 crmd: [2473]: info: config_query_callback: Sending expected-votes=4 to corosync
Apr 12 13:57:22 node1 corosync[2461]:   [pcmk  ] info: update_expected_votes: Expected quorum votes 2 -> 4
Apr 12 13:57:22 node1 crmd: [2473]: info: ais_dispatch: Membership 748: quorum still lost
Apr 12 13:57:22 node1 crmd: [2473]: info: crm_update_peer: Node node1: id=1778493632 state=member (new) addr=r(0) ip(192.168.1.106)  (new) votes=1 (new) born=0 seen=748 proc=00000000000000000000000000053312 (new)
Apr 12 13:57:22 node1 crmd: [2473]: debug: post_cache_update: Updated cache after membership event 748.
Apr 12 13:57:22 node1 crmd: [2473]: debug: post_cache_update: post_cache_update added action A_ELECTION_CHECK to the FSA
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_STARTED
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_started: Init server comms
Apr 12 13:57:22 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:22 node1 corosync[2461]:   [TOTEM ] Delivering c to d
Apr 12 13:57:22 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d to pending delivery queue
Apr 12 13:57:22 node1 crmd: [2473]: info: do_started: The local CRM is operational
Apr 12 13:57:22 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including d
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_ELECTION_CHECK
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_election_check: Ignore election check: we not in an election
Apr 12 13:57:22 node1 crmd: [2473]: debug: s_crmd_fsa: Processing I_PENDING: [ state=S_STARTING cause=C_FSA_INTERNAL origin=do_started ]
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_LOG   
Apr 12 13:57:22 node1 crmd: [2473]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_INTEGRATE_TIMER_STOP
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_FINALIZE_TIMER_STOP
Apr 12 13:57:22 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_CL_JOIN_QUERY
Apr 12 13:57:23 node1 mgmtd: [2474]: debug: main: run the loop...
Apr 12 13:57:23 node1 mgmtd: [2474]: info: Started.
Apr 12 13:57:23 node1 kernel: [   35.360853] BIOS EDD facility v0.16 2004-Jun-25, 1 devices found
Apr 12 13:57:23 node1 crmd: [2473]: debug: do_cl_join_query: Querying for a DC
Apr 12 13:57:23 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_DC_TIMER_START
Apr 12 13:57:23 node1 crmd: [2473]: debug: crm_timer_start: Started Election Trigger (I_DC_TIMEOUT:60000ms), src=11
Apr 12 13:57:23 node1 crmd: [2473]: info: ais_dispatch: Membership 748: quorum still lost
Apr 12 13:57:23 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:23 node1 corosync[2461]:   [TOTEM ] Delivering d to e
Apr 12 13:57:23 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e to pending delivery queue
Apr 12 13:57:23 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including e
Apr 12 13:57:24 node1 kernel: [   35.703100] IPMI System Interface driver.
Apr 12 13:57:24 node1 kernel: [   35.703112] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 0
Apr 12 13:57:24 node1 kernel: [   35.849466] ipmi: Found new BMC (man_id: 0x000002,  prod_id: 0x0011, dev_id: 0x20)
Apr 12 13:57:24 node1 kernel: [   35.853745] ipmi_si ipmi_si.0: Found BMC with sensor interface v3.10 2006-06-29 on interface 0
Apr 12 13:57:24 node1 kernel: [   35.961053] ipmi_si ipmi_si.0: Found AEM v1.0 at 0x0
Apr 12 13:57:24 node1 kernel: [   35.965296] ipmi_si ipmi_si.0: Found AEM v2.1 at 0x20
Apr 12 13:57:24 node1 kernel: [   35.984122] IPMI kcs interface initialized
Apr 12 13:57:24 node1 avahi-daemon[2893]: Found user 'avahi' (UID 105) and group 'avahi' (GID 107).
Apr 12 13:57:24 node1 avahi-daemon[2893]: Successfully dropped root privileges.
Apr 12 13:57:24 node1 avahi-daemon[2893]: avahi-daemon 0.6.25 starting up.
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] entering GATHER state from 9.
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] entering GATHER state from 11.
Apr 12 13:57:24 node1 avahi-daemon[2893]: Loading service file /etc/avahi/services/sftp-ssh.service.
Apr 12 13:57:24 node1 avahi-daemon[2893]: Loading service file /etc/avahi/services/ssh.service.
Apr 12 13:57:24 node1 avahi-daemon[2893]: Joining mDNS multicast group on interface br0.IPv4 with address 192.168.1.106.
Apr 12 13:57:24 node1 avahi-daemon[2893]: New relevant interface br0.IPv4 for mDNS.
Apr 12 13:57:24 node1 avahi-daemon[2893]: Network interface enumeration completed.
Apr 12 13:57:24 node1 avahi-daemon[2893]: Registering new address record for fe80::221:5eff:fe52:62a8 on br0.*.
Apr 12 13:57:24 node1 avahi-daemon[2893]: Registering new address record for 192.168.1.106 on br0.IPv4.
Apr 12 13:57:24 node1 avahi-daemon[2893]: Registering new address record for fe80::221:5eff:fe52:62a8 on eth0.*.
Apr 12 13:57:24 node1 avahi-daemon[2893]: Registering HINFO record with values 'X86_64'/'LINUX'.
Apr 12 13:57:24 node1 kernel: [   36.116112] coretemp coretemp.0: Using relative temperature scale!
Apr 12 13:57:24 node1 kernel: [   36.116164] coretemp coretemp.1: Using relative temperature scale!
Apr 12 13:57:24 node1 kernel: [   36.116232] coretemp coretemp.2: Using relative temperature scale!
Apr 12 13:57:24 node1 kernel: [   36.116296] coretemp coretemp.3: Using relative temperature scale!
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Creating commit token because I am the rep.
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Saving state aru e high seq received e
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Storing new sequence id for ring 2f8
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] entering COMMIT state.
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] got commit token
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] entering RECOVERY state.
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] TRANS [0] member 192.168.1.106:
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] position [0] member 192.168.1.106:
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] previous ring seq 748 rep 192.168.1.106
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] aru e high delivered e received flag 1
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] position [1] member 192.168.1.107:
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] previous ring seq 756 rep 192.168.1.107
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] aru bb high delivered bb received flag 1
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] position [2] member 192.168.1.108:
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] previous ring seq 756 rep 192.168.1.107
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] aru bb high delivered bb received flag 1
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] position [3] member 192.168.1.109:
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] previous ring seq 756 rep 192.168.1.107
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] aru bb high delivered bb received flag 1
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Did not need to originate any messages in recovery.
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] got commit token
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Sending initial ORF token
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 0, aru 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] install seq 0 aru 0 high seq received 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 1, aru 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] install seq 0 aru 0 high seq received 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 2, aru 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] install seq 0 aru 0 high seq received 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] token retrans flag is 0 my set retrans flag0 retrans queue empty 1 count 3, aru 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] install seq 0 aru 0 high seq received 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] retrans flag count 4 token aru 0 install seq 0 aru 0 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] recovery to regular 1-0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering to app f to e
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 760: memb=1, new=0, lost=0
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: memb: node1 1778493632
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 760: memb=4, new=3, lost=0
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Creating entry for node 1795270848 born on 760
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Node 1795270848/unknown is now: member
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: NEW:  .pending. 1795270848
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] debug: pcmk_peer_update: Node 1795270848 has address r(0) ip(192.168.1.107) 
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Creating entry for node 1812048064 born on 760
Apr 12 13:57:24 node1 crmd: [2473]: info: ais_dispatch: Membership 760: quorum still lost
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Node 1812048064/unknown is now: member
Apr 12 13:57:24 node1 cib: [2469]: info: ais_dispatch: Membership 760: quorum still lost
Apr 12 13:57:24 node1 crmd: [2473]: debug: crm_new_peer: Creating entry for node (null)/1795270848
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: NEW:  .pending. 1812048064
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_new_peer: Node <null> now has id: 1795270848
Apr 12 13:57:24 node1 cib: [2469]: debug: crm_new_peer: Creating entry for node (null)/1795270848
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] debug: pcmk_peer_update: Node 1812048064 has address r(0) ip(192.168.1.108) 
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_update_peer: Node (null): id=1795270848 state=member (new) addr=r(0) ip(192.168.1.107)  votes=0 born=0 seen=760 proc=00000000000000000000000000000000
Apr 12 13:57:24 node1 crmd: [2473]: debug: crm_new_peer: Creating entry for node (null)/1812048064
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_new_peer: Node <null> now has id: 1812048064
Apr 12 13:57:24 node1 cib: [2469]: info: crm_new_peer: Node <null> now has id: 1795270848
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Creating entry for node 1828825280 born on 760
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_update_peer: Node (null): id=1812048064 state=member (new) addr=r(0) ip(192.168.1.108)  votes=0 born=0 seen=760 proc=00000000000000000000000000000000
Apr 12 13:57:24 node1 crmd: [2473]: debug: crm_new_peer: Creating entry for node (null)/1828825280
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_new_peer: Node <null> now has id: 1828825280
Apr 12 13:57:24 node1 cib: [2469]: info: crm_update_peer: Node (null): id=1795270848 state=member (new) addr=r(0) ip(192.168.1.107)  votes=0 born=0 seen=760 proc=00000000000000000000000000000000
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Node 1828825280/unknown is now: member
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_update_peer: Node (null): id=1828825280 state=member (new) addr=r(0) ip(192.168.1.109)  votes=0 born=0 seen=760 proc=00000000000000000000000000000000
Apr 12 13:57:24 node1 cib: [2469]: debug: crm_new_peer: Creating entry for node (null)/1812048064
Apr 12 13:57:24 node1 cib: [2469]: info: crm_new_peer: Node <null> now has id: 1812048064
Apr 12 13:57:24 node1 crmd: [2473]: debug: post_cache_update: Updated cache after membership event 760.
Apr 12 13:57:24 node1 cib: [2469]: info: crm_update_peer: Node (null): id=1812048064 state=member (new) addr=r(0) ip(192.168.1.108)  votes=0 born=0 seen=760 proc=00000000000000000000000000000000
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: NEW:  .pending. 1828825280
Apr 12 13:57:24 node1 crmd: [2473]: debug: post_cache_update: post_cache_update added action A_ELECTION_CHECK to the FSA
Apr 12 13:57:24 node1 cib: [2469]: debug: crm_new_peer: Creating entry for node (null)/1828825280
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] debug: pcmk_peer_update: Node 1828825280 has address r(0) ip(192.168.1.109) 
Apr 12 13:57:24 node1 cib: [2469]: info: crm_new_peer: Node <null> now has id: 1828825280
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: MEMB: node1 1778493632
Apr 12 13:57:24 node1 cib: [2469]: info: crm_update_peer: Node (null): id=1828825280 state=member (new) addr=r(0) ip(192.168.1.109)  votes=0 born=0 seen=760 proc=00000000000000000000000000000000
Apr 12 13:57:24 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_ELECTION_CHECK
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: MEMB: .pending. 1795270848
Apr 12 13:57:24 node1 cib: [2469]: info: ais_dispatch: Membership 760: quorum still lost
Apr 12 13:57:24 node1 crmd: [2473]: debug: do_election_check: Ignore election check: we not in an election
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: MEMB: .pending. 1812048064
Apr 12 13:57:24 node1 crmd: [2473]: info: ais_dispatch: Membership 760: quorum still lost
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: pcmk_peer_update: MEMB: .pending. 1828825280
Apr 12 13:57:24 node1 cib: [2469]: info: crm_get_peer: Node 1795270848 is now known as node2
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_get_peer: Node 1795270848 is now known as node2
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] debug: pcmk_peer_update: 3 nodes changed
Apr 12 13:57:24 node1 cib: [2469]: info: crm_update_peer: Node node2: id=1795270848 state=member addr=r(0) ip(192.168.1.107)  votes=1 (new) born=756 seen=760 proc=00000000000000000000000000053312 (new)
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_update_peer: Node node2: id=1795270848 state=member addr=r(0) ip(192.168.1.107)  votes=1 (new) born=756 seen=760 proc=00000000000000000000000000053312 (new)
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: send_member_notification: Sending membership update 760 to 2 children
Apr 12 13:57:24 node1 cib: [2469]: notice: ais_dispatch: Membership 760: quorum acquired
Apr 12 13:57:24 node1 crmd: [2473]: debug: post_cache_update: Updated cache after membership event 760.
Apr 12 13:57:24 node1 crmd: [2473]: debug: post_cache_update: post_cache_update added action A_ELECTION_CHECK to the FSA
Apr 12 13:57:24 node1 cib: [2469]: info: crm_get_peer: Node 1812048064 is now known as node3
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] debug: send_cluster_id: Local update: id=1778493632, born=760, seq=760
Apr 12 13:57:24 node1 cib: [2469]: info: crm_update_peer: Node node3: id=1812048064 state=member addr=r(0) ip(192.168.1.108)  votes=1 (new) born=748 seen=760 proc=00000000000000000000000000053312 (new)
Apr 12 13:57:24 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_ELECTION_CHECK
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: 0x66f3d0 Node 1778493632 ((null)) born on: 760
Apr 12 13:57:24 node1 cib: [2469]: info: ais_dispatch: Membership 760: quorum retained
Apr 12 13:57:24 node1 crmd: [2473]: debug: do_election_check: Ignore election check: we not in an election
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] This node is within the primary component and will provide service.
Apr 12 13:57:24 node1 crmd: [2473]: notice: ais_dispatch: Membership 760: quorum acquired
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] entering OPERATIONAL state.
Apr 12 13:57:24 node1 cib: [2469]: info: crm_get_peer: Node 1828825280 is now known as node4
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_get_peer: Node 1812048064 is now known as node3
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
Apr 12 13:57:24 node1 cib: [2469]: info: crm_update_peer: Node node4: id=1828825280 state=member addr=r(0) ip(192.168.1.109)  votes=1 (new) born=748 seen=760 proc=00000000000000000000000000053312 (new)
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_update_peer: Node node3: id=1812048064 state=member addr=r(0) ip(192.168.1.108)  votes=1 (new) born=748 seen=760 proc=00000000000000000000000000053312 (new)
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 1
Apr 12 13:57:24 node1 crmd: [2473]: debug: post_cache_update: Updated cache after membership event 760.
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 0 to 1
Apr 12 13:57:24 node1 crmd: [2473]: debug: post_cache_update: post_cache_update added action A_ELECTION_CHECK to the FSA
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 1 to pending delivery queue
Apr 12 13:57:24 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_ELECTION_CHECK
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] debug: pcmk_cluster_id_callback: Node update: node2 (1.0.8)
Apr 12 13:57:24 node1 crmd: [2473]: debug: do_election_check: Ignore election check: we not in an election
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: 0x67c3a0 Node 1795270848 (node2) born on: 756
Apr 12 13:57:24 node1 crmd: [2473]: info: ais_dispatch: Membership 760: quorum retained
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: 0x67c3a0 Node 1795270848 now known as node2 (was: (null))
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_get_peer: Node 1828825280 is now known as node4
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Node node2 now has process list: 00000000000000000000000000053312 (340754)
Apr 12 13:57:24 node1 crmd: [2473]: info: crm_update_peer: Node node4: id=1828825280 state=member addr=r(0) ip(192.168.1.109)  votes=1 (new) born=748 seen=760 proc=00000000000000000000000000053312 (new)
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Node node2 now has 1 quorum votes (was 0)
Apr 12 13:57:24 node1 crmd: [2473]: debug: post_cache_update: Updated cache after membership event 760.
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: send_member_notification: Sending membership update 760 to 2 children
Apr 12 13:57:24 node1 crmd: [2473]: debug: post_cache_update: post_cache_update added action A_ELECTION_CHECK to the FSA
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1795270848
Apr 12 13:57:24 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_ELECTION_CHECK
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 0. 
Apr 12 13:57:24 node1 crmd: [2473]: debug: do_election_check: Ignore election check: we not in an election
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 2
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 1 to 2
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 2 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 3
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 2 to 3
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 3 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] debug: pcmk_cluster_id_callback: Node update: node3 (1.0.8)
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: 0x67c410 Node 1812048064 (node3) born on: 748
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: 0x67c410 Node 1812048064 now known as node3 (was: (null))
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Node node3 now has process list: 00000000000000000000000000053312 (340754)
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Node node3 now has 1 quorum votes (was 0)
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: send_member_notification: Sending membership update 760 to 2 children
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1812048064
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 4
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 3 to 4
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 4 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 5
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 4 to 5
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 5 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] debug: pcmk_cluster_id_callback: Node update: node4 (1.0.8)
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: 0x67c4a0 Node 1828825280 (node4) born on: 748
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: 0x67c4a0 Node 1828825280 now known as node4 (was: (null))
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Node node4 now has process list: 00000000000000000000000000053312 (340754)
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: update_member: Node node4 now has 1 quorum votes (was 0)
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] info: send_member_notification: Sending membership update 760 to 2 children
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1828825280
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 6
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 5 to 6
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 6 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 6 to 8
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 7 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [pcmk  ] debug: pcmk_cluster_id_callback: Node update: node1 (1.0.8)
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (dummy CLM service)
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 8 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 7
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 8
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 6
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 8 to 9
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 9 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 9
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 9 to a
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering a to b
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering b to c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 8
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering c to d
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering d to e
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1795270848
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering e to f
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1812048064
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 10
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering f to 10
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 10 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1828825280
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (dummy CLM service)
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (dummy AMF service)
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 10
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 11
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 10 to 11
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 11 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1828825280
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 11 to 12
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 12 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 12
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 13
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 12 to 13
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 13 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1795270848
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 14
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 13 to 14
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 14 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1812048064
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (dummy AMF service)
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (dummy CKPT service)
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 11
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 14 to 15
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 15 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 15
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 14
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 16
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 15 to 16
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 16 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1812048064
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 17
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 16 to 17
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 17 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1828825280
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 15
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 17 to 18
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 18 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 18
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 19
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 18 to 19
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 19 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1795270848
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (dummy CKPT service)
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (dummy EVT service)
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 17
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 1a
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 19 to 1a
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 1a to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 1b
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 1a to 1b
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 1b to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 1c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 1b to 1c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 1c to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 19
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 1c to 1d
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 1d to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 1d
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 1c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 1d to 1e
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 1e to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 1e
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 1f
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 1e to 1f
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 1f to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 20
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 1f to 20
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 20 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 21
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 20 to 21
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 21 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 1d
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 21
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 22
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 21 to 22
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 22 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1828825280
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 22 to 23
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 23 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 23
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 24
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 23 to 24
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 24 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1795270848
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 25
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 24 to 25
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 25 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1812048064
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (dummy EVT service)
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization actions starting for (corosync cluster closed process group service v1.01)
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 22
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 26
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 25 to 26
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 26 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 27
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 26 to 27
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 27 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [CPG   ] downlist left_list: 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 28
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 27 to 28
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 28 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 29
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 28 to 29
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 29 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [CPG   ] downlist left_list: 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 25
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 29 to 2b
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 2a to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 2b to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [CPG   ] downlist left_list: 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 2a
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 2b
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 2c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 2b to 2c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 2c to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 2d
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 2c to 2d
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 2d to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [CPG   ] downlist left_list: 0
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 2e
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 2d to 2e
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 2e to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1812048064
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 2f
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 2e to 2f
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 2f to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1828825280
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 29
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 2f to 30
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 30 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1778493632
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 0. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 30
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 31
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 30 to 31
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 31 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] confchg entries 4
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier Start Received From 1795270848
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1778493632 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1795270848 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1812048064 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Barrier completion status for nodeid 1828825280 = 1. 
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Synchronization barrier completed
Apr 12 13:57:24 node1 corosync[2461]:   [SYNC  ] Committing synchronization for (corosync cluster closed process group service v1.01)
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 32
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 31 to 32
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 32 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 33
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 32 to 33
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 33 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 2f
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 33 to 34
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 34 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 34
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 35
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 34 to 35
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 35 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [MAIN  ] Completed service synchronization, ready to provide service.
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 33
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 35
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 36
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 35 to 36
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 36 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 36
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 37
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 36 to 37
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 37 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 38
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 37 to 38
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 38 to pending delivery queue
Apr 12 13:57:24 node1 cib: [2469]: info: cib_process_diff: Diff 0.246.24 -> 0.246.25 not applied to 0.245.0: current "epoch" is less than required
Apr 12 13:57:24 node1 sshd[2937]: Server listening on 0.0.0.0 port 22.
Apr 12 13:57:24 node1 cib: [2469]: info: cib_server_process_diff: Requesting re-sync from peer
Apr 12 13:57:24 node1 sshd[2937]: Server listening on :: port 22.
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 38
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 38 to 39
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 39 to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 39
Apr 12 13:57:24 node1 cib: [2469]: WARN: cib_diff_notify: Local-only Change (client:crmd, call: 48): 0.0.0 (Application of an update diff failed, requesting a full refresh)
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 39
Apr 12 13:57:24 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 3a
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 39 to 3a
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 3a to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 3b
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 3a to 3b
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 3b to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 3c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 3b to 3c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 3c to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 3d
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering 3c to 3d
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 3d to pending delivery queue
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 3c
Apr 12 13:57:24 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 3d
Apr 12 13:57:24 node1 cib: [2469]: debug: activateCibXml: Triggering CIB write for cib_replace op
Apr 12 13:57:24 node1 cib: [2469]: info: cib_replace_notify: Replaced: 0.245.0 -> 0.246.25 from node3
Apr 12 13:57:24 node1 crmd: [2473]: debug: do_cib_replaced: Updating the CIB after a replace: DC=false
Apr 12 13:57:24 node1 cib: [2469]: debug: Forking temp process write_cib_contents
Apr 12 13:57:24 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:24 node1 cib: [2938]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-10.raw
Apr 12 13:57:24 node1 cib: [2938]: info: write_cib_contents: Wrote version 0.246.0 of the CIB to disk (digest: 4eec0fcb8eb77881d30cf981a78ce803)
Apr 12 13:57:24 node1 cib: [2938]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.ROun5F (digest: /var/lib/heartbeat/crm/cib.WRNU3v)
Apr 12 13:57:24 node1 cib: [2469]: info: Managed write_cib_contents process 2938 exited with return code 0.
Apr 12 13:57:25 node1 /usr/sbin/cron[3071]: (CRON) STARTUP (V5.0)
Apr 12 13:57:26 node1 xenstored: Checking store ...
Apr 12 13:57:26 node1 xenstored: Checking store complete.
Apr 12 13:57:26 node1 kernel: [   38.078888]   alloc irq_desc for 448 on node 0
Apr 12 13:57:26 node1 kernel: [   38.078891]   alloc kstat_irqs on node 0
Apr 12 13:57:26 node1 kernel: [   38.083361]   alloc irq_desc for 449 on node 0
Apr 12 13:57:26 node1 kernel: [   38.083363]   alloc kstat_irqs on node 0
Apr 12 13:57:26 node1 kernel: [   38.083376] suspend: event channel 40
Apr 12 13:57:26 node1 BLKTAPCTRL[3090]: blktapctrl.c:789: blktapctrl: v1.0.0
Apr 12 13:57:26 node1 BLKTAPCTRL[3090]: blktapctrl.c:791: Found driver: [raw image (aio)]
Apr 12 13:57:26 node1 BLKTAPCTRL[3090]: blktapctrl.c:791: Found driver: [raw image (sync)]
Apr 12 13:57:26 node1 BLKTAPCTRL[3090]: blktapctrl.c:791: Found driver: [vmware image (vmdk)]
Apr 12 13:57:26 node1 BLKTAPCTRL[3090]: blktapctrl.c:791: Found driver: [ramdisk image (ram)]
Apr 12 13:57:26 node1 BLKTAPCTRL[3090]: blktapctrl.c:791: Found driver: [qcow disk (qcow)]
Apr 12 13:57:26 node1 BLKTAPCTRL[3090]: blktapctrl.c:791: Found driver: [qcow2 disk (qcow2)]
Apr 12 13:57:26 node1 BLKTAPCTRL[3090]: blktapctrl.c:791: Found driver: [raw image (cdrom)]
Apr 12 13:57:26 node1 BLKTAPCTRL[3090]: blktapctrl_linux.c:23: /dev/xen/blktap0 device already exists
Apr 12 13:57:26 node1 attrd: [2471]: debug: cib_connect: CIB signon attempt 1
Apr 12 13:57:26 node1 attrd: [2471]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_rw
Apr 12 13:57:26 node1 attrd: [2471]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/cib_callback
Apr 12 13:57:26 node1 attrd: [2471]: debug: cib_native_signon_raw: Connection to CIB successful
Apr 12 13:57:26 node1 attrd: [2471]: info: cib_connect: Connected to the CIB after 1 signon attempts
Apr 12 13:57:26 node1 attrd: [2471]: info: cib_connect: Sending full refresh
Apr 12 13:57:26 node1 cib: [2469]: debug: cib_common_callback_worker: Setting cib_refresh_notify callbacks for 2471 (8f1ce85c-54df-43e3-ac5e-40e42574df3b): on
Apr 12 13:57:31 node1 kernel: [   43.064009] eth0: no IPv6 routers present
Apr 12 13:57:31 node1 kernel: [   43.468008] br0: no IPv6 routers present
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 3e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 3d to 3e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 3e to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 3f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 3e to 3f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 3f to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 40
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 3f to 40
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 40 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 41
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 40 to 41
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 41 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 3f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 41
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 42
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 41 to 42
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 42 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 43
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 42 to 43
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 43 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 44
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 43 to 44
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 44 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 45
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 44 to 45
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 45 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 43
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 45
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 46
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 45 to 46
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 46 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 47
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 46 to 47
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 47 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 48
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 47 to 48
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 48 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 49
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 48 to 49
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 49 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 47
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 49
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 4a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 49 to 4a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 4a to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 4b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 4a to 4b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 4b to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 4c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 4b to 4c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 4c to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 4b
Apr 12 13:57:36 node1 crmd: [2473]: debug: handle_request: Raising I_JOIN_OFFER: join-2
Apr 12 13:57:36 node1 crmd: [2473]: debug: s_crmd_fsa: Processing I_JOIN_OFFER: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_DC_TIMER_STOP
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_CL_JOIN_REQUEST
Apr 12 13:57:36 node1 crmd: [2473]: info: update_dc: Set DC to node3 (3.0.1)
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_cl_join_offer_respond: do_cl_join_offer_respond added action A_DC_TIMER_STOP to the FSA
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_DC_TIMER_STOP
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 4c
Apr 12 13:57:36 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 4d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 4c to 4d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 4d to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 4d
Apr 12 13:57:36 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 4e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 4d to 4e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 4e to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 4f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 4e to 4f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 4f to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: debug: crm_new_peer: Creating entry for node node2/1795270848
Apr 12 13:57:36 node1 attrd: [2471]: info: crm_new_peer: Node node2 now has id: 1795270848
Apr 12 13:57:36 node1 attrd: [2471]: info: crm_new_peer: Node 1795270848 is now known as node2
Apr 12 13:57:36 node1 attrd: [2471]: info: find_hash_entry: Creating hash entry for fail-count-rsa-fencing-1
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 4f
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 50
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 4f to 50
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 50 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 51
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 50 to 51
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 51 to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: info: find_hash_entry: Creating hash entry for last-failure-rsa-fencing-1
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 52
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 51 to 52
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 52 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 51
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 53
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 52 to 53
Apr 12 13:57:36 node1 attrd: [2471]: info: find_hash_entry: Creating hash entry for fail-count-rsa-fencing-4
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 53 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 54
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 53 to 54
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 54 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 52
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 55
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 54 to 55
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 55 to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 54
Apr 12 13:57:36 node1 crmd: [2473]: debug: join_query_callback: Respond to join offer join-2
Apr 12 13:57:36 node1 crmd: [2473]: debug: join_query_callback: Acknowledging node3 as our DC
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 56
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 55 to 56
Apr 12 13:57:36 node1 attrd: [2471]: info: find_hash_entry: Creating hash entry for last-failure-rsa-fencing-4
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 56 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 57
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 56 to 57
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 57 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 58
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 57 to 58
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 58 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 59
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 58 to 59
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 59 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 55
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 59 to 5a
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 5a to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 5a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 59
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 5a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 5b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 5a to 5b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 5b to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 5c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 5b to 5c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 5c to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 5c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 5d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 5c to 5d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 5d to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 5e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 5d to 5e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 5e to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 5e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 5f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 5e to 5f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 5f to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 60
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 5f to 60
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 60 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 60
Apr 12 13:57:36 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 61
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 60 to 61
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 61 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 62
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 61 to 62
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 62 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 63
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 62 to 63
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 63 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 64
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 63 to 64
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 64 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 65
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 64 to 65
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 65 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 63
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 65
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 66
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 65 to 66
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 66 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 67
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 66 to 67
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 67 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 68
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 67 to 68
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 68 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 69
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 68 to 69
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 69 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 69
Apr 12 13:57:36 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 6a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 69 to 6a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 6a to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 6a
Apr 12 13:57:36 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 6b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 6a to 6b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 6b to pending delivery queue
Apr 12 13:57:36 node1 crmd: [2473]: debug: handle_request: Raising I_JOIN_RESULT: join-2
Apr 12 13:57:36 node1 crmd: [2473]: debug: s_crmd_fsa: Processing I_JOIN_RESULT: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_CL_JOIN_RESULT
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_cl_join_finalize_respond: Confirming join join-2: join_ack_nack
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 6b
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_cl_join_finalize_respond: join-2: Join complete.  Sending local LRM status to node3
Apr 12 13:57:36 node1 crmd: [2473]: info: update_attrd: Connecting to attrd...
Apr 12 13:57:36 node1 crmd: [2473]: debug: init_client_ipc_comms_nodispatch: Attempting to talk on: /var/run/crm/attrd
Apr 12 13:57:36 node1 crmd: [2473]: debug: attrd_update: Sent update: terminate=(null) for node1
Apr 12 13:57:36 node1 crmd: [2473]: debug: attrd_update: Sent update: shutdown=(null) for node1
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_local_callback: update message from crmd: terminate=<null>
Apr 12 13:57:36 node1 crmd: [2473]: debug: attrd_update: Sent update: (null)=(null) for localhost
Apr 12 13:57:36 node1 attrd: [2471]: info: find_hash_entry: Creating hash entry for terminate
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_local_callback: Supplied: (null), Current: (null), Stored: (null)
Apr 12 13:57:36 node1 crmd: [2473]: debug: s_crmd_fsa: Processing I_NOT_DC: [ state=S_PENDING cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_LOG   
Apr 12 13:57:36 node1 crmd: [2473]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_DC_TIMER_STOP
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_INTEGRATE_TIMER_STOP
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_local_callback: update message from crmd: shutdown=<null>
Apr 12 13:57:36 node1 crmd: [2473]: debug: do_fsa_action: actions:trace: #011// A_FINALIZE_TIMER_STOP
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 attrd: [2471]: info: find_hash_entry: Creating hash entry for shutdown
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 6b to 6c
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_local_callback: Supplied: (null), Current: (null), Stored: (null)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 6c to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 6c
Apr 12 13:57:36 node1 attrd: [2471]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-rsa-fencing-1 (<null>)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 6c
Apr 12 13:57:36 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 attrd: [2471]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 6c to 6e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 6d to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 6e to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 6d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 6e
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='shutdown'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 6e to 6f
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for shutdown=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 6f to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 6f
Apr 12 13:57:36 node1 attrd: [2471]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-rsa-fencing-1 (<null>)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 70
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 6f to 70
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 70 to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 attrd: [2471]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-rsa-fencing-4 (<null>)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 6e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 70 to 72
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 71 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 72 to pending delivery queue
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 71
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 72
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 attrd: [2471]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 73
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 72 to 73
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 73 to pending delivery queue
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='terminate'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 74
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 73 to 74
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 74 to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for terminate=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 attrd: [2471]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-rsa-fencing-4 (<null>)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 70
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 74 to 76
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 75 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 76 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 75
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 76
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 77
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 76 to 77
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 77 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 78
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 77 to 78
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 78 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 74
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 78 to 79
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 79 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 79
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 7a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 79 to 7a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 7a to pending delivery queue
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='shutdown'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for shutdown=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 78
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='shutdown'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for shutdown=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 7a
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 7b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 7a to 7b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 7b to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 7c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 7b to 7c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 7c to pending delivery queue
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 7d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 7c to 7d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 7d to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 7c
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 7e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 7d to 7e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 7e to pending delivery queue
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='terminate'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 7d
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for terminate=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 7f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 7e to 7f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 7f to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 80
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 7f to 80
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 80 to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 7e
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 80
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='terminate'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 81
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for terminate=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 80 to 81
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 81 to pending delivery queue
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 81
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 attrd: [2471]: info: find_hash_entry: Creating hash entry for probe_complete
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='probe_complete'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for probe_complete=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 82
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 81 to 82
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 82 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 83
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 82 to 83
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 83 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 82
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 84
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 83 to 84
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 84 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 83
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 84
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 85
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 84 to 85
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 85 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 86
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 85 to 86
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 86 to pending delivery queue
Apr 12 13:57:36 node1 crmd: [2473]: info: erase_xpath_callback: Deletion of "//node_state[@uname='node1']/transient_attributes": ok (rc=0)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 86
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 87
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 86 to 87
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 87 to pending delivery queue
Apr 12 13:57:36 node1 crmd: [2473]: info: erase_xpath_callback: Deletion of "//node_state[@uname='node1']/lrm": ok (rc=0)
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 87
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 88
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 87 to 88
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 88 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 88
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 89
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 88 to 89
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 89 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 89
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 8a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 89 to 8a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 8a to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 8a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 8b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 8a to 8b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 8b to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 8b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 8c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 8b to 8c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 8c to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 8d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 8c to 8d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 8d to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 8e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 8d to 8e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 8e to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 8f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 8e to 8f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 8f to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 8f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 90
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 8f to 90
Apr 12 13:57:36 node1 attrd: [2471]: debug: crm_new_peer: Creating entry for node node4/1828825280
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 90 to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: info: crm_new_peer: Node node4 now has id: 1828825280
Apr 12 13:57:36 node1 attrd: [2471]: info: crm_new_peer: Node 1828825280 is now known as node4
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='shutdown'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 91
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for shutdown=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 90 to 91
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 91 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 90
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 92
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 91 to 92
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 92 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 93
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 92 to 93
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 93 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 91
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-1'] does not exist
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-1=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 94
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 93 to 94
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 94 to pending delivery queue
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='terminate'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 95
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 94 to 95
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 95 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 93
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for terminate=(null) passed
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 96
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 95 to 96
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 96 to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 97
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 96 to 97
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 97 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 95
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-4'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 98
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 97 to 98
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 98 to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-4=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 99
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 98 to 99
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 99 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 9a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 99 to 9a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 9a to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 97
Apr 12 13:57:36 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='probe_complete'] does not exist
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 9b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 9a to 9b
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 9b to pending delivery queue
Apr 12 13:57:36 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for probe_complete=(null) passed
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 9c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 9b to 9c
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 9c to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 9d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 9c to 9d
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 9d to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 9e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 9d to 9e
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 9e to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 9f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 9e to 9f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 9f to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 9a
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 9f
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a0
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering 9f to a0
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a0 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a0
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a1
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering a0 to a1
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a1 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a1
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a2
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering a1 to a2
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a2 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a2
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a3
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering a2 to a3
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a3 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a3
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a4
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering a3 to a4
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a4 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a4
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a5
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering a4 to a5
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a5 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a5
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a6
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering a5 to a6
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a6 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a6
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a7
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering a6 to a7
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a7 to pending delivery queue
Apr 12 13:57:36 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering a7 to a8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a8 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq a9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering a8 to a9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq a9 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including a9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq aa
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering a9 to aa
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq aa to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including aa
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ab
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering aa to ab
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ab to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including ab
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ac
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ab to ac
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ac to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including ac
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ad
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ac to ad
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ad to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ae
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ad to ae
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ae to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq af
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ae to af
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq af to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering af to b0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b0 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including b0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b0 to b1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b1 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b1 to b2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b2 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b2 to b3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b3 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b3 to b4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b4 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b4 to b5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b5 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b6
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b5 to b6
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b6 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b6 to b7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b7 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b7 to b8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b8 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including b8
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq b9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b8 to b9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq b9 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ba
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering b9 to ba
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ba to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including ba
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq bb
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ba to bb
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq bb to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq bc
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering bb to bc
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq bc to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq bd
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering bc to bd
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq bd to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq be
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering bd to be
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq be to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including be
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq bf
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering be to bf
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq bf to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering bf to c0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c0 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c0 to c1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c1 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c1 to c2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c2 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c2 to c3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c3 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c3 to c4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c4 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c4 to c5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c5 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including c5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c6
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c5 to c6
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c6 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c6 to c7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c7 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c7 to c8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c8 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq c9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c8 to c9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq c9 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including c9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ca
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering c9 to ca
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ca to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq cb
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ca to cb
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq cb to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq cc
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering cb to cc
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq cc to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq cd
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering cc to cd
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq cd to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ce
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering cd to ce
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ce to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq cf
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ce to cf
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq cf to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering cf to d0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d0 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including d0
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d0 to d1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d1 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d1 to d2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d2 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d2 to d3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d3 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d3 to d4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d4 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d4 to d5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d5 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d6
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d5 to d6
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d6 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including d3
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_add_rsc:client [2473] adds resource dlm:0
Apr 12 13:57:37 node1 crmd: [2473]: info: do_lrm_rsc_op: Performing key=6:2:7:d672cd06-6fba-41c7-b684-ee542f69d22a op=dlm:0_monitor_0 )
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including d6
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op:2351: copying parameters for rsc dlm:0
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op: add an operation operation monitor[2] on ocf::controld::dlm:0 for client 2473, its parameters: CRM_meta_clone_max=[4] crm_feature_set=[3.0.1] CRM_meta_timeout=[20000] CRM_meta_globally_unique=[false] CRM_meta_op_target_rc=[7] CRM_meta_clone=[0]  to the operation list.
Apr 12 13:57:37 node1 lrmd: [2470]: info: rsc:dlm:0: monitor
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_add_rsc:client [2473] adds resource o2cb:0
Apr 12 13:57:37 node1 crmd: [2473]: info: do_lrm_rsc_op: Performing key=7:2:7:d672cd06-6fba-41c7-b684-ee542f69d22a op=o2cb:0_monitor_0 )
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op:2351: copying parameters for rsc o2cb:0
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op: add an operation operation monitor[3] on ocf::o2cb::o2cb:0 for client 2473, its parameters: CRM_meta_clone_max=[4] crm_feature_set=[3.0.1] CRM_meta_timeout=[20000] CRM_meta_globally_unique=[false] CRM_meta_op_target_rc=[7] CRM_meta_clone=[0]  to the operation list.
Apr 12 13:57:37 node1 lrmd: [2470]: info: rsc:o2cb:0: monitor
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_add_rsc:client [2473] adds resource rsa-fencing-1
Apr 12 13:57:37 node1 lrmd: [2470]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Apr 12 13:57:37 node1 crmd: [2473]: info: do_lrm_rsc_op: Performing key=8:2:7:d672cd06-6fba-41c7-b684-ee542f69d22a op=rsa-fencing-1_monitor_0 )
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op:2351: copying parameters for rsc rsa-fencing-1
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op: add an operation operation monitor[4] on stonith::external/ibmrsa-telnet::rsa-fencing-1 for client 2473, its parameters: crm_feature_set=[3.0.1] username=[hacluster] nodename=[nodo1] CRM_meta_timeout=[20000] CRM_meta_op_target_rc=[7] ip_address=[192.168.1.12] password=[xxxxxxx]  to the operation list.
Apr 12 13:57:37 node1 lrmd: [2470]: info: rsc:rsa-fencing-1: monitor
Apr 12 13:57:37 node1 lrmd: [3277]: debug: stonithd_signon: creating connection
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_add_rsc:client [2473] adds resource rsa-fencing-2
Apr 12 13:57:37 node1 lrmd: [2470]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Apr 12 13:57:37 node1 lrmd: [3277]: debug: sending out the signon msg.
Apr 12 13:57:37 node1 crmd: [2473]: info: do_lrm_rsc_op: Performing key=9:2:7:d672cd06-6fba-41c7-b684-ee542f69d22a op=rsa-fencing-2_monitor_0 )
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op:2351: copying parameters for rsc rsa-fencing-2
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op: add an operation operation monitor[5] on stonith::external/ibmrsa-telnet::rsa-fencing-2 for client 2473, its parameters: crm_feature_set=[3.0.1] username=[hacluster] nodename=[nodo2] CRM_meta_timeout=[20000] CRM_meta_op_target_rc=[7] ip_address=[192.168.1.13] password=[xxxxxxx]  to the operation list.
Apr 12 13:57:37 node1 lrmd: [2470]: info: rsc:rsa-fencing-2: monitor
Apr 12 13:57:37 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3277 (pid=3277) succeeded to signon to stonithd.
Apr 12 13:57:37 node1 lrmd: [3277]: debug: signed on to stonithd.
Apr 12 13:57:37 node1 lrmd: [3277]: debug: waiting for the stonithRA reply msg.
Apr 12 13:57:37 node1 lrmd: [3278]: debug: stonithd_signon: creating connection
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d6 to d7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d7 to pending delivery queue
Apr 12 13:57:37 node1 lrmd: [3278]: debug: sending out the signon msg.
Apr 12 13:57:37 node1 attrd: [2471]: debug: crm_new_peer: Creating entry for node node3/1812048064
Apr 12 13:57:37 node1 attrd: [2471]: info: crm_new_peer: Node node3 now has id: 1812048064
Apr 12 13:57:37 node1 attrd: [2471]: info: crm_new_peer: Node 1812048064 is now known as node3
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_add_rsc:client [2473] adds resource rsa-fencing-3
Apr 12 13:57:37 node1 lrmd: [2470]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Apr 12 13:57:37 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3277 [pid: 3277] requests a resource operation monitor on rsa-fencing-1 (external/ibmrsa-telnet)
Apr 12 13:57:37 node1 crmd: [2473]: info: do_lrm_rsc_op: Performing key=10:2:7:d672cd06-6fba-41c7-b684-ee542f69d22a op=rsa-fencing-3_monitor_0 )
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d8
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op:2351: copying parameters for rsc rsa-fencing-3
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op: add an operation operation monitor[6] on stonith::external/ibmrsa-telnet::rsa-fencing-3 for client 2473, its parameters: crm_feature_set=[3.0.1] username=[hacluster] nodename=[nodo3] CRM_meta_timeout=[20000] CRM_meta_op_target_rc=[7] ip_address=[192.168.1.14] password=[xxxxxx]  to the operation list.
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d7 to d8
Apr 12 13:57:37 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='shutdown'] does not exist
Apr 12 13:57:37 node1 stonithd: [2468]: debug: stonithRA_monitor: rsa-fencing-1 is not started.
Apr 12 13:57:37 node1 lrmd: [2470]: notice: max_child_count (4) reached, postponing execution of operation monitor[6] on stonith::external/ibmrsa-telnet::rsa-fencing-3 for client 2473, its parameters: crm_feature_set=[3.0.1] username=[hacluster] nodename=[nodo3] CRM_meta_timeout=[20000] CRM_meta_op_target_rc=[7] ip_address=[192.168.1.14] password=[xxxxxxxx]  by 1000 ms
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d8 to pending delivery queue
Apr 12 13:57:37 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for shutdown=(null) passed
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including d7
Apr 12 13:57:37 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-1'] does not exist
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq d9
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_add_rsc:client [2473] adds resource rsa-fencing-4
Apr 12 13:57:37 node1 lrmd: [2470]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d8 to d9
Apr 12 13:57:37 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-1=(null) passed
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq d9 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including d8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq da
Apr 12 13:57:37 node1 crmd: [2473]: info: do_lrm_rsc_op: Performing key=11:2:7:d672cd06-6fba-41c7-b684-ee542f69d22a op=rsa-fencing-4_monitor_0 )
Apr 12 13:57:37 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-1'] does not exist
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering d9 to da
Apr 12 13:57:37 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-1=(null) passed
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq da to pending delivery queue
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op:2351: copying parameters for rsc rsa-fencing-4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including d9
Apr 12 13:57:37 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='terminate'] does not exist
Apr 12 13:57:37 node1 lrmd: [2470]: debug: on_msg_perform_op: add an operation operation monitor[7] on stonith::external/ibmrsa-telnet::rsa-fencing-4 for client 2473, its parameters: crm_feature_set=[3.0.1] username=[hacluster] nodename=[nodo4] CRM_meta_timeout=[20000] CRM_meta_op_target_rc=[7] ip_address=[192.168.1.15] password=[xxxxxxxx]  to the operation list.
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq db
Apr 12 13:57:37 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for terminate=(null) passed
Apr 12 13:57:37 node1 lrmd: [2470]: notice: max_child_count (4) reached, postponing execution of operation monitor[7] on stonith::external/ibmrsa-telnet::rsa-fencing-4 for client 2473, its parameters: crm_feature_set=[3.0.1] username=[hacluster] nodename=[nodo4] CRM_meta_timeout=[20000] CRM_meta_op_target_rc=[7] ip_address=[192.168.1.15] password=[xxxxxxx]  by 1000 ms
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering da to db
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq db to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq dc
Apr 12 13:57:37 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='fail-count-rsa-fencing-4'] does not exist
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering db to dc
Apr 12 13:57:37 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for fail-count-rsa-fencing-4=(null) passed
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq dc to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq dd
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering dc to dd
Apr 12 13:57:37 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='last-failure-rsa-fencing-4'] does not exist
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq dd to pending delivery queue
Apr 12 13:57:37 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for last-failure-rsa-fencing-4=(null) passed
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including da
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq de
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering dd to de
Apr 12 13:57:37 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='probe_complete'] does not exist
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq de to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq df
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering de to df
Apr 12 13:57:37 node1 attrd: [2471]: debug: attrd_cib_callback: Update -22 for probe_complete=(null) passed
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq df to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including dd
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering df to e0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e0 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including df
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering e0 to e1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e1 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering e1 to e2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e2 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including e0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering e2 to e3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e3 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including e2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including e3
Apr 12 13:57:37 node1 lrmd: [3277]: debug: a stonith RA operation queue to run, call_id=3279.
Apr 12 13:57:37 node1 lrmd: [3277]: debug: stonithd_receive_ops_result: begin
Apr 12 13:57:37 node1 stonithd: [2468]: debug: Child process unknown_rsa-fencing-1_monitor [3279] exited, its exit code: 7 when signo=0.
Apr 12 13:57:37 node1 stonithd: [2468]: debug: rsa-fencing-1's (external/ibmrsa-telnet) op monitor finished. op_result=7
Apr 12 13:57:37 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3278 (pid=3278) succeeded to signon to stonithd.
Apr 12 13:57:37 node1 lrmd: [3278]: debug: signed on to stonithd.
Apr 12 13:57:37 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3277 (pid=3277) signed off
Apr 12 13:57:37 node1 lrmd: [3278]: debug: waiting for the stonithRA reply msg.
Apr 12 13:57:37 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3278 [pid: 3278] requests a resource operation monitor on rsa-fencing-2 (external/ibmrsa-telnet)
Apr 12 13:57:37 node1 stonithd: [2468]: debug: stonithRA_monitor: rsa-fencing-2 is not started.
Apr 12 13:57:37 node1 lrmd: [2470]: WARN: Managed rsa-fencing-1:monitor process 3277 exited with return code 7.
Apr 12 13:57:37 node1 crmd: [2473]: info: process_lrm_event: LRM operation rsa-fencing-1_monitor_0 (call=4, rc=7, cib-update=8, confirmed=true) not running
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering e3 to e5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e4 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e5 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e5
Apr 12 13:57:37 node1 lrmd: [3278]: debug: a stonith RA operation queue to run, call_id=3280.
Apr 12 13:57:37 node1 lrmd: [3278]: debug: stonithd_receive_ops_result: begin
Apr 12 13:57:37 node1 stonithd: [2468]: debug: Child process unknown_rsa-fencing-2_monitor [3280] exited, its exit code: 7 when signo=0.
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e6
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering e5 to e6
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e6 to pending delivery queue
Apr 12 13:57:37 node1 stonithd: [2468]: debug: rsa-fencing-2's (external/ibmrsa-telnet) op monitor finished. op_result=7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including e6
Apr 12 13:57:37 node1 lrmd: [2470]: WARN: Managed rsa-fencing-2:monitor process 3278 exited with return code 7.
Apr 12 13:57:37 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3278 (pid=3278) signed off
Apr 12 13:57:37 node1 crmd: [2473]: info: process_lrm_event: LRM operation rsa-fencing-2_monitor_0 (call=5, rc=7, cib-update=9, confirmed=true) not running
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering e6 to e8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e7 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e8 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including e8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq e9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering e8 to e9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq e9 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including e9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ea
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering e9 to ea
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ea to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including ea
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq eb
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ea to eb
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq eb to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including eb
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ec
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering eb to ec
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ec to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including ec
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ed
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ec to ed
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ed to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including ed
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ee
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ed to ee
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ee to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ef
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ee to ef
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ef to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including ef
Apr 12 13:57:37 node1 o2cb[3276]: INFO: configfs not laoded
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering ef to f0
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f0 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering f0 to f1
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f1 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including f1
Apr 12 13:57:37 node1 lrmd: [2470]: info: RA output: (o2cb:0:monitor:stderr) 2010/04/12_13:57:37 INFO: configfs not laoded
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 lrmd: [2470]: WARN: Managed o2cb:0:monitor process 3276 exited with return code 7.
Apr 12 13:57:37 node1 crmd: [2473]: info: process_lrm_event: LRM operation o2cb:0_monitor_0 (call=3, rc=7, cib-update=10, confirmed=true) not running
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering f1 to f3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f2 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f3 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f2
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f3
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including f3
Apr 12 13:57:37 node1 lrmd: [2470]: info: RA output: (dlm:0:monitor:stderr) dlm_controld.pcmk: no process found
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering f3 to f4
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f4 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering f4 to f5
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f5 to pending delivery queue
Apr 12 13:57:37 node1 lrmd: [2470]: WARN: Managed dlm:0:monitor process 3275 exited with return code 7.
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including f5
Apr 12 13:57:37 node1 crmd: [2473]: info: process_lrm_event: LRM operation dlm:0_monitor_0 (call=2, rc=7, cib-update=11, confirmed=true) not running
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering f5 to f7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f6 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f7 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f6
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f7
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering f7 to f8
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f8 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq f9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering f8 to f9
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq f9 to pending delivery queue
Apr 12 13:57:37 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including f9
Apr 12 13:57:37 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:38 node1 lrmd: [2470]: info: rsc:rsa-fencing-3: monitor
Apr 12 13:57:38 node1 lrmd: [3307]: debug: stonithd_signon: creating connection
Apr 12 13:57:38 node1 lrmd: [3307]: debug: sending out the signon msg.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3307 (pid=3307) succeeded to signon to stonithd.
Apr 12 13:57:38 node1 lrmd: [3307]: debug: signed on to stonithd.
Apr 12 13:57:38 node1 lrmd: [3307]: debug: waiting for the stonithRA reply msg.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3307 [pid: 3307] requests a resource operation monitor on rsa-fencing-3 (external/ibmrsa-telnet)
Apr 12 13:57:38 node1 stonithd: [2468]: debug: stonithRA_monitor: rsa-fencing-3 is not started.
Apr 12 13:57:38 node1 lrmd: [3307]: debug: a stonith RA operation queue to run, call_id=3308.
Apr 12 13:57:38 node1 lrmd: [3307]: debug: stonithd_receive_ops_result: begin
Apr 12 13:57:38 node1 stonithd: [2468]: debug: Child process unknown_rsa-fencing-3_monitor [3308] exited, its exit code: 7 when signo=0.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: rsa-fencing-3's (external/ibmrsa-telnet) op monitor finished. op_result=7
Apr 12 13:57:38 node1 lrmd: [2470]: WARN: Managed rsa-fencing-3:monitor process 3307 exited with return code 7.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3307 (pid=3307) signed off
Apr 12 13:57:38 node1 lrmd: [2470]: info: rsc:rsa-fencing-4: monitor
Apr 12 13:57:38 node1 crmd: [2473]: info: process_lrm_event: LRM operation rsa-fencing-3_monitor_0 (call=6, rc=7, cib-update=12, confirmed=true) not running
Apr 12 13:57:38 node1 lrmd: [3309]: debug: stonithd_signon: creating connection
Apr 12 13:57:38 node1 lrmd: [3309]: debug: sending out the signon msg.
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3309 (pid=3309) succeeded to signon to stonithd.
Apr 12 13:57:38 node1 lrmd: [3309]: debug: signed on to stonithd.
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering f9 to fb
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq fa to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq fb to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq fa
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq fb
Apr 12 13:57:38 node1 lrmd: [3309]: debug: waiting for the stonithRA reply msg.
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including fb
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3309 [pid: 3309] requests a resource operation monitor on rsa-fencing-4 (external/ibmrsa-telnet)
Apr 12 13:57:38 node1 stonithd: [2468]: debug: stonithRA_monitor: rsa-fencing-4 is not started.
Apr 12 13:57:38 node1 lrmd: [3309]: debug: a stonith RA operation queue to run, call_id=3310.
Apr 12 13:57:38 node1 lrmd: [3309]: debug: stonithd_receive_ops_result: begin
Apr 12 13:57:38 node1 stonithd: [2468]: debug: Child process unknown_rsa-fencing-4_monitor [3310] exited, its exit code: 7 when signo=0.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: rsa-fencing-4's (external/ibmrsa-telnet) op monitor finished. op_result=7
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq fc
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering fb to fc
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq fc to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq fd
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering fc to fd
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq fd to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including fd
Apr 12 13:57:38 node1 lrmd: [2470]: WARN: Managed rsa-fencing-4:monitor process 3309 exited with return code 7.
Apr 12 13:57:38 node1 crmd: [2473]: info: process_lrm_event: LRM operation rsa-fencing-4_monitor_0 (call=7, rc=7, cib-update=13, confirmed=true) not running
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3309 (pid=3309) signed off
Apr 12 13:57:38 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering fd to ff
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq fe to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq ff to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq fe
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq ff
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 100
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering ff to 100
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 100 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 101
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 100 to 101
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 101 to pending delivery queue
Apr 12 13:57:38 node1 crmd: [2473]: debug: attrd_update: Sent update: probe_complete=true for localhost
Apr 12 13:57:38 node1 attrd: [2471]: debug: attrd_local_callback: update message from crmd: probe_complete=true
Apr 12 13:57:38 node1 attrd: [2471]: debug: attrd_local_callback: Supplied: true, Current: (null), Stored: (null)
Apr 12 13:57:38 node1 attrd: [2471]: debug: attrd_local_callback: New value of probe_complete is true
Apr 12 13:57:38 node1 attrd: [2471]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 102
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 101 to 102
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 102 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 103
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 102 to 103
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 103 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 104
Apr 12 13:57:38 node1 cib: [2469]: debug: cib_process_xpath: cib_query: //cib/status//node_state[@id='node1']//nvpair[@name='probe_complete'] does not exist
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 103 to 104
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 104 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 101
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 104
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 105
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 104 to 105
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 105 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 106
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 105 to 106
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 106 to pending delivery queue
Apr 12 13:57:38 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:38 node1 cib: [2469]: debug: cib_process_xpath: Processing cib_query op for /cib (/cib)
Apr 12 13:57:38 node1 attrd: [2471]: info: attrd_perform_update: Sent update 41: probe_complete=true
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 107
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 106 to 107
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 107 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 108
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 107 to 108
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 108 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 106
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 108 to 10a
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 109 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 10a to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 109
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 10a
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 108
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 10b
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 10a to 10b
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 10b to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 10a
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 10c
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 10b to 10c
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 10c to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 10d
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 10c to 10d
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 10d to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 10b
Apr 12 13:57:38 node1 crmd: [2473]: info: do_lrm_rsc_op: Performing key=23:2:0:d672cd06-6fba-41c7-b684-ee542f69d22a op=rsa-fencing-1_start_0 )
Apr 12 13:57:38 node1 lrmd: [2470]: debug: on_msg_perform_op:2351: copying parameters for rsc rsa-fencing-1
Apr 12 13:57:38 node1 lrmd: [2470]: debug: on_msg_perform_op: add an operation operation start[8] on stonith::external/ibmrsa-telnet::rsa-fencing-1 for client 2473, its parameters: crm_feature_set=[3.0.1] username=[hacluster] nodename=[nodo1] CRM_meta_timeout=[20000] ip_address=[192.168.1.12] password=[xxxxxxx]  to the operation list.
Apr 12 13:57:38 node1 lrmd: [2470]: info: rsc:rsa-fencing-1: start
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 10d
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 10e
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 10d to 10e
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 10e to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 10f
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 10e to 10f
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 10f to pending delivery queue
Apr 12 13:57:38 node1 lrmd: [3311]: debug: stonithd_signon: creating connection
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 10f
Apr 12 13:57:38 node1 lrmd: [3311]: debug: sending out the signon msg.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3311 (pid=3311) succeeded to signon to stonithd.
Apr 12 13:57:38 node1 lrmd: [3311]: debug: signed on to stonithd.
Apr 12 13:57:38 node1 lrmd: [3311]: info: Try to start STONITH resource <rsc_id=rsa-fencing-1> : Device=external/ibmrsa-telnet
Apr 12 13:57:38 node1 lrmd: [3311]: debug: waiting for the stonithRA reply msg.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3311 [pid: 3311] requests a resource operation start on rsa-fencing-1 (external/ibmrsa-telnet)
Apr 12 13:57:38 node1 stonithd: [2468]: debug: stonithRA_start: got a shmem seg of size 8192, shmid: 32768
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 110
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 10f to 110
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 110 to pending delivery queue
Apr 12 13:57:38 node1 crmd: [2473]: info: do_lrm_rsc_op: Performing key=28:2:0:d672cd06-6fba-41c7-b684-ee542f69d22a op=rsa-fencing-4_start_0 )
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 111
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 110 to 111
Apr 12 13:57:38 node1 lrmd: [2470]: debug: on_msg_perform_op:2351: copying parameters for rsc rsa-fencing-4
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 111 to pending delivery queue
Apr 12 13:57:38 node1 lrmd: [2470]: debug: on_msg_perform_op: add an operation operation start[9] on stonith::external/ibmrsa-telnet::rsa-fencing-4 for client 2473, its parameters: crm_feature_set=[3.0.1] username=[hacluster] nodename=[nodo4] CRM_meta_timeout=[20000] ip_address=[192.168.1.15] password=[xxxxxxx]  to the operation list.
Apr 12 13:57:38 node1 lrmd: [2470]: info: rsc:rsa-fencing-4: start
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 112
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 111 to 112
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 112 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 110
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 112
Apr 12 13:57:38 node1 lrmd: [3312]: debug: stonithd_signon: creating connection
Apr 12 13:57:38 node1 lrmd: [3312]: debug: sending out the signon msg.
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 113
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 112 to 113
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 113 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 114
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 113 to 114
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 114 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 114
Apr 12 13:57:38 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 115
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 114 to 115
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 115 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 115
Apr 12 13:57:38 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 116
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering 115 to 116
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 116 to pending delivery queue
Apr 12 13:57:38 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 116
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_set_config: called.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: called.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_run_cmd: Calling '/usr/lib64/stonith/plugins/external/ibmrsa-telnet getconfignames'
Apr 12 13:57:38 node1 attrd: [2471]: debug: attrd_cib_callback: Update 41 for probe_complete=true passed
Apr 12 13:57:38 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_run_cmd: '/usr/lib64/stonith/plugins/external/ibmrsa-telnet getconfignames' output: nodename#012ip_address#012username#012password
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: 'ibmrsa-telnet getconfignames' returned 0
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: ibmrsa-telnet configname nodename
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: ibmrsa-telnet configname ip_address
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: ibmrsa-telnet configname username
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: ibmrsa-telnet configname password
Apr 12 13:57:38 node1 lrmd: [3311]: debug: a stonith RA operation queue to run, call_id=3314.
Apr 12 13:57:38 node1 lrmd: [3311]: debug: stonithd_receive_ops_result: begin
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3312 (pid=3312) succeeded to signon to stonithd.
Apr 12 13:57:38 node1 stonithd: [3314]: debug: external_status: called.
Apr 12 13:57:38 node1 lrmd: [3312]: debug: signed on to stonithd.
Apr 12 13:57:38 node1 stonithd: [3314]: debug: external_run_cmd: Calling '/usr/lib64/stonith/plugins/external/ibmrsa-telnet status'
Apr 12 13:57:38 node1 lrmd: [3312]: info: Try to start STONITH resource <rsc_id=rsa-fencing-4> : Device=external/ibmrsa-telnet
Apr 12 13:57:38 node1 lrmd: [3312]: debug: waiting for the stonithRA reply msg.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3312 [pid: 3312] requests a resource operation start on rsa-fencing-4 (external/ibmrsa-telnet)
Apr 12 13:57:38 node1 stonithd: [2468]: debug: stonithRA_start: got a shmem seg of size 8192, shmid: 65537
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_new: called.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_set_config: called.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: called.
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_run_cmd: Calling '/usr/lib64/stonith/plugins/external/ibmrsa-telnet getconfignames'
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_run_cmd: '/usr/lib64/stonith/plugins/external/ibmrsa-telnet getconfignames' output: nodename#012ip_address#012username#012password
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: 'ibmrsa-telnet getconfignames' returned 0
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: ibmrsa-telnet configname nodename
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: ibmrsa-telnet configname ip_address
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: ibmrsa-telnet configname username
Apr 12 13:57:38 node1 stonithd: [2468]: debug: external_get_confignames: ibmrsa-telnet configname password
Apr 12 13:57:38 node1 lrmd: [3312]: debug: a stonith RA operation queue to run, call_id=3317.
Apr 12 13:57:38 node1 lrmd: [3312]: debug: stonithd_receive_ops_result: begin
Apr 12 13:57:38 node1 stonithd: [3317]: debug: external_status: called.
Apr 12 13:57:38 node1 stonithd: [3317]: debug: external_run_cmd: Calling '/usr/lib64/stonith/plugins/external/ibmrsa-telnet status'
Apr 12 13:57:39 node1 stonithd: [3314]: debug: external_run_cmd: '/usr/lib64/stonith/plugins/external/ibmrsa-telnet status' output: 
Apr 12 13:57:39 node1 stonithd: [3314]: debug: external_status: running 'ibmrsa-telnet status' returned 0
Apr 12 13:57:39 node1 stonithd: [3314]: debug: external_hostlist: called.
Apr 12 13:57:39 node1 stonithd: [3314]: debug: external_run_cmd: Calling '/usr/lib64/stonith/plugins/external/ibmrsa-telnet gethosts'
Apr 12 13:57:39 node1 stonithd: [3317]: debug: external_run_cmd: '/usr/lib64/stonith/plugins/external/ibmrsa-telnet status' output: 
Apr 12 13:57:39 node1 stonithd: [3317]: debug: external_status: running 'ibmrsa-telnet status' returned 0
Apr 12 13:57:39 node1 stonithd: [3317]: debug: external_hostlist: called.
Apr 12 13:57:39 node1 stonithd: [3317]: debug: external_run_cmd: Calling '/usr/lib64/stonith/plugins/external/ibmrsa-telnet gethosts'
Apr 12 13:57:39 node1 stonithd: [3314]: debug: external_run_cmd: '/usr/lib64/stonith/plugins/external/ibmrsa-telnet gethosts' output: nodo1
Apr 12 13:57:39 node1 stonithd: [3314]: debug: external_hostlist: running 'ibmrsa-telnet gethosts' returned 0
Apr 12 13:57:39 node1 stonithd: [3314]: debug: external_hostlist: ibmrsa-telnet host nodo1
Apr 12 13:57:39 node1 stonithd: [3314]: debug: rsa-fencing-1 claims it can manage node nodo1
Apr 12 13:57:39 node1 stonithd: [2468]: debug: Child process external_rsa-fencing-1_start [3314] exited, its exit code: 0 when signo=0.
Apr 12 13:57:39 node1 stonithd: [2468]: debug: rsa-fencing-1's (external/ibmrsa-telnet) op start finished. op_result=0
Apr 12 13:57:39 node1 stonithd: [2468]: info: rsa-fencing-1 stonith resource started
Apr 12 13:57:39 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3311 (pid=3311) signed off
Apr 12 13:57:39 node1 lrmd: [2470]: info: Managed rsa-fencing-1:start process 3311 exited with return code 0.
Apr 12 13:57:39 node1 lrmd: [2470]: debug: stonithRA plugin: provider attribute is not needed and will be ignored.
Apr 12 13:57:39 node1 stonithd: [3317]: debug: external_run_cmd: '/usr/lib64/stonith/plugins/external/ibmrsa-telnet gethosts' output: nodo4
Apr 12 13:57:39 node1 stonithd: [3317]: debug: external_hostlist: running 'ibmrsa-telnet gethosts' returned 0
Apr 12 13:57:39 node1 stonithd: [3317]: debug: external_hostlist: ibmrsa-telnet host nodo4
Apr 12 13:57:39 node1 stonithd: [3317]: debug: rsa-fencing-4 claims it can manage node nodo4
Apr 12 13:57:39 node1 stonithd: [2468]: debug: Child process external_rsa-fencing-4_start [3317] exited, its exit code: 0 when signo=0.
Apr 12 13:57:39 node1 stonithd: [2468]: debug: rsa-fencing-4's (external/ibmrsa-telnet) op start finished. op_result=0
Apr 12 13:57:39 node1 stonithd: [2468]: info: rsa-fencing-4 stonith resource started
Apr 12 13:57:39 node1 stonithd: [2468]: debug: client STONITH_RA_EXEC_3312 (pid=3312) signed off
Apr 12 13:57:39 node1 lrmd: [2470]: info: Managed rsa-fencing-4:start process 3312 exited with return code 0.
Apr 12 13:57:39 node1 crmd: [2473]: info: process_lrm_event: LRM operation rsa-fencing-1_start_0 (call=8, rc=0, cib-update=14, confirmed=true) ok
Apr 12 13:57:39 node1 crmd: [2473]: info: process_lrm_event: LRM operation rsa-fencing-4_start_0 (call=9, rc=0, cib-update=15, confirmed=true) ok
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] mcasted message added to pending queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering 116 to 119
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 117 to pending delivery queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 118 to pending delivery queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 119 to pending delivery queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 117
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 118
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 119
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 119
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 11a
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering 119 to 11a
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 11a to pending delivery queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 11b
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering 11a to 11b
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 11b to pending delivery queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 11b
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 11c
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering 11b to 11c
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 11c to pending delivery queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Received ringid(192.168.1.106:760) seq 11d
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering 11c to 11d
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] Delivering MCAST message with seq 11d to pending delivery queue
Apr 12 13:57:39 node1 corosync[2461]:   [TOTEM ] releasing messages up to and including 11d
Apr 12 13:57:39 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:39 node1 mgmtd: [2474]: debug: update cib finished
Apr 12 13:57:54 node1 cib: [2469]: debug: cib_common_callback_worker: Setting cib_diff_notify callbacks for 3362 (dcf6a8e0-ebc5-4261-8fe9-3f9f7709ace2): off
Apr 12 13:57:54 node1 cib: [2469]: debug: cib_common_callback_worker: Setting cib_diff_notify callbacks for 3362 (dcf6a8e0-ebc5-4261-8fe9-3f9f7709ace2): on
