Oct 14 10:28:18 alpha openais[12204]: [MAIN ] AIS Executive Service RELEASE 'subrev 1152 version 0.80'
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors.
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] Copyright (C) 2006 Red Hat, Inc.
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] AIS Executive Service: started and ready to provide service.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] Token Timeout (10000 ms) retransmit timeout (495 ms)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] token hold (386 ms) retransmits before loss (20 retrans)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] join (60 ms) send_join (0 ms) consensus (4800 ms) merge (200 ms)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1500
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (20 messages)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] send threads (0 threads)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] RRP token expired timeout (495 ms)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] RRP token problem counter (2000 ms)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] RRP threshold (10 problem count)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] RRP mode set to none.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] heartbeat_failures_allowed (0)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] max_network_delay (50 ms)
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] Receive multicast socket recv buffer size (262142 bytes).
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] Transmit multicast socket send buffer size (262142 bytes).
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] The network interface [192.168.67.10] is now up.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] Created or loaded sequence id 12.192.168.67.10 for this ring.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] entering GATHER state from 15.
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: process_ais_conf: Reading configure
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: config_find_next: Processing additional logging options...
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: get_config_opt: Found 'off' for option: debug
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: get_config_opt: Found 'yes' for option: to_syslog
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: get_config_opt: Found 'daemon' for option: syslog_facility
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: get_config_opt: Defaulting to 'off' for option: to_file
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: config_find_next: Processing additional service options...
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: get_config_opt: Defaulting to '2' for option: expected_nodes
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: get_config_opt: Defaulting to '2' for option: expected_votes
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: get_config_opt: Defaulting to '1' for option: quorum_votes
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: get_config_opt: Defaulting to 'no' for option: use_logd
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: get_config_opt: Defaulting to 'no' for option: use_mgmtd
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: crm_plugin_init: CRM: Initialized
Oct 14 10:28:18 alpha openais[12204]: [crm  ] Logging: Initialized crm_plugin_init
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: crm_plugin_init: Service: 9
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: crm_plugin_init: Local node id: 172206272
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: crm_plugin_init: Local hostname: alpha
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: update_member: Creating entry for node 172206272 born on 0
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: update_member: 0x773e50 Node 172206272 now known as alpha (was: (null))
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: update_member: Node alpha now has 1 quorum votes (was 0)
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: update_member: Node 172206272/alpha is now: member
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: spawn_child: Forked child 12210 for process stonithd
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: spawn_child: Forked child 12211 for process cib
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: spawn_child: Forked child 12212 for process lrmd
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: spawn_child: Forked child 12213 for process pengine
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: spawn_child: Forked child 12214 for process attrd
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: spawn_child: Forked child 12215 for process crmd
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: crm_exec_init_fn: CRM: Initialized
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] Service initialized 'Pacemaker Cluster Manager'
Oct 14 10:28:18 alpha openais[12204]: [SERV ] Service initialized 'openais extended virtual synchrony service'
Oct 14 10:28:18 alpha openais[12204]: [SERV ] Service initialized 'openais cluster membership service B.01.01'
Oct 14 10:28:18 alpha openais[12204]: [SERV ] Service initialized 'openais availability management framework B.01.01'
Oct 14 10:28:18 alpha openais[12204]: [SERV ] Service initialized 'openais checkpoint service B.01.01'
Oct 14 10:28:18 alpha openais[12204]: [SERV ] Service initialized 'openais event service B.01.01'
Oct 14 10:28:18 alpha openais[12204]: [SERV ] Service initialized 'openais distributed locking service B.01.01'
Oct 14 10:28:18 alpha openais[12204]: [SERV ] Service initialized 'openais message service B.01.01'
Oct 14 10:28:18 alpha openais[12204]: [SERV ] Service initialized 'openais configuration service'
Oct 14 10:28:18 alpha openais[12204]: [SERV ] Service initialized 'openais cluster closed process group service v1.01'
Oct 14 10:28:18 alpha openais[12204]: [SYNC ] Not using a virtual synchrony filter.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] Creating commit token because I am the rep.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] Saving state aru 0 high seq received 0
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] Storing new sequence id for ring 10
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] entering COMMIT state.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] entering RECOVERY state.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] position [0] member 192.168.67.10:
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] previous ring seq 12 rep 192.168.67.10
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] aru 0 high delivered 0 received flag 1
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] Did not need to originate any messages in recovery.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] Sending initial ORF token
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] New Configuration:
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] Members Left:
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] Members Joined:
Oct 14 10:28:18 alpha openais[12204]: [crm  ] notice: global_confchg_fn: Transitional membership event on ring 16: memb=0, new=0, lost=0
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] New Configuration:
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] 	r(0) ip(192.168.67.10) 
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] Members Left:
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] Members Joined:
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] 	r(0) ip(192.168.67.10) 
Oct 14 10:28:18 alpha openais[12204]: [crm  ] notice: global_confchg_fn: Stable membership event on ring 16: memb=1, new=1, lost=0
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: global_confchg_fn: NEW:  alpha 172206272
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: global_confchg_fn: MEMB: alpha 172206272
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] info: update_member: Node alpha now has process list: 00000000000000000000000000013312 (78610)
Oct 14 10:28:18 alpha openais[12204]: [SYNC ] This node is within the primary component and will provide service.
Oct 14 10:28:18 alpha openais[12204]: [TOTEM] entering OPERATIONAL state.
Oct 14 10:28:18 alpha openais[12204]: [CLM  ] got nodejoin message 192.168.67.10
Oct 14 10:28:18 alpha lrmd: [12212]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 14 10:28:18 alpha lrmd: [12212]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Oct 14 10:28:18 alpha stonithd: [12210]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Oct 14 10:28:18 alpha stonithd: [12210]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Oct 14 10:28:18 alpha attrd: [12214]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 14 10:28:18 alpha cib: [12211]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 14 10:28:18 alpha attrd: [12214]: info: main: Starting up....
Oct 14 10:28:18 alpha cib: [12211]: info: G_main_add_TriggerHandler: Added signal manual handler
Oct 14 10:28:18 alpha attrd: [12214]: notice: crm_peer_init: 2 expected quorum votes
Oct 14 10:28:18 alpha cib: [12211]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Oct 14 10:28:18 alpha attrd: [12214]: notice: crm_peer_init: 2 expected nodes
Oct 14 10:28:18 alpha cib: [12211]: notice: crm_peer_init: 2 expected quorum votes
Oct 14 10:28:18 alpha attrd: [12214]: notice: init_ais_connection: Local node name: alpha
Oct 14 10:28:18 alpha cib: [12211]: notice: crm_peer_init: 2 expected nodes
Oct 14 10:28:18 alpha lrmd: [12212]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Oct 14 10:28:18 alpha attrd: [12214]: info: init_ais_connection: Creating connection to our AIS plugin
Oct 14 10:28:18 alpha cib: [12211]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Oct 14 10:28:18 alpha lrmd: [12212]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Oct 14 10:28:18 alpha lrmd: [12212]: info: Started.
Oct 14 10:28:18 alpha stonithd: [12210]: notice: crm_peer_init: 2 expected quorum votes
Oct 14 10:28:18 alpha stonithd: [12210]: notice: crm_peer_init: 2 expected nodes
Oct 14 10:28:18 alpha stonithd: [12210]: notice: init_ais_connection: Local node name: alpha
Oct 14 10:28:18 alpha stonithd: [12210]: info: init_ais_connection: Creating connection to our AIS plugin
Oct 14 10:28:18 alpha crmd: [12215]: info: main: CRM Hg Version: node: 27be064e090742359bbdd1914f9d7dd363c8e0d8
Oct 14 10:28:18 alpha stonithd: [12210]: info: init_ais_connection: AIS connection established
Oct 14 10:28:18 alpha attrd: [12214]: info: init_ais_connection: AIS connection established
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: ais_ipc_message_callback: Recorded connection 0x7cbd80 for attrd/12214
Oct 14 10:28:18 alpha crmd: [12215]: info: crmd_init: Starting crmd
Oct 14 10:28:18 alpha crmd: [12215]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 14 10:28:18 alpha crmd: [12215]: info: G_main_add_TriggerHandler: Added signal manual handler
Oct 14 10:28:18 alpha crmd: [12215]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] notice: process_ais_message: Msg[0] (dest=local:ais, from=alpha:attrd.12214, remote=true, size=6): 12214
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: ais_ipc_message_callback: Recorded connection 0x77ca90 for stonithd/12210
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] notice: process_ais_message: Msg[0] (dest=local:ais, from=alpha:stonithd.12210, remote=true, size=6): 12210
Oct 14 10:28:18 alpha stonithd: [12210]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
Oct 14 10:28:18 alpha stonithd: [12210]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Oct 14 10:28:18 alpha pengine: [12213]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 14 10:28:18 alpha pengine: [12213]: info: main: Starting pengine
Oct 14 10:28:18 alpha cib: [12211]: info: startCib: CIB Initialization completed successfully
Oct 14 10:28:18 alpha cib: [12211]: notice: crm_peer_init: 2 expected quorum votes
Oct 14 10:28:18 alpha cib: [12211]: notice: crm_peer_init: 2 expected nodes
Oct 14 10:28:18 alpha cib: [12211]: notice: init_ais_connection: Local node name: alpha
Oct 14 10:28:18 alpha cib: [12211]: info: init_ais_connection: Creating connection to our AIS plugin
Oct 14 10:28:18 alpha cib: [12211]: info: init_ais_connection: AIS connection established
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: ais_ipc_message_callback: Recorded connection 0x7f4400 for cib/12211
Oct 14 10:28:18 alpha openais[12204]: [crm  ] info: ais_ipc_message_callback: Sending membership update 16 to cib
Oct 14 10:28:18 alpha openais[12204]: [MAIN ] notice: process_ais_message: Msg[0] (dest=local:ais, from=alpha:cib.12211, remote=true, size=6): 12211
Oct 14 10:28:18 alpha cib: [12211]: info: cib_init: Starting cib mainloop
Oct 14 10:28:18 alpha cib: [12211]: WARN: ais_dispatch: Pausing to allow membership stability (size 0 -> 1): We've come up alone
Oct 14 10:28:18 alpha cib: [12211]: info: crm_update_peer: Node 172206272 is now known as alpha
Oct 14 10:28:18 alpha cib: [12211]: info: crm_update_peer: Node alpha now has id: 172206272
Oct 14 10:28:18 alpha cib: [12211]: info: crm_update_peer: New Node alpha: id=172206272 (new) state=member (new) addr=r(0) ip(192.168.67.10)  votes=1 born=0 seen=16 proc=00000000000000000000000000013312
Oct 14 10:28:18 alpha cib: [12222]: info: write_cib_contents: Wrote version 0.7.0 of the CIB to disk (digest: 7f8452273531802760a957e5659ca06b)
Oct 14 10:28:18 alpha cib: [12222]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Oct 14 10:28:19 alpha crmd: [12215]: info: do_cib_control: CIB connection established
Oct 14 10:28:19 alpha crmd: [12215]: notice: crm_peer_init: 2 expected quorum votes
Oct 14 10:28:19 alpha cib: [12211]: info: cib_common_callback_worker: Setting cib_refresh_notify callbacks for 12215 (ec19d65d-0f66-4843-924d-606f6cba79fa): on
Oct 14 10:28:19 alpha crmd: [12215]: notice: crm_peer_init: 2 expected nodes
Oct 14 10:28:19 alpha crmd: [12215]: notice: init_ais_connection: Local node name: alpha
Oct 14 10:28:19 alpha crmd: [12215]: info: init_ais_connection: Creating connection to our AIS plugin
Oct 14 10:28:19 alpha crmd: [12215]: info: init_ais_connection: AIS connection established
Oct 14 10:28:19 alpha crmd: [12215]: info: do_ha_control: Connected to Heartbeat
Oct 14 10:28:19 alpha openais[12204]: [crm  ] info: ais_ipc_message_callback: Recorded connection 0x81bb20 for crmd/12215
Oct 14 10:28:19 alpha openais[12204]: [crm  ] info: ais_ipc_message_callback: Sending membership update 16 to crmd
Oct 14 10:28:19 alpha openais[12204]: [MAIN ] notice: process_ais_message: Msg[0] (dest=local:ais, from=alpha:crmd.12215, remote=true, size=6): 12215
Oct 14 10:28:19 alpha crmd: [12215]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Oct 14 10:28:19 alpha crmd: [12215]: info: crmd_init: Starting crmd's mainloop
Oct 14 10:28:19 alpha crmd: [12215]: WARN: ais_dispatch: Pausing to allow membership stability (size 0 -> 1): We've come up alone
Oct 14 10:28:19 alpha crmd: [12215]: info: crm_update_peer: Node 172206272 is now known as alpha
Oct 14 10:28:19 alpha crmd: [12215]: info: crm_update_peer: Node alpha now has id: 172206272
Oct 14 10:28:19 alpha crmd: [12215]: info: crm_update_peer: New Node alpha: id=172206272 (new) state=member (new) addr=r(0) ip(192.168.67.10)  votes=1 born=0 seen=16 proc=00000000000000000000000000013312
Oct 14 10:28:19 alpha crmd: [12215]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Oct 14 10:28:22 alpha cib: [12211]: info: ais_dispatch: Processing membership 16
Oct 14 10:28:23 alpha crmd: [12215]: info: ais_dispatch: Processing membership 16
Oct 14 10:28:23 alpha crmd: [12215]: info: do_started: The local CRM is operational
Oct 14 10:28:23 alpha crmd: [12215]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Oct 14 10:28:23 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_slave for section 'all' (origin=local/crmd/4): ok (rc=0)
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] entering GATHER state from 11.
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] Creating commit token because I am the rep.
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] Saving state aru c high seq received c
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] Storing new sequence id for ring 14
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] entering COMMIT state.
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] entering RECOVERY state.
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] position [0] member 192.168.67.10:
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] previous ring seq 16 rep 192.168.67.10
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] aru c high delivered c received flag 1
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] position [1] member 192.168.67.11:
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] previous ring seq 12 rep 192.168.67.11
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] aru a high delivered a received flag 1
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] Did not need to originate any messages in recovery.
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] Sending initial ORF token
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] New Configuration:
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] 	r(0) ip(192.168.67.10) 
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] Members Left:
Oct 14 10:28:27 alpha crmd: [12215]: info: ais_dispatch: Processing membership 20
Oct 14 10:28:27 alpha crmd: [12215]: info: crm_update_peer: Node <null> now has id: 188983488
Oct 14 10:28:27 alpha cib: [12211]: info: ais_dispatch: Processing membership 20
Oct 14 10:28:27 alpha crmd: [12215]: info: crm_update_peer: Node (null): id=188983488 (new) state=member (new) addr=r(0) ip(192.168.67.11)  votes=0 born=0 seen=20 proc=00000000000000000000000000000000
Oct 14 10:28:27 alpha cib: [12211]: info: crm_update_peer: Node <null> now has id: 188983488
Oct 14 10:28:27 alpha cib: [12211]: info: crm_update_peer: Node (null): id=188983488 (new) state=member (new) addr=r(0) ip(192.168.67.11)  votes=0 born=0 seen=20 proc=00000000000000000000000000000000
Oct 14 10:28:27 alpha cib: [12211]: info: crm_update_peer: Node 188983488 is now known as bravo
Oct 14 10:28:27 alpha cib: [12211]: info: crm_update_peer: New Node bravo: id=188983488 state=member addr=r(0) ip(192.168.67.11)  votes=1 (new) born=20 seen=20 proc=00000000000000000000000000013312 (new)
Oct 14 10:28:27 alpha cib: [12211]: notice: crm_calculate_quorum: Membership 0: quorum attained
Oct 14 10:28:27 alpha crmd: [12215]: info: crm_update_peer: Node 188983488 is now known as bravo
Oct 14 10:28:27 alpha crmd: [12215]: info: crm_update_peer: New Node bravo: id=188983488 state=member addr=r(0) ip(192.168.67.11)  votes=1 (new) born=20 seen=20 proc=00000000000000000000000000013312 (new)
Oct 14 10:28:27 alpha crmd: [12215]: notice: crm_calculate_quorum: Membership 6: quorum attained
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] Members Joined:
Oct 14 10:28:27 alpha openais[12204]: [crm  ] notice: global_confchg_fn: Transitional membership event on ring 20: memb=1, new=0, lost=0
Oct 14 10:28:27 alpha openais[12204]: [crm  ] info: global_confchg_fn: memb: alpha 172206272
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] New Configuration:
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] 	r(0) ip(192.168.67.10) 
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] 	r(0) ip(192.168.67.11) 
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] Members Left:
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] Members Joined:
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] 	r(0) ip(192.168.67.11) 
Oct 14 10:28:27 alpha openais[12204]: [crm  ] notice: global_confchg_fn: Stable membership event on ring 20: memb=2, new=1, lost=0
Oct 14 10:28:27 alpha openais[12204]: [MAIN ] info: update_member: Creating entry for node 188983488 born on 20
Oct 14 10:28:27 alpha openais[12204]: [MAIN ] info: update_member: Node 188983488/unknown is now: member
Oct 14 10:28:27 alpha openais[12204]: [crm  ] info: global_confchg_fn: NEW:  .pending. 188983488
Oct 14 10:28:27 alpha openais[12204]: [crm  ] info: global_confchg_fn: MEMB: alpha 172206272
Oct 14 10:28:27 alpha openais[12204]: [crm  ] info: global_confchg_fn: MEMB: .pending. 188983488
Oct 14 10:28:27 alpha openais[12204]: [crm  ] info: send_member_notification: Sending membership update 20 to 2 children
Oct 14 10:28:27 alpha openais[12204]: [MAIN ] info: update_member: 0x773e50 Node 172206272 ((null)) born on: 20
Oct 14 10:28:27 alpha openais[12204]: [SYNC ] This node is within the primary component and will provide service.
Oct 14 10:28:27 alpha openais[12204]: [TOTEM] entering OPERATIONAL state.
Oct 14 10:28:27 alpha openais[12204]: [MAIN ] info: update_member: 0x77c9a0 Node 188983488 (bravo) born on: 20
Oct 14 10:28:27 alpha openais[12204]: [MAIN ] info: update_member: 0x77c9a0 Node 188983488 now known as bravo (was: (null))
Oct 14 10:28:27 alpha openais[12204]: [MAIN ] info: update_member: Node bravo now has process list: 00000000000000000000000000013312 (78610)
Oct 14 10:28:27 alpha openais[12204]: [MAIN ] info: update_member: Node bravo now has 1 quorum votes (was 0)
Oct 14 10:28:27 alpha openais[12204]: [crm  ] info: send_member_notification: Sending membership update 20 to 2 children
Oct 14 10:28:27 alpha openais[12204]: [MAIN ] info: update_member: 0x773e50 Node 172206272 (alpha) born on: 20
Oct 14 10:28:27 alpha openais[12204]: [crm  ] info: send_member_notification: Sending membership update 20 to 2 children
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] got nodejoin message 192.168.67.10
Oct 14 10:28:27 alpha openais[12204]: [CLM  ] got nodejoin message 192.168.67.11
Oct 14 10:28:28 alpha cib: [12211]: info: cib_common_callback_worker: Setting cib_refresh_notify callbacks for 12214 (8558f752-e949-46e9-8835-b18555be5928): on
Oct 14 10:28:28 alpha attrd: [12214]: info: main: Starting mainloop...
Oct 14 10:28:34 alpha crmd: [12215]: info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped!
Oct 14 10:28:34 alpha crmd: [12215]: WARN: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING
Oct 14 10:28:34 alpha crmd: [12215]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
Oct 14 10:28:34 alpha crmd: [12215]: info: do_election_count_vote: Updated voted hash for alpha to vote
Oct 14 10:28:34 alpha crmd: [12215]: info: do_election_count_vote: Election ignore: our vote (alpha)
Oct 14 10:28:34 alpha crmd: [12215]: info: do_election_check: Still waiting on 1 non-votes (2 total)
Oct 14 10:28:34 alpha crmd: [12215]: info: do_election_count_vote: Updated voted hash for bravo to no-vote
Oct 14 10:28:34 alpha crmd: [12215]: info: do_election_count_vote: Election ignore: no-vote from bravo
Oct 14 10:28:34 alpha crmd: [12215]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ]
Oct 14 10:28:34 alpha crmd: [12215]: info: do_te_control: Registering TE UUID: 07d6ba3a-6c72-43df-8dca-524253a4e1dc
Oct 14 10:28:34 alpha crmd: [12215]: info: G_main_add_TriggerHandler: Added signal manual handler
Oct 14 10:28:34 alpha crmd: [12215]: info: G_main_add_TriggerHandler: Added signal manual handler
Oct 14 10:28:34 alpha crmd: [12215]: WARN: cib_client_add_notify_callback: Callback already present
Oct 14 10:28:34 alpha crmd: [12215]: info: set_graph_functions: Setting custom graph functions
Oct 14 10:28:34 alpha crmd: [12215]: info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses
Oct 14 10:28:34 alpha cib: [12211]: info: cib_common_callback_worker: Setting cib_diff_notify callbacks for 12215 (ec19d65d-0f66-4843-924d-606f6cba79fa): on
Oct 14 10:28:34 alpha crmd: [12215]: info: do_dc_takeover: Taking over DC status for this partition
Oct 14 10:28:34 alpha cib: [12211]: info: cib_process_readwrite: We are now in R/W mode
Oct 14 10:28:34 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/6): ok (rc=0)
Oct 14 10:28:34 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/7): ok (rc=0)
Oct 14 10:28:34 alpha cib: [12211]: info: cib_process_xpath: Processing cib_query op for //cib/configuration/crm_config//nvpair[@name='dc-version'] (/cib/configuration/crm_config/cluster_property_set/nvpair)
Oct 14 10:28:34 alpha crmd: [12215]: info: join_make_offer: Making join offers based on membership 10
Oct 14 10:28:34 alpha crmd: [12215]: info: do_dc_join_offer_all: join-1: Waiting on 2 outstanding join acks
Oct 14 10:28:34 alpha crmd: [12215]: info: update_dc: Set DC to alpha (3.0)
Oct 14 10:28:34 alpha crmd: [12215]: info: te_connect_stonith: Attempting connection to fencing daemon...
Oct 14 10:28:34 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/9): ok (rc=0)
Oct 14 10:28:35 alpha crmd: [12215]: info: te_connect_stonith: Connected
Oct 14 10:28:35 alpha crmd: [12215]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Oct 14 10:28:35 alpha crmd: [12215]: info: do_state_transition: All 2 cluster nodes responded to the join offer.
Oct 14 10:28:35 alpha cib: [12211]: info: sync_our_cib: Syncing CIB to all peers
Oct 14 10:28:35 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/11): ok (rc=0)
Oct 14 10:28:35 alpha crmd: [12215]: info: update_dc: Set DC to alpha (3.0)
Oct 14 10:28:35 alpha cib: [12211]: info: cib_config_changed: Attr changes
Oct 14 10:28:35 alpha crmd: [12215]: info: do_dc_join_ack: join-1: Updating node state to member for alpha
Oct 14 10:28:35 alpha crmd: [12215]: info: erase_status_tag: Erasing //node_state[@uname='alpha']/lrm
Oct 14 10:28:35 alpha crmd: [12215]: info: do_dc_join_ack: join-1: Updating node state to member for bravo
Oct 14 10:28:35 alpha crmd: [12215]: info: erase_status_tag: Erasing //node_state[@uname='bravo']/lrm
Oct 14 10:28:35 alpha cib: [12211]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="7" num_updates="0" />
Oct 14 10:28:35 alpha cib: [12211]: info: log_data_element: cib:diff: + <cib dc-uuid="alpha" admin_epoch="0" epoch="8" num_updates="1" />
Oct 14 10:28:35 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=local/crmd/12): ok (rc=0)
Oct 14 10:28:35 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/13): ok (rc=0)
Oct 14 10:28:35 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/14): ok (rc=0)
Oct 14 10:28:35 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='alpha']/lrm (origin=local/crmd/15): ok (rc=0)
Oct 14 10:28:35 alpha crmd: [12215]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
Oct 14 10:28:35 alpha crmd: [12215]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Oct 14 10:28:35 alpha crmd: [12215]: info: do_dc_join_final: Ensuring quorum and node attributes are up-to-date
Oct 14 10:28:35 alpha crmd: [12215]: info: update_attrd: Connecting to attrd...
Oct 14 10:28:35 alpha crmd: [12215]: info: crm_update_quorum: Updating quorum status to true (call=21)
Oct 14 10:28:35 alpha crmd: [12215]: info: abort_transition_graph: do_te_invoke:196 - Triggered transition abort (complete=1) : Peer Cancelled
Oct 14 10:28:35 alpha crmd: [12215]: info: do_pe_invoke: Query 22: Requesting the current CIB: S_POLICY_ENGINE
Oct 14 10:28:35 alpha attrd: [12214]: info: attrd_local_callback: Sending full refresh
Oct 14 10:28:35 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='bravo']/lrm (origin=local/crmd/17): ok (rc=0)
Oct 14 10:28:35 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/19): ok (rc=0)
Oct 14 10:28:35 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/21): ok (rc=0)
Oct 14 10:28:35 alpha crmd: [12215]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1255505315-12, seq=10, quorate=1
Oct 14 10:28:35 alpha pengine: [12213]: WARN: unpack_resources: No STONITH resources have been defined
Oct 14 10:28:35 alpha pengine: [12213]: info: determine_online_status: Node alpha is online
Oct 14 10:28:35 alpha pengine: [12213]: info: determine_online_status: Node bravo is online
Oct 14 10:28:35 alpha pengine: [12213]: info: stage6: Delaying fencing operations until there are resources to manage
Oct 14 10:28:35 alpha crmd: [12215]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 14 10:28:35 alpha crmd: [12215]: info: unpack_graph: Unpacked transition 0: 2 actions in 2 synapses
Oct 14 10:28:35 alpha crmd: [12215]: info: do_te_invoke: Processing graph 0 (ref=pe_calc-dc-1255505315-12) derived from /var/lib/heartbeat/pengine/pe-input-5.bz2
Oct 14 10:28:35 alpha crmd: [12215]: info: send_rsc_command: Initiating action 2: probe_complete probe_complete on alpha
Oct 14 10:28:35 alpha crmd: [12215]: info: send_rsc_command: Initiating action 3: probe_complete probe_complete on bravo
Oct 14 10:28:35 alpha crmd: [12215]: info: run_graph: ====================================================
Oct 14 10:28:35 alpha crmd: [12215]: notice: run_graph: Transition 0 (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/heartbeat/pengine/pe-input-5.bz2): Complete
Oct 14 10:28:35 alpha crmd: [12215]: info: te_graph_trigger: Transition 0 is now complete
Oct 14 10:28:35 alpha crmd: [12215]: info: notify_crmd: Transition 0 status: done - <null>
Oct 14 10:28:35 alpha crmd: [12215]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Oct 14 10:28:35 alpha cib: [12211]: info: cib_process_xpath: Processing cib_query op for /cib (/cib)
Oct 14 10:28:35 alpha pengine: [12213]: info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-5.bz2
Oct 14 10:28:35 alpha pengine: [12213]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Oct 14 10:28:35 alpha cib: [12226]: info: write_cib_contents: Wrote version 0.8.0 of the CIB to disk (digest: 759187e9b839a5886a810984edb7beec)
Oct 14 10:28:35 alpha cib: [12226]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Oct 14 10:29:05 alpha crm_shadow: [12234]: info: Invoked: crm_shadow 
Oct 14 10:29:05 alpha crm_shadow: [12248]: info: Invoked: crm_shadow 
Oct 14 10:29:05 alpha cibadmin: [12249]: info: Invoked: cibadmin -Ql 
Oct 14 10:29:31 alpha crm_mon: [12250]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 14 10:29:31 alpha crm_mon: [12250]: info: G_main_add_SignalHandler: Added signal handler for signal 2
Oct 14 10:38:18 alpha cib: [12211]: info: cib_stats: Processed 64 operations (2031.00us average, 0% utilization) in the last 10min
Oct 14 10:48:18 alpha cib: [12211]: info: cib_stats: Processed 40 operations (0.00us average, 0% utilization) in the last 10min
Oct 14 10:58:18 alpha cib: [12211]: info: cib_stats: Processed 40 operations (0.00us average, 0% utilization) in the last 10min
Oct 14 10:59:30 alpha syslog-ng[1979]: Log statistics; dropped='pipe(/dev/xconsole)=0', dropped='pipe(/dev/tty10)=0', processed='center(queued)=1536', processed='center(received)=1383', processed='destination(newsnotice)=0', processed='destination(acpid)=1', processed='destination(firewall)=0', processed='destination(null)=3', processed='destination(mail)=18', processed='destination(mailinfo)=18', processed='destination(console)=37', processed='destination(newserr)=0', processed='destination(newscrit)=0', processed='destination(messages)=1361', processed='destination(mailwarn)=0', processed='destination(localmessages)=0', processed='destination(netmgm)=0', processed='destination(mailerr)=0', processed='destination(xconsole)=37', processed='destination(warn)=61', processed='source(src)=1383'
Oct 14 11:08:18 alpha cib: [12211]: info: cib_stats: Processed 40 operations (0.00us average, 0% utilization) in the last 10min
Oct 14 11:18:18 alpha cib: [12211]: info: cib_stats: Processed 40 operations (0.00us average, 0% utilization) in the last 10min
Oct 14 11:28:18 alpha cib: [12211]: info: cib_stats: Processed 18 operations (0.00us average, 0% utilization) in the last 10min
Oct 14 11:48:18 alpha -- MARK --
Oct 14 11:59:30 alpha syslog-ng[1979]: Log statistics; dropped='pipe(/dev/xconsole)=0', dropped='pipe(/dev/tty10)=0', processed='center(queued)=1541', processed='center(received)=1388', processed='destination(newsnotice)=0', processed='destination(acpid)=1', processed='destination(firewall)=0', processed='destination(null)=3', processed='destination(mail)=18', processed='destination(mailinfo)=18', processed='destination(console)=37', processed='destination(newserr)=0', processed='destination(newscrit)=0', processed='destination(messages)=1366', processed='destination(mailwarn)=0', processed='destination(localmessages)=0', processed='destination(netmgm)=0', processed='destination(mailerr)=0', processed='destination(xconsole)=37', processed='destination(warn)=61', processed='source(src)=1388'
Oct 14 12:06:30 alpha ntpd[3463]: kernel time sync status change 4001
Oct 14 12:18:16 alpha crm_shadow: [12467]: info: Invoked: crm_shadow 
Oct 14 12:18:16 alpha crm_shadow: [12481]: info: Invoked: crm_shadow 
Oct 14 12:18:18 alpha cibadmin: [12482]: info: Invoked: cibadmin -Ql 
Oct 14 12:19:07 alpha cibadmin: [12483]: info: Invoked: cibadmin -Ql 
Oct 14 12:19:07 alpha cibadmin: [12484]: info: Invoked: cibadmin -p -R -o crm_config 
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="8" num_updates="5" />
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="9" num_updates="1" >
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: +   <configuration >
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: +     <crm_config >
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-no-quorum-policy" name="no-quorum-policy" value="ignore" __crm_diff_marker__="added:top" />
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-stonith-enabled" name="stonith-enabled" value="false" __crm_diff_marker__="added:top" />
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-default-resource-stickiness" name="default-resource-stickiness" value="1000" __crm_diff_marker__="added:top" />
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: +       </cluster_property_set>
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: +     </crm_config>
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: +   </configuration>
Oct 14 12:19:07 alpha cib: [12211]: info: log_data_element: cib:diff: + </cib>
Oct 14 12:19:07 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_replace for section crm_config (origin=local/cibadmin/2): ok (rc=0)
Oct 14 12:19:07 alpha crmd: [12215]: info: abort_transition_graph: need_abort:60 - Triggered transition abort (complete=1) : Non-status change
Oct 14 12:19:07 alpha crmd: [12215]: info: need_abort: Aborting on change to admin_epoch
Oct 14 12:19:07 alpha crmd: [12215]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Oct 14 12:19:07 alpha crmd: [12215]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Oct 14 12:19:07 alpha crmd: [12215]: info: do_pe_invoke: Query 26: Requesting the current CIB: S_POLICY_ENGINE
Oct 14 12:19:07 alpha crmd: [12215]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1255511947-15, seq=10, quorate=1
Oct 14 12:19:07 alpha pengine: [12213]: notice: unpack_config: On loss of CCM Quorum: Ignore
Oct 14 12:19:07 alpha pengine: [12213]: info: determine_online_status: Node alpha is online
Oct 14 12:19:07 alpha pengine: [12213]: info: determine_online_status: Node bravo is online
Oct 14 12:19:07 alpha crmd: [12215]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 14 12:19:07 alpha crmd: [12215]: info: unpack_graph: Unpacked transition 1: 0 actions in 0 synapses
Oct 14 12:19:07 alpha crmd: [12215]: info: do_te_invoke: Processing graph 1 (ref=pe_calc-dc-1255511947-15) derived from /var/lib/heartbeat/pengine/pe-input-6.bz2
Oct 14 12:19:07 alpha crmd: [12215]: info: run_graph: ====================================================
Oct 14 12:19:07 alpha crmd: [12215]: notice: run_graph: Transition 1 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/heartbeat/pengine/pe-input-6.bz2): Complete
Oct 14 12:19:07 alpha crmd: [12215]: info: te_graph_trigger: Transition 1 is now complete
Oct 14 12:19:07 alpha crmd: [12215]: info: notify_crmd: Transition 1 status: done - <null>
Oct 14 12:19:07 alpha crmd: [12215]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Oct 14 12:19:07 alpha pengine: [12213]: info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-6.bz2
Oct 14 12:19:07 alpha cib: [12485]: info: write_cib_contents: Wrote version 0.9.0 of the CIB to disk (digest: 2e65869918b1380f49f0272540245ef3)
Oct 14 12:19:07 alpha cib: [12485]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Oct 14 12:19:24 alpha crm_shadow: [12492]: info: Invoked: crm_shadow 
Oct 14 12:19:24 alpha crm_shadow: [12506]: info: Invoked: crm_shadow 
Oct 14 12:19:24 alpha cibadmin: [12507]: info: Invoked: cibadmin -Ql 
Oct 14 12:19:34 alpha crm_shadow: [12514]: info: Invoked: crm_shadow 
Oct 14 12:19:34 alpha crm_shadow: [12528]: info: Invoked: crm_shadow 
Oct 14 12:19:48 alpha cibadmin: [12529]: info: Invoked: cibadmin -Ql 
Oct 14 12:22:52 alpha sshd[12530]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 42185 ssh2
Oct 14 12:23:33 alpha ntpd[3463]: kernel time sync status change 0001
Oct 14 12:28:18 alpha cib: [12211]: info: cib_stats: Processed 6 operations (3333.00us average, 0% utilization) in the last 10min
Oct 14 12:30:32 alpha cibadmin: [12586]: info: Invoked: cibadmin -Ql 
Oct 14 12:30:32 alpha cibadmin: [12587]: info: Invoked: cibadmin -p -C -o resources 
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="9" num_updates="1" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="10" num_updates="1" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +   <configuration >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +     <resources >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +       <group id="mysql" __crm_diff_marker__="added:top" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         <primitive class="ocf" id="fs_mysql" provider="heartbeat" type="Filesystem" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           <instance_attributes id="fs_mysql-instance_attributes" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +             <nvpair id="fs_mysql-instance_attributes-device" name="device" value="/dev/drbd0" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +             <nvpair id="fs_mysql-instance_attributes-directory" name="directory" value="/service/" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +             <nvpair id="fs_mysql-instance_attributes-fstype" name="fstype" value="ext3" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           </instance_attributes>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         </primitive>
Oct 14 12:30:32 alpha crmd: [12215]: info: abort_transition_graph: need_abort:60 - Triggered transition abort (complete=1) : Non-status change
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         <primitive class="ocf" id="ip_mysql" provider="heartbeat" type="IPaddr2" >
Oct 14 12:30:32 alpha crmd: [12215]: info: need_abort: Aborting on change to admin_epoch
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           <instance_attributes id="ip_mysql-instance_attributes" >
Oct 14 12:30:32 alpha crmd: [12215]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +             <nvpair id="ip_mysql-instance_attributes-ip" name="ip" value="192.168.1.72" />
Oct 14 12:30:32 alpha crmd: [12215]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +             <nvpair id="ip_mysql-instance_attributes-nic" name="nic" value="eth2:0" />
Oct 14 12:30:32 alpha crmd: [12215]: info: do_pe_invoke: Query 27: Requesting the current CIB: S_POLICY_ENGINE
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           </instance_attributes>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         </primitive>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         <primitive class="lsb" id="mysqld" type="mysql" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         <primitive class="lsb" id="apache" type="apache2" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +       </group>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +     </resources>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +   </configuration>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: + </cib>
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_create for section resources (origin=local/cibadmin/2): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1255512632-16, seq=10, quorate=1
Oct 14 12:30:32 alpha pengine: [12213]: notice: unpack_config: On loss of CCM Quorum: Ignore
Oct 14 12:30:32 alpha pengine: [12213]: info: determine_online_status: Node alpha is online
Oct 14 12:30:32 alpha pengine: [12213]: info: determine_online_status: Node bravo is online
Oct 14 12:30:32 alpha pengine: [12213]: notice: group_print: Resource Group: mysql
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     fs_mysql	(ocf::heartbeat:Filesystem):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     ip_mysql	(ocf::heartbeat:IPaddr2):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     mysqld	(lsb:mysql):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     apache	(lsb:apache2):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: notice: StartRsc:  alpha	Start fs_mysql
Oct 14 12:30:32 alpha pengine: [12213]: notice: StartRsc:  alpha	Start ip_mysql
Oct 14 12:30:32 alpha pengine: [12213]: notice: StartRsc:  alpha	Start mysqld
Oct 14 12:30:32 alpha pengine: [12213]: notice: StartRsc:  alpha	Start apache
Oct 14 12:30:32 alpha cibadmin: [12589]: info: Invoked: cibadmin -p -C -o resources 
Oct 14 12:30:32 alpha crmd: [12215]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 14 12:30:32 alpha crmd: [12215]: info: unpack_graph: Unpacked transition 2: 24 actions in 24 synapses
Oct 14 12:30:32 alpha crmd: [12215]: info: do_te_invoke: Processing graph 2 (ref=pe_calc-dc-1255512632-16) derived from /var/lib/heartbeat/pengine/pe-input-7.bz2
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 4: monitor fs_mysql_monitor_0 on alpha
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 9: monitor fs_mysql_monitor_0 on bravo
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 5: monitor ip_mysql_monitor_0 on alpha
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 10: monitor ip_mysql_monitor_0 on bravo
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 6: monitor mysqld_monitor_0 on alpha
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 11: monitor mysqld_monitor_0 on bravo
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 7: monitor apache_monitor_0 on alpha
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 12: monitor apache_monitor_0 on bravo
Oct 14 12:30:32 alpha crmd: [12215]: info: do_lrm_rsc_op: Performing key=4:2:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc op=fs_mysql_monitor_0 )
Oct 14 12:30:32 alpha lrmd: [12212]: info: rsc:fs_mysql: monitor
Oct 14 12:30:32 alpha crmd: [12215]: info: do_lrm_rsc_op: Performing key=5:2:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc op=ip_mysql_monitor_0 )
Oct 14 12:30:32 alpha lrmd: [12212]: info: rsc:ip_mysql: monitor
Oct 14 12:30:32 alpha lrmd: [12212]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Oct 14 12:30:32 alpha crmd: [12215]: info: do_lrm_rsc_op: Performing key=6:2:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc op=mysqld_monitor_0 )
Oct 14 12:30:32 alpha lrmd: [12212]: info: rsc:mysqld: monitor
Oct 14 12:30:32 alpha lrmd: [12212]: notice: lrmd_rsc_new(): No lrm_rprovider field in message
Oct 14 12:30:32 alpha crmd: [12215]: info: do_lrm_rsc_op: Performing key=7:2:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc op=apache_monitor_0 )
Oct 14 12:30:32 alpha lrmd: [12212]: info: rsc:apache: monitor
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="10" num_updates="1" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="11" num_updates="1" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +   <configuration >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +     <resources >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +       <master id="ms_drbd_mysql" __crm_diff_marker__="added:top" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         <meta_attributes id="ms_drbd_mysql-meta_attributes" >
Oct 14 12:30:32 alpha crmd: [12215]: info: abort_transition_graph: need_abort:60 - Triggered transition abort (complete=0) : Non-status change
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           <nvpair id="ms_drbd_mysql-meta_attributes-master-max" name="master-max" value="1" />
Oct 14 12:30:32 alpha crmd: [12215]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           <nvpair id="ms_drbd_mysql-meta_attributes-master-node-max" name="master-node-max" value="1" />
Oct 14 12:30:32 alpha crmd: [12215]: info: update_abort_priority: Abort action done superceeded by restart
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           <nvpair id="ms_drbd_mysql-meta_attributes-clone-max" name="clone-max" value="2" />
Oct 14 12:30:32 alpha crmd: [12215]: info: need_abort: Aborting on change to admin_epoch
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           <nvpair id="ms_drbd_mysql-meta_attributes-clone-node-max" name="clone-node-max" value="1" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           <nvpair id="ms_drbd_mysql-meta_attributes-notify" name="notify" value="true" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         </meta_attributes>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         <primitive class="ocf" id="drbd_mysql" provider="linbit" type="drbd" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           <instance_attributes id="drbd_mysql-instance_attributes" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +             <nvpair id="drbd_mysql-instance_attributes-drbd_resource" name="drbd_resource" value="r0" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           </instance_attributes>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           <operations id="drbd_mysql-ops" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +             <op id="drbd_mysql-monitor-15s" interval="15s" name="monitor" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +           </operations>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +         </primitive>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +       </master>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +     </resources>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +   </configuration>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: + </cib>
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_create for section resources (origin=local/cibadmin/2): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: process_lrm_event: LRM operation apache_monitor_0 (call=5, rc=7, cib-update=28, confirmed=true) complete not running
Oct 14 12:30:32 alpha cibadmin: [12611]: info: Invoked: cibadmin -p -C -o constraints 
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=bravo/crmd/10): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action apache_monitor_0 (12) confirmed on bravo (rc=0)
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=local/crmd/28): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action apache_monitor_0 (7) confirmed on alpha (rc=0)
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="11" num_updates="3" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="12" num_updates="1" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +   <configuration >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +     <constraints >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +       <rsc_colocation id="mysql_on_drbd" rsc="mysql" score="INFINITY" with-rsc="ms_drbd_mysql" with-rsc-role="Master" __crm_diff_marker__="added:top" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +     </constraints>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +   </configuration>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: + </cib>
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_create for section constraints (origin=local/cibadmin/2): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: abort_transition_graph: need_abort:60 - Triggered transition abort (complete=0) : Non-status change
Oct 14 12:30:32 alpha crmd: [12215]: info: need_abort: Aborting on change to admin_epoch
Oct 14 12:30:32 alpha cibadmin: [12612]: info: Invoked: cibadmin -p -C -o constraints 
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="12" num_updates="1" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="13" num_updates="1" >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +   <configuration >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +     <constraints >
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +       <rsc_order first="ms_drbd_mysql" first-action="promote" id="mysql_after_drbd" score="INFINITY" then="mysql" then-action="start" __crm_diff_marker__="added:top" />
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +     </constraints>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: +   </configuration>
Oct 14 12:30:32 alpha cib: [12211]: info: log_data_element: cib:diff: + </cib>
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_create for section constraints (origin=local/cibadmin/2): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: abort_transition_graph: need_abort:60 - Triggered transition abort (complete=0) : Non-status change
Oct 14 12:30:32 alpha crmd: [12215]: info: need_abort: Aborting on change to admin_epoch
Oct 14 12:30:32 alpha pengine: [12213]: info: process_pe_message: Transition 2: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-7.bz2
Oct 14 12:30:32 alpha lrmd: [12212]: info: RA output: (mysqld:monitor:stderr) mkdir: cannot create directory `/service/mysql/.tmp': No such file or directory
Oct 14 12:30:32 alpha lrmd: [12212]: info: RA output: (mysqld:monitor:stderr) chown: cannot access `/service/mysql/.tmp': No such file or directory
Oct 14 12:30:32 alpha lrmd: [12212]: info: RA output: (mysqld:monitor:stderr) chmod: cannot access `/service/mysql/.tmp'
Oct 14 12:30:32 alpha lrmd: [12212]: info: RA output: (mysqld:monitor:stderr) : No such file or directory
Oct 14 12:30:32 alpha crmd: [12215]: info: process_lrm_event: LRM operation mysqld_monitor_0 (call=4, rc=7, cib-update=29, confirmed=true) complete not running
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=local/crmd/29): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action mysqld_monitor_0 (6) confirmed on alpha (rc=0)
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=bravo/crmd/11): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action fs_mysql_monitor_0 (9) confirmed on bravo (rc=0)
Oct 14 12:30:32 alpha lrmd: [12212]: info: RA output: (fs_mysql:monitor:stderr) 2009/10/14_12:30:32 WARNING: Couldn't find device [/dev/drbd0]. Expected /dev/??? to exist
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=bravo/crmd/12): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action ip_mysql_monitor_0 (10) confirmed on bravo (rc=0)
Oct 14 12:30:32 alpha lrmd: [12212]: info: RA output: (ip_mysql:monitor:stderr) eth2:0: warning: name may be invalid
Oct 14 12:30:32 alpha crmd: [12215]: info: process_lrm_event: LRM operation fs_mysql_monitor_0 (call=2, rc=7, cib-update=30, confirmed=true) complete not running
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=bravo/crmd/13): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action mysqld_monitor_0 (11) confirmed on bravo (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 8: probe_complete probe_complete on bravo
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=local/crmd/30): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action fs_mysql_monitor_0 (4) confirmed on alpha (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: process_lrm_event: LRM operation ip_mysql_monitor_0 (call=3, rc=7, cib-update=31, confirmed=true) complete not running
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=local/crmd/31): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action ip_mysql_monitor_0 (5) confirmed on alpha (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 3: probe_complete probe_complete on alpha
Oct 14 12:30:32 alpha crmd: [12215]: info: run_graph: ====================================================
Oct 14 12:30:32 alpha crmd: [12215]: notice: run_graph: Transition 2 (Complete=10, Pending=0, Fired=0, Skipped=14, Incomplete=0, Source=/var/lib/heartbeat/pengine/pe-input-7.bz2): Stopped
Oct 14 12:30:32 alpha crmd: [12215]: info: te_graph_trigger: Transition 2 is now complete
Oct 14 12:30:32 alpha crmd: [12215]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Oct 14 12:30:32 alpha crmd: [12215]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Oct 14 12:30:32 alpha crmd: [12215]: info: do_pe_invoke: Query 32: Requesting the current CIB: S_POLICY_ENGINE
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_xpath: Processing cib_query op for //cib/status//node_state[@id='alpha']//nvpair[@name='probe_complete'] (/cib/status/node_state[1]/transient_attributes/instance_attributes/nvpair)
Oct 14 12:30:32 alpha crmd: [12215]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1255512632-27, seq=10, quorate=1
Oct 14 12:30:32 alpha pengine: [12213]: notice: unpack_config: On loss of CCM Quorum: Ignore
Oct 14 12:30:32 alpha pengine: [12213]: info: determine_online_status: Node alpha is online
Oct 14 12:30:32 alpha pengine: [12213]: info: determine_online_status: Node bravo is online
Oct 14 12:30:32 alpha pengine: [12213]: notice: group_print: Resource Group: mysql
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     fs_mysql	(ocf::heartbeat:Filesystem):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     ip_mysql	(ocf::heartbeat:IPaddr2):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     mysqld	(lsb:mysql):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     apache	(lsb:apache2):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: notice: clone_print: Master/Slave Set: ms_drbd_mysql
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     drbd_mysql:0	(ocf::linbit:drbd):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: notice: native_print:     drbd_mysql:1	(ocf::linbit:drbd):	Stopped 
Oct 14 12:30:32 alpha pengine: [12213]: info: master_color: ms_drbd_mysql: Promoted 0 instances of a possible 1 to master
Oct 14 12:30:32 alpha pengine: [12213]: WARN: native_color: Resource fs_mysql cannot run anywhere
Oct 14 12:30:32 alpha pengine: [12213]: WARN: native_color: Resource ip_mysql cannot run anywhere
Oct 14 12:30:32 alpha pengine: [12213]: WARN: native_color: Resource mysqld cannot run anywhere
Oct 14 12:30:32 alpha pengine: [12213]: WARN: native_color: Resource apache cannot run anywhere
Oct 14 12:30:32 alpha pengine: [12213]: info: master_color: ms_drbd_mysql: Promoted 0 instances of a possible 1 to master
Oct 14 12:30:32 alpha pengine: [12213]: notice: StartRsc:  alpha	Start drbd_mysql:0
Oct 14 12:30:32 alpha pengine: [12213]: notice: RecurringOp:  Start recurring monitor (15s) for drbd_mysql:0 on alpha
Oct 14 12:30:32 alpha pengine: [12213]: notice: StartRsc:  bravo	Start drbd_mysql:1
Oct 14 12:30:32 alpha pengine: [12213]: notice: RecurringOp:  Start recurring monitor (15s) for drbd_mysql:1 on bravo
Oct 14 12:30:32 alpha pengine: [12213]: notice: StartRsc:  alpha	Start drbd_mysql:0
Oct 14 12:30:32 alpha pengine: [12213]: notice: RecurringOp:  Start recurring monitor (15s) for drbd_mysql:0 on alpha
Oct 14 12:30:32 alpha pengine: [12213]: notice: StartRsc:  bravo	Start drbd_mysql:1
Oct 14 12:30:32 alpha pengine: [12213]: notice: RecurringOp:  Start recurring monitor (15s) for drbd_mysql:1 on bravo
Oct 14 12:30:32 alpha crmd: [12215]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 14 12:30:32 alpha crmd: [12215]: info: unpack_graph: Unpacked transition 3: 20 actions in 20 synapses
Oct 14 12:30:32 alpha crmd: [12215]: info: do_te_invoke: Processing graph 3 (ref=pe_calc-dc-1255512632-27) derived from /var/lib/heartbeat/pengine/pe-warn-0.bz2
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 4: monitor drbd_mysql:0_monitor_0 on alpha
Oct 14 12:30:32 alpha cib: [12588]: info: write_cib_contents: Wrote version 0.10.0 of the CIB to disk (digest: 300959bafafde7aba0ab0bb8530ef1e1)
Oct 14 12:30:32 alpha pengine: [12213]: WARN: process_pe_message: Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-0.bz2
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 7: monitor drbd_mysql:0_monitor_0 on bravo
Oct 14 12:30:32 alpha pengine: [12213]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 5: monitor drbd_mysql:1_monitor_0 on alpha
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 8: monitor drbd_mysql:1_monitor_0 on bravo
Oct 14 12:30:32 alpha crmd: [12215]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Oct 14 12:30:32 alpha crmd: [12215]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Oct 14 12:30:32 alpha crmd: [12215]: info: do_lrm_rsc_op: Performing key=4:3:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc op=drbd_mysql:0_monitor_0 )
Oct 14 12:30:32 alpha lrmd: [12212]: info: rsc:drbd_mysql:0: monitor
Oct 14 12:30:32 alpha lrmd: [12683]: ERROR: (raexecocf.c:execra:178) execl failed for /usr/lib/ocf/resource.d//linbit/drbd: No such file or directory
Oct 14 12:30:32 alpha crmd: [12215]: info: do_lrm_rsc_op: Performing key=5:3:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc op=drbd_mysql:1_monitor_0 )
Oct 14 12:30:32 alpha lrmd: [12212]: info: rsc:drbd_mysql:1: monitor
Oct 14 12:30:32 alpha crmd: [12215]: info: process_lrm_event: LRM operation drbd_mysql:0_monitor_0 (call=6, rc=5, cib-update=35, confirmed=true) complete not installed
Oct 14 12:30:32 alpha lrmd: [12684]: ERROR: (raexecocf.c:execra:178) execl failed for /usr/lib/ocf/resource.d//linbit/drbd: No such file or directory
Oct 14 12:30:32 alpha crmd: [12215]: info: process_lrm_event: LRM operation drbd_mysql:1_monitor_0 (call=7, rc=5, cib-update=36, confirmed=true) complete not installed
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=local/crmd/35): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: WARN: status_from_rc: Action 4 (drbd_mysql:0_monitor_0) on alpha failed (target: 7 vs. rc: 5): Error
Oct 14 12:30:32 alpha crmd: [12215]: info: abort_transition_graph: match_graph_event:283 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_mysql:0_monitor_0, magic=0:5;4:3:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc) : Event failed
Oct 14 12:30:32 alpha crmd: [12215]: info: update_abort_priority: Abort priority upgraded from 0 to 1
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=local/crmd/36): ok (rc=0)
Oct 14 12:30:32 alpha crmd: [12215]: info: update_abort_priority: Abort action done superceeded by restart
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action drbd_mysql:0_monitor_0 (4) confirmed on alpha (rc=4)
Oct 14 12:30:32 alpha cib: [12588]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Oct 14 12:30:32 alpha crmd: [12215]: WARN: status_from_rc: Action 5 (drbd_mysql:1_monitor_0) on alpha failed (target: 7 vs. rc: 5): Error
Oct 14 12:30:32 alpha crmd: [12215]: info: abort_transition_graph: match_graph_event:283 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_mysql:1_monitor_0, magic=0:5;5:3:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc) : Event failed
Oct 14 12:30:32 alpha crmd: [12215]: info: match_graph_event: Action drbd_mysql:1_monitor_0 (5) confirmed on alpha (rc=4)
Oct 14 12:30:32 alpha crmd: [12215]: info: send_rsc_command: Initiating action 3: probe_complete probe_complete on alpha
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=bravo/crmd/16): ok (rc=0)
Oct 14 12:30:32 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_modify for section 'all' (origin=bravo/crmd/17): ok (rc=0)
Oct 14 12:30:33 alpha cib: [12211]: info: cib_process_xpath: Processing cib_query op for //cib/status//node_state[@id='alpha']//nvpair[@name='probe_complete'] (/cib/status/node_state[1]/transient_attributes/instance_attributes/nvpair)
Oct 14 12:30:33 alpha crmd: [12215]: WARN: status_from_rc: Action 7 (drbd_mysql:0_monitor_0) on bravo failed (target: 7 vs. rc: 5): Error
Oct 14 12:30:33 alpha crmd: [12215]: info: abort_transition_graph: match_graph_event:283 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_mysql:0_monitor_0, magic=0:5;7:3:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc) : Event failed
Oct 14 12:30:33 alpha crmd: [12215]: info: match_graph_event: Action drbd_mysql:0_monitor_0 (7) confirmed on bravo (rc=4)
Oct 14 12:30:33 alpha crmd: [12215]: WARN: status_from_rc: Action 8 (drbd_mysql:1_monitor_0) on bravo failed (target: 7 vs. rc: 5): Error
Oct 14 12:30:33 alpha crmd: [12215]: info: abort_transition_graph: match_graph_event:283 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_mysql:1_monitor_0, magic=0:5;8:3:7:07d6ba3a-6c72-43df-8dca-524253a4e1dc) : Event failed
Oct 14 12:30:33 alpha crmd: [12215]: info: match_graph_event: Action drbd_mysql:1_monitor_0 (8) confirmed on bravo (rc=4)
Oct 14 12:30:33 alpha crmd: [12215]: info: send_rsc_command: Initiating action 6: probe_complete probe_complete on bravo
Oct 14 12:30:33 alpha crmd: [12215]: info: run_graph: ====================================================
Oct 14 12:30:33 alpha crmd: [12215]: notice: run_graph: Transition 3 (Complete=8, Pending=0, Fired=0, Skipped=7, Incomplete=5, Source=/var/lib/heartbeat/pengine/pe-warn-0.bz2): Stopped
Oct 14 12:30:33 alpha crmd: [12215]: info: te_graph_trigger: Transition 3 is now complete
Oct 14 12:30:33 alpha crmd: [12215]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Oct 14 12:30:33 alpha crmd: [12215]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Oct 14 12:30:33 alpha crmd: [12215]: info: do_pe_invoke: Query 39: Requesting the current CIB: S_POLICY_ENGINE
Oct 14 12:30:33 alpha crmd: [12215]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1255512633-34, seq=10, quorate=1
Oct 14 12:30:33 alpha pengine: [12213]: notice: unpack_config: On loss of CCM Quorum: Ignore
Oct 14 12:30:33 alpha pengine: [12213]: info: determine_online_status: Node alpha is online
Oct 14 12:30:33 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:0_monitor_0 on alpha returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 12:30:33 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on alpha
Oct 14 12:30:33 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:1_monitor_0 on alpha returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 12:30:33 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on alpha
Oct 14 12:30:33 alpha pengine: [12213]: info: determine_online_status: Node bravo is online
Oct 14 12:30:33 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:0_monitor_0 on bravo returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 12:30:33 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on bravo
Oct 14 12:30:33 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:1_monitor_0 on bravo returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 12:30:33 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on bravo
Oct 14 12:30:33 alpha pengine: [12213]: notice: group_print: Resource Group: mysql
Oct 14 12:30:33 alpha pengine: [12213]: notice: native_print:     fs_mysql	(ocf::heartbeat:Filesystem):	Stopped 
Oct 14 12:30:33 alpha pengine: [12213]: notice: native_print:     ip_mysql	(ocf::heartbeat:IPaddr2):	Stopped 
Oct 14 12:30:33 alpha pengine: [12213]: notice: native_print:     mysqld	(lsb:mysql):	Stopped 
Oct 14 12:30:33 alpha pengine: [12213]: notice: native_print:     apache	(lsb:apache2):	Stopped 
Oct 14 12:30:33 alpha pengine: [12213]: notice: clone_print: Master/Slave Set: ms_drbd_mysql
Oct 14 12:30:33 alpha pengine: [12213]: notice: native_print:     drbd_mysql:0	(ocf::linbit:drbd):	Stopped 
Oct 14 12:30:33 alpha pengine: [12213]: notice: native_print:     drbd_mysql:1	(ocf::linbit:drbd):	Stopped 
Oct 14 12:30:33 alpha pengine: [12213]: WARN: native_color: Resource drbd_mysql:0 cannot run anywhere
Oct 14 12:30:33 alpha pengine: [12213]: WARN: native_color: Resource drbd_mysql:1 cannot run anywhere
Oct 14 12:30:33 alpha pengine: [12213]: info: master_color: ms_drbd_mysql: Promoted 0 instances of a possible 1 to master
Oct 14 12:30:33 alpha pengine: [12213]: WARN: native_color: Resource fs_mysql cannot run anywhere
Oct 14 12:30:33 alpha pengine: [12213]: WARN: native_color: Resource ip_mysql cannot run anywhere
Oct 14 12:30:33 alpha pengine: [12213]: WARN: native_color: Resource mysqld cannot run anywhere
Oct 14 12:30:33 alpha cib: [12685]: info: write_cib_contents: Wrote version 0.13.0 of the CIB to disk (digest: 045c6d9941d6ff64b12cec5f88d0b6e5)
Oct 14 12:30:33 alpha pengine: [12213]: WARN: native_color: Resource apache cannot run anywhere
Oct 14 12:30:33 alpha pengine: [12213]: info: master_color: ms_drbd_mysql: Promoted 0 instances of a possible 1 to master
Oct 14 12:30:33 alpha crmd: [12215]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 14 12:30:33 alpha crmd: [12215]: info: unpack_graph: Unpacked transition 4: 0 actions in 0 synapses
Oct 14 12:30:33 alpha crmd: [12215]: info: do_te_invoke: Processing graph 4 (ref=pe_calc-dc-1255512633-34) derived from /var/lib/heartbeat/pengine/pe-warn-1.bz2
Oct 14 12:30:33 alpha crmd: [12215]: info: run_graph: ====================================================
Oct 14 12:30:33 alpha crmd: [12215]: notice: run_graph: Transition 4 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/heartbeat/pengine/pe-warn-1.bz2): Complete
Oct 14 12:30:33 alpha crmd: [12215]: info: te_graph_trigger: Transition 4 is now complete
Oct 14 12:30:33 alpha crmd: [12215]: info: notify_crmd: Transition 4 status: done - <null>
Oct 14 12:30:33 alpha pengine: [12213]: WARN: process_pe_message: Transition 4: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-1.bz2
Oct 14 12:30:33 alpha cib: [12685]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Oct 14 12:30:33 alpha crmd: [12215]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Oct 14 12:30:33 alpha pengine: [12213]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Oct 14 12:31:32 alpha crm_mon: [12687]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on alpha
Oct 14 12:31:32 alpha crm_mon: [12687]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on alpha
Oct 14 12:31:32 alpha crm_mon: [12687]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on bravo
Oct 14 12:31:32 alpha crm_mon: [12687]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on bravo
Oct 14 12:31:51 alpha crm_shadow: [12694]: info: Invoked: crm_shadow 
Oct 14 12:31:51 alpha crm_shadow: [12708]: info: Invoked: crm_shadow 
Oct 14 12:31:51 alpha cibadmin: [12709]: info: Invoked: cibadmin -Ql 
Oct 14 12:32:06 alpha crm_shadow: [12716]: info: Invoked: crm_shadow 
Oct 14 12:32:06 alpha crm_shadow: [12730]: info: Invoked: crm_shadow 
Oct 14 12:32:09 alpha cibadmin: [12731]: info: Invoked: cibadmin -Ql 
Oct 14 12:33:08 alpha cibadmin: [12732]: info: Invoked: cibadmin -Ql 
Oct 14 12:33:08 alpha cibadmin: [12733]: info: Invoked: cibadmin -p -D 
Oct 14 12:33:08 alpha cib: [12211]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="13" num_updates="11" >
Oct 14 12:33:08 alpha cib: [12211]: info: log_data_element: cib:diff: -   <configuration >
Oct 14 12:33:08 alpha cib: [12211]: info: log_data_element: cib:diff: -     <constraints >
Oct 14 12:33:08 alpha cib: [12211]: info: log_data_element: cib:diff: -       <rsc_order first="ms_drbd_mysql" first-action="promote" id="mysql_after_drbd" score="INFINITY" then="mysql" then-action="start" __crm_diff_marker__="removed:top" />
Oct 14 12:33:08 alpha cib: [12211]: info: log_data_element: cib:diff: -     </constraints>
Oct 14 12:33:08 alpha cib: [12211]: info: log_data_element: cib:diff: -   </configuration>
Oct 14 12:33:08 alpha cib: [12211]: info: log_data_element: cib:diff: - </cib>
Oct 14 12:33:08 alpha cib: [12211]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="14" num_updates="1" />
Oct 14 12:33:08 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_delete for section 'all' (origin=local/cibadmin/2): ok (rc=0)
Oct 14 12:33:08 alpha crmd: [12215]: info: abort_transition_graph: need_abort:60 - Triggered transition abort (complete=1) : Non-status change
Oct 14 12:33:08 alpha crmd: [12215]: info: need_abort: Aborting on change to admin_epoch
Oct 14 12:33:08 alpha crmd: [12215]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Oct 14 12:33:08 alpha crmd: [12215]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Oct 14 12:33:08 alpha crmd: [12215]: info: do_pe_invoke: Query 40: Requesting the current CIB: S_POLICY_ENGINE
Oct 14 12:33:08 alpha crmd: [12215]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1255512788-35, seq=10, quorate=1
Oct 14 12:33:08 alpha pengine: [12213]: notice: unpack_config: On loss of CCM Quorum: Ignore
Oct 14 12:33:08 alpha pengine: [12213]: info: determine_online_status: Node alpha is online
Oct 14 12:33:08 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:0_monitor_0 on alpha returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 12:33:08 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on alpha
Oct 14 12:33:08 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:1_monitor_0 on alpha returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 12:33:08 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on alpha
Oct 14 12:33:08 alpha pengine: [12213]: info: determine_online_status: Node bravo is online
Oct 14 12:33:08 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:0_monitor_0 on bravo returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 12:33:08 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on bravo
Oct 14 12:33:08 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:1_monitor_0 on bravo returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 12:33:08 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on bravo
Oct 14 12:33:08 alpha pengine: [12213]: notice: group_print: Resource Group: mysql
Oct 14 12:33:08 alpha pengine: [12213]: notice: native_print:     fs_mysql	(ocf::heartbeat:Filesystem):	Stopped 
Oct 14 12:33:08 alpha pengine: [12213]: notice: native_print:     ip_mysql	(ocf::heartbeat:IPaddr2):	Stopped 
Oct 14 12:33:08 alpha pengine: [12213]: notice: native_print:     mysqld	(lsb:mysql):	Stopped 
Oct 14 12:33:08 alpha pengine: [12213]: notice: native_print:     apache	(lsb:apache2):	Stopped 
Oct 14 12:33:08 alpha pengine: [12213]: notice: clone_print: Master/Slave Set: ms_drbd_mysql
Oct 14 12:33:08 alpha pengine: [12213]: notice: native_print:     drbd_mysql:0	(ocf::linbit:drbd):	Stopped 
Oct 14 12:33:08 alpha pengine: [12213]: notice: native_print:     drbd_mysql:1	(ocf::linbit:drbd):	Stopped 
Oct 14 12:33:08 alpha pengine: [12213]: WARN: native_color: Resource drbd_mysql:0 cannot run anywhere
Oct 14 12:33:08 alpha pengine: [12213]: WARN: native_color: Resource drbd_mysql:1 cannot run anywhere
Oct 14 12:33:08 alpha pengine: [12213]: info: master_color: ms_drbd_mysql: Promoted 0 instances of a possible 1 to master
Oct 14 12:33:08 alpha pengine: [12213]: WARN: native_color: Resource fs_mysql cannot run anywhere
Oct 14 12:33:08 alpha pengine: [12213]: WARN: native_color: Resource ip_mysql cannot run anywhere
Oct 14 12:33:08 alpha pengine: [12213]: WARN: native_color: Resource mysqld cannot run anywhere
Oct 14 12:33:08 alpha pengine: [12213]: WARN: native_color: Resource apache cannot run anywhere
Oct 14 12:33:08 alpha pengine: [12213]: info: master_color: ms_drbd_mysql: Promoted 0 instances of a possible 1 to master
Oct 14 12:33:08 alpha cibadmin: [12735]: info: Invoked: cibadmin -p -C -o constraints 
Oct 14 12:33:08 alpha crmd: [12215]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 14 12:33:08 alpha crmd: [12215]: info: unpack_graph: Unpacked transition 5: 0 actions in 0 synapses
Oct 14 12:33:08 alpha crmd: [12215]: info: do_te_invoke: Processing graph 5 (ref=pe_calc-dc-1255512788-35) derived from /var/lib/heartbeat/pengine/pe-warn-2.bz2
Oct 14 12:33:08 alpha crmd: [12215]: info: run_graph: ====================================================
Oct 14 12:33:08 alpha cib: [12211]: ERROR: Invalid attribute score for element rsc_order
Oct 14 12:33:08 alpha cib: [12211]: ERROR: Element constraints has extra content: rsc_colocation
Oct 14 12:33:08 alpha pengine: [12213]: WARN: process_pe_message: Transition 5: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-2.bz2
Oct 14 12:33:08 alpha crmd: [12215]: notice: run_graph: Transition 5 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/heartbeat/pengine/pe-warn-2.bz2): Complete
Oct 14 12:33:08 alpha cib: [12734]: info: write_cib_contents: Wrote version 0.14.0 of the CIB to disk (digest: e1820e3828e6eb802f683067dacefc24)
Oct 14 12:33:08 alpha cib: [12211]: ERROR: Invalid sequence in interleave
Oct 14 12:33:08 alpha cib: [12211]: ERROR: Element configuration failed to validate content
Oct 14 12:33:08 alpha crmd: [12215]: info: te_graph_trigger: Transition 5 is now complete
Oct 14 12:33:08 alpha pengine: [12213]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Oct 14 12:33:08 alpha cib: [12211]: ERROR: Element cib failed to validate content
Oct 14 12:33:08 alpha crmd: [12215]: info: notify_crmd: Transition 5 status: done - <null>
Oct 14 12:33:08 alpha cib: [12734]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Oct 14 12:33:08 alpha crmd: [12215]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Oct 14 12:33:08 alpha cib: [12211]: WARN: cib_perform_op: Updated CIB does not validate against pacemaker-1.0 schema/dtd
Oct 14 12:33:08 alpha cib: [12211]: WARN: cib_diff_notify: Local-only Change (client:cibadmin, call: 2): 0.15.1 (Update does not conform to the configured schema/DTD)
Oct 14 12:33:08 alpha cib: [12211]: WARN: cib_process_request: Operation complete: op cib_create for section constraints (origin=local/cibadmin/2): Update does not conform to the configured schema/DTD (rc=-47)
Oct 14 12:37:39 alpha cibadmin: [12736]: info: Invoked: cibadmin -Ql 
Oct 14 12:37:39 alpha cibadmin: [12737]: info: Invoked: cibadmin -p -C -o constraints 
Oct 14 12:37:39 alpha cib: [12211]: ERROR: Invalid attribute score for element rsc_order
Oct 14 12:37:39 alpha cib: [12211]: ERROR: Element constraints has extra content: rsc_colocation
Oct 14 12:37:39 alpha cib: [12211]: ERROR: Invalid sequence in interleave
Oct 14 12:37:39 alpha cib: [12211]: ERROR: Element configuration failed to validate content
Oct 14 12:37:39 alpha cib: [12211]: ERROR: Element cib failed to validate content
Oct 14 12:37:39 alpha cib: [12211]: WARN: cib_perform_op: Updated CIB does not validate against pacemaker-1.0 schema/dtd
Oct 14 12:37:39 alpha cib: [12211]: WARN: cib_diff_notify: Local-only Change (client:cibadmin, call: 2): 0.15.1 (Update does not conform to the configured schema/DTD)
Oct 14 12:37:39 alpha cib: [12211]: WARN: cib_process_request: Operation complete: op cib_create for section constraints (origin=local/cibadmin/2): Update does not conform to the configured schema/DTD (rc=-47)
Oct 14 12:38:18 alpha cib: [12211]: info: cib_stats: Processed 35 operations (14285.00us average, 0% utilization) in the last 10min
Oct 14 12:39:41 alpha cibadmin: [12738]: info: Invoked: cibadmin -Ql 
Oct 14 12:39:41 alpha cibadmin: [12739]: info: Invoked: cibadmin -p -C -o constraints 
Oct 14 12:39:41 alpha cib: [12211]: ERROR: Invalid attribute score for element rsc_order
Oct 14 12:39:41 alpha cib: [12211]: ERROR: Element constraints has extra content: rsc_colocation
Oct 14 12:39:41 alpha cib: [12211]: ERROR: Invalid sequence in interleave
Oct 14 12:39:41 alpha cib: [12211]: ERROR: Element configuration failed to validate content
Oct 14 12:39:41 alpha cib: [12211]: ERROR: Element cib failed to validate content
Oct 14 12:39:41 alpha cib: [12211]: WARN: cib_perform_op: Updated CIB does not validate against pacemaker-1.0 schema/dtd
Oct 14 12:39:41 alpha cib: [12211]: WARN: cib_diff_notify: Local-only Change (client:cibadmin, call: 2): 0.15.1 (Update does not conform to the configured schema/DTD)
Oct 14 12:39:41 alpha cib: [12211]: WARN: cib_process_request: Operation complete: op cib_create for section constraints (origin=local/cibadmin/2): Update does not conform to the configured schema/DTD (rc=-47)
Oct 14 12:45:25 alpha cibadmin: [12763]: info: Invoked: cibadmin -Ql 
Oct 14 12:45:25 alpha cibadmin: [12764]: info: Invoked: cibadmin -p -C -o constraints 
Oct 14 12:45:25 alpha cib: [12211]: ERROR: Invalid attribute score for element rsc_order
Oct 14 12:45:25 alpha cib: [12211]: ERROR: Element constraints has extra content: rsc_colocation
Oct 14 12:45:25 alpha cib: [12211]: ERROR: Invalid sequence in interleave
Oct 14 12:45:25 alpha cib: [12211]: ERROR: Element configuration failed to validate content
Oct 14 12:45:25 alpha cib: [12211]: ERROR: Element cib failed to validate content
Oct 14 12:45:25 alpha cib: [12211]: WARN: cib_perform_op: Updated CIB does not validate against pacemaker-1.0 schema/dtd
Oct 14 12:45:25 alpha cib: [12211]: WARN: cib_diff_notify: Local-only Change (client:cibadmin, call: 2): 0.15.1 (Update does not conform to the configured schema/DTD)
Oct 14 12:45:25 alpha cib: [12211]: WARN: cib_process_request: Operation complete: op cib_create for section constraints (origin=local/cibadmin/2): Update does not conform to the configured schema/DTD (rc=-47)
Oct 14 12:48:18 alpha cib: [12211]: info: cib_stats: Processed 4 operations (7500.00us average, 0% utilization) in the last 10min
Oct 14 12:50:20 alpha cibadmin: [12765]: info: Invoked: cibadmin -Ql 
Oct 14 12:50:20 alpha cibadmin: [12766]: info: Invoked: cibadmin -p -C -o constraints 
Oct 14 12:50:20 alpha cib: [12211]: ERROR: Invalid attribute score for element rsc_order
Oct 14 12:50:20 alpha cib: [12211]: ERROR: Element constraints has extra content: rsc_colocation
Oct 14 12:50:20 alpha cib: [12211]: ERROR: Invalid sequence in interleave
Oct 14 12:50:20 alpha cib: [12211]: ERROR: Element configuration failed to validate content
Oct 14 12:50:20 alpha cib: [12211]: ERROR: Element cib failed to validate content
Oct 14 12:50:20 alpha cib: [12211]: WARN: cib_perform_op: Updated CIB does not validate against pacemaker-1.0 schema/dtd
Oct 14 12:50:20 alpha cib: [12211]: WARN: cib_diff_notify: Local-only Change (client:cibadmin, call: 2): 0.15.1 (Update does not conform to the configured schema/DTD)
Oct 14 12:50:20 alpha cib: [12211]: WARN: cib_process_request: Operation complete: op cib_create for section constraints (origin=local/cibadmin/2): Update does not conform to the configured schema/DTD (rc=-47)
Oct 14 12:57:45 alpha ntpd[3463]: kernel time sync status change 4001
Oct 14 12:58:18 alpha cib: [12211]: info: cib_stats: Processed 2 operations (0.00us average, 0% utilization) in the last 10min
Oct 14 12:58:26 alpha cibadmin: [12848]: info: Invoked: cibadmin -Ql 
Oct 14 12:59:30 alpha syslog-ng[1979]: Log statistics; dropped='pipe(/dev/xconsole)=0', dropped='pipe(/dev/tty10)=0', processed='center(queued)=2135', processed='center(received)=1827', processed='destination(newsnotice)=0', processed='destination(acpid)=1', processed='destination(firewall)=0', processed='destination(null)=3', processed='destination(mail)=18', processed='destination(mailinfo)=18', processed='destination(console)=76', processed='destination(newserr)=0', processed='destination(newscrit)=0', processed='destination(messages)=1805', processed='destination(mailwarn)=0', processed='destination(localmessages)=0', processed='destination(netmgm)=0', processed='destination(mailerr)=0', processed='destination(xconsole)=76', processed='destination(warn)=138', processed='source(src)=1827'
Oct 14 13:00:15 alpha su: (to nobody) root on none
Oct 14 13:00:15 alpha su: (to nobody) root on none
Oct 14 13:00:15 alpha su: (to nobody) root on none
Oct 14 13:00:25 alpha crm_mon: [16905]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on alpha
Oct 14 13:00:25 alpha crm_mon: [16905]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on alpha
Oct 14 13:00:25 alpha crm_mon: [16905]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on bravo
Oct 14 13:00:25 alpha crm_mon: [16905]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on bravo
Oct 14 13:08:18 alpha cib: [12211]: info: cib_stats: Processed 2 operations (0.00us average, 0% utilization) in the last 10min
Oct 14 13:22:26 alpha crm_shadow: [16938]: info: Invoked: crm_shadow 
Oct 14 13:22:26 alpha crm_shadow: [16952]: info: Invoked: crm_shadow 
Oct 14 13:22:28 alpha cibadmin: [16953]: info: Invoked: cibadmin -Ql 
Oct 14 13:22:59 alpha cibadmin: [16955]: info: Invoked: cibadmin -Ql 
Oct 14 13:22:59 alpha cibadmin: [16956]: info: Invoked: cibadmin -p -C -o constraints 
Oct 14 13:22:59 alpha cib: [12211]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="14" num_updates="1" />
Oct 14 13:22:59 alpha cib: [12211]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="15" num_updates="1" >
Oct 14 13:22:59 alpha cib: [12211]: info: log_data_element: cib:diff: +   <configuration >
Oct 14 13:22:59 alpha cib: [12211]: info: log_data_element: cib:diff: +     <constraints >
Oct 14 13:22:59 alpha cib: [12211]: info: log_data_element: cib:diff: +       <rsc_order first="ms_drbd_mysql" first-action="promote" id="mysql_after_drbd" score="INFINITY" then="mysql" then-action="start" __crm_diff_marker__="added:top" />
Oct 14 13:22:59 alpha cib: [12211]: info: log_data_element: cib:diff: +     </constraints>
Oct 14 13:22:59 alpha cib: [12211]: info: log_data_element: cib:diff: +   </configuration>
Oct 14 13:22:59 alpha cib: [12211]: info: log_data_element: cib:diff: + </cib>
Oct 14 13:22:59 alpha cib: [12211]: info: cib_process_request: Operation complete: op cib_create for section constraints (origin=local/cibadmin/2): ok (rc=0)
Oct 14 13:22:59 alpha crmd: [12215]: info: abort_transition_graph: need_abort:60 - Triggered transition abort (complete=1) : Non-status change
Oct 14 13:22:59 alpha crmd: [12215]: info: need_abort: Aborting on change to admin_epoch
Oct 14 13:22:59 alpha crmd: [12215]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Oct 14 13:22:59 alpha crmd: [12215]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Oct 14 13:22:59 alpha crmd: [12215]: info: do_pe_invoke: Query 41: Requesting the current CIB: S_POLICY_ENGINE
Oct 14 13:22:59 alpha crmd: [12215]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1255515779-36, seq=10, quorate=1
Oct 14 13:22:59 alpha pengine: [12213]: notice: unpack_config: On loss of CCM Quorum: Ignore
Oct 14 13:22:59 alpha pengine: [12213]: info: determine_online_status: Node alpha is online
Oct 14 13:22:59 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:0_monitor_0 on alpha returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 13:22:59 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on alpha
Oct 14 13:22:59 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:1_monitor_0 on alpha returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 13:22:59 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on alpha
Oct 14 13:22:59 alpha pengine: [12213]: info: determine_online_status: Node bravo is online
Oct 14 13:22:59 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:0_monitor_0 on bravo returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 13:22:59 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:0_monitor_0 failed with rc=5: Preventing drbd_mysql:0 from re-starting on bravo
Oct 14 13:22:59 alpha pengine: [12213]: info: unpack_rsc_op: drbd_mysql:1_monitor_0 on bravo returned 5 (not installed) instead of the expected value: 7 (not running)
Oct 14 13:22:59 alpha pengine: [12213]: ERROR: unpack_rsc_op: Hard error - drbd_mysql:1_monitor_0 failed with rc=5: Preventing drbd_mysql:1 from re-starting on bravo
Oct 14 13:22:59 alpha pengine: [12213]: notice: group_print: Resource Group: mysql
Oct 14 13:22:59 alpha pengine: [12213]: notice: native_print:     fs_mysql	(ocf::heartbeat:Filesystem):	Stopped 
Oct 14 13:22:59 alpha pengine: [12213]: notice: native_print:     ip_mysql	(ocf::heartbeat:IPaddr2):	Stopped 
Oct 14 13:22:59 alpha pengine: [12213]: notice: native_print:     mysqld	(lsb:mysql):	Stopped 
Oct 14 13:22:59 alpha pengine: [12213]: notice: native_print:     apache	(lsb:apache2):	Stopped 
Oct 14 13:22:59 alpha pengine: [12213]: notice: clone_print: Master/Slave Set: ms_drbd_mysql
Oct 14 13:22:59 alpha pengine: [12213]: notice: native_print:     drbd_mysql:0	(ocf::linbit:drbd):	Stopped 
Oct 14 13:22:59 alpha pengine: [12213]: notice: native_print:     drbd_mysql:1	(ocf::linbit:drbd):	Stopped 
Oct 14 13:22:59 alpha pengine: [12213]: WARN: native_color: Resource drbd_mysql:0 cannot run anywhere
Oct 14 13:22:59 alpha pengine: [12213]: WARN: native_color: Resource drbd_mysql:1 cannot run anywhere
Oct 14 13:22:59 alpha pengine: [12213]: info: master_color: ms_drbd_mysql: Promoted 0 instances of a possible 1 to master
Oct 14 13:22:59 alpha pengine: [12213]: WARN: native_color: Resource fs_mysql cannot run anywhere
Oct 14 13:22:59 alpha pengine: [12213]: WARN: native_color: Resource ip_mysql cannot run anywhere
Oct 14 13:22:59 alpha pengine: [12213]: WARN: native_color: Resource mysqld cannot run anywhere
Oct 14 13:22:59 alpha pengine: [12213]: WARN: native_color: Resource apache cannot run anywhere
Oct 14 13:22:59 alpha pengine: [12213]: info: master_color: ms_drbd_mysql: Promoted 0 instances of a possible 1 to master
Oct 14 13:22:59 alpha crmd: [12215]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Oct 14 13:22:59 alpha crmd: [12215]: info: unpack_graph: Unpacked transition 6: 0 actions in 0 synapses
Oct 14 13:22:59 alpha crmd: [12215]: info: do_te_invoke: Processing graph 6 (ref=pe_calc-dc-1255515779-36) derived from /var/lib/heartbeat/pengine/pe-warn-3.bz2
Oct 14 13:22:59 alpha crmd: [12215]: info: run_graph: ====================================================
Oct 14 13:22:59 alpha crmd: [12215]: notice: run_graph: Transition 6 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/heartbeat/pengine/pe-warn-3.bz2): Complete
Oct 14 13:22:59 alpha cib: [16957]: info: write_cib_contents: Wrote version 0.15.0 of the CIB to disk (digest: ac7640964bb2c07c6664140ee8ead163)
Oct 14 13:22:59 alpha pengine: [12213]: WARN: process_pe_message: Transition 6: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-3.bz2
Oct 14 13:22:59 alpha crmd: [12215]: info: te_graph_trigger: Transition 6 is now complete
Oct 14 13:22:59 alpha pengine: [12213]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Oct 14 13:22:59 alpha crmd: [12215]: info: notify_crmd: Transition 6 status: done - <null>
Oct 14 13:22:59 alpha crmd: [12215]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Oct 14 13:23:00 alpha cib: [16957]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Oct 14 13:25:38 alpha sshd[16969]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48131 ssh2
Oct 14 13:25:38 alpha sshd[16963]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48130 ssh2
Oct 14 13:25:38 alpha sshd[16960]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48128 ssh2
Oct 14 13:25:38 alpha sshd[16961]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48129 ssh2
Oct 14 13:25:39 alpha sshd[17096]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48133 ssh2
Oct 14 13:25:43 alpha sshd[17131]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48134 ssh2
Oct 14 13:25:43 alpha sshd[17163]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48135 ssh2
Oct 14 13:25:43 alpha sshd[17196]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48136 ssh2
Oct 14 13:25:45 alpha sshd[17228]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48137 ssh2
Oct 14 13:25:47 alpha sshd[17262]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48138 ssh2
Oct 14 13:25:49 alpha sshd[17316]: Accepted keyboard-interactive/pam for root from 192.168.1.30 port 48139 ssh2
