Apr 10 14:06:25 vsanqa4 corosync[2966]: [MAIN ] Corosync Cluster Engine ('1.4.1'): started and ready to provide service. Apr 10 14:06:25 vsanqa4 corosync[2966]: [MAIN ] Corosync built-in features: nss dbus rdma snmp Apr 10 14:06:25 vsanqa4 corosync[2966]: [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'. Apr 10 14:06:25 vsanqa4 corosync[2966]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 10 14:06:25 vsanqa4 corosync[2966]: [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0). Apr 10 14:06:25 vsanqa4 corosync[2966]: [TOTEM ] The network interface [172.16.68.117] is now up. Apr 10 14:06:25 vsanqa4 corosync[2966]: [pcmk ] info: process_ais_conf: Reading configure Apr 10 14:06:25 vsanqa4 corosync[2966]: [pcmk ] ERROR: process_ais_conf: You have configured a cluster using the Pacemaker plugin for Corosync. The plugin is not supported in this environment and will be removed very soon. Apr 10 14:06:25 vsanqa4 corosync[2966]: [pcmk ] ERROR: process_ais_conf: Please see Chapter 8 of 'Clusters from Scratch' (http://www.clusterlabs.org/doc) for details on using Pacemaker with CMAN Apr 10 14:06:25 vsanqa4 corosync[2966]: [pcmk ] info: config_find_init: Local handle: 4730966301143465985 for logging Apr 10 14:06:25 vsanqa4 corosync[2966]: [pcmk ] info: config_find_next: Processing additional logging options... Apr 10 14:06:25 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: Found 'off' for option: debug Apr 10 14:06:25 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: Found 'yes' for option: to_logfile Apr 10 14:06:25 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: Found '/var/log/cluster/corosync.log' for option: logfile Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: Found 'yes' for option: to_syslog Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: Defaulting to 'daemon' for option: syslog_facility Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: config_find_init: Local handle: 7739444317642555394 for quorum Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: config_find_next: No additional configuration supplied for: quorum Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: No default for option: provider Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: config_find_init: Local handle: 5650605097994944515 for service Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: config_find_next: Processing additional service options... Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: Found '1' for option: ver Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: process_ais_conf: Enabling MCP mode: Use the Pacemaker init script to complete Pacemaker startup Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: Defaulting to 'pcmk' for option: clustername Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_logd Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_mgmtd Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_startup: CRM: Initialized Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] Logging: Initialized pcmk_startup Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_startup: Maximum core file size is: 18446744073709551615 Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_startup: Service: 9 Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_startup: Local hostname: vsanqa4 Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_update_nodeid: Local node id: 1967394988 Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: update_member: Creating entry for node 1967394988 born on 0 Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: update_member: 0x2756590 Node 1967394988 now known as vsanqa4 (was: (null)) Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: update_member: Node vsanqa4 now has 1 quorum votes (was 0) Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: update_member: Node 1967394988/vsanqa4 is now: member Apr 10 14:06:26 vsanqa4 corosync[2966]: [SERV ] Service engine loaded: Pacemaker Cluster Manager 1.1.8 Apr 10 14:06:26 vsanqa4 corosync[2966]: [SERV ] Service engine loaded: corosync extended virtual synchrony service Apr 10 14:06:26 vsanqa4 corosync[2966]: [SERV ] Service engine loaded: corosync configuration service Apr 10 14:06:26 vsanqa4 corosync[2966]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 Apr 10 14:06:26 vsanqa4 corosync[2966]: [SERV ] Service engine loaded: corosync cluster config database access v1.01 Apr 10 14:06:26 vsanqa4 corosync[2966]: [SERV ] Service engine loaded: corosync profile loading service Apr 10 14:06:26 vsanqa4 corosync[2966]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1 Apr 10 14:06:26 vsanqa4 corosync[2966]: [MAIN ] Compatibility mode set to whitetank. Using V1 and V2 of the synchronization engine. Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 166048: memb=0, new=0, lost=0 Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 166048: memb=1, new=1, lost=0 Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_peer_update: NEW: vsanqa4 1967394988 Apr 10 14:06:26 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_peer_update: MEMB: vsanqa4 1967394988 Apr 10 14:06:26 vsanqa4 corosync[2966]: [TOTEM ] A processor joined or left the membership and a new membership was formed. Apr 10 14:06:26 vsanqa4 corosync[2966]: [CPG ] chosen downlist: sender r(0) ip(172.16.68.117) ; members(old:0 left:0) Apr 10 14:06:26 vsanqa4 corosync[2966]: [MAIN ] Completed service synchronization, ready to provide service. Apr 10 14:06:26 vsanqa4 avahi-daemon[2921]: Server startup complete. Host name is vsanqa4.local. Local service cookie is 76459358. Apr 10 14:06:27 vsanqa4 avahi-daemon[2921]: Service "vsanqa4" (/services/ssh.service) successfully established. Apr 10 14:06:27 vsanqa4 rpc.statd[2988]: Version 1.2.3 starting Apr 10 14:06:27 vsanqa4 sm-notify[2989]: Version 1.2.3 starting Apr 10 14:06:28 vsanqa4 kernel: RPC: Registered udp transport module. Apr 10 14:06:28 vsanqa4 kernel: RPC: Registered tcp transport module. Apr 10 14:06:28 vsanqa4 kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. Apr 10 14:06:28 vsanqa4 acpid: starting up Apr 10 14:06:28 vsanqa4 acpid: 1 rule loaded Apr 10 14:06:28 vsanqa4 acpid: waiting for events: event logging is off Apr 10 14:06:28 vsanqa4 acpid: client connected from 3121[68:68] Apr 10 14:06:28 vsanqa4 acpid: 1 client rule loaded Apr 10 14:06:29 vsanqa4 automount[3140]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master Apr 10 14:06:29 vsanqa4 ntpd[3171]: ntpd 4.2.4p8@1.1612-o Tue Nov 29 00:09:12 UTC 2011 (1) Apr 10 14:06:29 vsanqa4 ntpd[3172]: precision = 0.143 usec Apr 10 14:06:29 vsanqa4 ntpd[3172]: Listening on interface #0 wildcard, 0.0.0.0#123 Disabled Apr 10 14:06:29 vsanqa4 ntpd[3172]: Listening on interface #1 wildcard, ::#123 Disabled Apr 10 14:06:29 vsanqa4 ntpd[3172]: Listening on interface #2 lo, ::1#123 Enabled Apr 10 14:06:29 vsanqa4 ntpd[3172]: Listening on interface #3 eth0, fe80::225:90ff:fe4f:ec9e#123 Enabled Apr 10 14:06:29 vsanqa4 ntpd[3172]: Listening on interface #4 lo, 127.0.0.1#123 Enabled Apr 10 14:06:29 vsanqa4 ntpd[3172]: Listening on interface #5 eth0, 172.16.68.117#123 Enabled Apr 10 14:06:29 vsanqa4 ntpd[3172]: Listening on routing socket on fd #22 for interface updates Apr 10 14:06:29 vsanqa4 ntpd[3172]: kernel time sync status 2040 Apr 10 14:06:29 vsanqa4 ntpd[3172]: frequency initialized 74.820 PPM from /var/lib/ntp/drift Apr 10 14:06:30 vsanqa4 abrtd: Init complete, entering main loop Apr 10 14:06:30 vsanqa4 logger[3298]: Set node_desc for mlx4_0: vsanqa4 HCA-1 Apr 10 14:06:30 vsanqa4 qpidd[3295]: 2013-04-10 14:06:30 notice Listening on TCP port 5672 Apr 10 14:06:30 vsanqa4 qpidd[3295]: 2013-04-10 14:06:30 notice SSL plugin not enabled, you must set --ssl-cert-db to enable it. Apr 10 14:06:30 vsanqa4 qpidd[3295]: 2013-04-10 14:06:30 notice Broker running Apr 10 14:06:31 vsanqa4 pacemakerd[3380]: notice: crm_add_logfile: Additional logging available in /var/log/cluster/corosync.log Apr 10 14:06:31 vsanqa4 pacemakerd[3380]: notice: main: Starting Pacemaker 1.1.8-7.el6 (Build: 394e906): generated-manpages agent-manpages ascii-docs publican-docs ncurses libqb-logging libqb-ipc corosync-plugin cman Apr 10 14:06:31 vsanqa4 pacemakerd[3380]: notice: get_local_node_name: Defaulting to uname(2).nodename for the local classic openais (with plugin) node name Apr 10 14:06:31 vsanqa4 pacemakerd[3380]: notice: update_node_processes: 0xf39f70 Node 1967394988 now known as vsanqa4, was: Apr 10 14:06:31 vsanqa4 stonith-ng[3387]: notice: crm_add_logfile: Additional logging available in /var/log/cluster/corosync.log Apr 10 14:06:31 vsanqa4 cib[3386]: notice: crm_add_logfile: Additional logging available in /var/log/cluster/corosync.log Apr 10 14:06:31 vsanqa4 stonith-ng[3387]: notice: crm_cluster_connect: Connecting to cluster infrastructure: classic openais (with plugin) Apr 10 14:06:31 vsanqa4 lrmd[3388]: notice: crm_add_logfile: Additional logging available in /var/log/cluster/corosync.log Apr 10 14:06:31 vsanqa4 attrd[3389]: notice: crm_add_logfile: Additional logging available in /var/log/cluster/corosync.log Apr 10 14:06:31 vsanqa4 attrd[3389]: notice: crm_cluster_connect: Connecting to cluster infrastructure: classic openais (with plugin) Apr 10 14:06:31 vsanqa4 pengine[3390]: notice: crm_add_logfile: Additional logging available in /var/log/cluster/corosync.log Apr 10 14:06:31 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_ipc: Recorded connection 0x27688e0 for stonith-ng/0 Apr 10 14:06:31 vsanqa4 crmd[3391]: notice: crm_add_logfile: Additional logging available in /var/log/cluster/corosync.log Apr 10 14:06:31 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_ipc: Recorded connection 0x276cc40 for attrd/0 Apr 10 14:06:31 vsanqa4 crmd[3391]: notice: main: CRM Git Version: 394e906 Apr 10 14:06:31 vsanqa4 attrd[3389]: notice: main: Starting mainloop... Apr 10 14:06:31 vsanqa4 cib[3386]: notice: main: Using legacy config location: /var/lib/heartbeat/crm Apr 10 14:06:31 vsanqa4 cib[3386]: notice: crm_cluster_connect: Connecting to cluster infrastructure: classic openais (with plugin) Apr 10 14:06:31 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_ipc: Recorded connection 0x2771470 for cib/0 Apr 10 14:06:31 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_ipc: Sending membership update 166048 to cib Apr 10 14:06:31 vsanqa4 cib[3386]: notice: crm_update_peer_state: crm_update_ais_node: Node vsanqa4[1967394988] - state is now member Apr 10 14:06:32 vsanqa4 stonith-ng[3387]: notice: setup_cib: Watching for stonith topology changes Apr 10 14:06:32 vsanqa4 crmd[3391]: notice: crm_cluster_connect: Connecting to cluster infrastructure: classic openais (with plugin) Apr 10 14:06:32 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_ipc: Recorded connection 0x27760e0 for crmd/0 Apr 10 14:06:32 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_ipc: Sending membership update 166048 to crmd Apr 10 14:06:32 vsanqa4 crmd[3391]: notice: crm_update_peer_state: crm_update_ais_node: Node vsanqa4[1967394988] - state is now member Apr 10 14:06:32 vsanqa4 crmd[3391]: error: crmd_ais_dispatch: Recieving messages from a node we think is dead: vsanqa4[1967394988] Apr 10 14:06:32 vsanqa4 crmd[3391]: notice: do_started: The local CRM is operational Apr 10 14:06:34 vsanqa4 OpenSM[2860]: SM port is down#012 Apr 10 14:06:38 vsanqa4 polkitd[3566]: started daemon version 0.96 using authority implementation `local' version `0.96' Apr 10 14:06:38 vsanqa4 rtkit-daemon[3577]: Sucessfully made thread 3575 of process 3575 (/usr/bin/pulseaudio) owned by '42' high priority at nice level -11. Apr 10 14:06:39 vsanqa4 gdm-simple-greeter[3563]: Gtk-WARNING: gtkwidget.c:5460: widget not within a GtkWindow Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 166056: memb=1, new=0, lost=0 Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_peer_update: memb: vsanqa4 1967394988 Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 166056: memb=2, new=1, lost=0 Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: update_member: Creating entry for node 1950617772 born on 166056 Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: update_member: Node 1950617772/unknown is now: member Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_peer_update: NEW: .pending. 1950617772 Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_peer_update: MEMB: .pending. 1950617772 Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_peer_update: MEMB: vsanqa4 1967394988 Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: send_member_notification: Sending membership update 166056 to 2 children Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: update_member: 0x2756590 Node 1967394988 ((null)) born on: 166048 Apr 10 14:06:44 vsanqa4 corosync[2966]: [TOTEM ] A processor joined or left the membership and a new membership was formed. Apr 10 14:06:44 vsanqa4 crmd[3391]: notice: crm_update_peer_state: crm_update_ais_node: Node (null)[1950617772] - state is now member Apr 10 14:06:44 vsanqa4 cib[3386]: notice: crm_update_peer_state: crm_update_ais_node: Node (null)[1950617772] - state is now member Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: update_member: 0x277a860 Node 1950617772 (vsanqa3) born on: 166056 Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: update_member: 0x277a860 Node 1950617772 now known as vsanqa3 (was: (null)) Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: update_member: Node vsanqa3 now has 1 quorum votes (was 0) Apr 10 14:06:44 vsanqa4 corosync[2966]: [pcmk ] info: send_member_notification: Sending membership update 166056 to 2 children Apr 10 14:06:44 vsanqa4 cib[3386]: notice: ais_dispatch_message: Membership 166056: quorum acquired Apr 10 14:06:44 vsanqa4 crmd[3391]: notice: ais_dispatch_message: Membership 166056: quorum acquired Apr 10 14:06:44 vsanqa4 corosync[2966]: [CPG ] chosen downlist: sender r(0) ip(172.16.68.116) ; members(old:1 left:0) Apr 10 14:06:44 vsanqa4 corosync[2966]: [MAIN ] Completed service synchronization, ready to provide service. Apr 10 14:06:50 vsanqa4 pacemakerd[3380]: notice: update_node_processes: 0xf385e0 Node 1950617772 now known as vsanqa3, was: Apr 10 14:06:51 vsanqa4 cib[3386]: warning: cib_process_diff: Diff 0.666.0 -> 0.666.1 from vsanqa3 not applied to 0.666.1: current "num_updates" is greater than required Apr 10 14:06:53 vsanqa4 crmd[3391]: warning: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING Apr 10 14:06:53 vsanqa4 crmd[3391]: notice: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] Apr 10 14:06:53 vsanqa4 attrd[3389]: notice: attrd_local_callback: Sending full refresh (origin=crmd) Apr 10 14:06:54 vsanqa4 pengine[3390]: notice: unpack_config: On loss of CCM Quorum: Ignore Apr 10 14:06:54 vsanqa4 pengine[3390]: notice: process_pe_message: Calculated Transition 0: /var/lib/pacemaker/pengine/pe-input-389.bz2 Apr 10 14:06:54 vsanqa4 attrd[3389]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true) Apr 10 14:06:54 vsanqa4 crmd[3391]: notice: run_graph: Transition 0 (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-389.bz2): Complete Apr 10 14:06:54 vsanqa4 crmd[3391]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] Apr 10 14:06:54 vsanqa4 attrd[3389]: notice: attrd_perform_update: Sent update 4: probe_complete=true Apr 10 14:06:54 vsanqa4 attrd[3389]: notice: attrd_perform_update: Sent update 6: probe_complete=true Apr 10 14:10:47 vsanqa4 ntpd[3172]: synchronized to 50.116.5.5, stratum 2 Apr 10 14:10:47 vsanqa4 ntpd[3172]: time reset +0.263081 s Apr 10 14:10:47 vsanqa4 ntpd[3172]: kernel time sync status change 2001 Apr 10 14:11:42 vsanqa4 cibadmin[3698]: notice: crm_log_args: Invoked: cibadmin -Ql Apr 10 14:11:42 vsanqa4 cibadmin[3699]: notice: crm_log_args: Invoked: cibadmin -Ql Apr 10 14:11:42 vsanqa4 crm_verify[3700]: notice: crm_log_args: Invoked: crm_verify -V -p Apr 10 14:11:43 vsanqa4 cibadmin[3716]: notice: crm_log_args: Invoked: cibadmin -p -R Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: Diff: --- 0.666.21 Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: Diff: +++ 0.667.1 de1df9bdb3733dd14f8aec4c395ccc82 Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: -- Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 crmd[3391]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:43 vsanqa4 crmd[3391]: notice: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] Apr 10 14:11:43 vsanqa4 corosync[2966]: [TOTEM ] Retransmit List: 89 8a 8b 8c Apr 10 14:11:43 vsanqa4 cibadmin[3717]: notice: crm_log_args: Invoked: cibadmin -Ql Apr 10 14:11:43 vsanqa4 attrd[3389]: notice: attrd_local_callback: Sending full refresh (origin=crmd) Apr 10 14:11:43 vsanqa4 attrd[3389]: notice: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true) Apr 10 14:11:43 vsanqa4 corosync[2966]: [TOTEM ] Retransmit List: a3 Apr 10 14:11:43 vsanqa4 cibadmin[3743]: notice: crm_log_args: Invoked: cibadmin -Ql -o resources Apr 10 14:11:43 vsanqa4 cibadmin[3744]: notice: crm_log_args: Invoked: cibadmin -p -R -o resources Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: Diff: --- 0.667.23 Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: Diff: +++ 0.668.1 cbf56573a1b5df9055cc72cd3ea68f53 Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: -- Apr 10 14:11:43 vsanqa4 cib[3386]: notice: cib:diff: ++ Apr 10 14:11:44 vsanqa4 pengine[3390]: notice: unpack_config: On loss of CCM Quorum: Ignore Apr 10 14:11:44 vsanqa4 pengine[3390]: notice: LogActions: Start vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e:0#011(vsanqa3) Apr 10 14:11:44 vsanqa4 pengine[3390]: notice: LogActions: Start vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e:1#011(vsanqa4) Apr 10 14:11:44 vsanqa4 pengine[3390]: notice: process_pe_message: Calculated Transition 1: /var/lib/pacemaker/pengine/pe-input-390.bz2 Apr 10 14:11:45 vsanqa4 crmd[3391]: notice: process_lrm_event: LRM operation vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_0 (call=6, rc=7, cib-update=58, confirmed=true) not running Apr 10 14:11:45 vsanqa4 attrd[3389]: notice: attrd_trigger_update: Sending flush op to all hosts for: master-vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e (1) Apr 10 14:11:45 vsanqa4 attrd[3389]: notice: attrd_perform_update: Sent update 18: master-vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e=1 Apr 10 14:11:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_start_0:3760 [ 2013/04/10_14:11:45 INFO: vhacm_start ] Apr 10 14:11:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_start_0:3760 [ 2013/04/10_14:11:45 INFO: vhacm_monitor ] Apr 10 14:11:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_start_0:3760 [ 2013/04/10_14:11:45 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:11:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_start_0:3760 [ 2013/04/10_14:11:45 INFO: vhacm_monitor: returning 0 ] Apr 10 14:11:45 vsanqa4 crmd[3391]: notice: process_lrm_event: LRM operation vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_start_0 (call=9, rc=0, cib-update=59, confirmed=true) ok Apr 10 14:11:45 vsanqa4 crmd[3391]: notice: run_graph: Transition 1 (Complete=9, Pending=0, Fired=0, Skipped=2, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-390.bz2): Stopped Apr 10 14:11:45 vsanqa4 pengine[3390]: notice: unpack_config: On loss of CCM Quorum: Ignore Apr 10 14:11:45 vsanqa4 pengine[3390]: notice: LogActions: Promote vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e:1#011(Slave -> Master vsanqa3) Apr 10 14:11:45 vsanqa4 pengine[3390]: notice: process_pe_message: Calculated Transition 2: /var/lib/pacemaker/pengine/pe-input-391.bz2 Apr 10 14:11:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:3847 [ 2013/04/10_14:11:45 INFO: vhacm_monitor ] Apr 10 14:11:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:3847 [ 2013/04/10_14:11:45 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:11:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:3847 [ 2013/04/10_14:11:45 INFO: vhacm_monitor: returning 0 ] Apr 10 14:11:45 vsanqa4 crmd[3391]: notice: process_lrm_event: LRM operation vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000 (call=12, rc=0, cib-update=61, confirmed=false) ok Apr 10 14:11:46 vsanqa4 crmd[3391]: notice: run_graph: Transition 2 (Complete=5, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-391.bz2): Complete Apr 10 14:11:46 vsanqa4 crmd[3391]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] Apr 10 14:12:16 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:3931 [ 2013/04/10_14:12:16 INFO: vhacm_monitor ] Apr 10 14:12:16 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:3931 [ 2013/04/10_14:12:16 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:12:16 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:3931 [ 2013/04/10_14:12:16 INFO: vhacm_monitor: returning 0 ] Apr 10 14:12:32 vsanqa4 corosync[2966]: [TOTEM ] A processor failed, forming new configuration. Apr 10 14:12:38 vsanqa4 corosync[2966]: [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 166060: memb=1, new=0, lost=1 Apr 10 14:12:38 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_peer_update: memb: vsanqa4 1967394988 Apr 10 14:12:38 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_peer_update: lost: vsanqa3 1950617772 Apr 10 14:12:38 vsanqa4 corosync[2966]: [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 166060: memb=1, new=0, lost=0 Apr 10 14:12:38 vsanqa4 corosync[2966]: [pcmk ] info: pcmk_peer_update: MEMB: vsanqa4 1967394988 Apr 10 14:12:38 vsanqa4 corosync[2966]: [pcmk ] info: ais_mark_unseen_peer_dead: Node vsanqa3 was not seen in the previous transition Apr 10 14:12:38 vsanqa4 corosync[2966]: [pcmk ] info: update_member: Node 1950617772/vsanqa3 is now: lost Apr 10 14:12:38 vsanqa4 corosync[2966]: [pcmk ] info: send_member_notification: Sending membership update 166060 to 2 children Apr 10 14:12:38 vsanqa4 corosync[2966]: [TOTEM ] A processor joined or left the membership and a new membership was formed. Apr 10 14:12:38 vsanqa4 cib[3386]: notice: ais_dispatch_message: Membership 166060: quorum lost Apr 10 14:12:38 vsanqa4 crmd[3391]: notice: ais_dispatch_message: Membership 166060: quorum lost Apr 10 14:12:38 vsanqa4 cib[3386]: notice: crm_update_peer_state: crm_update_ais_node: Node vsanqa3[1950617772] - state is now lost Apr 10 14:12:38 vsanqa4 crmd[3391]: notice: crm_update_peer_state: crm_update_ais_node: Node vsanqa3[1950617772] - state is now lost Apr 10 14:12:38 vsanqa4 corosync[2966]: [CPG ] chosen downlist: sender r(0) ip(172.16.68.117) ; members(old:2 left:1) Apr 10 14:12:38 vsanqa4 corosync[2966]: [MAIN ] Completed service synchronization, ready to provide service. Apr 10 14:12:47 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4016 [ 2013/04/10_14:12:47 INFO: vhacm_monitor ] Apr 10 14:12:47 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4016 [ 2013/04/10_14:12:47 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:12:47 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4016 [ 2013/04/10_14:12:47 INFO: vhacm_monitor: returning 0 ] Apr 10 14:13:19 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4099 [ 2013/04/10_14:13:18 INFO: vhacm_monitor ] Apr 10 14:13:19 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4099 [ 2013/04/10_14:13:19 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:13:19 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4099 [ 2013/04/10_14:13:19 INFO: vhacm_monitor: returning 0 ] Apr 10 14:13:50 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4185 [ 2013/04/10_14:13:50 INFO: vhacm_monitor ] Apr 10 14:13:50 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4185 [ 2013/04/10_14:13:50 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:13:50 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4185 [ 2013/04/10_14:13:50 INFO: vhacm_monitor: returning 0 ] Apr 10 14:14:21 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4268 [ 2013/04/10_14:14:21 INFO: vhacm_monitor ] Apr 10 14:14:21 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4268 [ 2013/04/10_14:14:21 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:14:21 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4268 [ 2013/04/10_14:14:21 INFO: vhacm_monitor: returning 0 ] Apr 10 14:14:52 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4351 [ 2013/04/10_14:14:52 INFO: vhacm_monitor ] Apr 10 14:14:52 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4351 [ 2013/04/10_14:14:52 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:14:52 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4351 [ 2013/04/10_14:14:52 INFO: vhacm_monitor: returning 0 ] Apr 10 14:15:23 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4436 [ 2013/04/10_14:15:23 INFO: vhacm_monitor ] Apr 10 14:15:23 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4436 [ 2013/04/10_14:15:23 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:15:23 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4436 [ 2013/04/10_14:15:23 INFO: vhacm_monitor: returning 0 ] Apr 10 14:15:54 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4520 [ 2013/04/10_14:15:54 INFO: vhacm_monitor ] Apr 10 14:15:54 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4520 [ 2013/04/10_14:15:54 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:15:54 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4520 [ 2013/04/10_14:15:54 INFO: vhacm_monitor: returning 0 ] Apr 10 14:16:25 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4605 [ 2013/04/10_14:16:25 INFO: vhacm_monitor ] Apr 10 14:16:25 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4605 [ 2013/04/10_14:16:25 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:16:25 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4605 [ 2013/04/10_14:16:25 INFO: vhacm_monitor: returning 0 ] Apr 10 14:16:56 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4687 [ 2013/04/10_14:16:56 INFO: vhacm_monitor ] Apr 10 14:16:56 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4687 [ 2013/04/10_14:16:56 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:16:56 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4687 [ 2013/04/10_14:16:56 INFO: vhacm_monitor: returning 0 ] Apr 10 14:17:27 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4770 [ 2013/04/10_14:17:27 INFO: vhacm_monitor ] Apr 10 14:17:27 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4770 [ 2013/04/10_14:17:27 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:17:27 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4770 [ 2013/04/10_14:17:27 INFO: vhacm_monitor: returning 0 ] Apr 10 14:17:59 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4855 [ 2013/04/10_14:17:59 INFO: vhacm_monitor ] Apr 10 14:17:59 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4855 [ 2013/04/10_14:17:59 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:17:59 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4855 [ 2013/04/10_14:17:59 INFO: vhacm_monitor: returning 0 ] Apr 10 14:18:30 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4938 [ 2013/04/10_14:18:30 INFO: vhacm_monitor ] Apr 10 14:18:30 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4938 [ 2013/04/10_14:18:30 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:18:30 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:4938 [ 2013/04/10_14:18:30 INFO: vhacm_monitor: returning 0 ] Apr 10 14:19:01 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5021 [ 2013/04/10_14:19:01 INFO: vhacm_monitor ] Apr 10 14:19:01 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5021 [ 2013/04/10_14:19:01 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:19:01 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5021 [ 2013/04/10_14:19:01 INFO: vhacm_monitor: returning 0 ] Apr 10 14:19:32 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5103 [ 2013/04/10_14:19:32 INFO: vhacm_monitor ] Apr 10 14:19:32 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5103 [ 2013/04/10_14:19:32 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:19:32 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5103 [ 2013/04/10_14:19:32 INFO: vhacm_monitor: returning 0 ] Apr 10 14:20:03 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5188 [ 2013/04/10_14:20:03 INFO: vhacm_monitor ] Apr 10 14:20:03 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5188 [ 2013/04/10_14:20:03 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:20:03 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5188 [ 2013/04/10_14:20:03 INFO: vhacm_monitor: returning 0 ] Apr 10 14:20:34 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5271 [ 2013/04/10_14:20:34 INFO: vhacm_monitor ] Apr 10 14:20:34 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5271 [ 2013/04/10_14:20:34 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:20:34 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5271 [ 2013/04/10_14:20:34 INFO: vhacm_monitor: returning 0 ] Apr 10 14:21:05 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5354 [ 2013/04/10_14:21:05 INFO: vhacm_monitor ] Apr 10 14:21:05 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5354 [ 2013/04/10_14:21:05 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:21:05 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5354 [ 2013/04/10_14:21:05 INFO: vhacm_monitor: returning 0 ] Apr 10 14:21:36 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5437 [ 2013/04/10_14:21:36 INFO: vhacm_monitor ] Apr 10 14:21:36 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5437 [ 2013/04/10_14:21:36 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:21:36 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5437 [ 2013/04/10_14:21:36 INFO: vhacm_monitor: returning 0 ] Apr 10 14:22:08 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5519 [ 2013/04/10_14:22:07 INFO: vhacm_monitor ] Apr 10 14:22:08 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5519 [ 2013/04/10_14:22:07 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:22:08 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5519 [ 2013/04/10_14:22:08 INFO: vhacm_monitor: returning 0 ] Apr 10 14:22:39 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5603 [ 2013/04/10_14:22:39 INFO: vhacm_monitor ] Apr 10 14:22:39 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5603 [ 2013/04/10_14:22:39 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:22:39 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5603 [ 2013/04/10_14:22:39 INFO: vhacm_monitor: returning 0 ] Apr 10 14:23:10 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5685 [ 2013/04/10_14:23:10 INFO: vhacm_monitor ] Apr 10 14:23:10 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5685 [ 2013/04/10_14:23:10 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:23:10 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5685 [ 2013/04/10_14:23:10 INFO: vhacm_monitor: returning 0 ] Apr 10 14:23:41 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5768 [ 2013/04/10_14:23:41 INFO: vhacm_monitor ] Apr 10 14:23:41 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5768 [ 2013/04/10_14:23:41 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:23:41 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5768 [ 2013/04/10_14:23:41 INFO: vhacm_monitor: returning 0 ] Apr 10 14:24:12 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5851 [ 2013/04/10_14:24:12 INFO: vhacm_monitor ] Apr 10 14:24:12 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5851 [ 2013/04/10_14:24:12 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:24:12 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5851 [ 2013/04/10_14:24:12 INFO: vhacm_monitor: returning 0 ] Apr 10 14:24:32 vsanqa4 cibadmin[5957]: notice: crm_log_args: Invoked: cibadmin -Ql Apr 10 14:24:43 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5959 [ 2013/04/10_14:24:43 INFO: vhacm_monitor ] Apr 10 14:24:43 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5959 [ 2013/04/10_14:24:43 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:24:43 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:5959 [ 2013/04/10_14:24:43 INFO: vhacm_monitor: returning 0 ] Apr 10 14:25:14 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:6042 [ 2013/04/10_14:25:14 INFO: vhacm_monitor ] Apr 10 14:25:14 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:6042 [ 2013/04/10_14:25:14 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:25:14 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:6042 [ 2013/04/10_14:25:14 INFO: vhacm_monitor: returning 0 ] Apr 10 14:25:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:6124 [ 2013/04/10_14:25:45 INFO: vhacm_monitor ] Apr 10 14:25:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:6124 [ 2013/04/10_14:25:45 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:25:45 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:6124 [ 2013/04/10_14:25:45 INFO: vhacm_monitor: returning 0 ] Apr 10 14:26:16 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:6207 [ 2013/04/10_14:26:16 INFO: vhacm_monitor ] Apr 10 14:26:16 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:6207 [ 2013/04/10_14:26:16 INFO: vhacm_monitor: Resource is SECONDARY ] Apr 10 14:26:16 vsanqa4 lrmd[3388]: notice: operation_finished: vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e_monitor_31000:6207 [ 2013/04/10_14:26:16 INFO: vhacm_monitor: returning 0 ] Apr 10 14:26:46 vsanqa4 crmd[3391]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ] Apr 10 14:26:46 vsanqa4 pengine[3390]: notice: unpack_config: On loss of CCM Quorum: Ignore Apr 10 14:26:46 vsanqa4 pengine[3390]: notice: LogActions: Promote vha-6f92a1f6-969c-4c41-b9ca-7eb6f83ace2e:0#011(Slave -> Master vsanqa4) Apr 10 14:26:46 vsanqa4 pengine[3390]: notice: process_pe_message: Calculated Transition 3: /var/lib/pacemaker/pengine/pe-input-392.bz2