May 20 06:40:40 finley rsyslogd: [origin software="rsyslogd" swVersion="4.6.4" x-pid="1043" x-info="http://www.rsyslog.com"] rsyslogd was HUPed, type 'lightweight'.
May 20 06:40:49 finley iSCSITarget[31964]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:41:00 finley iSCSITarget[32155]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:41:10 finley iSCSITarget[32347]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:41:20 finley iSCSITarget[32537]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:41:30 finley iSCSITarget[32727]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:41:40 finley iSCSITarget[450]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:41:50 finley iSCSITarget[641]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:42:00 finley iSCSITarget[850]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:42:10 finley iSCSITarget[1046]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:42:20 finley iSCSITarget[1245]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:42:30 finley iSCSITarget[1436]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:42:40 finley iSCSITarget[1626]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:42:50 finley iSCSITarget[1818]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:43:01 finley iSCSITarget[2010]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:43:11 finley iSCSITarget[2215]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:43:21 finley iSCSITarget[2410]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:43:31 finley iSCSITarget[2600]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:43:41 finley iSCSITarget[2790]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:43:51 finley iSCSITarget[2982]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:44:01 finley iSCSITarget[3172]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:44:11 finley iSCSITarget[3360]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:44:21 finley iSCSITarget[3542]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:44:31 finley iSCSITarget[3732]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:44:41 finley iSCSITarget[3922]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:44:51 finley iSCSITarget[4112]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:45:01 finley /USR/SBIN/CRON[4303]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 06:45:02 finley iSCSITarget[4305]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:45:12 finley iSCSITarget[4495]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:45:22 finley iSCSITarget[4685]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:45:32 finley iSCSITarget[4875]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:45:42 finley iSCSITarget[5065]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:45:52 finley iSCSITarget[5255]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:46:02 finley iSCSITarget[5443]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:46:12 finley iSCSITarget[5628]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:46:22 finley iSCSITarget[5815]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:46:32 finley iSCSITarget[6002]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:46:42 finley iSCSITarget[6192]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:46:52 finley iSCSITarget[6379]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:47:03 finley iSCSITarget[6566]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:47:13 finley iSCSITarget[6756]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:47:23 finley iSCSITarget[6944]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:47:33 finley iSCSITarget[7133]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:47:43 finley iSCSITarget[7323]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:47:53 finley iSCSITarget[7514]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:48:03 finley iSCSITarget[7703]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:48:13 finley iSCSITarget[7893]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:48:23 finley iSCSITarget[8084]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:48:33 finley iSCSITarget[8274]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:48:43 finley iSCSITarget[8465]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:48:54 finley iSCSITarget[8657]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:49:04 finley iSCSITarget[8847]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:49:14 finley iSCSITarget[9037]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:49:24 finley iSCSITarget[9227]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:49:34 finley iSCSITarget[9417]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:49:44 finley iSCSITarget[9607]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:49:54 finley iSCSITarget[9797]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:50:04 finley iSCSITarget[9987]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:50:14 finley iSCSITarget[10178]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:50:24 finley iSCSITarget[10366]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:50:34 finley iSCSITarget[10556]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:50:45 finley iSCSITarget[10747]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:50:55 finley iSCSITarget[10937]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:51:05 finley iSCSITarget[11127]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:51:15 finley iSCSITarget[11317]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:51:25 finley iSCSITarget[11507]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:51:35 finley iSCSITarget[11697]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:51:45 finley iSCSITarget[11887]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:51:55 finley iSCSITarget[12077]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:52:05 finley iSCSITarget[12267]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:52:15 finley iSCSITarget[12458]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:52:16 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 06:52:16 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 06:52:16 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 06:52:16 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 06:52:16 finley crmd: [25840]: info: do_pe_invoke: Query 5563: Requesting the current CIB: S_POLICY_ENGINE
May 20 06:52:17 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5563, ref=pe_calc-dc-1305867137-6122, seq=1716, quorate=1
May 20 06:52:17 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 06:52:17 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 06:52:17 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 06:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 06:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 06:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 06:52:17 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 06:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 06:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 06:52:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 06:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 06:52:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 06:52:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 06:52:17 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 06:52:17 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 06:52:17 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 06:52:17 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 06:52:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 06:52:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 06:52:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 06:52:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 06:52:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 06:52:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 06:52:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 06:52:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 06:52:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 06:52:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 06:52:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 06:52:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 06:52:17 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 06:52:17 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 06:52:17 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 06:52:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 06:52:17 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 06:52:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 06:52:17 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 06:52:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 06:52:17 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 06:52:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 06:52:17 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 06:52:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 06:52:17 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 06:52:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 06:52:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 06:52:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 06:52:17 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 06:52:17 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3556: 0 actions in 0 synapses
May 20 06:52:17 finley crmd: [25840]: info: do_te_invoke: Processing graph 3556 (ref=pe_calc-dc-1305867137-6122) derived from /var/lib/pengine/pe-input-4715.bz2
May 20 06:52:17 finley crmd: [25840]: info: run_graph: ====================================================
May 20 06:52:17 finley crmd: [25840]: notice: run_graph: Transition 3556 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4715.bz2): Complete
May 20 06:52:17 finley crmd: [25840]: info: te_graph_trigger: Transition 3556 is now complete
May 20 06:52:17 finley crmd: [25840]: info: notify_crmd: Transition 3556 status: done - <null>
May 20 06:52:17 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 06:52:17 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 06:52:17 finley pengine: [25839]: info: process_pe_message: Transition 3556: PEngine Input stored in: /var/lib/pengine/pe-input-4715.bz2
May 20 06:52:25 finley iSCSITarget[12649]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:52:35 finley iSCSITarget[12839]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:52:46 finley iSCSITarget[13029]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:52:56 finley iSCSITarget[13219]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:53:06 finley iSCSITarget[13409]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:53:16 finley iSCSITarget[13599]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:53:26 finley iSCSITarget[13789]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:53:36 finley iSCSITarget[13979]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:53:46 finley iSCSITarget[14169]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:53:56 finley iSCSITarget[14359]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:54:06 finley iSCSITarget[14549]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:54:16 finley iSCSITarget[14739]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:54:26 finley iSCSITarget[14929]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:54:36 finley iSCSITarget[15120]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:54:47 finley iSCSITarget[15310]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:54:57 finley iSCSITarget[15500]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:55:01 finley /USR/SBIN/CRON[15605]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 06:55:07 finley iSCSITarget[15693]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:55:08 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 110 to 109
May 20 06:55:17 finley iSCSITarget[15883]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:55:27 finley iSCSITarget[16073]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:55:37 finley iSCSITarget[16263]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:55:47 finley iSCSITarget[16454]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:55:57 finley iSCSITarget[16642]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:56:07 finley iSCSITarget[16827]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:56:17 finley iSCSITarget[17014]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:56:27 finley iSCSITarget[17204]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:56:37 finley iSCSITarget[17394]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:56:48 finley iSCSITarget[17584]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:56:58 finley iSCSITarget[17770]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:57:08 finley iSCSITarget[17955]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:57:18 finley iSCSITarget[18139]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:57:28 finley iSCSITarget[18325]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:57:38 finley iSCSITarget[18516]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:57:48 finley iSCSITarget[18699]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:57:58 finley iSCSITarget[18884]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:58:08 finley iSCSITarget[19071]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:58:18 finley iSCSITarget[19264]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:58:28 finley iSCSITarget[19458]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:58:39 finley iSCSITarget[19647]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:58:49 finley iSCSITarget[19834]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:58:59 finley iSCSITarget[20024]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:59:09 finley iSCSITarget[20209]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:59:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 06:59:19 finley iSCSITarget[20408]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:59:29 finley iSCSITarget[20598]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:59:39 finley iSCSITarget[20788]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:59:49 finley iSCSITarget[20978]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 06:59:59 finley iSCSITarget[21168]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:00:09 finley iSCSITarget[21358]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:00:20 finley iSCSITarget[21553]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:00:30 finley iSCSITarget[21767]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:00:40 finley iSCSITarget[21957]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:00:50 finley iSCSITarget[22147]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:01:00 finley iSCSITarget[22337]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:01:10 finley iSCSITarget[22527]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:01:20 finley iSCSITarget[22717]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:01:30 finley iSCSITarget[22907]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:01:40 finley iSCSITarget[23097]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:01:50 finley iSCSITarget[23287]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:02:00 finley iSCSITarget[23477]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:02:01 finley /USR/SBIN/CRON[23564]: (logcheck) CMD (   if [ -x /usr/sbin/logcheck ]; then nice -n10 /usr/sbin/logcheck; fi)
May 20 07:02:10 finley iSCSITarget[24633]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:02:20 finley iSCSITarget[24824]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:02:31 finley iSCSITarget[25014]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:02:41 finley iSCSITarget[25204]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:02:51 finley iSCSITarget[25394]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:03:01 finley iSCSITarget[25588]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:03:11 finley iSCSITarget[25773]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:03:21 finley iSCSITarget[25985]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:03:31 finley iSCSITarget[26170]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:03:41 finley iSCSITarget[26357]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:03:51 finley iSCSITarget[26547]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:04:01 finley iSCSITarget[26735]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:04:11 finley iSCSITarget[26925]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:04:22 finley iSCSITarget[27118]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:04:32 finley iSCSITarget[27307]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:04:42 finley iSCSITarget[27497]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:04:52 finley iSCSITarget[27687]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:05:01 finley /USR/SBIN/CRON[27827]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 07:05:02 finley iSCSITarget[27880]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:05:12 finley iSCSITarget[28065]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:05:22 finley iSCSITarget[28250]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:05:32 finley iSCSITarget[28440]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:05:42 finley iSCSITarget[28630]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:05:52 finley iSCSITarget[28820]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:06:02 finley iSCSITarget[29008]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:06:13 finley iSCSITarget[29198]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:06:23 finley iSCSITarget[29388]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:06:33 finley iSCSITarget[29578]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:06:43 finley iSCSITarget[29768]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:06:53 finley iSCSITarget[29958]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:07:03 finley iSCSITarget[30148]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:07:13 finley iSCSITarget[30339]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:07:17 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 07:07:17 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 07:07:17 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 07:07:17 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 07:07:17 finley crmd: [25840]: info: do_pe_invoke: Query 5564: Requesting the current CIB: S_POLICY_ENGINE
May 20 07:07:17 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5564, ref=pe_calc-dc-1305868037-6123, seq=1716, quorate=1
May 20 07:07:17 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 07:07:17 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 07:07:17 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 07:07:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 07:07:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 07:07:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 07:07:17 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 07:07:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 07:07:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 07:07:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 07:07:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 07:07:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 07:07:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 07:07:17 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 07:07:17 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 07:07:17 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 07:07:17 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 07:07:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:07:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:07:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:07:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 07:07:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:07:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:07:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 07:07:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:07:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:07:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 07:07:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:07:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:07:17 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 07:07:17 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 07:07:17 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 07:07:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 07:07:17 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 07:07:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 07:07:17 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 07:07:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 07:07:17 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 07:07:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 07:07:17 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 07:07:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 07:07:17 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 07:07:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:07:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 07:07:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 07:07:17 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 07:07:17 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3557: 0 actions in 0 synapses
May 20 07:07:17 finley crmd: [25840]: info: do_te_invoke: Processing graph 3557 (ref=pe_calc-dc-1305868037-6123) derived from /var/lib/pengine/pe-input-4716.bz2
May 20 07:07:17 finley crmd: [25840]: info: run_graph: ====================================================
May 20 07:07:17 finley crmd: [25840]: notice: run_graph: Transition 3557 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4716.bz2): Complete
May 20 07:07:17 finley crmd: [25840]: info: te_graph_trigger: Transition 3557 is now complete
May 20 07:07:17 finley crmd: [25840]: info: notify_crmd: Transition 3557 status: done - <null>
May 20 07:07:17 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 07:07:17 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 07:07:17 finley pengine: [25839]: info: process_pe_message: Transition 3557: PEngine Input stored in: /var/lib/pengine/pe-input-4716.bz2
May 20 07:07:23 finley iSCSITarget[30529]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:07:33 finley iSCSITarget[30719]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:07:43 finley iSCSITarget[30910]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:07:53 finley iSCSITarget[31100]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:08:03 finley iSCSITarget[31290]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:08:14 finley iSCSITarget[31480]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:08:24 finley iSCSITarget[31671]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:08:34 finley iSCSITarget[31863]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:08:44 finley iSCSITarget[32053]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:08:54 finley iSCSITarget[32246]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:09:04 finley iSCSITarget[32436]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:09:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (50000.00us average, 0% utilization) in the last 10min
May 20 07:09:14 finley iSCSITarget[32626]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:09:24 finley iSCSITarget[349]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:09:34 finley iSCSITarget[540]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:09:44 finley iSCSITarget[741]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:09:54 finley iSCSITarget[939]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:10:05 finley iSCSITarget[1137]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:10:15 finley iSCSITarget[1333]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:10:25 finley iSCSITarget[1524]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:10:35 finley iSCSITarget[1716]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:10:45 finley iSCSITarget[1906]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:10:55 finley iSCSITarget[2103]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:11:05 finley iSCSITarget[2308]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:11:15 finley iSCSITarget[2498]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:11:25 finley iSCSITarget[2688]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:11:35 finley iSCSITarget[2868]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:11:45 finley iSCSITarget[3060]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:11:56 finley iSCSITarget[3250]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:12:06 finley iSCSITarget[3440]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:12:16 finley iSCSITarget[3630]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:12:26 finley iSCSITarget[3820]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:12:36 finley iSCSITarget[4010]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:12:46 finley iSCSITarget[4200]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:12:56 finley iSCSITarget[4390]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:13:06 finley iSCSITarget[4580]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:13:16 finley iSCSITarget[4770]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:13:26 finley iSCSITarget[4960]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:13:36 finley iSCSITarget[5150]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:13:46 finley iSCSITarget[5340]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:13:57 finley iSCSITarget[5530]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:14:07 finley iSCSITarget[5720]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:14:17 finley iSCSITarget[5910]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:14:27 finley iSCSITarget[6100]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:14:37 finley iSCSITarget[6290]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:14:47 finley iSCSITarget[6484]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:14:57 finley iSCSITarget[6674]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:15:01 finley /USR/SBIN/CRON[6801]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 07:15:07 finley iSCSITarget[6867]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:15:17 finley iSCSITarget[7057]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:15:27 finley iSCSITarget[7247]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:15:32 finley lrmd: [25837]: info: rsc:ping_nodes:0:1076: monitor
May 20 07:15:37 finley iSCSITarget[7437]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:15:47 finley iSCSITarget[7627]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:15:48 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1099: monitor
May 20 07:15:48 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1097: monitor
May 20 07:15:58 finley iSCSITarget[7817]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:15:58 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1101: monitor
May 20 07:16:08 finley iSCSITarget[8007]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:16:18 finley iSCSITarget[8197]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:16:28 finley iSCSITarget[8387]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:16:34 finley lrmd: [25837]: info: rsc:ip_virtual0:1093: monitor
May 20 07:16:38 finley lrmd: [25837]: info: rsc:iscsi0_target:1095: monitor
May 20 07:16:38 finley iSCSITarget[8577]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:16:48 finley iSCSITarget[8769]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:16:58 finley iSCSITarget[8959]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:17:01 finley /USR/SBIN/CRON[9074]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
May 20 07:17:08 finley iSCSITarget[9152]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:17:18 finley iSCSITarget[9342]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:17:28 finley iSCSITarget[9532]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:17:38 finley iSCSITarget[9720]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:17:48 finley iSCSITarget[9910]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:17:59 finley iSCSITarget[10100]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:18:09 finley iSCSITarget[10291]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:18:19 finley iSCSITarget[10481]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:18:29 finley iSCSITarget[10672]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:18:39 finley iSCSITarget[10862]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:18:49 finley iSCSITarget[11052]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:18:59 finley iSCSITarget[11242]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:19:09 finley iSCSITarget[11432]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:19:19 finley iSCSITarget[11623]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:19:29 finley iSCSITarget[11813]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:19:39 finley iSCSITarget[12003]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:19:49 finley iSCSITarget[12193]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:20:00 finley iSCSITarget[12384]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:20:10 finley iSCSITarget[12575]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:20:20 finley iSCSITarget[12765]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:20:30 finley iSCSITarget[12955]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:20:40 finley iSCSITarget[13145]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:20:50 finley iSCSITarget[13335]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:21:00 finley iSCSITarget[13525]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:21:10 finley iSCSITarget[13715]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:21:20 finley iSCSITarget[13905]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:21:30 finley iSCSITarget[14095]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:21:40 finley iSCSITarget[14285]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:21:50 finley iSCSITarget[14475]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:22:00 finley iSCSITarget[14665]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:22:11 finley iSCSITarget[14855]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:22:17 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 07:22:17 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 07:22:17 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 07:22:17 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 07:22:17 finley crmd: [25840]: info: do_pe_invoke: Query 5565: Requesting the current CIB: S_POLICY_ENGINE
May 20 07:22:17 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5565, ref=pe_calc-dc-1305868937-6124, seq=1716, quorate=1
May 20 07:22:17 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 07:22:17 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 07:22:17 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 07:22:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 07:22:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 07:22:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 07:22:17 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 07:22:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 07:22:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 07:22:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 07:22:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 07:22:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 07:22:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 07:22:17 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 07:22:17 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 07:22:17 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 07:22:17 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 07:22:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:22:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:22:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:22:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 07:22:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:22:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:22:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 07:22:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:22:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:22:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 07:22:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:22:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:22:17 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 07:22:17 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 07:22:17 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 07:22:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 07:22:17 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 07:22:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 07:22:17 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 07:22:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 07:22:17 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 07:22:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 07:22:17 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 07:22:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 07:22:17 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 07:22:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:22:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 07:22:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 07:22:17 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 07:22:17 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3558: 0 actions in 0 synapses
May 20 07:22:17 finley crmd: [25840]: info: do_te_invoke: Processing graph 3558 (ref=pe_calc-dc-1305868937-6124) derived from /var/lib/pengine/pe-input-4717.bz2
May 20 07:22:17 finley crmd: [25840]: info: run_graph: ====================================================
May 20 07:22:17 finley crmd: [25840]: notice: run_graph: Transition 3558 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4717.bz2): Complete
May 20 07:22:17 finley crmd: [25840]: info: te_graph_trigger: Transition 3558 is now complete
May 20 07:22:17 finley crmd: [25840]: info: notify_crmd: Transition 3558 status: done - <null>
May 20 07:22:17 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 07:22:17 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 07:22:17 finley pengine: [25839]: info: process_pe_message: Transition 3558: PEngine Input stored in: /var/lib/pengine/pe-input-4717.bz2
May 20 07:22:21 finley iSCSITarget[15045]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:22:31 finley iSCSITarget[15236]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:22:41 finley iSCSITarget[15426]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:22:51 finley iSCSITarget[15616]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:23:01 finley iSCSITarget[15806]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:23:11 finley iSCSITarget[15986]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:23:21 finley iSCSITarget[16176]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:23:31 finley iSCSITarget[16366]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:23:41 finley iSCSITarget[16558]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:23:51 finley iSCSITarget[16748]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:24:01 finley iSCSITarget[16938]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:24:12 finley iSCSITarget[17128]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:24:22 finley iSCSITarget[17318]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:24:32 finley iSCSITarget[17508]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:24:42 finley iSCSITarget[17698]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:24:52 finley iSCSITarget[17888]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:25:01 finley /USR/SBIN/CRON[18077]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 07:25:02 finley iSCSITarget[18081]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:25:08 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 109 to 110
May 20 07:25:12 finley iSCSITarget[18271]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:25:22 finley iSCSITarget[18461]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:25:32 finley iSCSITarget[18651]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:25:42 finley iSCSITarget[18841]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:25:52 finley iSCSITarget[19031]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:26:02 finley iSCSITarget[19221]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:26:13 finley iSCSITarget[19411]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:26:23 finley iSCSITarget[19601]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:26:33 finley iSCSITarget[19791]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:26:43 finley iSCSITarget[19981]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:26:53 finley iSCSITarget[20171]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:27:03 finley iSCSITarget[20361]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:27:13 finley iSCSITarget[20551]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:27:23 finley iSCSITarget[20741]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:27:33 finley iSCSITarget[20931]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:27:43 finley iSCSITarget[21121]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:27:53 finley iSCSITarget[21311]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:28:03 finley iSCSITarget[21501]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:28:14 finley iSCSITarget[21692]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:28:24 finley iSCSITarget[21882]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:28:34 finley iSCSITarget[22072]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:28:44 finley iSCSITarget[22262]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:28:54 finley iSCSITarget[22450]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:29:04 finley iSCSITarget[22640]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:29:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 07:29:14 finley iSCSITarget[22830]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:29:24 finley iSCSITarget[23020]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:29:34 finley iSCSITarget[23210]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:29:44 finley iSCSITarget[23400]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:29:54 finley iSCSITarget[23590]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:30:04 finley iSCSITarget[23781]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:30:14 finley iSCSITarget[23971]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:30:25 finley iSCSITarget[24161]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:30:35 finley iSCSITarget[24351]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:30:45 finley iSCSITarget[24541]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:30:55 finley iSCSITarget[24731]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:31:05 finley iSCSITarget[24922]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:31:15 finley iSCSITarget[25112]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:31:25 finley iSCSITarget[25302]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:31:35 finley iSCSITarget[25493]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:31:45 finley iSCSITarget[25686]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:31:55 finley iSCSITarget[25895]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:32:05 finley iSCSITarget[26085]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:32:15 finley iSCSITarget[26275]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:32:26 finley iSCSITarget[26465]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:32:36 finley iSCSITarget[26655]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:32:46 finley iSCSITarget[26845]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:32:56 finley iSCSITarget[27035]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:33:06 finley iSCSITarget[27228]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:33:16 finley iSCSITarget[27419]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:33:26 finley iSCSITarget[27609]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:33:36 finley iSCSITarget[27799]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:33:46 finley iSCSITarget[27989]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:33:56 finley iSCSITarget[28179]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:34:06 finley iSCSITarget[28369]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:34:16 finley iSCSITarget[28559]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:34:27 finley iSCSITarget[28749]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:34:37 finley iSCSITarget[28937]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:34:47 finley iSCSITarget[29120]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:34:57 finley iSCSITarget[29310]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:35:01 finley /USR/SBIN/CRON[29465]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 07:35:07 finley iSCSITarget[29503]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:35:17 finley iSCSITarget[29693]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:35:27 finley iSCSITarget[29883]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:35:37 finley iSCSITarget[30073]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:35:47 finley iSCSITarget[30264]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:35:57 finley iSCSITarget[30454]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:36:07 finley iSCSITarget[30644]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:36:17 finley iSCSITarget[30834]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:36:28 finley iSCSITarget[31024]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:36:38 finley iSCSITarget[31214]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:36:48 finley iSCSITarget[31404]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:36:58 finley iSCSITarget[31596]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:37:08 finley iSCSITarget[31788]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:37:17 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 07:37:17 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 07:37:17 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 07:37:17 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 07:37:17 finley crmd: [25840]: info: do_pe_invoke: Query 5566: Requesting the current CIB: S_POLICY_ENGINE
May 20 07:37:17 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5566, ref=pe_calc-dc-1305869837-6125, seq=1716, quorate=1
May 20 07:37:17 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 07:37:17 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 07:37:17 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 07:37:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 07:37:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 07:37:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 07:37:17 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 07:37:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 07:37:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 07:37:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 07:37:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 07:37:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 07:37:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 07:37:17 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 07:37:17 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 07:37:17 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 07:37:17 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 07:37:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:37:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:37:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:37:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 07:37:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:37:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:37:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 07:37:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:37:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:37:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 07:37:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:37:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:37:17 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 07:37:17 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 07:37:17 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 07:37:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 07:37:17 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 07:37:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 07:37:17 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 07:37:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 07:37:17 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 07:37:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 07:37:17 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 07:37:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 07:37:17 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 07:37:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:37:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 07:37:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 07:37:17 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 07:37:17 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3559: 0 actions in 0 synapses
May 20 07:37:17 finley crmd: [25840]: info: do_te_invoke: Processing graph 3559 (ref=pe_calc-dc-1305869837-6125) derived from /var/lib/pengine/pe-input-4718.bz2
May 20 07:37:17 finley crmd: [25840]: info: run_graph: ====================================================
May 20 07:37:17 finley crmd: [25840]: notice: run_graph: Transition 3559 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4718.bz2): Complete
May 20 07:37:17 finley crmd: [25840]: info: te_graph_trigger: Transition 3559 is now complete
May 20 07:37:17 finley crmd: [25840]: info: notify_crmd: Transition 3559 status: done - <null>
May 20 07:37:17 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 07:37:17 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 07:37:17 finley pengine: [25839]: info: process_pe_message: Transition 3559: PEngine Input stored in: /var/lib/pengine/pe-input-4718.bz2
May 20 07:37:18 finley iSCSITarget[31978]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:37:28 finley iSCSITarget[32169]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:37:38 finley iSCSITarget[32361]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:37:48 finley iSCSITarget[32551]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:37:58 finley iSCSITarget[32741]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:38:08 finley iSCSITarget[464]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:38:18 finley iSCSITarget[656]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:38:29 finley iSCSITarget[865]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:38:39 finley iSCSITarget[1062]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:38:49 finley iSCSITarget[1259]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:38:59 finley iSCSITarget[1450]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:39:09 finley iSCSITarget[1640]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:39:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 07:39:19 finley iSCSITarget[1832]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:39:29 finley iSCSITarget[2024]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:39:39 finley iSCSITarget[2229]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:39:49 finley iSCSITarget[2424]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:39:59 finley iSCSITarget[2614]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:40:09 finley iSCSITarget[2802]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:40:19 finley iSCSITarget[2994]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:40:30 finley iSCSITarget[3184]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:40:40 finley iSCSITarget[3374]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:40:50 finley iSCSITarget[3564]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:41:00 finley iSCSITarget[3754]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:41:10 finley iSCSITarget[3944]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:41:20 finley iSCSITarget[4134]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:41:30 finley iSCSITarget[4324]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:41:40 finley iSCSITarget[4514]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:41:50 finley iSCSITarget[4704]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:42:00 finley iSCSITarget[4894]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:42:10 finley iSCSITarget[5084]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:42:20 finley iSCSITarget[5274]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:42:31 finley iSCSITarget[5464]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:42:41 finley iSCSITarget[5654]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:42:51 finley iSCSITarget[5844]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:43:01 finley iSCSITarget[6034]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:43:11 finley iSCSITarget[6224]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:43:21 finley iSCSITarget[6417]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:43:31 finley iSCSITarget[6608]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:43:41 finley iSCSITarget[6798]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:43:51 finley iSCSITarget[6988]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:44:01 finley iSCSITarget[7178]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:44:11 finley iSCSITarget[7368]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:44:21 finley iSCSITarget[7558]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:44:32 finley iSCSITarget[7748]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:44:42 finley iSCSITarget[7938]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:44:52 finley iSCSITarget[8128]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:45:01 finley /USR/SBIN/CRON[8309]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 07:45:02 finley iSCSITarget[8321]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:45:12 finley iSCSITarget[8511]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:45:22 finley iSCSITarget[8703]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:45:32 finley iSCSITarget[8893]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:45:42 finley iSCSITarget[9076]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:45:52 finley iSCSITarget[9264]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:46:02 finley iSCSITarget[9453]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:46:12 finley iSCSITarget[9643]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:46:22 finley iSCSITarget[9833]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:46:32 finley iSCSITarget[10023]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:46:43 finley iSCSITarget[10214]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:46:53 finley iSCSITarget[10404]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:47:03 finley iSCSITarget[10594]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:47:13 finley iSCSITarget[10785]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:47:23 finley iSCSITarget[10980]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:47:33 finley iSCSITarget[11193]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:47:43 finley iSCSITarget[11383]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:47:53 finley iSCSITarget[11573]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:48:03 finley iSCSITarget[11763]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:48:13 finley iSCSITarget[11953]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:48:23 finley iSCSITarget[12143]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:48:34 finley iSCSITarget[12333]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:48:44 finley iSCSITarget[12524]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:48:54 finley iSCSITarget[12715]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:49:04 finley iSCSITarget[12905]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:49:14 finley iSCSITarget[13096]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:49:24 finley iSCSITarget[13286]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:49:34 finley iSCSITarget[13476]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:49:44 finley iSCSITarget[13666]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:49:54 finley iSCSITarget[13856]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:50:04 finley iSCSITarget[14046]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:50:14 finley iSCSITarget[14236]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:50:24 finley iSCSITarget[14426]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:50:35 finley iSCSITarget[14616]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:50:45 finley iSCSITarget[14806]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:50:55 finley iSCSITarget[14996]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:51:05 finley iSCSITarget[15188]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:51:15 finley iSCSITarget[15378]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:51:25 finley iSCSITarget[15568]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:51:35 finley iSCSITarget[15758]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:51:45 finley iSCSITarget[15948]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:51:55 finley iSCSITarget[16138]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:52:05 finley iSCSITarget[16328]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:52:15 finley iSCSITarget[16519]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:52:17 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 07:52:17 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 07:52:17 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 07:52:17 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 07:52:17 finley crmd: [25840]: info: do_pe_invoke: Query 5567: Requesting the current CIB: S_POLICY_ENGINE
May 20 07:52:17 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5567, ref=pe_calc-dc-1305870737-6126, seq=1716, quorate=1
May 20 07:52:17 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 07:52:17 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 07:52:17 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 07:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 07:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 07:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 07:52:17 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 07:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 07:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 07:52:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 07:52:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 07:52:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 07:52:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 07:52:17 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 07:52:17 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 07:52:17 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 07:52:17 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 07:52:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:52:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:52:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 07:52:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 07:52:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:52:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:52:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 07:52:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:52:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:52:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 07:52:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 07:52:17 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 07:52:17 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 07:52:17 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 07:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 07:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 07:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 07:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 07:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 07:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 07:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 07:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 07:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 07:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 07:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 07:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 07:52:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 07:52:18 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 07:52:18 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3560: 0 actions in 0 synapses
May 20 07:52:18 finley crmd: [25840]: info: do_te_invoke: Processing graph 3560 (ref=pe_calc-dc-1305870737-6126) derived from /var/lib/pengine/pe-input-4719.bz2
May 20 07:52:18 finley crmd: [25840]: info: run_graph: ====================================================
May 20 07:52:18 finley crmd: [25840]: notice: run_graph: Transition 3560 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4719.bz2): Complete
May 20 07:52:18 finley crmd: [25840]: info: te_graph_trigger: Transition 3560 is now complete
May 20 07:52:18 finley crmd: [25840]: info: notify_crmd: Transition 3560 status: done - <null>
May 20 07:52:18 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 07:52:18 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 07:52:18 finley pengine: [25839]: info: process_pe_message: Transition 3560: PEngine Input stored in: /var/lib/pengine/pe-input-4719.bz2
May 20 07:52:25 finley iSCSITarget[16708]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:52:36 finley iSCSITarget[16898]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:52:46 finley iSCSITarget[17088]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:52:56 finley iSCSITarget[17278]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:53:06 finley iSCSITarget[17468]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:53:16 finley iSCSITarget[17659]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:53:26 finley iSCSITarget[17849]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:53:36 finley iSCSITarget[18039]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:53:46 finley iSCSITarget[18229]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:53:56 finley iSCSITarget[18419]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:54:06 finley iSCSITarget[18609]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:54:16 finley iSCSITarget[18799]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:54:26 finley iSCSITarget[18989]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:54:37 finley iSCSITarget[19179]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:54:47 finley iSCSITarget[19369]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:54:57 finley iSCSITarget[19559]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:55:01 finley /USR/SBIN/CRON[19663]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 07:55:07 finley iSCSITarget[19752]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:55:08 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 110 to 107
May 20 07:55:08 finley smartd[1692]: Device: /dev/sdd [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 111 to 104
May 20 07:55:17 finley iSCSITarget[19942]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:55:27 finley iSCSITarget[20132]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:55:37 finley iSCSITarget[20322]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:55:47 finley iSCSITarget[20512]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:55:57 finley iSCSITarget[20702]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:56:07 finley iSCSITarget[20892]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:56:17 finley iSCSITarget[21082]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:56:27 finley iSCSITarget[21272]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:56:38 finley iSCSITarget[21462]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:56:48 finley iSCSITarget[21652]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:56:58 finley iSCSITarget[21842]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:57:08 finley iSCSITarget[22032]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:57:18 finley iSCSITarget[22222]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:57:28 finley iSCSITarget[22412]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:57:38 finley iSCSITarget[22602]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:57:48 finley iSCSITarget[22792]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:57:58 finley iSCSITarget[22973]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:58:08 finley iSCSITarget[23162]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:58:18 finley iSCSITarget[23352]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:58:28 finley iSCSITarget[23542]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:58:39 finley iSCSITarget[23734]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:58:49 finley iSCSITarget[23924]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:58:59 finley iSCSITarget[24114]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:59:09 finley iSCSITarget[24304]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:59:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 07:59:19 finley iSCSITarget[24494]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:59:29 finley iSCSITarget[24684]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:59:39 finley iSCSITarget[24875]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:59:49 finley iSCSITarget[25065]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 07:59:59 finley iSCSITarget[25255]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:00:09 finley iSCSITarget[25445]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:00:19 finley iSCSITarget[25639]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:00:29 finley iSCSITarget[25848]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:00:39 finley iSCSITarget[26038]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:00:50 finley iSCSITarget[26228]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:01:00 finley iSCSITarget[26418]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:01:10 finley iSCSITarget[26608]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:01:20 finley iSCSITarget[26798]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:01:30 finley iSCSITarget[26988]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:01:40 finley iSCSITarget[27181]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:01:50 finley iSCSITarget[27372]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:02:00 finley iSCSITarget[27562]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:02:01 finley /USR/SBIN/CRON[27590]: (logcheck) CMD (   if [ -x /usr/sbin/logcheck ]; then nice -n10 /usr/sbin/logcheck; fi)
May 20 08:02:10 finley iSCSITarget[28717]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:02:20 finley iSCSITarget[28907]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:02:30 finley iSCSITarget[29098]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:02:40 finley iSCSITarget[29288]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:02:51 finley iSCSITarget[29478]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:03:01 finley iSCSITarget[29668]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:03:11 finley iSCSITarget[29858]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:03:21 finley iSCSITarget[30048]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:03:31 finley iSCSITarget[30239]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:03:41 finley iSCSITarget[30427]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:03:51 finley iSCSITarget[30617]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:04:01 finley iSCSITarget[30807]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:04:11 finley iSCSITarget[30997]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:04:21 finley iSCSITarget[31187]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:04:31 finley iSCSITarget[31377]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:04:41 finley iSCSITarget[31567]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:04:52 finley iSCSITarget[31759]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:05:01 finley /USR/SBIN/CRON[31950]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 08:05:02 finley iSCSITarget[31952]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:05:12 finley iSCSITarget[32143]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:05:22 finley iSCSITarget[32335]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:05:32 finley iSCSITarget[32525]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:05:42 finley iSCSITarget[32715]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:05:52 finley iSCSITarget[438]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:06:02 finley iSCSITarget[629]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:06:12 finley iSCSITarget[837]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:06:22 finley iSCSITarget[1032]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:06:32 finley iSCSITarget[1232]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:06:42 finley iSCSITarget[1423]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:06:53 finley iSCSITarget[1613]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:07:03 finley iSCSITarget[1805]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:07:13 finley iSCSITarget[1997]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:07:18 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 08:07:18 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 08:07:18 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 08:07:18 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 08:07:18 finley crmd: [25840]: info: do_pe_invoke: Query 5568: Requesting the current CIB: S_POLICY_ENGINE
May 20 08:07:18 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5568, ref=pe_calc-dc-1305871638-6127, seq=1716, quorate=1
May 20 08:07:18 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 08:07:18 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 08:07:18 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 08:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 08:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 08:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 08:07:18 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 08:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 08:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 08:07:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 08:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 08:07:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 08:07:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 08:07:18 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 08:07:18 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 08:07:18 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 08:07:18 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 08:07:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:07:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:07:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:07:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 08:07:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:07:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:07:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 08:07:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:07:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:07:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 08:07:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:07:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:07:18 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 08:07:18 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 08:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 08:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 08:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 08:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 08:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 08:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 08:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 08:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 08:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 08:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 08:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 08:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 08:07:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 08:07:18 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 08:07:18 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3561: 0 actions in 0 synapses
May 20 08:07:18 finley crmd: [25840]: info: do_te_invoke: Processing graph 3561 (ref=pe_calc-dc-1305871638-6127) derived from /var/lib/pengine/pe-input-4720.bz2
May 20 08:07:18 finley crmd: [25840]: info: run_graph: ====================================================
May 20 08:07:18 finley crmd: [25840]: notice: run_graph: Transition 3561 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4720.bz2): Complete
May 20 08:07:18 finley crmd: [25840]: info: te_graph_trigger: Transition 3561 is now complete
May 20 08:07:18 finley crmd: [25840]: info: notify_crmd: Transition 3561 status: done - <null>
May 20 08:07:18 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 08:07:18 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 08:07:18 finley pengine: [25839]: info: process_pe_message: Transition 3561: PEngine Input stored in: /var/lib/pengine/pe-input-4720.bz2
May 20 08:07:23 finley iSCSITarget[2202]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:07:33 finley iSCSITarget[2397]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:07:43 finley iSCSITarget[2587]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:07:53 finley iSCSITarget[2777]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:08:03 finley iSCSITarget[2969]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:08:13 finley iSCSITarget[3159]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:08:23 finley iSCSITarget[3349]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:08:33 finley iSCSITarget[3539]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:08:43 finley iSCSITarget[3729]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:08:54 finley iSCSITarget[3909]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:09:04 finley iSCSITarget[4099]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:09:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 08:09:14 finley iSCSITarget[4289]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:09:24 finley iSCSITarget[4479]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:09:34 finley iSCSITarget[4669]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:09:44 finley iSCSITarget[4859]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:09:54 finley iSCSITarget[5049]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:10:04 finley iSCSITarget[5239]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:10:14 finley iSCSITarget[5429]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:10:24 finley iSCSITarget[5619]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:10:34 finley iSCSITarget[5809]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:10:44 finley iSCSITarget[5999]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:10:55 finley iSCSITarget[6189]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:11:05 finley iSCSITarget[6380]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:11:15 finley iSCSITarget[6573]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:11:25 finley iSCSITarget[6763]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:11:35 finley iSCSITarget[6953]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:11:45 finley iSCSITarget[7143]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:11:55 finley iSCSITarget[7333]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:12:05 finley iSCSITarget[7523]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:12:15 finley iSCSITarget[7713]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:12:25 finley iSCSITarget[7903]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:12:35 finley iSCSITarget[8093]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:12:45 finley iSCSITarget[8283]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:12:56 finley iSCSITarget[8473]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:13:06 finley iSCSITarget[8665]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:13:16 finley iSCSITarget[8855]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:13:26 finley iSCSITarget[9045]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:13:36 finley iSCSITarget[9235]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:13:46 finley iSCSITarget[9425]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:13:56 finley iSCSITarget[9615]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:14:06 finley iSCSITarget[9805]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:14:16 finley iSCSITarget[9995]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:14:26 finley iSCSITarget[10186]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:14:36 finley iSCSITarget[10376]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:14:46 finley iSCSITarget[10566]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:14:57 finley iSCSITarget[10757]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:15:01 finley /USR/SBIN/CRON[10860]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 08:15:07 finley iSCSITarget[10950]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:15:17 finley iSCSITarget[11138]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:15:27 finley iSCSITarget[11328]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:15:32 finley lrmd: [25837]: info: rsc:ping_nodes:0:1076: monitor
May 20 08:15:37 finley iSCSITarget[11518]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:15:47 finley iSCSITarget[11708]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:15:53 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1097: monitor
May 20 08:15:53 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1099: monitor
May 20 08:15:57 finley iSCSITarget[11898]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:15:58 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1101: monitor
May 20 08:16:07 finley iSCSITarget[12088]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:16:17 finley iSCSITarget[12278]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:16:27 finley iSCSITarget[12469]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:16:37 finley iSCSITarget[12660]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:16:41 finley lrmd: [25837]: info: rsc:ip_virtual0:1093: monitor
May 20 08:16:47 finley lrmd: [25837]: info: rsc:iscsi0_target:1095: monitor
May 20 08:16:47 finley iSCSITarget[12850]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:16:58 finley iSCSITarget[13040]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:17:01 finley /USR/SBIN/CRON[13115]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
May 20 08:17:08 finley iSCSITarget[13233]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:17:18 finley iSCSITarget[13423]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:17:28 finley iSCSITarget[13613]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:17:38 finley iSCSITarget[13803]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:17:48 finley iSCSITarget[13993]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:17:58 finley iSCSITarget[14183]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:18:08 finley iSCSITarget[14373]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:18:18 finley iSCSITarget[14563]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:18:28 finley iSCSITarget[14753]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:18:38 finley iSCSITarget[14944]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:18:48 finley iSCSITarget[15135]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:18:58 finley iSCSITarget[15325]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:19:09 finley iSCSITarget[15516]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:19:19 finley iSCSITarget[15706]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:19:29 finley iSCSITarget[15896]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:19:39 finley iSCSITarget[16086]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:19:49 finley iSCSITarget[16276]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:19:59 finley iSCSITarget[16467]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:20:09 finley iSCSITarget[16658]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:20:19 finley iSCSITarget[16848]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:20:29 finley iSCSITarget[17038]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:20:39 finley iSCSITarget[17228]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:20:49 finley iSCSITarget[17411]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:20:59 finley iSCSITarget[17599]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:21:10 finley iSCSITarget[17789]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:21:20 finley iSCSITarget[17979]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:21:30 finley iSCSITarget[18169]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:21:40 finley iSCSITarget[18359]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:21:50 finley iSCSITarget[18549]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:22:00 finley iSCSITarget[18739]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:22:10 finley iSCSITarget[18929]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:22:18 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 08:22:18 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 08:22:18 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 08:22:18 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 08:22:18 finley crmd: [25840]: info: do_pe_invoke: Query 5569: Requesting the current CIB: S_POLICY_ENGINE
May 20 08:22:18 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5569, ref=pe_calc-dc-1305872538-6128, seq=1716, quorate=1
May 20 08:22:18 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 08:22:18 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 08:22:18 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 08:22:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 08:22:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 08:22:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 08:22:18 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 08:22:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 08:22:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 08:22:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 08:22:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 08:22:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 08:22:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 08:22:18 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 08:22:18 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 08:22:18 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 08:22:18 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 08:22:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:22:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:22:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:22:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 08:22:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:22:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:22:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 08:22:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:22:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:22:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 08:22:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:22:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:22:18 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 08:22:18 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 08:22:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 08:22:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 08:22:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 08:22:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 08:22:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 08:22:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 08:22:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 08:22:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 08:22:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 08:22:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 08:22:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 08:22:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:22:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 08:22:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 08:22:18 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 08:22:18 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3562: 0 actions in 0 synapses
May 20 08:22:18 finley crmd: [25840]: info: do_te_invoke: Processing graph 3562 (ref=pe_calc-dc-1305872538-6128) derived from /var/lib/pengine/pe-input-4721.bz2
May 20 08:22:18 finley crmd: [25840]: info: run_graph: ====================================================
May 20 08:22:18 finley crmd: [25840]: notice: run_graph: Transition 3562 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4721.bz2): Complete
May 20 08:22:18 finley crmd: [25840]: info: te_graph_trigger: Transition 3562 is now complete
May 20 08:22:18 finley crmd: [25840]: info: notify_crmd: Transition 3562 status: done - <null>
May 20 08:22:18 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 08:22:18 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 08:22:18 finley pengine: [25839]: info: process_pe_message: Transition 3562: PEngine Input stored in: /var/lib/pengine/pe-input-4721.bz2
May 20 08:22:20 finley iSCSITarget[19119]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:22:30 finley iSCSITarget[19309]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:22:40 finley iSCSITarget[19499]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:22:50 finley iSCSITarget[19689]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:23:00 finley iSCSITarget[19879]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:23:11 finley iSCSITarget[20069]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:23:21 finley iSCSITarget[20259]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:23:31 finley iSCSITarget[20449]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:23:41 finley iSCSITarget[20639]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:23:51 finley iSCSITarget[20829]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:24:01 finley iSCSITarget[21019]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:24:11 finley iSCSITarget[21209]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:24:21 finley iSCSITarget[21399]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:24:31 finley iSCSITarget[21589]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:24:41 finley iSCSITarget[21779]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:24:51 finley iSCSITarget[21969]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:25:01 finley /USR/SBIN/CRON[22160]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 08:25:01 finley iSCSITarget[22162]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:25:07 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 107 to 104
May 20 08:25:07 finley smartd[1692]: Device: /dev/sdd [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 104 to 99
May 20 08:25:11 finley iSCSITarget[22352]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:25:22 finley iSCSITarget[22542]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:25:32 finley iSCSITarget[22732]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:25:42 finley iSCSITarget[22922]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:25:52 finley iSCSITarget[23112]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:26:02 finley iSCSITarget[23302]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:26:12 finley iSCSITarget[23492]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:26:22 finley iSCSITarget[23682]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:26:32 finley iSCSITarget[23873]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:26:42 finley iSCSITarget[24063]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:26:52 finley iSCSITarget[24251]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:27:02 finley iSCSITarget[24441]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:27:12 finley iSCSITarget[24631]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:27:23 finley iSCSITarget[24822]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:27:33 finley iSCSITarget[25012]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:27:43 finley iSCSITarget[25202]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:27:53 finley iSCSITarget[25392]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:28:03 finley iSCSITarget[25586]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:28:13 finley iSCSITarget[25776]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:28:23 finley iSCSITarget[25985]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:28:33 finley iSCSITarget[26175]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:28:43 finley iSCSITarget[26365]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:28:53 finley iSCSITarget[26555]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:29:03 finley iSCSITarget[26745]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:29:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 08:29:13 finley iSCSITarget[26935]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:29:24 finley iSCSITarget[27127]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:29:34 finley iSCSITarget[27319]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:29:44 finley iSCSITarget[27509]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:29:54 finley iSCSITarget[27699]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:30:04 finley iSCSITarget[27889]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:30:14 finley iSCSITarget[28079]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:30:24 finley iSCSITarget[28269]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:30:34 finley iSCSITarget[28459]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:30:44 finley iSCSITarget[28649]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:30:54 finley iSCSITarget[28839]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:31:04 finley iSCSITarget[29029]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:31:14 finley iSCSITarget[29220]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:31:24 finley iSCSITarget[29410]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:31:35 finley iSCSITarget[29600]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:31:45 finley iSCSITarget[29790]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:31:55 finley iSCSITarget[29980]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:32:05 finley iSCSITarget[30171]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:32:15 finley iSCSITarget[30361]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:32:25 finley iSCSITarget[30551]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:32:35 finley iSCSITarget[30741]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:32:45 finley iSCSITarget[30931]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:32:55 finley iSCSITarget[31121]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:33:05 finley iSCSITarget[31301]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:33:15 finley iSCSITarget[31491]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:33:26 finley iSCSITarget[31681]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:33:36 finley iSCSITarget[31873]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:33:46 finley iSCSITarget[32063]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:33:56 finley iSCSITarget[32256]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:34:06 finley iSCSITarget[32446]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:34:16 finley iSCSITarget[32636]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:34:26 finley iSCSITarget[359]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:34:36 finley iSCSITarget[550]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:34:46 finley iSCSITarget[751]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:34:56 finley iSCSITarget[949]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:35:01 finley /USR/SBIN/CRON[1069]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 08:35:06 finley iSCSITarget[1153]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:35:16 finley iSCSITarget[1346]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:35:26 finley iSCSITarget[1537]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:35:37 finley iSCSITarget[1729]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:35:47 finley iSCSITarget[1919]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:35:57 finley iSCSITarget[2116]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:36:07 finley iSCSITarget[2349]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:36:17 finley iSCSITarget[2539]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:36:27 finley iSCSITarget[2729]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:36:37 finley iSCSITarget[2920]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:36:47 finley iSCSITarget[3111]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:36:57 finley iSCSITarget[3302]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:37:07 finley iSCSITarget[3492]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:37:17 finley iSCSITarget[3682]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:37:18 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 08:37:18 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 08:37:18 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 08:37:18 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 08:37:18 finley crmd: [25840]: info: do_pe_invoke: Query 5570: Requesting the current CIB: S_POLICY_ENGINE
May 20 08:37:18 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5570, ref=pe_calc-dc-1305873438-6129, seq=1716, quorate=1
May 20 08:37:18 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 08:37:18 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 08:37:18 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 08:37:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 08:37:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 08:37:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 08:37:18 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 08:37:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 08:37:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 08:37:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 08:37:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 08:37:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 08:37:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 08:37:18 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 08:37:18 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 08:37:18 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 08:37:18 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 08:37:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:37:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:37:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:37:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 08:37:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:37:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:37:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 08:37:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:37:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:37:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 08:37:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:37:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:37:18 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 08:37:18 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 08:37:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 08:37:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 08:37:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 08:37:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 08:37:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 08:37:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 08:37:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 08:37:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 08:37:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 08:37:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 08:37:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 08:37:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:37:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 08:37:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 08:37:18 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 08:37:18 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3563: 0 actions in 0 synapses
May 20 08:37:18 finley crmd: [25840]: info: do_te_invoke: Processing graph 3563 (ref=pe_calc-dc-1305873438-6129) derived from /var/lib/pengine/pe-input-4722.bz2
May 20 08:37:18 finley crmd: [25840]: info: run_graph: ====================================================
May 20 08:37:18 finley crmd: [25840]: notice: run_graph: Transition 3563 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4722.bz2): Complete
May 20 08:37:18 finley crmd: [25840]: info: te_graph_trigger: Transition 3563 is now complete
May 20 08:37:18 finley crmd: [25840]: info: notify_crmd: Transition 3563 status: done - <null>
May 20 08:37:18 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 08:37:18 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 08:37:18 finley pengine: [25839]: info: process_pe_message: Transition 3563: PEngine Input stored in: /var/lib/pengine/pe-input-4722.bz2
May 20 08:37:28 finley iSCSITarget[3872]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:37:38 finley iSCSITarget[4062]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:37:48 finley iSCSITarget[4252]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:37:58 finley iSCSITarget[4442]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:38:08 finley iSCSITarget[4632]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:38:18 finley iSCSITarget[4823]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:38:28 finley iSCSITarget[5013]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:38:38 finley iSCSITarget[5203]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:38:48 finley iSCSITarget[5393]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:38:58 finley iSCSITarget[5583]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:39:08 finley iSCSITarget[5771]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:39:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 08:39:18 finley iSCSITarget[5961]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:39:28 finley iSCSITarget[6151]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:39:39 finley iSCSITarget[6342]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:39:49 finley iSCSITarget[6535]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:39:59 finley iSCSITarget[6725]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:40:09 finley iSCSITarget[6915]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:40:19 finley iSCSITarget[7105]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:40:29 finley iSCSITarget[7295]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:40:39 finley iSCSITarget[7485]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:40:49 finley iSCSITarget[7675]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:40:59 finley iSCSITarget[7865]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:41:09 finley iSCSITarget[8055]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:41:19 finley iSCSITarget[8245]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:41:29 finley iSCSITarget[8435]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:41:40 finley iSCSITarget[8625]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:41:50 finley iSCSITarget[8817]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:42:00 finley iSCSITarget[9007]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:42:10 finley iSCSITarget[9197]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:42:20 finley iSCSITarget[9387]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:42:30 finley iSCSITarget[9577]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:42:40 finley iSCSITarget[9767]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:42:50 finley iSCSITarget[9957]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:43:00 finley iSCSITarget[10147]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:43:10 finley iSCSITarget[10338]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:43:20 finley iSCSITarget[10528]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:43:30 finley iSCSITarget[10719]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:43:41 finley iSCSITarget[10909]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:43:51 finley iSCSITarget[11099]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:44:01 finley iSCSITarget[11289]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:44:11 finley iSCSITarget[11479]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:44:21 finley iSCSITarget[11669]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:44:31 finley iSCSITarget[11859]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:44:41 finley iSCSITarget[12049]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:44:51 finley iSCSITarget[12232]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:45:01 finley /USR/SBIN/CRON[12435]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 08:45:01 finley iSCSITarget[12420]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:45:11 finley iSCSITarget[12614]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:45:21 finley iSCSITarget[12804]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:45:31 finley iSCSITarget[12994]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:45:42 finley iSCSITarget[13184]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:45:52 finley iSCSITarget[13374]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:46:02 finley iSCSITarget[13564]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:46:12 finley iSCSITarget[13754]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:46:22 finley iSCSITarget[13944]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:46:32 finley iSCSITarget[14134]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:46:42 finley iSCSITarget[14324]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:46:52 finley iSCSITarget[14514]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:47:02 finley iSCSITarget[14704]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:47:12 finley iSCSITarget[14894]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:47:22 finley iSCSITarget[15085]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:47:32 finley iSCSITarget[15275]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:47:43 finley iSCSITarget[15465]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:47:53 finley iSCSITarget[15655]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:48:03 finley iSCSITarget[15845]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:48:13 finley iSCSITarget[16035]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:48:23 finley iSCSITarget[16225]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:48:33 finley iSCSITarget[16416]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:48:43 finley iSCSITarget[16607]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:48:53 finley iSCSITarget[16797]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:49:03 finley iSCSITarget[16987]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:49:13 finley iSCSITarget[17177]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:49:23 finley iSCSITarget[17367]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:49:33 finley iSCSITarget[17557]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:49:44 finley iSCSITarget[17747]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:49:54 finley iSCSITarget[17937]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:50:04 finley iSCSITarget[18127]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:50:14 finley iSCSITarget[18317]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:50:24 finley iSCSITarget[18507]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:50:34 finley iSCSITarget[18697]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:50:44 finley iSCSITarget[18887]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:50:54 finley iSCSITarget[19077]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:51:04 finley iSCSITarget[19265]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:51:14 finley iSCSITarget[19455]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:51:24 finley iSCSITarget[19645]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:51:35 finley iSCSITarget[19835]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:51:45 finley iSCSITarget[20025]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:51:55 finley iSCSITarget[20215]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:52:05 finley iSCSITarget[20405]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:52:15 finley iSCSITarget[20595]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:52:18 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 08:52:18 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 08:52:18 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 08:52:18 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 08:52:18 finley crmd: [25840]: info: do_pe_invoke: Query 5571: Requesting the current CIB: S_POLICY_ENGINE
May 20 08:52:18 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5571, ref=pe_calc-dc-1305874338-6130, seq=1716, quorate=1
May 20 08:52:18 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 08:52:18 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 08:52:18 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 08:52:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 08:52:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 08:52:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 08:52:18 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 08:52:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 08:52:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 08:52:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 08:52:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 08:52:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 08:52:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 08:52:18 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 08:52:18 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 08:52:18 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 08:52:18 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 08:52:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:52:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:52:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 08:52:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 08:52:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:52:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:52:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 08:52:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:52:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:52:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 08:52:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 08:52:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 08:52:18 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 08:52:18 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 08:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 08:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 08:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 08:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 08:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 08:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 08:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 08:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 08:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 08:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 08:52:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 08:52:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:52:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 08:52:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 08:52:18 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 08:52:18 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3564: 0 actions in 0 synapses
May 20 08:52:18 finley crmd: [25840]: info: do_te_invoke: Processing graph 3564 (ref=pe_calc-dc-1305874338-6130) derived from /var/lib/pengine/pe-input-4723.bz2
May 20 08:52:18 finley crmd: [25840]: info: run_graph: ====================================================
May 20 08:52:18 finley crmd: [25840]: notice: run_graph: Transition 3564 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4723.bz2): Complete
May 20 08:52:18 finley crmd: [25840]: info: te_graph_trigger: Transition 3564 is now complete
May 20 08:52:18 finley crmd: [25840]: info: notify_crmd: Transition 3564 status: done - <null>
May 20 08:52:18 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 08:52:18 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 08:52:18 finley pengine: [25839]: info: process_pe_message: Transition 3564: PEngine Input stored in: /var/lib/pengine/pe-input-4723.bz2
May 20 08:52:25 finley iSCSITarget[20786]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:52:35 finley iSCSITarget[20976]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:52:45 finley iSCSITarget[21166]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:52:55 finley iSCSITarget[21356]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:53:05 finley iSCSITarget[21546]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:53:15 finley iSCSITarget[21737]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:53:25 finley iSCSITarget[21927]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:53:36 finley iSCSITarget[22117]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:53:46 finley iSCSITarget[22307]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:53:56 finley iSCSITarget[22497]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:54:06 finley iSCSITarget[22687]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:54:16 finley iSCSITarget[22877]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:54:26 finley iSCSITarget[23067]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:54:36 finley iSCSITarget[23257]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:54:46 finley iSCSITarget[23447]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:54:56 finley iSCSITarget[23637]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:55:01 finley /USR/SBIN/CRON[23714]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 08:55:06 finley iSCSITarget[23831]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:55:08 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 104 to 102
May 20 08:55:16 finley iSCSITarget[24021]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:55:26 finley iSCSITarget[24211]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:55:37 finley iSCSITarget[24401]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:55:47 finley iSCSITarget[24591]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:55:57 finley iSCSITarget[24781]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:56:07 finley iSCSITarget[24972]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:56:17 finley iSCSITarget[25162]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:56:27 finley iSCSITarget[25352]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:56:37 finley iSCSITarget[25545]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:56:47 finley iSCSITarget[25736]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:56:57 finley iSCSITarget[25942]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:57:07 finley iSCSITarget[26128]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:57:17 finley iSCSITarget[26315]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:57:27 finley iSCSITarget[26505]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:57:38 finley iSCSITarget[26695]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:57:48 finley iSCSITarget[26885]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:57:58 finley iSCSITarget[27077]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:58:08 finley iSCSITarget[27269]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:58:18 finley iSCSITarget[27459]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:58:28 finley iSCSITarget[27649]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:58:38 finley iSCSITarget[27839]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:58:48 finley iSCSITarget[28029]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:58:58 finley iSCSITarget[28219]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:59:08 finley iSCSITarget[28409]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:59:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 08:59:18 finley iSCSITarget[28599]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:59:28 finley iSCSITarget[28789]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:59:39 finley iSCSITarget[28979]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:59:49 finley iSCSITarget[29170]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 08:59:59 finley iSCSITarget[29360]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:00:09 finley iSCSITarget[29550]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:00:19 finley iSCSITarget[29740]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:00:29 finley iSCSITarget[29930]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:00:39 finley iSCSITarget[30120]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:00:49 finley iSCSITarget[30311]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:00:59 finley iSCSITarget[30501]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:01:09 finley iSCSITarget[30691]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:01:19 finley iSCSITarget[30881]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:01:29 finley iSCSITarget[31071]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:01:39 finley iSCSITarget[31261]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:01:50 finley iSCSITarget[31451]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:02:00 finley iSCSITarget[31641]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:02:01 finley /USR/SBIN/CRON[31676]: (logcheck) CMD (   if [ -x /usr/sbin/logcheck ]; then nice -n10 /usr/sbin/logcheck; fi)
May 20 09:02:10 finley iSCSITarget[333]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:02:20 finley iSCSITarget[525]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:02:30 finley iSCSITarget[724]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:02:40 finley iSCSITarget[924]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:02:50 finley iSCSITarget[1121]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:03:00 finley iSCSITarget[1318]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:03:10 finley iSCSITarget[1508]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:03:20 finley iSCSITarget[1701]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:03:30 finley iSCSITarget[1891]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:03:40 finley iSCSITarget[2088]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:03:51 finley iSCSITarget[2294]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:04:01 finley iSCSITarget[2484]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:04:11 finley iSCSITarget[2674]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:04:21 finley iSCSITarget[2864]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:04:31 finley iSCSITarget[3056]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:04:41 finley iSCSITarget[3246]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:04:51 finley iSCSITarget[3436]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:05:01 finley iSCSITarget[3626]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:05:01 finley /USR/SBIN/CRON[3653]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 09:05:11 finley iSCSITarget[3819]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:05:21 finley iSCSITarget[4009]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:05:31 finley iSCSITarget[4199]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:05:41 finley iSCSITarget[4389]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:05:52 finley iSCSITarget[4579]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:06:02 finley iSCSITarget[4769]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:06:12 finley iSCSITarget[4959]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:06:22 finley iSCSITarget[5149]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:06:32 finley iSCSITarget[5339]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:06:42 finley iSCSITarget[5529]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:06:52 finley iSCSITarget[5719]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:07:02 finley iSCSITarget[5909]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:07:12 finley iSCSITarget[6099]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:07:18 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 09:07:18 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 09:07:18 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 09:07:18 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 09:07:18 finley crmd: [25840]: info: do_pe_invoke: Query 5572: Requesting the current CIB: S_POLICY_ENGINE
May 20 09:07:18 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5572, ref=pe_calc-dc-1305875238-6131, seq=1716, quorate=1
May 20 09:07:18 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 09:07:18 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 09:07:18 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 09:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 09:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 09:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 09:07:18 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 09:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 09:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 09:07:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 09:07:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 09:07:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 09:07:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 09:07:18 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 09:07:18 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 09:07:18 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 09:07:18 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 09:07:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:07:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:07:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:07:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 09:07:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:07:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:07:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 09:07:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:07:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:07:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 09:07:18 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:07:18 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:07:18 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 09:07:18 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 09:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 09:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 09:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 09:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 09:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 09:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 09:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 09:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 09:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 09:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 09:07:18 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 09:07:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:07:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 09:07:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 09:07:19 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 09:07:19 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3565: 0 actions in 0 synapses
May 20 09:07:19 finley crmd: [25840]: info: do_te_invoke: Processing graph 3565 (ref=pe_calc-dc-1305875238-6131) derived from /var/lib/pengine/pe-input-4724.bz2
May 20 09:07:19 finley crmd: [25840]: info: run_graph: ====================================================
May 20 09:07:19 finley crmd: [25840]: notice: run_graph: Transition 3565 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4724.bz2): Complete
May 20 09:07:19 finley crmd: [25840]: info: te_graph_trigger: Transition 3565 is now complete
May 20 09:07:19 finley crmd: [25840]: info: notify_crmd: Transition 3565 status: done - <null>
May 20 09:07:19 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 09:07:19 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 09:07:19 finley pengine: [25839]: info: process_pe_message: Transition 3565: PEngine Input stored in: /var/lib/pengine/pe-input-4724.bz2
May 20 09:07:22 finley iSCSITarget[6289]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:07:32 finley iSCSITarget[6483]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:07:42 finley iSCSITarget[6673]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:07:53 finley iSCSITarget[6863]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:08:03 finley iSCSITarget[7053]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:08:13 finley iSCSITarget[7241]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:08:23 finley iSCSITarget[7431]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:08:33 finley iSCSITarget[7614]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:08:43 finley iSCSITarget[7804]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:08:53 finley iSCSITarget[7994]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:09:03 finley iSCSITarget[8184]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:09:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 09:09:13 finley iSCSITarget[8374]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:09:23 finley iSCSITarget[8564]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:09:33 finley iSCSITarget[8756]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:09:43 finley iSCSITarget[8946]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:09:54 finley iSCSITarget[9136]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:10:04 finley iSCSITarget[9326]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:10:14 finley iSCSITarget[9516]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:10:24 finley iSCSITarget[9706]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:10:34 finley iSCSITarget[9892]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:10:44 finley iSCSITarget[10070]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:10:54 finley iSCSITarget[10260]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:11:04 finley iSCSITarget[10442]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:11:14 finley iSCSITarget[10632]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:11:24 finley iSCSITarget[10818]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:11:34 finley iSCSITarget[11001]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:11:45 finley iSCSITarget[11191]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:11:55 finley iSCSITarget[11374]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:12:05 finley iSCSITarget[11569]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:12:15 finley iSCSITarget[11759]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:12:25 finley iSCSITarget[11952]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:12:35 finley iSCSITarget[12142]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:12:45 finley iSCSITarget[12337]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:12:55 finley iSCSITarget[12533]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:13:05 finley iSCSITarget[12724]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:13:15 finley iSCSITarget[12914]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:13:26 finley iSCSITarget[13104]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:13:36 finley iSCSITarget[13294]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:13:46 finley iSCSITarget[13484]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:13:56 finley iSCSITarget[13674]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:14:06 finley iSCSITarget[13864]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:14:16 finley iSCSITarget[14054]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:14:26 finley iSCSITarget[14244]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:14:36 finley iSCSITarget[14434]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:14:46 finley iSCSITarget[14624]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:14:56 finley iSCSITarget[14814]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:15:02 finley /USR/SBIN/CRON[14953]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 09:15:06 finley iSCSITarget[15007]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:15:17 finley iSCSITarget[15198]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:15:27 finley iSCSITarget[15388]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:15:33 finley lrmd: [25837]: info: rsc:ping_nodes:0:1076: monitor
May 20 09:15:37 finley iSCSITarget[15578]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:15:47 finley iSCSITarget[15768]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:15:57 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1099: monitor
May 20 09:15:57 finley iSCSITarget[15958]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:15:57 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1097: monitor
May 20 09:15:59 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1101: monitor
May 20 09:16:07 finley iSCSITarget[16148]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:16:17 finley iSCSITarget[16338]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:16:27 finley iSCSITarget[16529]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:16:37 finley iSCSITarget[16717]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:16:47 finley lrmd: [25837]: info: rsc:iscsi0_target:1095: monitor
May 20 09:16:47 finley iSCSITarget[16907]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:16:48 finley lrmd: [25837]: info: rsc:ip_virtual0:1093: monitor
May 20 09:16:57 finley iSCSITarget[17097]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:17:01 finley /USR/SBIN/CRON[17226]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
May 20 09:17:07 finley iSCSITarget[17290]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:17:18 finley iSCSITarget[17480]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:17:28 finley iSCSITarget[17670]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:17:38 finley iSCSITarget[17860]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:17:48 finley iSCSITarget[18050]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:17:58 finley iSCSITarget[18240]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:18:08 finley iSCSITarget[18430]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:18:18 finley iSCSITarget[18620]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:18:28 finley iSCSITarget[18810]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:18:38 finley iSCSITarget[19000]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:18:48 finley iSCSITarget[19190]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:18:58 finley iSCSITarget[19380]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:19:08 finley iSCSITarget[19570]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:19:19 finley iSCSITarget[19760]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:19:29 finley iSCSITarget[19950]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:19:39 finley iSCSITarget[20140]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:19:49 finley iSCSITarget[20330]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:19:59 finley iSCSITarget[20520]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:20:09 finley iSCSITarget[20710]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:20:19 finley iSCSITarget[20900]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:20:29 finley iSCSITarget[21090]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:20:39 finley iSCSITarget[21280]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:20:49 finley iSCSITarget[21465]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:20:59 finley iSCSITarget[21655]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:21:09 finley iSCSITarget[21841]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:21:20 finley iSCSITarget[22031]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:21:30 finley iSCSITarget[22221]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:21:40 finley iSCSITarget[22411]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:21:50 finley iSCSITarget[22598]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:22:00 finley iSCSITarget[22788]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:22:10 finley iSCSITarget[22978]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:22:19 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 09:22:19 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 09:22:19 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 09:22:19 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 09:22:19 finley crmd: [25840]: info: do_pe_invoke: Query 5573: Requesting the current CIB: S_POLICY_ENGINE
May 20 09:22:19 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5573, ref=pe_calc-dc-1305876139-6132, seq=1716, quorate=1
May 20 09:22:19 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 09:22:19 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 09:22:19 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 09:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 09:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 09:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 09:22:19 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 09:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 09:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 09:22:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 09:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 09:22:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 09:22:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 09:22:19 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 09:22:19 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 09:22:19 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 09:22:19 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 09:22:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:22:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:22:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:22:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 09:22:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:22:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:22:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 09:22:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:22:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:22:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 09:22:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:22:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:22:19 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 09:22:19 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 09:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 09:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 09:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 09:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 09:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 09:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 09:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 09:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 09:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 09:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 09:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 09:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 09:22:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 09:22:19 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 09:22:19 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3566: 0 actions in 0 synapses
May 20 09:22:19 finley crmd: [25840]: info: do_te_invoke: Processing graph 3566 (ref=pe_calc-dc-1305876139-6132) derived from /var/lib/pengine/pe-input-4725.bz2
May 20 09:22:19 finley crmd: [25840]: info: run_graph: ====================================================
May 20 09:22:19 finley crmd: [25840]: notice: run_graph: Transition 3566 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4725.bz2): Complete
May 20 09:22:19 finley crmd: [25840]: info: te_graph_trigger: Transition 3566 is now complete
May 20 09:22:19 finley crmd: [25840]: info: notify_crmd: Transition 3566 status: done - <null>
May 20 09:22:19 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 09:22:19 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 09:22:19 finley pengine: [25839]: info: process_pe_message: Transition 3566: PEngine Input stored in: /var/lib/pengine/pe-input-4725.bz2
May 20 09:22:20 finley iSCSITarget[23167]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:22:30 finley iSCSITarget[23351]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:22:40 finley iSCSITarget[23556]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:22:50 finley iSCSITarget[23747]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:23:00 finley iSCSITarget[23940]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:23:11 finley iSCSITarget[24125]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:23:21 finley iSCSITarget[24315]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:23:31 finley iSCSITarget[24505]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:23:41 finley iSCSITarget[24695]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:23:51 finley iSCSITarget[24887]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:24:01 finley iSCSITarget[25076]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:24:11 finley iSCSITarget[25266]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:24:21 finley iSCSITarget[25456]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:24:31 finley iSCSITarget[25650]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:24:41 finley iSCSITarget[25859]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:24:52 finley iSCSITarget[26049]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:25:01 finley /USR/SBIN/CRON[26210]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 09:25:02 finley iSCSITarget[26242]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:25:07 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 102 to 104
May 20 09:25:08 finley smartd[1692]: Device: /dev/sdd [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 99 to 102
May 20 09:25:12 finley iSCSITarget[26432]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:25:22 finley iSCSITarget[26622]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:25:32 finley iSCSITarget[26812]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:25:42 finley iSCSITarget[27002]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:25:52 finley iSCSITarget[27195]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:26:02 finley iSCSITarget[27386]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:26:12 finley iSCSITarget[27576]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:26:22 finley iSCSITarget[27766]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:26:32 finley iSCSITarget[27956]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:26:42 finley iSCSITarget[28146]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:26:53 finley iSCSITarget[28336]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:27:03 finley iSCSITarget[28526]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:27:13 finley iSCSITarget[28716]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:27:23 finley iSCSITarget[28906]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:27:33 finley iSCSITarget[29097]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:27:43 finley iSCSITarget[29287]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:27:53 finley iSCSITarget[29477]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:28:03 finley iSCSITarget[29667]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:28:13 finley iSCSITarget[29857]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:28:23 finley iSCSITarget[30047]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:28:33 finley iSCSITarget[30238]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:28:43 finley iSCSITarget[30428]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:28:54 finley iSCSITarget[30618]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:29:04 finley iSCSITarget[30808]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:29:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 09:29:14 finley iSCSITarget[30998]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:29:24 finley iSCSITarget[31186]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:29:34 finley iSCSITarget[31376]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:29:44 finley iSCSITarget[31566]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:29:54 finley iSCSITarget[31758]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:30:04 finley iSCSITarget[31948]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:30:14 finley iSCSITarget[32139]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:30:24 finley iSCSITarget[32331]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:30:34 finley iSCSITarget[32521]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:30:45 finley iSCSITarget[32711]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:30:55 finley iSCSITarget[434]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:31:05 finley iSCSITarget[625]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:31:15 finley iSCSITarget[833]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:31:25 finley iSCSITarget[1028]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:31:35 finley iSCSITarget[1228]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:31:45 finley iSCSITarget[1419]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:31:55 finley iSCSITarget[1609]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:32:05 finley iSCSITarget[1801]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:32:15 finley iSCSITarget[1993]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:32:25 finley iSCSITarget[2194]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:32:35 finley iSCSITarget[2394]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:32:46 finley iSCSITarget[2584]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:32:56 finley iSCSITarget[2775]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:33:06 finley iSCSITarget[2967]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:33:16 finley iSCSITarget[3158]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:33:26 finley iSCSITarget[3348]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:33:36 finley iSCSITarget[3538]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:33:46 finley iSCSITarget[3728]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:33:56 finley iSCSITarget[3918]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:34:06 finley iSCSITarget[4108]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:34:16 finley iSCSITarget[4298]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:34:26 finley iSCSITarget[4488]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:34:36 finley iSCSITarget[4678]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:34:47 finley iSCSITarget[4868]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:34:57 finley iSCSITarget[5058]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:35:01 finley /USR/SBIN/CRON[5185]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 09:35:07 finley iSCSITarget[5249]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:35:17 finley iSCSITarget[5434]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:35:27 finley iSCSITarget[5621]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:35:37 finley iSCSITarget[5811]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:35:47 finley iSCSITarget[6001]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:35:57 finley iSCSITarget[6191]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:36:07 finley iSCSITarget[6382]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:36:17 finley iSCSITarget[6575]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:36:27 finley iSCSITarget[6765]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:36:37 finley iSCSITarget[6955]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:36:47 finley iSCSITarget[7145]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:36:58 finley iSCSITarget[7335]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:37:08 finley iSCSITarget[7525]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:37:18 finley iSCSITarget[7715]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:37:19 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 09:37:19 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 09:37:19 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 09:37:19 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 09:37:19 finley crmd: [25840]: info: do_pe_invoke: Query 5574: Requesting the current CIB: S_POLICY_ENGINE
May 20 09:37:19 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5574, ref=pe_calc-dc-1305877039-6133, seq=1716, quorate=1
May 20 09:37:19 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 09:37:19 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 09:37:19 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 09:37:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 09:37:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 09:37:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 09:37:19 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 09:37:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 09:37:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 09:37:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 09:37:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 09:37:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 09:37:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 09:37:19 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 09:37:19 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 09:37:19 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 09:37:19 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 09:37:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:37:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:37:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:37:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 09:37:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:37:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:37:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 09:37:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:37:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:37:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 09:37:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:37:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:37:19 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 09:37:19 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 09:37:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 09:37:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 09:37:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 09:37:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 09:37:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 09:37:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 09:37:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 09:37:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 09:37:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 09:37:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 09:37:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 09:37:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:37:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 09:37:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 09:37:19 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 09:37:19 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3567: 0 actions in 0 synapses
May 20 09:37:19 finley crmd: [25840]: info: do_te_invoke: Processing graph 3567 (ref=pe_calc-dc-1305877039-6133) derived from /var/lib/pengine/pe-input-4726.bz2
May 20 09:37:19 finley crmd: [25840]: info: run_graph: ====================================================
May 20 09:37:19 finley crmd: [25840]: notice: run_graph: Transition 3567 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4726.bz2): Complete
May 20 09:37:19 finley crmd: [25840]: info: te_graph_trigger: Transition 3567 is now complete
May 20 09:37:19 finley crmd: [25840]: info: notify_crmd: Transition 3567 status: done - <null>
May 20 09:37:19 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 09:37:19 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 09:37:19 finley pengine: [25839]: info: process_pe_message: Transition 3567: PEngine Input stored in: /var/lib/pengine/pe-input-4726.bz2
May 20 09:37:28 finley iSCSITarget[7905]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:37:38 finley iSCSITarget[8095]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:37:48 finley iSCSITarget[8285]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:37:58 finley iSCSITarget[8475]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:38:08 finley iSCSITarget[8667]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:38:18 finley iSCSITarget[8857]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:38:28 finley iSCSITarget[9047]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:38:38 finley iSCSITarget[9237]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:38:48 finley iSCSITarget[9427]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:38:59 finley iSCSITarget[9617]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:39:09 finley iSCSITarget[9807]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:39:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 09:39:19 finley iSCSITarget[9997]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:39:29 finley iSCSITarget[10188]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:39:39 finley iSCSITarget[10378]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:39:49 finley iSCSITarget[10568]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:39:59 finley iSCSITarget[10759]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:40:09 finley iSCSITarget[10949]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:40:19 finley iSCSITarget[11139]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:40:29 finley iSCSITarget[11329]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:40:39 finley iSCSITarget[11519]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:40:49 finley iSCSITarget[11707]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:41:00 finley iSCSITarget[11897]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:41:10 finley iSCSITarget[12087]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:41:20 finley iSCSITarget[12277]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:41:30 finley iSCSITarget[12468]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:41:40 finley iSCSITarget[12659]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:41:50 finley iSCSITarget[12849]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:42:00 finley iSCSITarget[13039]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:42:10 finley iSCSITarget[13229]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:42:20 finley iSCSITarget[13419]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:42:30 finley iSCSITarget[13609]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:42:40 finley iSCSITarget[13799]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:42:50 finley iSCSITarget[13989]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:43:01 finley iSCSITarget[14179]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:43:11 finley iSCSITarget[14369]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:43:21 finley iSCSITarget[14559]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:43:31 finley iSCSITarget[14749]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:43:41 finley iSCSITarget[14939]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:43:51 finley iSCSITarget[15131]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:44:01 finley iSCSITarget[15321]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:44:11 finley iSCSITarget[15511]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:44:21 finley iSCSITarget[15701]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:44:31 finley iSCSITarget[15891]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:44:41 finley iSCSITarget[16081]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:44:51 finley iSCSITarget[16271]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:45:01 finley /USR/SBIN/CRON[16453]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 09:45:02 finley iSCSITarget[16465]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:45:12 finley iSCSITarget[16655]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:45:22 finley iSCSITarget[16845]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:45:32 finley iSCSITarget[17035]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:45:42 finley iSCSITarget[17225]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:45:52 finley iSCSITarget[17415]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:46:02 finley iSCSITarget[17605]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:46:12 finley iSCSITarget[17795]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:46:22 finley iSCSITarget[17978]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:46:32 finley iSCSITarget[18165]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:46:42 finley iSCSITarget[18355]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:46:52 finley iSCSITarget[18545]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:47:03 finley iSCSITarget[18735]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:47:13 finley iSCSITarget[18925]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:47:23 finley iSCSITarget[19115]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:47:33 finley iSCSITarget[19305]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:47:43 finley iSCSITarget[19495]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:47:53 finley iSCSITarget[19685]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:48:03 finley iSCSITarget[19875]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:48:13 finley iSCSITarget[20065]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:48:23 finley iSCSITarget[20255]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:48:33 finley iSCSITarget[20445]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:48:43 finley iSCSITarget[20635]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:48:53 finley iSCSITarget[20825]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:49:04 finley iSCSITarget[21015]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:49:14 finley iSCSITarget[21205]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:49:24 finley iSCSITarget[21395]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:49:34 finley iSCSITarget[21585]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:49:44 finley iSCSITarget[21775]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:49:54 finley iSCSITarget[21965]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:50:04 finley iSCSITarget[22155]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:50:14 finley iSCSITarget[22345]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:50:24 finley iSCSITarget[22535]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:50:34 finley iSCSITarget[22725]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:50:44 finley iSCSITarget[22915]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:50:54 finley iSCSITarget[23105]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:51:05 finley iSCSITarget[23295]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:51:15 finley iSCSITarget[23485]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:51:25 finley iSCSITarget[23675]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:51:35 finley iSCSITarget[23866]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:51:45 finley iSCSITarget[24054]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:51:55 finley iSCSITarget[24244]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:52:05 finley iSCSITarget[24434]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:52:15 finley iSCSITarget[24624]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:52:19 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 09:52:19 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 09:52:19 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 09:52:19 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 09:52:19 finley crmd: [25840]: info: do_pe_invoke: Query 5575: Requesting the current CIB: S_POLICY_ENGINE
May 20 09:52:19 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5575, ref=pe_calc-dc-1305877939-6134, seq=1716, quorate=1
May 20 09:52:19 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 09:52:19 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 09:52:19 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 09:52:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 09:52:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 09:52:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 09:52:19 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 09:52:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 09:52:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 09:52:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 09:52:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 09:52:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 09:52:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 09:52:19 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 09:52:19 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 09:52:19 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 09:52:19 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 09:52:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:52:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:52:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 09:52:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 09:52:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:52:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:52:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 09:52:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:52:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:52:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 09:52:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 09:52:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 09:52:19 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 09:52:19 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 09:52:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 09:52:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 09:52:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 09:52:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 09:52:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 09:52:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 09:52:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 09:52:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 09:52:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 09:52:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 09:52:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 09:52:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:52:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 09:52:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 09:52:19 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 09:52:19 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3568: 0 actions in 0 synapses
May 20 09:52:19 finley crmd: [25840]: info: do_te_invoke: Processing graph 3568 (ref=pe_calc-dc-1305877939-6134) derived from /var/lib/pengine/pe-input-4727.bz2
May 20 09:52:19 finley crmd: [25840]: info: run_graph: ====================================================
May 20 09:52:19 finley crmd: [25840]: notice: run_graph: Transition 3568 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4727.bz2): Complete
May 20 09:52:19 finley crmd: [25840]: info: te_graph_trigger: Transition 3568 is now complete
May 20 09:52:19 finley crmd: [25840]: info: notify_crmd: Transition 3568 status: done - <null>
May 20 09:52:19 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 09:52:19 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 09:52:19 finley pengine: [25839]: info: process_pe_message: Transition 3568: PEngine Input stored in: /var/lib/pengine/pe-input-4727.bz2
May 20 09:52:25 finley iSCSITarget[24814]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:52:35 finley iSCSITarget[25005]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:52:45 finley iSCSITarget[25195]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:52:55 finley iSCSITarget[25385]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:53:05 finley iSCSITarget[25579]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:53:16 finley iSCSITarget[25769]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:53:26 finley iSCSITarget[25978]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:53:36 finley iSCSITarget[26168]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:53:46 finley iSCSITarget[26358]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:53:56 finley iSCSITarget[26548]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:54:06 finley iSCSITarget[26738]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:54:16 finley iSCSITarget[26928]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:54:26 finley iSCSITarget[27120]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:54:36 finley iSCSITarget[27312]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:54:46 finley iSCSITarget[27502]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:54:56 finley iSCSITarget[27692]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:55:01 finley /USR/SBIN/CRON[27847]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 09:55:06 finley iSCSITarget[27885]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:55:07 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 104 to 107
May 20 09:55:08 finley smartd[1692]: Device: /dev/sdd [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 102 to 109
May 20 09:55:17 finley iSCSITarget[28075]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:55:27 finley iSCSITarget[28265]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:55:37 finley iSCSITarget[28455]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:55:47 finley iSCSITarget[28645]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:55:57 finley iSCSITarget[28835]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:56:07 finley iSCSITarget[29025]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:56:17 finley iSCSITarget[29217]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:56:27 finley iSCSITarget[29407]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:56:37 finley iSCSITarget[29597]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:56:47 finley iSCSITarget[29787]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:56:57 finley iSCSITarget[29974]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:57:07 finley iSCSITarget[30166]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:57:18 finley iSCSITarget[30348]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:57:28 finley iSCSITarget[30538]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:57:38 finley iSCSITarget[30728]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:57:48 finley iSCSITarget[30918]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:57:58 finley iSCSITarget[31108]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:58:08 finley iSCSITarget[31298]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:58:18 finley iSCSITarget[31489]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:58:28 finley iSCSITarget[31679]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:58:38 finley iSCSITarget[31871]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:58:48 finley iSCSITarget[32061]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:58:58 finley iSCSITarget[32254]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:59:08 finley iSCSITarget[32444]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:59:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 09:59:19 finley iSCSITarget[32634]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:59:29 finley iSCSITarget[357]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:59:39 finley iSCSITarget[548]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:59:49 finley iSCSITarget[749]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 09:59:59 finley iSCSITarget[947]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:00:09 finley iSCSITarget[1146]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:00:19 finley iSCSITarget[1341]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:00:29 finley iSCSITarget[1532]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:00:39 finley iSCSITarget[1724]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:00:49 finley iSCSITarget[1914]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:00:59 finley iSCSITarget[2111]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:01:09 finley iSCSITarget[2317]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:01:20 finley iSCSITarget[2507]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:01:30 finley iSCSITarget[2697]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:01:40 finley iSCSITarget[2887]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:01:50 finley iSCSITarget[3079]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:02:00 finley iSCSITarget[3269]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:02:01 finley /USR/SBIN/CRON[3294]: (logcheck) CMD (   if [ -x /usr/sbin/logcheck ]; then nice -n10 /usr/sbin/logcheck; fi)
May 20 10:02:10 finley iSCSITarget[4424]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:02:20 finley iSCSITarget[4614]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:02:30 finley iSCSITarget[4804]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:02:40 finley iSCSITarget[4994]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:02:50 finley iSCSITarget[5184]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:03:00 finley iSCSITarget[5372]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:03:10 finley iSCSITarget[5562]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:03:20 finley iSCSITarget[5752]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:03:31 finley iSCSITarget[5942]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:03:41 finley iSCSITarget[6132]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:03:51 finley iSCSITarget[6323]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:04:01 finley iSCSITarget[6516]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:04:11 finley iSCSITarget[6706]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:04:21 finley iSCSITarget[6897]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:04:31 finley iSCSITarget[7087]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:04:41 finley iSCSITarget[7277]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:04:51 finley iSCSITarget[7467]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:05:01 finley /USR/SBIN/CRON[7658]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 10:05:01 finley iSCSITarget[7660]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:05:11 finley iSCSITarget[7850]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:05:21 finley iSCSITarget[8040]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:05:32 finley iSCSITarget[8230]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:05:42 finley iSCSITarget[8420]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:05:52 finley iSCSITarget[8610]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:06:02 finley iSCSITarget[8802]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:06:12 finley iSCSITarget[8992]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:06:22 finley iSCSITarget[9182]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:06:32 finley iSCSITarget[9372]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:06:42 finley iSCSITarget[9562]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:06:52 finley iSCSITarget[9752]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:07:02 finley iSCSITarget[9942]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:07:12 finley iSCSITarget[10132]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:07:19 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 10:07:19 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 10:07:19 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 10:07:19 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 10:07:19 finley crmd: [25840]: info: do_pe_invoke: Query 5576: Requesting the current CIB: S_POLICY_ENGINE
May 20 10:07:19 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5576, ref=pe_calc-dc-1305878839-6135, seq=1716, quorate=1
May 20 10:07:19 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 10:07:19 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 10:07:19 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 10:07:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 10:07:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 10:07:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 10:07:19 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 10:07:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 10:07:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 10:07:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 10:07:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 10:07:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 10:07:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 10:07:19 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 10:07:19 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 10:07:19 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 10:07:19 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 10:07:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:07:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:07:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:07:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 10:07:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:07:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:07:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 10:07:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:07:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:07:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 10:07:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:07:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:07:19 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 10:07:19 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 10:07:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 10:07:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 10:07:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 10:07:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 10:07:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 10:07:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 10:07:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 10:07:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 10:07:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 10:07:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 10:07:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 10:07:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:07:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 10:07:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 10:07:19 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 10:07:19 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3569: 0 actions in 0 synapses
May 20 10:07:19 finley crmd: [25840]: info: do_te_invoke: Processing graph 3569 (ref=pe_calc-dc-1305878839-6135) derived from /var/lib/pengine/pe-input-4728.bz2
May 20 10:07:19 finley crmd: [25840]: info: run_graph: ====================================================
May 20 10:07:19 finley crmd: [25840]: notice: run_graph: Transition 3569 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4728.bz2): Complete
May 20 10:07:19 finley crmd: [25840]: info: te_graph_trigger: Transition 3569 is now complete
May 20 10:07:19 finley crmd: [25840]: info: notify_crmd: Transition 3569 status: done - <null>
May 20 10:07:19 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 10:07:19 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 10:07:19 finley pengine: [25839]: info: process_pe_message: Transition 3569: PEngine Input stored in: /var/lib/pengine/pe-input-4728.bz2
May 20 10:07:22 finley iSCSITarget[10323]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:07:33 finley iSCSITarget[10513]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:07:43 finley iSCSITarget[10704]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:07:53 finley iSCSITarget[10894]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:08:03 finley iSCSITarget[11084]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:08:13 finley iSCSITarget[11267]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:08:23 finley iSCSITarget[11456]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:08:33 finley iSCSITarget[11645]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:08:43 finley iSCSITarget[11835]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:08:53 finley iSCSITarget[12025]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:09:03 finley iSCSITarget[12215]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:09:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 10:09:13 finley iSCSITarget[12406]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:09:23 finley iSCSITarget[12597]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:09:34 finley iSCSITarget[12787]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:09:44 finley iSCSITarget[12977]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:09:54 finley iSCSITarget[13167]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:10:04 finley iSCSITarget[13357]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:10:14 finley iSCSITarget[13575]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:10:24 finley iSCSITarget[13765]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:10:34 finley iSCSITarget[13955]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:10:44 finley iSCSITarget[14145]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:10:54 finley iSCSITarget[14335]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:11:04 finley iSCSITarget[14525]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:11:14 finley iSCSITarget[14715]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:11:24 finley iSCSITarget[14905]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:11:35 finley iSCSITarget[15096]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:11:45 finley iSCSITarget[15286]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:11:55 finley iSCSITarget[15476]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:12:05 finley iSCSITarget[15666]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:12:15 finley iSCSITarget[15856]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:12:25 finley iSCSITarget[16046]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:12:35 finley iSCSITarget[16236]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:12:45 finley iSCSITarget[16427]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:12:55 finley iSCSITarget[16617]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:13:05 finley iSCSITarget[16807]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:13:15 finley iSCSITarget[16997]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:13:25 finley iSCSITarget[17187]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:13:36 finley iSCSITarget[17377]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:13:46 finley iSCSITarget[17567]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:13:56 finley iSCSITarget[17757]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:14:06 finley iSCSITarget[17947]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:14:16 finley iSCSITarget[18135]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:14:26 finley iSCSITarget[18325]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:14:36 finley iSCSITarget[18515]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:14:46 finley iSCSITarget[18705]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:14:56 finley iSCSITarget[18895]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:15:01 finley /USR/SBIN/CRON[19024]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 10:15:06 finley iSCSITarget[19088]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:15:16 finley iSCSITarget[19278]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:15:26 finley iSCSITarget[19468]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:15:34 finley lrmd: [25837]: info: rsc:ping_nodes:0:1076: monitor
May 20 10:15:37 finley iSCSITarget[19658]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:15:47 finley iSCSITarget[19848]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:15:57 finley iSCSITarget[20038]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:16:00 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1099: monitor
May 20 10:16:01 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1097: monitor
May 20 10:16:01 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1101: monitor
May 20 10:16:07 finley iSCSITarget[20228]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:16:17 finley iSCSITarget[20418]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:16:27 finley iSCSITarget[20608]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:16:37 finley iSCSITarget[20798]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:16:47 finley lrmd: [25837]: info: rsc:iscsi0_target:1095: monitor
May 20 10:16:47 finley iSCSITarget[20988]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:16:56 finley lrmd: [25837]: info: rsc:ip_virtual0:1093: monitor
May 20 10:16:57 finley iSCSITarget[21178]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:17:01 finley /USR/SBIN/CRON[21253]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
May 20 10:17:07 finley iSCSITarget[21371]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:17:17 finley iSCSITarget[21561]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:17:27 finley iSCSITarget[21751]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:17:38 finley iSCSITarget[21941]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:17:48 finley iSCSITarget[22131]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:17:58 finley iSCSITarget[22321]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:18:08 finley iSCSITarget[22511]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:18:18 finley iSCSITarget[22701]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:18:28 finley iSCSITarget[22891]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:18:38 finley iSCSITarget[23081]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:18:48 finley iSCSITarget[23271]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:18:58 finley iSCSITarget[23461]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:19:08 finley iSCSITarget[23651]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:19:18 finley iSCSITarget[23842]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:19:28 finley iSCSITarget[24032]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:19:39 finley iSCSITarget[24222]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:19:49 finley iSCSITarget[24412]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:19:59 finley iSCSITarget[24602]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:20:09 finley iSCSITarget[24782]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:20:19 finley iSCSITarget[24973]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:20:29 finley iSCSITarget[25163]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:20:39 finley iSCSITarget[25353]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:20:49 finley iSCSITarget[25546]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:20:59 finley iSCSITarget[25737]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:21:09 finley iSCSITarget[25946]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:21:19 finley iSCSITarget[26136]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:21:29 finley iSCSITarget[26326]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:21:40 finley iSCSITarget[26516]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:21:50 finley iSCSITarget[26706]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:22:00 finley iSCSITarget[26896]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:22:10 finley iSCSITarget[27088]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:22:19 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 10:22:19 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 10:22:19 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 10:22:19 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 10:22:19 finley crmd: [25840]: info: do_pe_invoke: Query 5577: Requesting the current CIB: S_POLICY_ENGINE
May 20 10:22:19 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5577, ref=pe_calc-dc-1305879739-6136, seq=1716, quorate=1
May 20 10:22:19 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 10:22:19 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 10:22:19 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 10:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 10:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 10:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 10:22:19 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 10:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 10:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 10:22:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 10:22:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 10:22:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 10:22:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 10:22:19 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 10:22:19 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 10:22:19 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 10:22:19 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 10:22:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:22:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:22:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:22:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 10:22:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:22:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:22:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 10:22:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:22:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:22:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 10:22:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:22:19 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:22:19 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 10:22:19 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 10:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 10:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 10:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 10:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 10:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 10:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 10:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 10:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 10:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 10:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 10:22:19 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 10:22:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:22:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 10:22:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 10:22:19 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 10:22:19 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3570: 0 actions in 0 synapses
May 20 10:22:19 finley crmd: [25840]: info: do_te_invoke: Processing graph 3570 (ref=pe_calc-dc-1305879739-6136) derived from /var/lib/pengine/pe-input-4729.bz2
May 20 10:22:19 finley crmd: [25840]: info: run_graph: ====================================================
May 20 10:22:19 finley crmd: [25840]: notice: run_graph: Transition 3570 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4729.bz2): Complete
May 20 10:22:19 finley crmd: [25840]: info: te_graph_trigger: Transition 3570 is now complete
May 20 10:22:19 finley crmd: [25840]: info: notify_crmd: Transition 3570 status: done - <null>
May 20 10:22:19 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 10:22:19 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 10:22:19 finley pengine: [25839]: info: process_pe_message: Transition 3570: PEngine Input stored in: /var/lib/pengine/pe-input-4729.bz2
May 20 10:22:20 finley iSCSITarget[27280]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:22:30 finley iSCSITarget[27470]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:22:40 finley iSCSITarget[27660]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:22:50 finley iSCSITarget[27850]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:23:00 finley iSCSITarget[28040]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:23:10 finley iSCSITarget[28230]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:23:20 finley iSCSITarget[28420]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:23:30 finley iSCSITarget[28610]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:23:40 finley iSCSITarget[28800]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:23:51 finley iSCSITarget[28990]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:24:01 finley iSCSITarget[29181]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:24:11 finley iSCSITarget[29371]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:24:21 finley iSCSITarget[29561]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:24:31 finley iSCSITarget[29751]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:24:41 finley iSCSITarget[29941]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:24:51 finley iSCSITarget[30131]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:25:01 finley /USR/SBIN/CRON[30323]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 10:25:01 finley iSCSITarget[30325]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:25:07 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 107 to 109
May 20 10:25:08 finley smartd[1692]: Device: /dev/sdd [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 109 to 110
May 20 10:25:11 finley iSCSITarget[30515]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:25:21 finley iSCSITarget[30705]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:25:31 finley iSCSITarget[30895]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:25:41 finley iSCSITarget[31085]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:25:52 finley iSCSITarget[31275]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:26:02 finley iSCSITarget[31463]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:26:12 finley iSCSITarget[31653]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:26:22 finley iSCSITarget[31845]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:26:32 finley iSCSITarget[32035]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:26:42 finley iSCSITarget[32228]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:26:52 finley iSCSITarget[32418]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:27:02 finley iSCSITarget[32608]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:27:12 finley iSCSITarget[330]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:27:22 finley iSCSITarget[522]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:27:32 finley iSCSITarget[720]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:27:42 finley iSCSITarget[921]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:27:52 finley iSCSITarget[1118]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:28:03 finley iSCSITarget[1315]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:28:13 finley iSCSITarget[1506]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:28:23 finley iSCSITarget[1698]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:28:33 finley iSCSITarget[1888]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:28:43 finley iSCSITarget[2085]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:28:53 finley iSCSITarget[2291]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:29:03 finley iSCSITarget[2482]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:29:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 10:29:13 finley iSCSITarget[2672]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:29:23 finley iSCSITarget[2862]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:29:33 finley iSCSITarget[3054]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:29:43 finley iSCSITarget[3244]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:29:53 finley iSCSITarget[3434]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:30:04 finley iSCSITarget[3624]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:30:14 finley iSCSITarget[3814]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:30:24 finley iSCSITarget[4004]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:30:34 finley iSCSITarget[4194]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:30:44 finley iSCSITarget[4384]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:30:54 finley iSCSITarget[4574]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:31:04 finley iSCSITarget[4764]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:31:14 finley iSCSITarget[4954]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:31:24 finley iSCSITarget[5144]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:31:34 finley iSCSITarget[5334]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:31:44 finley iSCSITarget[5514]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:31:54 finley iSCSITarget[5704]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:32:05 finley iSCSITarget[5894]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:32:15 finley iSCSITarget[6084]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:32:25 finley iSCSITarget[6274]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:32:35 finley iSCSITarget[6468]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:32:45 finley iSCSITarget[6658]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:32:55 finley iSCSITarget[6848]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:33:05 finley iSCSITarget[7038]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:33:15 finley iSCSITarget[7228]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:33:25 finley iSCSITarget[7418]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:33:35 finley iSCSITarget[7608]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:33:45 finley iSCSITarget[7798]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:33:55 finley iSCSITarget[7988]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:34:06 finley iSCSITarget[8178]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:34:16 finley iSCSITarget[8368]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:34:26 finley iSCSITarget[8558]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:34:36 finley iSCSITarget[8750]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:34:46 finley iSCSITarget[8940]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:34:56 finley iSCSITarget[9130]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:35:01 finley /USR/SBIN/CRON[9295]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 10:35:06 finley iSCSITarget[9323]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:35:16 finley iSCSITarget[9513]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:35:26 finley iSCSITarget[9703]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:35:36 finley iSCSITarget[9893]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:35:46 finley iSCSITarget[10083]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:35:56 finley iSCSITarget[10274]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:36:06 finley iSCSITarget[10464]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:36:17 finley iSCSITarget[10654]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:36:27 finley iSCSITarget[10845]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:36:37 finley iSCSITarget[11035]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:36:47 finley iSCSITarget[11225]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:36:57 finley iSCSITarget[11416]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:37:07 finley iSCSITarget[11606]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:37:17 finley iSCSITarget[11796]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:37:19 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 10:37:19 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 10:37:19 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 10:37:19 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 10:37:19 finley crmd: [25840]: info: do_pe_invoke: Query 5578: Requesting the current CIB: S_POLICY_ENGINE
May 20 10:37:20 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5578, ref=pe_calc-dc-1305880640-6137, seq=1716, quorate=1
May 20 10:37:20 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 10:37:20 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 10:37:20 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 10:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 10:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 10:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 10:37:20 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 10:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 10:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 10:37:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 10:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 10:37:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 10:37:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 10:37:20 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 10:37:20 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 10:37:20 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 10:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 10:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:37:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 10:37:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:37:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:37:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 10:37:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:37:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:37:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 10:37:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:37:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:37:20 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 10:37:20 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 10:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 10:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 10:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 10:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 10:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 10:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 10:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 10:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 10:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 10:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 10:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 10:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 10:37:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 10:37:20 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 10:37:20 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3571: 0 actions in 0 synapses
May 20 10:37:20 finley crmd: [25840]: info: do_te_invoke: Processing graph 3571 (ref=pe_calc-dc-1305880640-6137) derived from /var/lib/pengine/pe-input-4730.bz2
May 20 10:37:20 finley crmd: [25840]: info: run_graph: ====================================================
May 20 10:37:20 finley crmd: [25840]: notice: run_graph: Transition 3571 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4730.bz2): Complete
May 20 10:37:20 finley crmd: [25840]: info: te_graph_trigger: Transition 3571 is now complete
May 20 10:37:20 finley crmd: [25840]: info: notify_crmd: Transition 3571 status: done - <null>
May 20 10:37:20 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 10:37:20 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 10:37:20 finley pengine: [25839]: info: process_pe_message: Transition 3571: PEngine Input stored in: /var/lib/pengine/pe-input-4730.bz2
May 20 10:37:27 finley iSCSITarget[11984]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:37:37 finley iSCSITarget[12174]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:37:47 finley iSCSITarget[12365]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:37:57 finley iSCSITarget[12556]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:38:07 finley iSCSITarget[12746]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:38:14 finley dhclient: DHCPREQUEST on bond0 to 192.168.24.1 port 67
May 20 10:38:14 finley dhclient: DHCPACK from 192.168.24.1
May 20 10:38:14 finley dhclient: bound to 192.168.24.11 -- renewal in 19528 seconds.
May 20 10:38:18 finley iSCSITarget[12943]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:38:28 finley iSCSITarget[13133]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:38:38 finley iSCSITarget[13323]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:38:48 finley iSCSITarget[13513]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:38:58 finley iSCSITarget[13703]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:39:08 finley iSCSITarget[13893]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:39:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (50000.00us average, 0% utilization) in the last 10min
May 20 10:39:18 finley iSCSITarget[14083]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:39:28 finley iSCSITarget[14273]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:39:38 finley iSCSITarget[14463]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:39:48 finley iSCSITarget[14653]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:39:58 finley iSCSITarget[14843]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:40:08 finley iSCSITarget[15033]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:40:19 finley iSCSITarget[15225]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:40:29 finley iSCSITarget[15415]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:40:39 finley iSCSITarget[15605]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:40:49 finley iSCSITarget[15795]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:40:59 finley iSCSITarget[15985]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:41:09 finley iSCSITarget[16175]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:41:19 finley iSCSITarget[16365]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:41:29 finley iSCSITarget[16556]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:41:39 finley iSCSITarget[16746]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:41:49 finley iSCSITarget[16936]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:41:59 finley iSCSITarget[17126]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:42:09 finley iSCSITarget[17316]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:42:20 finley iSCSITarget[17506]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:42:30 finley iSCSITarget[17696]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:42:40 finley iSCSITarget[17884]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:42:50 finley iSCSITarget[18069]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:43:00 finley iSCSITarget[18256]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:43:10 finley iSCSITarget[18446]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:43:20 finley iSCSITarget[18637]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:43:30 finley iSCSITarget[18827]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:43:40 finley iSCSITarget[19017]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:43:50 finley iSCSITarget[19208]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:44:00 finley iSCSITarget[19398]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:44:10 finley iSCSITarget[19588]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:44:21 finley iSCSITarget[19778]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:44:31 finley iSCSITarget[19968]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:44:41 finley iSCSITarget[20158]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:44:51 finley iSCSITarget[20348]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:45:01 finley iSCSITarget[20538]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:45:01 finley /USR/SBIN/CRON[20563]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 10:45:11 finley iSCSITarget[20731]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:45:21 finley iSCSITarget[20921]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:45:31 finley iSCSITarget[21111]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:45:41 finley iSCSITarget[21301]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:45:51 finley iSCSITarget[21491]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:46:01 finley iSCSITarget[21681]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:46:11 finley iSCSITarget[21871]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:46:22 finley iSCSITarget[22061]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:46:32 finley iSCSITarget[22251]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:46:42 finley iSCSITarget[22441]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:46:52 finley iSCSITarget[22631]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:47:02 finley iSCSITarget[22821]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:47:12 finley iSCSITarget[23011]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:47:22 finley iSCSITarget[23201]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:47:32 finley iSCSITarget[23391]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:47:42 finley iSCSITarget[23581]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:47:52 finley iSCSITarget[23772]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:48:02 finley iSCSITarget[23962]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:48:12 finley iSCSITarget[24152]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:48:23 finley iSCSITarget[24342]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:48:33 finley iSCSITarget[24532]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:48:43 finley iSCSITarget[24722]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:48:53 finley iSCSITarget[24913]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:49:03 finley iSCSITarget[25101]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:49:13 finley iSCSITarget[25291]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:49:23 finley iSCSITarget[25481]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:49:33 finley iSCSITarget[25675]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:49:43 finley iSCSITarget[25884]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:49:53 finley iSCSITarget[26074]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:50:03 finley iSCSITarget[26264]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:50:13 finley iSCSITarget[26454]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:50:23 finley iSCSITarget[26644]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:50:34 finley iSCSITarget[26834]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:50:44 finley iSCSITarget[27024]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:50:54 finley iSCSITarget[27217]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:51:04 finley iSCSITarget[27408]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:51:14 finley iSCSITarget[27598]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:51:24 finley iSCSITarget[27788]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:51:34 finley iSCSITarget[27978]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:51:44 finley iSCSITarget[28168]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:51:54 finley iSCSITarget[28358]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:52:04 finley iSCSITarget[28548]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:52:14 finley iSCSITarget[28738]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:52:20 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 10:52:20 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 10:52:20 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 10:52:20 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 10:52:20 finley crmd: [25840]: info: do_pe_invoke: Query 5579: Requesting the current CIB: S_POLICY_ENGINE
May 20 10:52:20 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5579, ref=pe_calc-dc-1305881540-6138, seq=1716, quorate=1
May 20 10:52:20 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 10:52:20 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 10:52:20 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 10:52:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 10:52:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 10:52:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 10:52:20 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 10:52:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 10:52:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 10:52:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 10:52:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 10:52:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 10:52:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 10:52:20 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 10:52:20 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 10:52:20 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 10:52:20 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 10:52:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:52:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:52:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 10:52:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 10:52:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:52:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:52:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 10:52:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:52:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:52:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 10:52:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 10:52:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 10:52:20 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 10:52:20 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 10:52:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 10:52:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 10:52:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 10:52:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 10:52:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 10:52:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 10:52:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 10:52:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 10:52:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 10:52:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 10:52:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 10:52:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:52:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 10:52:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 10:52:20 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 10:52:20 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3572: 0 actions in 0 synapses
May 20 10:52:20 finley crmd: [25840]: info: do_te_invoke: Processing graph 3572 (ref=pe_calc-dc-1305881540-6138) derived from /var/lib/pengine/pe-input-4731.bz2
May 20 10:52:20 finley crmd: [25840]: info: run_graph: ====================================================
May 20 10:52:20 finley crmd: [25840]: notice: run_graph: Transition 3572 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4731.bz2): Complete
May 20 10:52:20 finley crmd: [25840]: info: te_graph_trigger: Transition 3572 is now complete
May 20 10:52:20 finley crmd: [25840]: info: notify_crmd: Transition 3572 status: done - <null>
May 20 10:52:20 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 10:52:20 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 10:52:20 finley pengine: [25839]: info: process_pe_message: Transition 3572: PEngine Input stored in: /var/lib/pengine/pe-input-4731.bz2
May 20 10:52:25 finley iSCSITarget[28928]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:52:35 finley iSCSITarget[29119]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:52:45 finley iSCSITarget[29309]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:52:55 finley iSCSITarget[29499]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:53:05 finley iSCSITarget[29689]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:53:15 finley iSCSITarget[29880]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:53:25 finley iSCSITarget[30070]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:53:35 finley iSCSITarget[30261]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:53:45 finley iSCSITarget[30451]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:53:55 finley iSCSITarget[30641]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:54:05 finley iSCSITarget[30831]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:54:15 finley iSCSITarget[31021]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:54:26 finley iSCSITarget[31211]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:54:36 finley iSCSITarget[31401]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:54:46 finley iSCSITarget[31591]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:54:56 finley iSCSITarget[31783]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:55:01 finley /USR/SBIN/CRON[31940]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 10:55:06 finley iSCSITarget[31976]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:55:16 finley iSCSITarget[32157]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:55:26 finley iSCSITarget[32349]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:55:36 finley iSCSITarget[32539]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:55:46 finley iSCSITarget[32729]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:55:56 finley iSCSITarget[452]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:56:06 finley iSCSITarget[643]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:56:16 finley iSCSITarget[851]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:56:27 finley iSCSITarget[1047]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:56:37 finley iSCSITarget[1246]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:56:47 finley iSCSITarget[1437]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:56:57 finley iSCSITarget[1627]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:57:07 finley iSCSITarget[1819]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:57:17 finley iSCSITarget[2011]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:57:27 finley iSCSITarget[2216]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:57:37 finley iSCSITarget[2412]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:57:47 finley iSCSITarget[2616]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:57:57 finley iSCSITarget[2819]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:58:07 finley iSCSITarget[3011]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:58:17 finley iSCSITarget[3201]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:58:28 finley iSCSITarget[3391]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:58:38 finley iSCSITarget[3581]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:58:48 finley iSCSITarget[3771]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:58:58 finley iSCSITarget[3961]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:59:08 finley iSCSITarget[4151]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:59:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 10:59:18 finley iSCSITarget[4341]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:59:28 finley iSCSITarget[4531]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:59:38 finley iSCSITarget[4721]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:59:48 finley iSCSITarget[4911]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 10:59:58 finley iSCSITarget[5101]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:00:08 finley iSCSITarget[5291]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:00:19 finley iSCSITarget[5481]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:00:29 finley iSCSITarget[5671]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:00:39 finley iSCSITarget[5861]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:00:49 finley iSCSITarget[6051]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:00:59 finley iSCSITarget[6241]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:01:09 finley iSCSITarget[6435]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:01:19 finley iSCSITarget[6625]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:01:29 finley iSCSITarget[6815]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:01:39 finley iSCSITarget[7005]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:01:49 finley iSCSITarget[7195]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:01:59 finley iSCSITarget[7383]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:02:01 finley /USR/SBIN/CRON[7420]: (logcheck) CMD (   if [ -x /usr/sbin/logcheck ]; then nice -n10 /usr/sbin/logcheck; fi)
May 20 11:02:09 finley iSCSITarget[8538]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:02:19 finley iSCSITarget[8730]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:02:30 finley iSCSITarget[8920]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:02:40 finley iSCSITarget[9110]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:02:50 finley iSCSITarget[9300]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:03:00 finley iSCSITarget[9490]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:03:10 finley iSCSITarget[9680]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:03:20 finley iSCSITarget[9870]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:03:30 finley iSCSITarget[10060]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:03:40 finley iSCSITarget[10251]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:03:50 finley iSCSITarget[10441]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:04:00 finley iSCSITarget[10631]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:04:10 finley iSCSITarget[10822]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:04:20 finley iSCSITarget[11013]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:04:31 finley iSCSITarget[11203]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:04:41 finley iSCSITarget[11393]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:04:51 finley iSCSITarget[11583]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:05:01 finley iSCSITarget[11773]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:05:01 finley /USR/SBIN/CRON[11798]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 11:05:11 finley iSCSITarget[11966]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:05:21 finley iSCSITarget[12156]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:05:31 finley iSCSITarget[12347]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:05:41 finley iSCSITarget[12537]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:05:51 finley iSCSITarget[12728]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:06:01 finley iSCSITarget[12918]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:06:11 finley iSCSITarget[13108]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:06:21 finley iSCSITarget[13298]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:06:32 finley iSCSITarget[13488]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:06:42 finley iSCSITarget[13678]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:06:52 finley iSCSITarget[13868]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:07:02 finley iSCSITarget[14058]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:07:12 finley iSCSITarget[14246]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:07:20 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 11:07:20 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 11:07:20 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 11:07:20 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 11:07:20 finley crmd: [25840]: info: do_pe_invoke: Query 5580: Requesting the current CIB: S_POLICY_ENGINE
May 20 11:07:20 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5580, ref=pe_calc-dc-1305882440-6139, seq=1716, quorate=1
May 20 11:07:20 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 11:07:20 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 11:07:20 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 11:07:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 11:07:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 11:07:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 11:07:20 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 11:07:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 11:07:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 11:07:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 11:07:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 11:07:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 11:07:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 11:07:20 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 11:07:20 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 11:07:20 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 11:07:20 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 11:07:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:07:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:07:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:07:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 11:07:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:07:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:07:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 11:07:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:07:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:07:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 11:07:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:07:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:07:20 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 11:07:20 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 11:07:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 11:07:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 11:07:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 11:07:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 11:07:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 11:07:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 11:07:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 11:07:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 11:07:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 11:07:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 11:07:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 11:07:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:07:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 11:07:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 11:07:20 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 11:07:20 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3573: 0 actions in 0 synapses
May 20 11:07:20 finley crmd: [25840]: info: do_te_invoke: Processing graph 3573 (ref=pe_calc-dc-1305882440-6139) derived from /var/lib/pengine/pe-input-4732.bz2
May 20 11:07:20 finley crmd: [25840]: info: run_graph: ====================================================
May 20 11:07:20 finley crmd: [25840]: notice: run_graph: Transition 3573 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4732.bz2): Complete
May 20 11:07:20 finley crmd: [25840]: info: te_graph_trigger: Transition 3573 is now complete
May 20 11:07:20 finley crmd: [25840]: info: notify_crmd: Transition 3573 status: done - <null>
May 20 11:07:20 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 11:07:20 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 11:07:20 finley pengine: [25839]: info: process_pe_message: Transition 3573: PEngine Input stored in: /var/lib/pengine/pe-input-4732.bz2
May 20 11:07:22 finley iSCSITarget[14431]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:07:32 finley iSCSITarget[14618]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:07:42 finley iSCSITarget[14808]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:07:52 finley iSCSITarget[14998]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:08:02 finley iSCSITarget[15189]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:08:12 finley iSCSITarget[15379]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:08:22 finley iSCSITarget[15570]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:08:33 finley iSCSITarget[15760]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:08:43 finley iSCSITarget[15950]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:08:53 finley iSCSITarget[16140]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:09:03 finley iSCSITarget[16330]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:09:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (50000.00us average, 0% utilization) in the last 10min
May 20 11:09:13 finley iSCSITarget[16521]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:09:23 finley iSCSITarget[16711]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:09:33 finley iSCSITarget[16901]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:09:43 finley iSCSITarget[17091]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:09:53 finley iSCSITarget[17281]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:10:03 finley iSCSITarget[17471]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:10:13 finley iSCSITarget[17662]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:10:23 finley iSCSITarget[17852]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:10:34 finley iSCSITarget[18042]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:10:44 finley iSCSITarget[18232]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:10:54 finley iSCSITarget[18422]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:11:04 finley iSCSITarget[18612]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:11:14 finley iSCSITarget[18802]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:11:24 finley iSCSITarget[18992]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:11:34 finley iSCSITarget[19183]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:11:44 finley iSCSITarget[19373]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:11:54 finley iSCSITarget[19563]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:12:04 finley iSCSITarget[19753]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:12:14 finley iSCSITarget[19943]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:12:24 finley iSCSITarget[20133]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:12:35 finley iSCSITarget[20323]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:12:45 finley iSCSITarget[20513]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:12:55 finley iSCSITarget[20703]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:13:05 finley iSCSITarget[20893]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:13:15 finley iSCSITarget[21081]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:13:25 finley iSCSITarget[21271]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:13:35 finley iSCSITarget[21461]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:13:45 finley iSCSITarget[21651]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:13:55 finley iSCSITarget[21841]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:14:05 finley iSCSITarget[22031]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:14:15 finley iSCSITarget[22221]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:14:25 finley iSCSITarget[22411]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:14:36 finley iSCSITarget[22601]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:14:46 finley iSCSITarget[22791]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:14:56 finley iSCSITarget[22981]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:15:01 finley /USR/SBIN/CRON[23120]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 11:15:06 finley iSCSITarget[23174]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:15:16 finley iSCSITarget[23364]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:15:26 finley iSCSITarget[23554]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:15:35 finley lrmd: [25837]: info: rsc:ping_nodes:0:1076: monitor
May 20 11:15:36 finley iSCSITarget[23745]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:15:46 finley iSCSITarget[23935]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:15:56 finley iSCSITarget[24125]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:16:01 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1099: monitor
May 20 11:16:01 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1097: monitor
May 20 11:16:02 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1101: monitor
May 20 11:16:06 finley iSCSITarget[24315]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:16:16 finley iSCSITarget[24505]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:16:26 finley iSCSITarget[24695]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:16:37 finley iSCSITarget[24886]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:16:47 finley iSCSITarget[25076]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:16:57 finley lrmd: [25837]: info: rsc:iscsi0_target:1095: monitor
May 20 11:16:57 finley iSCSITarget[25266]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:17:01 finley /USR/SBIN/CRON[25341]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
May 20 11:17:03 finley lrmd: [25837]: info: rsc:ip_virtual0:1093: monitor
May 20 11:17:07 finley iSCSITarget[25459]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:17:17 finley iSCSITarget[25653]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:17:27 finley iSCSITarget[25862]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:17:37 finley iSCSITarget[26052]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:17:47 finley iSCSITarget[26242]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:17:57 finley iSCSITarget[26432]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:18:07 finley iSCSITarget[26622]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:18:17 finley iSCSITarget[26812]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:18:27 finley iSCSITarget[27002]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:18:37 finley iSCSITarget[27195]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:18:48 finley iSCSITarget[27376]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:18:58 finley iSCSITarget[27566]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:19:08 finley iSCSITarget[27756]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:19:18 finley iSCSITarget[27946]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:19:28 finley iSCSITarget[28136]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:19:38 finley iSCSITarget[28326]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:19:48 finley iSCSITarget[28516]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:19:58 finley iSCSITarget[28706]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:20:08 finley iSCSITarget[28896]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:20:18 finley iSCSITarget[29086]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:20:28 finley iSCSITarget[29277]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:20:38 finley iSCSITarget[29467]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:20:49 finley iSCSITarget[29657]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:20:59 finley iSCSITarget[29847]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:21:09 finley iSCSITarget[30037]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:21:19 finley iSCSITarget[30228]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:21:29 finley iSCSITarget[30418]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:21:39 finley iSCSITarget[30608]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:21:49 finley iSCSITarget[30798]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:21:59 finley iSCSITarget[30988]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:22:09 finley iSCSITarget[31178]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:22:19 finley iSCSITarget[31368]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:22:20 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 11:22:20 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 11:22:20 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 11:22:20 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 11:22:20 finley crmd: [25840]: info: do_pe_invoke: Query 5581: Requesting the current CIB: S_POLICY_ENGINE
May 20 11:22:20 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5581, ref=pe_calc-dc-1305883340-6140, seq=1716, quorate=1
May 20 11:22:20 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 11:22:20 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 11:22:20 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 11:22:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 11:22:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 11:22:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 11:22:20 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 11:22:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 11:22:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 11:22:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 11:22:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 11:22:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 11:22:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 11:22:20 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 11:22:20 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 11:22:20 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 11:22:20 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 11:22:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:22:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:22:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:22:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 11:22:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:22:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:22:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 11:22:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:22:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:22:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 11:22:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:22:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:22:20 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 11:22:20 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 11:22:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 11:22:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 11:22:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 11:22:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 11:22:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 11:22:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 11:22:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 11:22:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 11:22:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 11:22:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 11:22:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 11:22:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:22:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 11:22:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 11:22:20 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 11:22:20 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3574: 0 actions in 0 synapses
May 20 11:22:20 finley crmd: [25840]: info: do_te_invoke: Processing graph 3574 (ref=pe_calc-dc-1305883340-6140) derived from /var/lib/pengine/pe-input-4733.bz2
May 20 11:22:20 finley crmd: [25840]: info: run_graph: ====================================================
May 20 11:22:20 finley crmd: [25840]: notice: run_graph: Transition 3574 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4733.bz2): Complete
May 20 11:22:20 finley crmd: [25840]: info: te_graph_trigger: Transition 3574 is now complete
May 20 11:22:20 finley crmd: [25840]: info: notify_crmd: Transition 3574 status: done - <null>
May 20 11:22:20 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 11:22:20 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 11:22:20 finley pengine: [25839]: info: process_pe_message: Transition 3574: PEngine Input stored in: /var/lib/pengine/pe-input-4733.bz2
May 20 11:22:29 finley iSCSITarget[31558]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:22:39 finley iSCSITarget[31750]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:22:50 finley iSCSITarget[31940]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:23:00 finley iSCSITarget[32130]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:23:10 finley iSCSITarget[32323]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:23:20 finley iSCSITarget[32513]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:23:30 finley iSCSITarget[32703]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:23:40 finley iSCSITarget[426]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:23:50 finley iSCSITarget[617]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:24:00 finley iSCSITarget[823]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:24:10 finley iSCSITarget[1020]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:24:20 finley iSCSITarget[1220]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:24:30 finley iSCSITarget[1412]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:24:40 finley iSCSITarget[1602]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:24:51 finley iSCSITarget[1792]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:25:01 finley iSCSITarget[1982]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:25:01 finley /USR/SBIN/CRON[2011]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 11:25:07 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 109 to 110
May 20 11:25:11 finley iSCSITarget[2187]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:25:21 finley iSCSITarget[2387]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:25:31 finley iSCSITarget[2577]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:25:41 finley iSCSITarget[2767]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:25:51 finley iSCSITarget[2959]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:26:01 finley iSCSITarget[3149]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:26:11 finley iSCSITarget[3339]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:26:21 finley iSCSITarget[3530]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:26:31 finley iSCSITarget[3720]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:26:41 finley iSCSITarget[3910]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:26:52 finley iSCSITarget[4100]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:27:02 finley iSCSITarget[4290]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:27:12 finley iSCSITarget[4480]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:27:22 finley iSCSITarget[4670]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:27:32 finley iSCSITarget[4860]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:27:42 finley iSCSITarget[5050]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:27:52 finley iSCSITarget[5240]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:28:02 finley iSCSITarget[5430]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:28:12 finley iSCSITarget[5620]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:28:22 finley iSCSITarget[5811]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:28:32 finley iSCSITarget[6001]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:28:42 finley iSCSITarget[6191]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:28:53 finley iSCSITarget[6382]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:29:03 finley iSCSITarget[6575]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:29:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 11:29:13 finley iSCSITarget[6765]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:29:23 finley iSCSITarget[6955]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:29:33 finley iSCSITarget[7145]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:29:43 finley iSCSITarget[7335]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:29:53 finley iSCSITarget[7525]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:30:03 finley iSCSITarget[7715]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:30:13 finley iSCSITarget[7905]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:30:23 finley iSCSITarget[8095]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:30:33 finley iSCSITarget[8285]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:30:43 finley iSCSITarget[8465]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:30:54 finley iSCSITarget[8657]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:31:04 finley iSCSITarget[8847]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:31:14 finley iSCSITarget[9037]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:31:24 finley iSCSITarget[9227]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:31:34 finley iSCSITarget[9417]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:31:44 finley iSCSITarget[9607]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:31:54 finley iSCSITarget[9797]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:32:04 finley iSCSITarget[9987]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:32:14 finley iSCSITarget[10178]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:32:24 finley iSCSITarget[10368]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:32:34 finley iSCSITarget[10558]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:32:44 finley iSCSITarget[10749]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:32:55 finley iSCSITarget[10939]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:33:05 finley iSCSITarget[11129]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:33:15 finley iSCSITarget[11319]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:33:25 finley iSCSITarget[11509]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:33:35 finley iSCSITarget[11699]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:33:45 finley iSCSITarget[11889]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:33:55 finley iSCSITarget[12079]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:34:05 finley iSCSITarget[12269]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:34:15 finley iSCSITarget[12460]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:34:25 finley iSCSITarget[12651]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:34:35 finley iSCSITarget[12841]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:34:45 finley iSCSITarget[13031]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:34:55 finley iSCSITarget[13221]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:35:01 finley /USR/SBIN/CRON[13362]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 11:35:06 finley iSCSITarget[13414]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:35:16 finley iSCSITarget[13604]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:35:26 finley iSCSITarget[13794]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:35:36 finley iSCSITarget[13984]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:35:46 finley iSCSITarget[14174]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:35:56 finley iSCSITarget[14364]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:36:06 finley iSCSITarget[14552]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:36:16 finley iSCSITarget[14742]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:36:26 finley iSCSITarget[14932]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:36:36 finley iSCSITarget[15124]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:36:46 finley iSCSITarget[15314]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:36:56 finley iSCSITarget[15504]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:37:07 finley iSCSITarget[15694]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:37:17 finley iSCSITarget[15884]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:37:20 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 11:37:20 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 11:37:20 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 11:37:20 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 11:37:20 finley crmd: [25840]: info: do_pe_invoke: Query 5582: Requesting the current CIB: S_POLICY_ENGINE
May 20 11:37:20 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5582, ref=pe_calc-dc-1305884240-6141, seq=1716, quorate=1
May 20 11:37:20 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 11:37:20 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 11:37:20 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 11:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 11:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 11:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 11:37:20 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 11:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 11:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 11:37:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 11:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 11:37:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 11:37:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 11:37:20 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 11:37:20 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 11:37:20 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 11:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 11:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:37:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 11:37:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:37:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:37:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 11:37:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:37:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:37:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 11:37:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:37:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:37:20 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 11:37:20 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 11:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 11:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 11:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 11:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 11:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 11:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 11:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 11:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 11:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 11:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 11:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 11:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 11:37:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 11:37:20 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 11:37:20 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3575: 0 actions in 0 synapses
May 20 11:37:20 finley crmd: [25840]: info: do_te_invoke: Processing graph 3575 (ref=pe_calc-dc-1305884240-6141) derived from /var/lib/pengine/pe-input-4734.bz2
May 20 11:37:20 finley crmd: [25840]: info: run_graph: ====================================================
May 20 11:37:20 finley crmd: [25840]: notice: run_graph: Transition 3575 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4734.bz2): Complete
May 20 11:37:20 finley crmd: [25840]: info: te_graph_trigger: Transition 3575 is now complete
May 20 11:37:20 finley crmd: [25840]: info: notify_crmd: Transition 3575 status: done - <null>
May 20 11:37:20 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 11:37:20 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 11:37:21 finley pengine: [25839]: info: process_pe_message: Transition 3575: PEngine Input stored in: /var/lib/pengine/pe-input-4734.bz2
May 20 11:37:27 finley iSCSITarget[16074]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:37:37 finley iSCSITarget[16264]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:37:47 finley iSCSITarget[16455]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:37:57 finley iSCSITarget[16645]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:38:07 finley iSCSITarget[16835]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:38:17 finley iSCSITarget[17026]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:38:27 finley iSCSITarget[17216]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:38:37 finley iSCSITarget[17406]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:38:47 finley iSCSITarget[17596]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:38:57 finley iSCSITarget[17786]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:39:08 finley iSCSITarget[17976]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:39:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 11:39:18 finley iSCSITarget[18166]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:39:28 finley iSCSITarget[18356]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:39:38 finley iSCSITarget[18546]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:39:48 finley iSCSITarget[18736]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:39:58 finley iSCSITarget[18926]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:40:08 finley iSCSITarget[19116]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:40:18 finley iSCSITarget[19307]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:40:28 finley iSCSITarget[19497]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:40:38 finley iSCSITarget[19687]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:40:48 finley iSCSITarget[19877]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:40:58 finley iSCSITarget[20067]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:41:09 finley iSCSITarget[20257]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:41:19 finley iSCSITarget[20447]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:41:29 finley iSCSITarget[20637]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:41:39 finley iSCSITarget[20817]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:41:49 finley iSCSITarget[21007]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:41:59 finley iSCSITarget[21197]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:42:09 finley iSCSITarget[21387]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:42:19 finley iSCSITarget[21577]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:42:29 finley iSCSITarget[21767]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:42:39 finley iSCSITarget[21957]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:42:49 finley iSCSITarget[22147]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:42:59 finley iSCSITarget[22337]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:43:10 finley iSCSITarget[22527]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:43:20 finley iSCSITarget[22717]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:43:30 finley iSCSITarget[22907]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:43:40 finley iSCSITarget[23097]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:43:50 finley iSCSITarget[23287]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:44:00 finley iSCSITarget[23477]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:44:10 finley iSCSITarget[23667]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:44:20 finley iSCSITarget[23858]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:44:30 finley iSCSITarget[24048]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:44:40 finley iSCSITarget[24238]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:44:50 finley iSCSITarget[24428]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:45:00 finley iSCSITarget[24619]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:45:01 finley /USR/SBIN/CRON[24682]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 11:45:11 finley iSCSITarget[24812]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:45:21 finley iSCSITarget[25003]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:45:31 finley iSCSITarget[25193]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:45:41 finley iSCSITarget[25383]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:45:51 finley iSCSITarget[25577]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:46:01 finley iSCSITarget[25775]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:46:11 finley iSCSITarget[26004]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:46:21 finley iSCSITarget[26194]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:46:31 finley iSCSITarget[26384]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:46:41 finley iSCSITarget[26574]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:46:51 finley iSCSITarget[26764]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:47:01 finley iSCSITarget[26954]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:47:11 finley iSCSITarget[27147]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:47:22 finley iSCSITarget[27337]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:47:32 finley iSCSITarget[27528]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:47:42 finley iSCSITarget[27716]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:47:52 finley iSCSITarget[27906]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:48:02 finley iSCSITarget[28096]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:48:12 finley iSCSITarget[28286]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:48:22 finley iSCSITarget[28477]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:48:32 finley iSCSITarget[28667]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:48:42 finley iSCSITarget[28857]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:48:52 finley iSCSITarget[29047]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:49:02 finley iSCSITarget[29238]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:49:12 finley iSCSITarget[29428]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:49:23 finley iSCSITarget[29618]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:49:33 finley iSCSITarget[29808]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:49:43 finley iSCSITarget[29998]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:49:53 finley iSCSITarget[30189]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:50:03 finley iSCSITarget[30379]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:50:13 finley iSCSITarget[30569]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:50:23 finley iSCSITarget[30759]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:50:33 finley iSCSITarget[30949]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:50:43 finley iSCSITarget[31139]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:50:53 finley iSCSITarget[31329]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:51:03 finley iSCSITarget[31519]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:51:13 finley iSCSITarget[31709]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:51:24 finley iSCSITarget[31901]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:51:34 finley iSCSITarget[32091]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:51:44 finley iSCSITarget[32284]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:51:54 finley iSCSITarget[32474]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:52:04 finley iSCSITarget[32664]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:52:14 finley iSCSITarget[387]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:52:20 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 11:52:20 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 11:52:20 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 11:52:20 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 11:52:20 finley crmd: [25840]: info: do_pe_invoke: Query 5583: Requesting the current CIB: S_POLICY_ENGINE
May 20 11:52:21 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5583, ref=pe_calc-dc-1305885141-6142, seq=1716, quorate=1
May 20 11:52:21 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 11:52:21 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 11:52:21 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 11:52:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 11:52:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 11:52:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 11:52:21 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 11:52:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 11:52:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 11:52:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 11:52:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 11:52:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 11:52:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 11:52:21 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 11:52:21 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 11:52:21 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 11:52:21 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 11:52:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:52:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:52:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 11:52:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 11:52:21 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:52:21 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:52:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 11:52:21 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:52:21 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:52:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 11:52:21 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 11:52:21 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 11:52:21 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 11:52:21 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 11:52:21 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 11:52:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 11:52:21 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 11:52:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 11:52:21 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 11:52:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 11:52:21 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 11:52:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 11:52:21 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 11:52:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 11:52:21 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 11:52:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:52:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 11:52:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 11:52:21 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 11:52:21 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3576: 0 actions in 0 synapses
May 20 11:52:21 finley crmd: [25840]: info: do_te_invoke: Processing graph 3576 (ref=pe_calc-dc-1305885141-6142) derived from /var/lib/pengine/pe-input-4735.bz2
May 20 11:52:21 finley crmd: [25840]: info: run_graph: ====================================================
May 20 11:52:21 finley crmd: [25840]: notice: run_graph: Transition 3576 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4735.bz2): Complete
May 20 11:52:21 finley crmd: [25840]: info: te_graph_trigger: Transition 3576 is now complete
May 20 11:52:21 finley crmd: [25840]: info: notify_crmd: Transition 3576 status: done - <null>
May 20 11:52:21 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 11:52:21 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 11:52:21 finley pengine: [25839]: info: process_pe_message: Transition 3576: PEngine Input stored in: /var/lib/pengine/pe-input-4735.bz2
May 20 11:52:24 finley iSCSITarget[578]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:52:34 finley iSCSITarget[781]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:52:44 finley iSCSITarget[977]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:52:54 finley iSCSITarget[1178]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:53:04 finley iSCSITarget[1363]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:53:14 finley iSCSITarget[1552]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:53:25 finley iSCSITarget[1744]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:53:35 finley iSCSITarget[1934]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:53:45 finley iSCSITarget[2136]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:53:55 finley iSCSITarget[2336]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:54:05 finley iSCSITarget[2526]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:54:15 finley iSCSITarget[2716]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:54:25 finley iSCSITarget[2907]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:54:35 finley iSCSITarget[3098]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:54:45 finley iSCSITarget[3288]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:54:55 finley iSCSITarget[3478]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:55:01 finley /USR/SBIN/CRON[3591]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 11:55:05 finley iSCSITarget[3671]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:55:08 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 110 to 109
May 20 11:55:15 finley iSCSITarget[3861]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:55:26 finley iSCSITarget[4051]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:55:36 finley iSCSITarget[4241]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:55:46 finley iSCSITarget[4431]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:55:56 finley iSCSITarget[4621]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:56:06 finley iSCSITarget[4811]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:56:16 finley iSCSITarget[5001]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:56:26 finley iSCSITarget[5191]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:56:36 finley iSCSITarget[5382]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:56:46 finley iSCSITarget[5573]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:56:56 finley iSCSITarget[5763]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:57:06 finley iSCSITarget[5953]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:57:16 finley iSCSITarget[6143]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:57:26 finley iSCSITarget[6334]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:57:37 finley iSCSITarget[6527]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:57:47 finley iSCSITarget[6717]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:57:57 finley iSCSITarget[6907]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:58:07 finley iSCSITarget[7097]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:58:17 finley iSCSITarget[7287]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:58:27 finley iSCSITarget[7475]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:58:37 finley iSCSITarget[7665]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:58:47 finley iSCSITarget[7855]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:58:57 finley iSCSITarget[8045]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:59:07 finley iSCSITarget[8235]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:59:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 11:59:17 finley iSCSITarget[8425]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:59:27 finley iSCSITarget[8615]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:59:38 finley iSCSITarget[8807]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:59:48 finley iSCSITarget[8997]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 11:59:58 finley iSCSITarget[9187]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:00:08 finley iSCSITarget[9377]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:00:18 finley iSCSITarget[9567]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:00:28 finley iSCSITarget[9757]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:00:38 finley iSCSITarget[9947]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:00:48 finley iSCSITarget[10137]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:00:58 finley iSCSITarget[10328]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:01:08 finley iSCSITarget[10518]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:01:18 finley iSCSITarget[10709]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:01:28 finley iSCSITarget[10899]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:01:39 finley iSCSITarget[11089]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:01:49 finley iSCSITarget[11279]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:01:59 finley iSCSITarget[11469]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:02:01 finley /USR/SBIN/CRON[11508]: (logcheck) CMD (   if [ -x /usr/sbin/logcheck ]; then nice -n10 /usr/sbin/logcheck; fi)
May 20 12:02:09 finley iSCSITarget[12626]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:02:19 finley iSCSITarget[12816]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:02:29 finley iSCSITarget[13006]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:02:39 finley iSCSITarget[13196]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:02:40 finley tgtd: conn_close(100) connection closed, 0x1b9f018 1
May 20 12:02:40 finley tgtd: conn_close(106) sesson 0x1bae5f0 1
May 20 12:02:49 finley iSCSITarget[13386]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:02:59 finley iSCSITarget[13576]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:03:09 finley iSCSITarget[13766]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:03:19 finley iSCSITarget[13956]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:03:29 finley iSCSITarget[14146]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:03:39 finley iSCSITarget[14336]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:03:50 finley iSCSITarget[14516]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:04:00 finley iSCSITarget[14706]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:04:10 finley iSCSITarget[14896]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:04:20 finley iSCSITarget[15086]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:04:30 finley iSCSITarget[15276]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:04:40 finley iSCSITarget[15466]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:04:50 finley iSCSITarget[15656]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:05:00 finley iSCSITarget[15846]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:05:01 finley /USR/SBIN/CRON[15881]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 12:05:10 finley iSCSITarget[16039]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:05:20 finley iSCSITarget[16229]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:05:30 finley iSCSITarget[16420]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:05:40 finley iSCSITarget[16610]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:05:51 finley iSCSITarget[16800]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:06:01 finley iSCSITarget[16990]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:06:11 finley iSCSITarget[17180]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:06:21 finley iSCSITarget[17370]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:06:31 finley iSCSITarget[17560]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:06:41 finley iSCSITarget[17750]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:06:51 finley iSCSITarget[17940]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:07:01 finley iSCSITarget[18130]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:07:11 finley iSCSITarget[18320]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:07:21 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 12:07:21 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 12:07:21 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 12:07:21 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 12:07:21 finley crmd: [25840]: info: do_pe_invoke: Query 5584: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:07:21 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5584, ref=pe_calc-dc-1305886041-6143, seq=1716, quorate=1
May 20 12:07:21 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:07:21 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:07:21 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:07:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:07:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:07:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:07:21 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:07:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:07:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:07:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 12:07:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:07:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 12:07:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 12:07:21 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 12:07:21 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:07:21 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:07:21 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:07:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:07:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:07:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:07:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:07:21 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:07:21 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:07:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:07:21 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:07:21 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:07:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:07:21 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:07:21 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:07:21 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:07:21 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 12:07:21 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:07:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:07:21 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:07:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:07:21 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:07:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:07:21 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:07:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:07:21 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:07:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:07:21 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:07:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:07:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:07:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:07:21 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:07:21 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3577: 0 actions in 0 synapses
May 20 12:07:21 finley crmd: [25840]: info: do_te_invoke: Processing graph 3577 (ref=pe_calc-dc-1305886041-6143) derived from /var/lib/pengine/pe-input-4736.bz2
May 20 12:07:21 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:07:21 finley crmd: [25840]: notice: run_graph: Transition 3577 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4736.bz2): Complete
May 20 12:07:21 finley crmd: [25840]: info: te_graph_trigger: Transition 3577 is now complete
May 20 12:07:21 finley crmd: [25840]: info: notify_crmd: Transition 3577 status: done - <null>
May 20 12:07:21 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:07:21 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:07:21 finley pengine: [25839]: info: process_pe_message: Transition 3577: PEngine Input stored in: /var/lib/pengine/pe-input-4736.bz2
May 20 12:07:21 finley iSCSITarget[18510]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:07:31 finley iSCSITarget[18700]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:07:41 finley iSCSITarget[18890]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:07:52 finley iSCSITarget[19080]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:08:02 finley iSCSITarget[19271]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:08:12 finley iSCSITarget[19461]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:08:22 finley iSCSITarget[19651]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:08:32 finley iSCSITarget[19841]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:08:42 finley iSCSITarget[20031]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:08:52 finley iSCSITarget[20221]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:09:02 finley iSCSITarget[20411]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:09:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 12:09:12 finley iSCSITarget[20601]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:09:22 finley iSCSITarget[20791]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:09:32 finley iSCSITarget[20981]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:09:42 finley iSCSITarget[21171]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:09:52 finley iSCSITarget[21359]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:10:03 finley iSCSITarget[21549]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:10:13 finley iSCSITarget[21739]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:10:23 finley iSCSITarget[21929]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:10:33 finley iSCSITarget[22119]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:10:43 finley iSCSITarget[22309]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:10:53 finley iSCSITarget[22499]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:11:03 finley iSCSITarget[22689]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:11:13 finley iSCSITarget[22879]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:11:23 finley iSCSITarget[23069]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:11:33 finley iSCSITarget[23259]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:11:43 finley iSCSITarget[23449]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:11:54 finley iSCSITarget[23639]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:12:04 finley iSCSITarget[23830]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:12:14 finley iSCSITarget[24020]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:12:24 finley iSCSITarget[24210]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:12:34 finley iSCSITarget[24400]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:12:44 finley iSCSITarget[24590]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:12:54 finley iSCSITarget[24780]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:13:04 finley iSCSITarget[24971]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:13:14 finley iSCSITarget[25161]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:13:24 finley iSCSITarget[25351]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:13:34 finley iSCSITarget[25543]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:13:44 finley iSCSITarget[25735]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:13:54 finley iSCSITarget[25944]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:14:05 finley iSCSITarget[26134]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:14:15 finley iSCSITarget[26324]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:14:25 finley iSCSITarget[26514]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:14:35 finley iSCSITarget[26704]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:14:45 finley iSCSITarget[26894]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:14:55 finley iSCSITarget[27086]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:15:01 finley /USR/SBIN/CRON[27166]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 12:15:05 finley iSCSITarget[27281]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:15:15 finley iSCSITarget[27471]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:15:25 finley iSCSITarget[27661]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:15:35 finley lrmd: [25837]: info: rsc:ping_nodes:0:1076: monitor
May 20 12:15:35 finley iSCSITarget[27851]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:15:45 finley iSCSITarget[28031]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:15:55 finley iSCSITarget[28221]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:16:01 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1099: monitor
May 20 12:16:02 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1097: monitor
May 20 12:16:02 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1101: monitor
May 20 12:16:06 finley iSCSITarget[28411]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:16:16 finley iSCSITarget[28601]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:16:26 finley iSCSITarget[28791]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:16:36 finley iSCSITarget[28981]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:16:46 finley iSCSITarget[29172]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:16:56 finley iSCSITarget[29362]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:17:01 finley /USR/SBIN/CRON[29449]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
May 20 12:17:06 finley lrmd: [25837]: info: rsc:iscsi0_target:1095: monitor
May 20 12:17:06 finley iSCSITarget[29555]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:17:10 finley lrmd: [25837]: info: rsc:ip_virtual0:1093: monitor
May 20 12:17:16 finley iSCSITarget[29745]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:17:26 finley iSCSITarget[29935]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:17:36 finley iSCSITarget[30125]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:17:46 finley iSCSITarget[30316]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:17:56 finley iSCSITarget[30506]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:18:07 finley iSCSITarget[30696]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:18:17 finley iSCSITarget[30886]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:18:27 finley iSCSITarget[31076]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:18:37 finley iSCSITarget[31266]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:18:47 finley iSCSITarget[31456]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:18:57 finley iSCSITarget[31646]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:19:07 finley iSCSITarget[31838]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:19:17 finley iSCSITarget[32028]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:19:27 finley iSCSITarget[32220]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:19:37 finley iSCSITarget[32411]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:19:47 finley iSCSITarget[32601]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:19:57 finley iSCSITarget[323]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:20:08 finley iSCSITarget[515]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:20:18 finley iSCSITarget[712]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:20:28 finley iSCSITarget[914]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:20:38 finley iSCSITarget[1111]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:20:48 finley iSCSITarget[1308]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:20:58 finley iSCSITarget[1499]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:21:08 finley iSCSITarget[1689]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:21:18 finley iSCSITarget[1881]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:21:28 finley iSCSITarget[2078]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:21:30 finley cib: [25836]: info: ais_dispatch: Membership 1720: quorum retained
May 20 12:21:30 finley cib: [25836]: info: crm_new_peer: Node <null> now has id: 18393280
May 20 12:21:30 finley cib: [25836]: info: crm_update_peer: Node (null): id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1720 proc=00000000000000000000000000000000
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 1720: memb=2, new=0, lost=0
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: finley 186165440
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: godfrey 270051520
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 1720: memb=3, new=1, lost=0
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] info: update_member: Creating entry for node 18393280 born on 1720
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] info: update_member: Node 18393280/unknown is now: member
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: NEW:  .pending. 18393280
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: .pending. 18393280
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: finley 186165440
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: godfrey 270051520
May 20 12:21:30 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1720 to 2 children
May 20 12:21:30 finley corosync[25820]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
May 20 12:21:30 finley crmd: [25840]: info: ais_dispatch: Membership 1720: quorum retained
May 20 12:21:30 finley crmd: [25840]: info: crm_new_peer: Node <null> now has id: 18393280
May 20 12:21:30 finley crmd: [25840]: info: crm_update_peer: Node (null): id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1720 proc=00000000000000000000000000000000
May 20 12:21:30 finley corosync[25820]:   [MAIN  ] Completed service synchronization, ready to provide service.
May 20 12:21:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5585, version=0.2123.26): ok (rc=0)
May 20 12:21:31 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 2
May 20 12:21:31 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5588, version=0.2123.26): ok (rc=0)
May 20 12:21:38 finley iSCSITarget[2283]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:21:48 finley iSCSITarget[2473]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:21:58 finley iSCSITarget[2661]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:22:08 finley iSCSITarget[2851]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:22:19 finley iSCSITarget[3043]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:22:21 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 12:22:21 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 12:22:21 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 12:22:21 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 12:22:21 finley crmd: [25840]: info: do_pe_invoke: Query 5589: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:22:21 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5589, ref=pe_calc-dc-1305886941-6145, seq=1720, quorate=1
May 20 12:22:21 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:22:21 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:22:21 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:22:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:22:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:22:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:22:21 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:22:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:22:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:22:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:2 (ORPHAN)
May 20 12:22:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:22:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:2 (ORPHAN)
May 20 12:22:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:2 (ORPHAN)
May 20 12:22:21 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:2 (ORPHAN)
May 20 12:22:21 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:22:21 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:22:21 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:22:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:22:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:22:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:22:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:22:21 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:22:21 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:22:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:22:21 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:22:21 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:22:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:22:21 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:22:21 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:22:21 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:22:21 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 12:22:21 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:22:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:22:21 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:22:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:22:21 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:22:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:22:21 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:22:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:22:21 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:22:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:22:21 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:22:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:22:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:22:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:22:21 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:22:21 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3578: 0 actions in 0 synapses
May 20 12:22:21 finley crmd: [25840]: info: do_te_invoke: Processing graph 3578 (ref=pe_calc-dc-1305886941-6145) derived from /var/lib/pengine/pe-input-4737.bz2
May 20 12:22:21 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:22:21 finley crmd: [25840]: notice: run_graph: Transition 3578 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4737.bz2): Complete
May 20 12:22:21 finley crmd: [25840]: info: te_graph_trigger: Transition 3578 is now complete
May 20 12:22:21 finley crmd: [25840]: info: notify_crmd: Transition 3578 status: done - <null>
May 20 12:22:21 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:22:21 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:22:21 finley pengine: [25839]: info: process_pe_message: Transition 3578: PEngine Input stored in: /var/lib/pengine/pe-input-4737.bz2
May 20 12:22:29 finley iSCSITarget[3233]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:22:39 finley iSCSITarget[3423]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:22:49 finley iSCSITarget[3613]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:22:59 finley iSCSITarget[3803]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:23:09 finley iSCSITarget[3993]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:23:19 finley iSCSITarget[4183]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:23:29 finley iSCSITarget[4373]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:23:39 finley iSCSITarget[4563]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:23:49 finley iSCSITarget[4753]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:23:59 finley iSCSITarget[4944]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:24:09 finley iSCSITarget[5134]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:24:20 finley iSCSITarget[5324]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:24:30 finley iSCSITarget[5514]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:24:40 finley iSCSITarget[5704]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:24:50 finley iSCSITarget[5894]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:25:00 finley iSCSITarget[6084]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:25:01 finley /USR/SBIN/CRON[6111]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 12:25:10 finley iSCSITarget[6277]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:25:20 finley iSCSITarget[6471]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:25:30 finley iSCSITarget[6661]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:25:40 finley iSCSITarget[6851]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:25:50 finley iSCSITarget[7041]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:26:00 finley iSCSITarget[7231]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:26:10 finley iSCSITarget[7421]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:26:20 finley iSCSITarget[7611]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:26:31 finley iSCSITarget[7801]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:26:41 finley iSCSITarget[7991]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:26:51 finley iSCSITarget[8181]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:27:01 finley iSCSITarget[8371]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:27:11 finley iSCSITarget[8561]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:27:21 finley iSCSITarget[8751]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:27:31 finley iSCSITarget[8941]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:27:39 finley crmd: [25840]: info: ais_dispatch: Membership 1724: quorum retained
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 1724: memb=2, new=0, lost=1
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: finley 186165440
May 20 12:27:39 finley crmd: [25840]: info: crm_update_peer: Node (null): id=18393280 state=lost (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1720 proc=00000000000000000000000000000000
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: godfrey 270051520
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: lost: .pending. 18393280
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 1724: memb=2, new=0, lost=0
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: finley 186165440
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: godfrey 270051520
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] info: ais_mark_unseen_peer_dead: Node (null) was not seen in the previous transition
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] info: update_member: Node 18393280/unknown is now: lost
May 20 12:27:39 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1724 to 2 children
May 20 12:27:39 finley corosync[25820]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
May 20 12:27:39 finley cib: [25836]: info: ais_dispatch: Membership 1724: quorum retained
May 20 12:27:39 finley cib: [25836]: info: crm_update_peer: Node (null): id=18393280 state=lost (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1720 proc=00000000000000000000000000000000
May 20 12:27:39 finley corosync[25820]:   [MAIN  ] Completed service synchronization, ready to provide service.
May 20 12:27:39 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5590, version=0.2123.26): ok (rc=0)
May 20 12:27:39 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 2
May 20 12:27:39 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5593, version=0.2123.26): ok (rc=0)
May 20 12:27:41 finley iSCSITarget[9123]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:27:51 finley iSCSITarget[9313]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:28:01 finley iSCSITarget[9521]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:28:11 finley iSCSITarget[9711]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:28:21 finley iSCSITarget[9901]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:28:32 finley iSCSITarget[10091]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:28:42 finley iSCSITarget[10282]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:28:52 finley iSCSITarget[10472]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:29:02 finley iSCSITarget[10662]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:29:11 finley cib: [25836]: info: cib_stats: Processed 9 operations (42222.00us average, 0% utilization) in the last 10min
May 20 12:29:12 finley iSCSITarget[10853]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:29:22 finley iSCSITarget[11043]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:29:32 finley iSCSITarget[11233]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:29:42 finley iSCSITarget[11423]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 1728: memb=2, new=0, lost=0
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: finley 186165440
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: godfrey 270051520
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 1728: memb=3, new=1, lost=0
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] info: update_member: Node 18393280/unknown is now: member
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: NEW:  .pending. 18393280
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: .pending. 18393280
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: finley 186165440
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: godfrey 270051520
May 20 12:29:45 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1728 to 2 children
May 20 12:29:45 finley cib: [25836]: info: ais_dispatch: Membership 1728: quorum retained
May 20 12:29:45 finley cib: [25836]: info: crm_update_peer: Node (null): id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1728 proc=00000000000000000000000000000000
May 20 12:29:45 finley corosync[25820]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
May 20 12:29:45 finley crmd: [25840]: info: ais_dispatch: Membership 1728: quorum retained
May 20 12:29:45 finley crmd: [25840]: info: crm_update_peer: Node (null): id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1728 proc=00000000000000000000000000000000
May 20 12:29:45 finley corosync[25820]:   [MAIN  ] Completed service synchronization, ready to provide service.
May 20 12:29:45 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5594, version=0.2123.26): ok (rc=0)
May 20 12:29:45 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 2
May 20 12:29:45 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5597, version=0.2123.26): ok (rc=0)
May 20 12:29:52 finley iSCSITarget[11613]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:30:02 finley iSCSITarget[11803]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:30:12 finley iSCSITarget[11993]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:30:22 finley iSCSITarget[12183]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:30:33 finley iSCSITarget[12374]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:30:43 finley iSCSITarget[12565]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:30:53 finley iSCSITarget[12755]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:31:03 finley iSCSITarget[12945]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:31:13 finley iSCSITarget[13135]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:31:18 finley cib: [25836]: info: ais_dispatch: Membership 1732: quorum retained
May 20 12:31:18 finley cib: [25836]: info: crm_update_peer: Node (null): id=18393280 state=lost (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1728 proc=00000000000000000000000000000000
May 20 12:31:18 finley crmd: [25840]: info: ais_dispatch: Membership 1732: quorum retained
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 1732: memb=2, new=0, lost=1
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: finley 186165440
May 20 12:31:18 finley crmd: [25840]: info: crm_update_peer: Node (null): id=18393280 state=lost (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1728 proc=00000000000000000000000000000000
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: godfrey 270051520
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: lost: .pending. 18393280
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 1732: memb=2, new=0, lost=0
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: finley 186165440
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: godfrey 270051520
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] info: ais_mark_unseen_peer_dead: Node (null) was not seen in the previous transition
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] info: update_member: Node 18393280/unknown is now: lost
May 20 12:31:18 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1732 to 2 children
May 20 12:31:18 finley corosync[25820]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
May 20 12:31:18 finley corosync[25820]:   [MAIN  ] Completed service synchronization, ready to provide service.
May 20 12:31:18 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5598, version=0.2123.26): ok (rc=0)
May 20 12:31:18 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 2
May 20 12:31:18 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5601, version=0.2123.26): ok (rc=0)
May 20 12:31:23 finley iSCSITarget[13325]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:31:33 finley iSCSITarget[13515]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:31:43 finley iSCSITarget[13705]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:31:53 finley iSCSITarget[13895]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:32:03 finley iSCSITarget[14085]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:32:13 finley iSCSITarget[14275]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:32:23 finley iSCSITarget[14465]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:32:34 finley iSCSITarget[14655]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:32:44 finley iSCSITarget[14845]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:32:54 finley iSCSITarget[15035]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:33:04 finley iSCSITarget[15225]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:33:14 finley iSCSITarget[15415]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:33:24 finley iSCSITarget[15605]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:33:34 finley iSCSITarget[15795]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:33:44 finley iSCSITarget[15985]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:33:54 finley iSCSITarget[16175]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:34:04 finley iSCSITarget[16363]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:34:14 finley iSCSITarget[16554]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:34:24 finley iSCSITarget[16744]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:34:35 finley iSCSITarget[16934]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:34:45 finley iSCSITarget[17132]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:34:55 finley iSCSITarget[17342]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:35:01 finley /USR/SBIN/CRON[17403]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 12:35:03 finley cib: [25836]: info: ais_dispatch: Membership 1736: quorum retained
May 20 12:35:03 finley cib: [25836]: info: crm_update_peer: Node (null): id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1736 proc=00000000000000000000000000000000
May 20 12:35:03 finley crmd: [25840]: info: ais_dispatch: Membership 1736: quorum retained
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 1736: memb=2, new=0, lost=0
May 20 12:35:03 finley crmd: [25840]: info: crm_update_peer: Node (null): id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1736 proc=00000000000000000000000000000000
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: finley 186165440
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: godfrey 270051520
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 1736: memb=3, new=1, lost=0
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] info: update_member: Node 18393280/unknown is now: member
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: NEW:  .pending. 18393280
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: .pending. 18393280
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: finley 186165440
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: godfrey 270051520
May 20 12:35:03 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1736 to 2 children
May 20 12:35:03 finley corosync[25820]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
May 20 12:35:03 finley corosync[25820]:   [MAIN  ] Completed service synchronization, ready to provide service.
May 20 12:35:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5602, version=0.2123.26): ok (rc=0)
May 20 12:35:03 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 2
May 20 12:35:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5605, version=0.2123.26): ok (rc=0)
May 20 12:35:05 finley iSCSITarget[17535]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:35:15 finley iSCSITarget[17725]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:35:25 finley iSCSITarget[17915]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:35:35 finley iSCSITarget[18105]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:35:45 finley iSCSITarget[18295]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:35:55 finley iSCSITarget[18485]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:36:05 finley iSCSITarget[18675]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:36:15 finley iSCSITarget[18885]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:36:25 finley iSCSITarget[19080]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:36:36 finley iSCSITarget[19270]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:36:46 finley iSCSITarget[19460]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:36:56 finley iSCSITarget[19650]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:37:06 finley iSCSITarget[19840]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:37:12 finley cib: [25836]: info: ais_dispatch: Membership 1740: quorum retained
May 20 12:37:12 finley cib: [25836]: info: crm_update_peer: Node (null): id=18393280 state=lost (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1736 proc=00000000000000000000000000000000
May 20 12:37:12 finley crmd: [25840]: info: ais_dispatch: Membership 1740: quorum retained
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 1740: memb=2, new=0, lost=1
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: finley 186165440
May 20 12:37:12 finley crmd: [25840]: info: crm_update_peer: Node (null): id=18393280 state=lost (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1736 proc=00000000000000000000000000000000
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: godfrey 270051520
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: lost: .pending. 18393280
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 1740: memb=2, new=0, lost=0
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: finley 186165440
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: godfrey 270051520
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] info: ais_mark_unseen_peer_dead: Node (null) was not seen in the previous transition
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] info: update_member: Node 18393280/unknown is now: lost
May 20 12:37:12 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1740 to 2 children
May 20 12:37:12 finley corosync[25820]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
May 20 12:37:12 finley corosync[25820]:   [MAIN  ] Completed service synchronization, ready to provide service.
May 20 12:37:12 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5606, version=0.2123.26): ok (rc=0)
May 20 12:37:12 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 2
May 20 12:37:12 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5609, version=0.2123.26): ok (rc=0)
May 20 12:37:15 finley cib: [25836]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:37:15 finley cib: [25836]: info: crm_update_peer: Node (null): id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1744 proc=00000000000000000000000000000000
May 20 12:37:15 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:37:15 finley crmd: [25840]: info: crm_update_peer: Node (null): id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=0 born=0 seen=1744 proc=00000000000000000000000000000000
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 1744: memb=2, new=0, lost=0
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: finley 186165440
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: godfrey 270051520
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 1744: memb=3, new=1, lost=0
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: update_member: Node 18393280/unknown is now: member
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: NEW:  .pending. 18393280
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: .pending. 18393280
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: finley 186165440
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: godfrey 270051520
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1744 to 2 children
May 20 12:37:15 finley corosync[25820]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: update_member: 0x7ffe78021dd0 Node 18393280 (ebony) born on: 1744
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: update_member: 0x7ffe78021dd0 Node 18393280 now known as ebony (was: (null))
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: update_member: Node ebony now has process list: 00000000000000000000000000013312 (78610)
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: update_member: Node ebony now has 1 quorum votes (was 0)
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: update_expected_votes: Expected quorum votes 2 -> 3
May 20 12:37:15 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1744 to 2 children
May 20 12:37:15 finley corosync[25820]:   [MAIN  ] Completed service synchronization, ready to provide service.
May 20 12:37:15 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5610, version=0.2123.26): ok (rc=0)
May 20 12:37:15 finley cib: [25836]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:37:15 finley cib: [25836]: info: crm_get_peer: Node 18393280 is now known as ebony
May 20 12:37:15 finley cib: [25836]: info: crm_update_peer: Node ebony: id=18393280 state=member addr=r(0) ip(192.168.24.1)  votes=1 (new) born=1744 seen=1744 proc=00000000000000000000000000013312 (new)
May 20 12:37:15 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 2
May 20 12:37:15 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:37:15 finley crmd: [25840]: info: crm_get_peer: Node 18393280 is now known as ebony
May 20 12:37:15 finley crmd: [25840]: info: ais_status_callback: status: ebony is now member
May 20 12:37:15 finley crmd: [25840]: info: crm_update_peer: Node ebony: id=18393280 state=member addr=r(0) ip(192.168.24.1)  votes=1 (new) born=1744 seen=1744 proc=00000000000000000000000000013312 (new)
May 20 12:37:15 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5613, version=0.2123.26): ok (rc=0)
May 20 12:37:15 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2123" num_updates="26" />
May 20 12:37:15 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2124" num_updates="1" >
May 20 12:37:15 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:37:15 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 12:37:15 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="ebony" uname="ebony" type="normal" __crm_diff_marker__="added:top" />
May 20 12:37:15 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 12:37:15 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:37:15 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:37:15 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5614, version=0.2124.1): ok (rc=0)
May 20 12:37:15 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:37:15 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 12:37:15 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:37:15 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:37:15 finley crmd: [25840]: info: do_state_transition: Membership changed: 1716 -> 1744 - join restart
May 20 12:37:15 finley crmd: [25840]: info: do_pe_invoke: Query 5618: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:37:15 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_FSA_INTERNAL origin=do_state_transition ]
May 20 12:37:15 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 12:37:15 finley crmd: [25840]: info: join_make_offer: Making join offers based on membership 1744
May 20 12:37:15 finley crmd: [25840]: info: do_dc_join_offer_all: join-31: Waiting on 3 outstanding join acks
May 20 12:37:15 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2124" num_updates="2" >
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="2" id="cib-bootstrap-options-expected-quorum-votes" />
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2125" num_updates="1" >
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="3" id="cib-bootstrap-options-expected-quorum-votes" />
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:37:16 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:37:16 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5617, version=0.2125.1): ok (rc=0)
May 20 12:37:16 finley cib: [20030]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-40.raw
May 20 12:37:16 finley cib: [20030]: info: write_cib_contents: Wrote version 0.2125.0 of the CIB to disk (digest: 841d3db60df4fa714b6b8221d99f0410)
May 20 12:37:16 finley cib: [20030]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.zL5EBB (digest: /var/lib/heartbeat/crm/cib.FXWmmr)
May 20 12:37:16 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync_one for section 'all' (origin=ebony/ebony/(null), version=0.2125.1): ok (rc=0)
May 20 12:37:16 finley iSCSITarget[20031]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:37:18 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 12:37:18 finley crmd: [25840]: info: do_dc_join_offer_all: A new node joined the cluster
May 20 12:37:18 finley crmd: [25840]: info: do_dc_join_offer_all: join-32: Waiting on 3 outstanding join acks
May 20 12:37:18 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 12:37:18 finley crmd: [25840]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 12:37:18 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes responded to the join offer.
May 20 12:37:18 finley crmd: [25840]: info: do_dc_join_finalize: join-32: Syncing the CIB from finley to the rest of the cluster
May 20 12:37:18 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/5621, version=0.2125.1): ok (rc=0)
May 20 12:37:18 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5622, version=0.2125.1): ok (rc=0)
May 20 12:37:18 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5623, version=0.2125.1): ok (rc=0)
May 20 12:37:18 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5624, version=0.2125.1): ok (rc=0)
May 20 12:37:18 finley crmd: [25840]: info: do_dc_join_ack: join-32: Updating node state to member for godfrey
May 20 12:37:18 finley crmd: [25840]: info: do_dc_join_ack: join-32: Updating node state to member for finley
May 20 12:37:18 finley crmd: [25840]: info: do_dc_join_ack: join-32: Updating node state to member for ebony
May 20 12:37:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/transient_attributes (origin=ebony/crmd/6, version=0.2125.1): ok (rc=0)
May 20 12:37:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']/lrm (origin=local/crmd/5625, version=0.2125.2): ok (rc=0)
May 20 12:37:19 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='godfrey']/lrm": ok (rc=0)
May 20 12:37:19 finley crmd: [25840]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 12:37:19 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:37:19 finley crmd: [25840]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
May 20 12:37:19 finley crmd: [25840]: info: crm_update_quorum: Updating quorum status to true (call=5633)
May 20 12:37:19 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
May 20 12:37:19 finley crmd: [25840]: info: do_pe_invoke: Query 5634: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:37:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']/lrm (origin=local/crmd/5627, version=0.2125.4): ok (rc=0)
May 20 12:37:19 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:0;12:5:7:b91d50c5-2309-4f96-ae7b-3bf7b28386fa, cib=0.2125.4) : Resource op removal
May 20 12:37:19 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='finley']/lrm": ok (rc=0)
May 20 12:37:19 finley crmd: [25840]: info: do_pe_invoke: Query 5635: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:37:19 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 15 resources updated: Skipping all resource events
May 20 12:37:19 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2125.5) : LRM Refresh
May 20 12:37:19 finley crmd: [25840]: info: do_pe_invoke: Query 5636: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:37:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/lrm (origin=local/crmd/5629, version=0.2125.5): ok (rc=0)
May 20 12:37:19 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='ebony']/lrm": ok (rc=0)
May 20 12:37:20 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5631, version=0.2125.6): ok (rc=0)
May 20 12:37:20 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5633, version=0.2125.6): ok (rc=0)
May 20 12:37:20 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5636, ref=pe_calc-dc-1305887840-6165, seq=1744, quorate=1
May 20 12:37:20 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:37:20 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:37:20 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:37:20 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:37:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:37:20 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:37:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:37:20 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:37:20 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:37:20 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 12:37:20 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:37:20 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:20 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:37:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:37:20 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:37:20 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 12:37:20 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 12:37:20 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:37:20 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:37:20 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:37:20 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:37:20 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:20 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:20 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:2 on ebony
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:37:20 finley pengine: [25839]: notice: LogActions: Start ping_nodes:2#011(ebony)
May 20 12:37:20 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:37:20 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3579: 15 actions in 15 synapses
May 20 12:37:20 finley crmd: [25840]: info: do_te_invoke: Processing graph 3579 (ref=pe_calc-dc-1305887840-6165) derived from /var/lib/pengine/pe-input-4738.bz2
May 20 12:37:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 16: monitor ip_virtual0_monitor_0 on ebony
May 20 12:37:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 17: monitor iscsi0_target_monitor_0 on ebony
May 20 12:37:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 18: monitor iscsi0_lun0_monitor_0 on ebony
May 20 12:37:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 19: monitor iscsi0_lun1_monitor_0 on ebony
May 20 12:37:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 20: monitor iscsi0_lun2_monitor_0 on ebony
May 20 12:37:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 21: monitor drbd_r0:0_monitor_0 on ebony
May 20 12:37:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 22: monitor drbd_r1:0_monitor_0 on ebony
May 20 12:37:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 23: monitor drbd_r2:0_monitor_0 on ebony
May 20 12:37:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 24: monitor ping_nodes:2_monitor_0 on ebony
May 20 12:37:20 finley pengine: [25839]: info: process_pe_message: Transition 3579: PEngine Input stored in: /var/lib/pengine/pe-input-4738.bz2
May 20 12:37:21 finley attrd: [25838]: info: crm_new_peer: Node ebony now has id: 18393280
May 20 12:37:21 finley attrd: [25838]: info: crm_new_peer: Node 18393280 is now known as ebony
May 20 12:37:21 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (16) confirmed on ebony (rc=0)
May 20 12:37:22 finley crmd: [25840]: WARN: status_from_rc: Action 17 (iscsi0_target_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:37:22 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:5;17:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2125.8) : Event failed
May 20 12:37:22 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1
May 20 12:37:22 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:37:22 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (17) confirmed on ebony (rc=4)
May 20 12:37:22 finley crmd: [25840]: WARN: status_from_rc: Action 18 (iscsi0_lun0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:37:22 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:5;18:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2125.9) : Event failed
May 20 12:37:22 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (18) confirmed on ebony (rc=4)
May 20 12:37:22 finley attrd: [25838]: info: attrd_local_callback: Sending full refresh (origin=crmd)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (20)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 12:37:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 12:37:23 finley crmd: [25840]: WARN: status_from_rc: Action 21 (drbd_r0:0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:37:23 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r0:0_monitor_0, magic=0:5;21:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2125.10) : Event failed
May 20 12:37:23 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_monitor_0 (21) confirmed on ebony (rc=4)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 12:37:23 finley crmd: [25840]: WARN: status_from_rc: Action 22 (drbd_r1:0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:37:23 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:5;22:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2125.11) : Event failed
May 20 12:37:23 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_monitor_0 (22) confirmed on ebony (rc=4)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (<null>)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 12:37:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (<null>)
May 20 12:37:23 finley crmd: [25840]: WARN: status_from_rc: Action 19 (iscsi0_lun1_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:37:23 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:5;19:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2125.12) : Event failed
May 20 12:37:23 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (19) confirmed on ebony (rc=4)
May 20 12:37:23 finley crmd: [25840]: WARN: status_from_rc: Action 23 (drbd_r2:0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:37:23 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r2:0_monitor_0, magic=0:5;23:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2125.13) : Event failed
May 20 12:37:23 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_monitor_0 (23) confirmed on ebony (rc=4)
May 20 12:37:24 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:2_monitor_0 (24) confirmed on ebony (rc=0)
May 20 12:37:24 finley crmd: [25840]: WARN: status_from_rc: Action 20 (iscsi0_lun2_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:37:24 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:5;20:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2125.15) : Event failed
May 20 12:37:24 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (20) confirmed on ebony (rc=4)
May 20 12:37:24 finley crmd: [25840]: info: te_rsc_command: Initiating action 15: probe_complete probe_complete on ebony - no waiting
May 20 12:37:24 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:37:24 finley crmd: [25840]: notice: run_graph: Transition 3579 (Complete=10, Pending=0, Fired=0, Skipped=4, Incomplete=1, Source=/var/lib/pengine/pe-input-4738.bz2): Stopped
May 20 12:37:24 finley crmd: [25840]: info: te_graph_trigger: Transition 3579 is now complete
May 20 12:37:24 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:37:24 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:37:24 finley crmd: [25840]: info: do_pe_invoke: Query 5637: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:37:24 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5637, ref=pe_calc-dc-1305887844-6176, seq=1744, quorate=1
May 20 12:37:24 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:37:24 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:37:24 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:37:24 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:37:24 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:37:24 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:37:24 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:37:24 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:37:24 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:37:24 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:37:24 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:37:24 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:37:24 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:37:24 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:37:24 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:37:24 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:37:24 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:24 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:24 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:24 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:37:24 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:37:24 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:37:24 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 12:37:24 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 12:37:24 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:37:24 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:37:24 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:37:24 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:37:24 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:37:24 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:37:24 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:37:24 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:37:24 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:37:24 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:37:24 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:37:24 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:37:24 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:37:24 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:37:24 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:24 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:24 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:2 on ebony
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:37:24 finley pengine: [25839]: notice: LogActions: Start ping_nodes:2#011(ebony)
May 20 12:37:24 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:37:24 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3580: 5 actions in 5 synapses
May 20 12:37:24 finley crmd: [25840]: info: do_te_invoke: Processing graph 3580 (ref=pe_calc-dc-1305887844-6176) derived from /var/lib/pengine/pe-input-4739.bz2
May 20 12:37:24 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 129 fired and confirmed
May 20 12:37:24 finley crmd: [25840]: info: te_rsc_command: Initiating action 15: probe_complete probe_complete on ebony - no waiting
May 20 12:37:24 finley crmd: [25840]: info: te_rsc_command: Initiating action 127: start ping_nodes:2_start_0 on ebony
May 20 12:37:24 finley pengine: [25839]: info: process_pe_message: Transition 3580: PEngine Input stored in: /var/lib/pengine/pe-input-4739.bz2
May 20 12:37:24 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=ebony, magic=NA, cib=0.2125.16) : Transient attribute: update
May 20 12:37:24 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 12:37:24 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:37:26 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:2_start_0 (127) confirmed on ebony (rc=0)
May 20 12:37:26 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 130 fired and confirmed
May 20 12:37:26 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:37:26 finley crmd: [25840]: notice: run_graph: Transition 3580 (Complete=4, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pengine/pe-input-4739.bz2): Stopped
May 20 12:37:26 finley crmd: [25840]: info: te_graph_trigger: Transition 3580 is now complete
May 20 12:37:26 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:37:26 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:37:26 finley crmd: [25840]: info: do_pe_invoke: Query 5638: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:37:26 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5638, ref=pe_calc-dc-1305887846-6179, seq=1744, quorate=1
May 20 12:37:26 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:37:26 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:37:26 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:37:26 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:37:26 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:37:26 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:37:26 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:37:26 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:37:26 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:37:26 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:37:26 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:37:26 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:37:26 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:37:26 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:37:26 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:37:26 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:37:26 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:26 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:26 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:26 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:37:26 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:37:26 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:37:26 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:37:26 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 12:37:26 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:37:26 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:37:26 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:37:26 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:37:26 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:37:26 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:37:26 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:37:26 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:37:26 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:37:26 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:37:26 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:37:26 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:37:26 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:37:26 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:37:26 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:26 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:26 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:2 on ebony
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:37:26 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 12:37:26 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:37:26 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3581: 1 actions in 1 synapses
May 20 12:37:26 finley crmd: [25840]: info: do_te_invoke: Processing graph 3581 (ref=pe_calc-dc-1305887846-6179) derived from /var/lib/pengine/pe-input-4740.bz2
May 20 12:37:26 finley crmd: [25840]: info: te_rsc_command: Initiating action 129: monitor ping_nodes:2_monitor_1000 on ebony
May 20 12:37:26 finley iSCSITarget[20275]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:37:26 finley pengine: [25839]: info: process_pe_message: Transition 3581: PEngine Input stored in: /var/lib/pengine/pe-input-4740.bz2
May 20 12:37:27 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=ebony, magic=NA, cib=0.2125.18) : Transient attribute: update
May 20 12:37:27 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 12:37:27 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:37:27 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:2_monitor_1000 (129) confirmed on ebony (rc=0)
May 20 12:37:27 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:37:27 finley crmd: [25840]: notice: run_graph: Transition 3581 (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4740.bz2): Complete
May 20 12:37:27 finley crmd: [25840]: info: te_graph_trigger: Transition 3581 is now complete
May 20 12:37:27 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:37:27 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:37:27 finley crmd: [25840]: info: do_pe_invoke: Query 5639: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:37:27 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5639, ref=pe_calc-dc-1305887847-6181, seq=1744, quorate=1
May 20 12:37:27 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:37:27 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:37:27 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:37:27 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:37:27 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:37:27 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:37:27 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:37:27 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:37:27 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:37:27 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:37:27 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:37:27 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:37:27 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:37:27 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:37:27 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:37:27 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:37:27 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:27 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:27 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:37:27 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:37:27 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:37:27 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:37:27 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:37:27 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 12:37:27 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:37:27 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:37:27 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:37:27 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:37:27 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:37:27 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:37:27 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:37:27 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:37:27 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:37:27 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:37:27 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:37:27 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:37:27 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:37:27 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:37:27 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:27 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:37:27 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 12:37:27 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:37:27 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3582: 0 actions in 0 synapses
May 20 12:37:27 finley crmd: [25840]: info: do_te_invoke: Processing graph 3582 (ref=pe_calc-dc-1305887847-6181) derived from /var/lib/pengine/pe-input-4741.bz2
May 20 12:37:27 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:37:27 finley crmd: [25840]: notice: run_graph: Transition 3582 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4741.bz2): Complete
May 20 12:37:27 finley crmd: [25840]: info: te_graph_trigger: Transition 3582 is now complete
May 20 12:37:27 finley crmd: [25840]: info: notify_crmd: Transition 3582 status: done - <null>
May 20 12:37:27 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:37:27 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:37:27 finley pengine: [25839]: info: process_pe_message: Transition 3582: PEngine Input stored in: /var/lib/pengine/pe-input-4741.bz2
May 20 12:37:36 finley iSCSITarget[20465]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:37:46 finley iSCSITarget[20656]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:37:56 finley iSCSITarget[20846]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:38:06 finley iSCSITarget[21036]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2125" num_updates="19" />
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2126" num_updates="1" >
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="ebony" >
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-ebony" __crm_diff_marker__="added:top" >
May 20 12:38:10 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 12:38:10 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: +           <nvpair id="nodes-ebony-standby" name="standby" value="on" />
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: +         </instance_attributes>
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: +       </node>
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 12:38:10 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:38:10 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:38:10 finley crmd: [25840]: info: do_pe_invoke: Query 5640: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:38:10 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:38:10 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=ebony/crm_attribute/5, version=0.2126.1): ok (rc=0)
May 20 12:38:10 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5640, ref=pe_calc-dc-1305887890-6182, seq=1744, quorate=1
May 20 12:38:10 finley cib: [21074]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-41.raw
May 20 12:38:10 finley cib: [21074]: info: write_cib_contents: Wrote version 0.2126.0 of the CIB to disk (digest: 608dd6803a9186e676f008d91232e4b9)
May 20 12:38:10 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:38:10 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:38:10 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:38:10 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:38:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:38:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:38:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:38:10 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:38:10 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:38:10 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:38:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:38:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:38:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:38:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:38:10 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:38:10 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:38:10 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:38:10 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:38:10 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:38:10 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:38:10 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:38:10 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:38:10 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:38:10 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:38:10 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 12:38:10 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:38:10 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:38:10 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:38:10 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:38:10 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:38:10 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:38:10 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:38:10 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:38:10 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:38:10 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:38:10 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:38:10 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:38:10 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:38:10 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:38:10 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:38:10 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:38:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:38:10 finley pengine: [25839]: notice: LogActions: Stop resource ping_nodes:2#011(ebony)
May 20 12:38:10 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:38:10 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3583: 4 actions in 4 synapses
May 20 12:38:10 finley crmd: [25840]: info: do_te_invoke: Processing graph 3583 (ref=pe_calc-dc-1305887890-6182) derived from /var/lib/pengine/pe-input-4742.bz2
May 20 12:38:10 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 131 fired and confirmed
May 20 12:38:10 finley crmd: [25840]: info: te_rsc_command: Initiating action 128: stop ping_nodes:2_stop_0 on ebony
May 20 12:38:10 finley cib: [21074]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.bgVY7b (digest: /var/lib/heartbeat/crm/cib.pJC0oC)
May 20 12:38:10 finley pengine: [25839]: info: process_pe_message: Transition 3583: PEngine Input stored in: /var/lib/pengine/pe-input-4742.bz2
May 20 12:38:11 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:2_stop_0 (128) confirmed on ebony (rc=0)
May 20 12:38:11 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 132 fired and confirmed
May 20 12:38:11 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 12 fired and confirmed
May 20 12:38:11 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:38:11 finley crmd: [25840]: notice: run_graph: Transition 3583 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4742.bz2): Complete
May 20 12:38:11 finley crmd: [25840]: info: te_graph_trigger: Transition 3583 is now complete
May 20 12:38:11 finley crmd: [25840]: info: notify_crmd: Transition 3583 status: done - <null>
May 20 12:38:11 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:38:11 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:38:12 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=1, tag=transient_attributes, id=ebony, magic=NA, cib=0.2126.3) : Transient attribute: removal
May 20 12:38:12 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:38:12 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:38:12 finley crmd: [25840]: info: do_pe_invoke: Query 5641: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:38:12 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5641, ref=pe_calc-dc-1305887892-6184, seq=1744, quorate=1
May 20 12:38:12 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:38:12 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:38:12 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:38:12 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:38:12 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:38:12 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:38:12 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:38:12 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:38:12 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:38:12 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:38:12 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:38:12 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:38:12 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:38:12 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:38:12 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:38:12 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:38:12 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:38:12 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:38:12 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:38:12 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:38:12 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:38:12 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:38:12 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:38:12 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 12:38:12 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 12:38:12 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:38:12 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:38:12 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:38:12 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:38:12 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:38:12 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:38:12 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:38:12 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:38:12 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:38:12 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:38:12 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:38:12 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:38:12 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:38:12 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:38:12 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:38:12 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:38:12 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave godfrey)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave godfrey)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave godfrey)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:38:12 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:38:12 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:38:12 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3584: 0 actions in 0 synapses
May 20 12:38:12 finley crmd: [25840]: info: do_te_invoke: Processing graph 3584 (ref=pe_calc-dc-1305887892-6184) derived from /var/lib/pengine/pe-input-4743.bz2
May 20 12:38:12 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:38:12 finley crmd: [25840]: notice: run_graph: Transition 3584 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4743.bz2): Complete
May 20 12:38:12 finley crmd: [25840]: info: te_graph_trigger: Transition 3584 is now complete
May 20 12:38:12 finley crmd: [25840]: info: notify_crmd: Transition 3584 status: done - <null>
May 20 12:38:12 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:38:12 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:38:12 finley pengine: [25839]: info: process_pe_message: Transition 3584: PEngine Input stored in: /var/lib/pengine/pe-input-4743.bz2
May 20 12:38:16 finley iSCSITarget[21227]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:38:26 finley iSCSITarget[21417]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:38:37 finley iSCSITarget[21605]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:38:47 finley iSCSITarget[21791]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:38:57 finley iSCSITarget[21978]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:39:01 finley cibadmin: [22058]: info: Invoked: cibadmin -Ql 
May 20 12:39:02 finley cibadmin: [22062]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:02 finley cibadmin: [22064]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:02 finley crm_resource: [22066]: info: Invoked: crm_resource -W -r ip_virtual0 
May 20 12:39:02 finley cibadmin: [22068]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:02 finley cibadmin: [22070]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:02 finley crm_resource: [22072]: info: Invoked: crm_resource -W -r iscsi0_target 
May 20 12:39:02 finley cibadmin: [22074]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:02 finley cibadmin: [22076]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:02 finley crm_resource: [22078]: info: Invoked: crm_resource -W -r iscsi0_lun0 
May 20 12:39:03 finley cibadmin: [22080]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:03 finley cibadmin: [22082]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:03 finley crm_resource: [22084]: info: Invoked: crm_resource -W -r iscsi0_lun1 
May 20 12:39:03 finley cibadmin: [22096]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:03 finley cibadmin: [22098]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:03 finley crm_resource: [22100]: info: Invoked: crm_resource -W -r iscsi0_lun2 
May 20 12:39:03 finley cibadmin: [22102]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:03 finley cibadmin: [22117]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:03 finley crm_resource: [22132]: info: Invoked: crm_resource -W -r ms_drbd_r0 
May 20 12:39:03 finley cibadmin: [22134]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:03 finley cibadmin: [22136]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:03 finley crm_resource: [22138]: info: Invoked: crm_resource -W -r ms_drbd_r1 
May 20 12:39:03 finley cibadmin: [22140]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:04 finley cibadmin: [22142]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:04 finley crm_resource: [22147]: info: Invoked: crm_resource -W -r ms_drbd_r2 
May 20 12:39:04 finley cibadmin: [22172]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:04 finley cibadmin: [22174]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:04 finley crm_resource: [22176]: info: Invoked: crm_resource -W -r ping_clone 
May 20 12:39:04 finley cibadmin: [22180]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:04 finley cibadmin: [22182]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:04 finley cibadmin: [22184]: info: Invoked: cibadmin -Ql 
May 20 12:39:05 finley crm_shadow: [22222]: info: Invoked: crm_shadow -c __crmshell.22036 
May 20 12:39:05 finley cibadmin: [22224]: info: Invoked: cibadmin -p -R -o crm_config 
May 20 12:39:05 finley cibadmin: [22236]: info: Invoked: cibadmin -p -R -o rsc_defaults 
May 20 12:39:05 finley crm_shadow: [22238]: info: Invoked: crm_shadow -C __crmshell.22036 --force 
May 20 12:39:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_replace for section 'all' (origin=local/crm_shadow/2, version=0.2126.3): ok (rc=0)
May 20 12:39:05 finley crm_shadow: [22240]: info: Invoked: crm_shadow -D __crmshell.22036 --force 
May 20 12:39:05 finley cibadmin: [22242]: info: Invoked: cibadmin -Ql 
May 20 12:39:07 finley iSCSITarget[22273]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:39:11 finley cib: [25836]: info: cib_stats: Processed 313 operations (19137.00us average, 0% utilization) in the last 10min
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2126" num_updates="3" >
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="godfrey" >
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-godfrey" >
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: -           <nvpair value="off" id="nodes-godfrey-standby" />
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: -         </instance_attributes>
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: -       </node>
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:39:13 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:39:13 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2127" num_updates="1" >
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 12:39:13 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="godfrey" >
May 20 12:39:13 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-godfrey" >
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: +           <nvpair value="on" id="nodes-godfrey-standby" />
May 20 12:39:13 finley crmd: [25840]: info: do_pe_invoke: Query 5642: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: +         </instance_attributes>
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: +       </node>
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:39:13 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:39:13 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=godfrey/crm_attribute/4, version=0.2127.1): ok (rc=0)
May 20 12:39:13 finley cib: [22344]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-42.raw
May 20 12:39:13 finley cib: [22344]: info: write_cib_contents: Wrote version 0.2127.0 of the CIB to disk (digest: df6f2d2e1bed131817ff598abe4f1720)
May 20 12:39:13 finley cib: [22344]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.1Fj1k3 (digest: /var/lib/heartbeat/crm/cib.x1m5Ok)
May 20 12:39:13 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5642, ref=pe_calc-dc-1305887953-6185, seq=1744, quorate=1
May 20 12:39:13 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:13 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:13 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:13 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:13 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:13 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:13 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:13 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:13 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:39:13 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:13 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:13 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:13 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:13 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:13 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:13 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:13 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:39:13 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:39:13 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:13 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:13 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:13 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:13 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:13 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:13 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 12:39:13 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 12:39:13 finley pengine: [25839]: info: native_color: Resource drbd_r0:1 cannot run anywhere
May 20 12:39:13 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:13 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:39:13 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:39:13 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 12:39:13 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:13 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:39:13 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:39:13 finley pengine: [25839]: info: native_color: Resource drbd_r2:1 cannot run anywhere
May 20 12:39:13 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:13 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:39:13 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:39:13 finley pengine: [25839]: info: master_color: Promoting drbd_r0:0 (Master finley)
May 20 12:39:13 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 1 instances of a possible 1 to master
May 20 12:39:13 finley pengine: [25839]: info: master_color: Promoting drbd_r1:0 (Master finley)
May 20 12:39:13 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 1 instances of a possible 1 to master
May 20 12:39:13 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:39:13 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:39:13 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:13 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:13 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Started finley)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Started finley)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Started finley)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Started finley)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Started finley)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Master finley)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r0:1#011(godfrey)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Master finley)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r1:1#011(godfrey)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r2:1#011(godfrey)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Stop resource ping_nodes:1#011(godfrey)
May 20 12:39:13 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:13 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:39:13 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3585: 34 actions in 34 synapses
May 20 12:39:13 finley crmd: [25840]: info: do_te_invoke: Processing graph 3585 (ref=pe_calc-dc-1305887953-6185) derived from /var/lib/pengine/pe-input-4744.bz2
May 20 12:39:13 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 43 fired and confirmed
May 20 12:39:13 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 72 fired and confirmed
May 20 12:39:13 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 101 fired and confirmed
May 20 12:39:13 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 122 fired and confirmed
May 20 12:39:13 finley crmd: [25840]: info: te_rsc_command: Initiating action 168: notify drbd_r0:0_pre_notify_stop_0 on finley (local)
May 20 12:39:13 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=168:3585:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_notify_0 )
May 20 12:39:13 finley lrmd: [25837]: info: rsc:drbd_r0:0:1114: notify
May 20 12:39:13 finley crmd: [25840]: info: te_rsc_command: Initiating action 170: notify drbd_r0:1_pre_notify_stop_0 on godfrey
May 20 12:39:13 finley crmd: [25840]: info: te_rsc_command: Initiating action 179: notify drbd_r1:0_pre_notify_stop_0 on finley (local)
May 20 12:39:13 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=179:3585:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_notify_0 )
May 20 12:39:13 finley lrmd: [25837]: info: rsc:drbd_r1:0:1115: notify
May 20 12:39:13 finley crmd: [25840]: info: te_rsc_command: Initiating action 181: notify drbd_r1:1_pre_notify_stop_0 on godfrey
May 20 12:39:13 finley crmd: [25840]: info: te_rsc_command: Initiating action 190: notify drbd_r2:0_pre_notify_stop_0 on finley (local)
May 20 12:39:13 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=190:3585:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_notify_0 )
May 20 12:39:13 finley crmd: [25840]: info: te_rsc_command: Initiating action 192: notify drbd_r2:1_pre_notify_stop_0 on godfrey
May 20 12:39:13 finley crmd: [25840]: info: te_rsc_command: Initiating action 119: stop ping_nodes:1_stop_0 on godfrey
May 20 12:39:13 finley pengine: [25839]: info: process_pe_message: Transition 3585: PEngine Input stored in: /var/lib/pengine/pe-input-4744.bz2
May 20 12:39:13 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:1_pre_notify_stop_0 (192) confirmed on godfrey (rc=0)
May 20 12:39:13 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:1_pre_notify_stop_0 (170) confirmed on godfrey (rc=0)
May 20 12:39:13 finley drbd[22347]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:13 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_notify_0 (call=1115, rc=0, cib-update=5643, confirmed=true) ok
May 20 12:39:13 finley drbd[22346]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:14 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:1_pre_notify_stop_0 (181) confirmed on godfrey (rc=0)
May 20 12:39:14 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_notify_0 (call=1114, rc=0, cib-update=5644, confirmed=true) ok
May 20 12:39:14 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_pre_notify_stop_0 (179) confirmed on finley (rc=0)
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 73 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 70 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: te_rsc_command: Initiating action 63: stop drbd_r1:1_stop_0 on godfrey
May 20 12:39:14 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_pre_notify_stop_0 (168) confirmed on finley (rc=0)
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 44 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 41 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: te_rsc_command: Initiating action 34: stop drbd_r0:1_stop_0 on godfrey
May 20 12:39:14 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:1_stop_0 (119) confirmed on godfrey (rc=0)
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 123 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: WARN: status_from_rc: Action 63 (drbd_r1:1_stop_0) on godfrey failed (target: 0 vs. rc: 6): Error
May 20 12:39:14 finley crmd: [25840]: WARN: update_failcount: Updating failcount for drbd_r1:1 on godfrey after failed stop: rc=6 (update=INFINITY, time=1305887954)
May 20 12:39:14 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r1:1_stop_0, magic=0:6;63:3585:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2127.8) : Event failed
May 20 12:39:14 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1
May 20 12:39:14 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:39:14 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:1_stop_0 (63) confirmed on godfrey (rc=4)
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 71 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 74 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: te_rsc_command: Initiating action 180: notify drbd_r1:0_post_notify_stop_0 on finley (local)
May 20 12:39:14 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=180:3585:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_notify_0 )
May 20 12:39:14 finley lrmd: [25837]: info: rsc:drbd_r1:0:1117: notify
May 20 12:39:14 finley crmd: [25840]: WARN: status_from_rc: Action 34 (drbd_r0:1_stop_0) on godfrey failed (target: 0 vs. rc: 6): Error
May 20 12:39:14 finley crmd: [25840]: WARN: update_failcount: Updating failcount for drbd_r0:1 on godfrey after failed stop: rc=6 (update=INFINITY, time=1305887954)
May 20 12:39:14 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r0:1_stop_0, magic=0:6;34:3585:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2127.9) : Event failed
May 20 12:39:14 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:1_stop_0 (34) confirmed on godfrey (rc=4)
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 42 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 45 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: te_rsc_command: Initiating action 169: notify drbd_r0:0_post_notify_stop_0 on finley (local)
May 20 12:39:14 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=169:3585:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_notify_0 )
May 20 12:39:14 finley lrmd: [25837]: info: rsc:drbd_r0:0:1118: notify
May 20 12:39:14 finley drbd[22438]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:14 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_notify_0 (call=1117, rc=0, cib-update=5645, confirmed=true) ok
May 20 12:39:14 finley drbd[22443]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:14 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_post_notify_stop_0 (180) confirmed on finley (rc=0)
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 75 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_notify_0 (call=1118, rc=0, cib-update=5646, confirmed=true) ok
May 20 12:39:14 finley attrd: [25838]: info: find_hash_entry: Creating hash entry for fail-count-drbd_r1:1
May 20 12:39:14 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_post_notify_stop_0 (169) confirmed on finley (rc=0)
May 20 12:39:14 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 46 fired and confirmed
May 20 12:39:14 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2127.12) : Transient attribute: update
May 20 12:39:14 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 1 to 1000000
May 20 12:39:14 finley crmd: [25840]: info: update_abort_priority: 'Event failed' abort superceeded
May 20 12:39:14 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2127.13) : Transient attribute: update
May 20 12:39:14 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2127.14) : Transient attribute: update
May 20 12:39:14 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2127.15) : Transient attribute: update
May 20 12:39:14 finley attrd: [25838]: info: find_hash_entry: Creating hash entry for last-failure-drbd_r1:1
May 20 12:39:14 finley attrd: [25838]: info: find_hash_entry: Creating hash entry for fail-count-drbd_r0:1
May 20 12:39:14 finley attrd: [25838]: info: find_hash_entry: Creating hash entry for last-failure-drbd_r0:1
May 20 12:39:14 finley lrmd: [25837]: info: rsc:drbd_r2:0:1116: notify
May 20 12:39:14 finley drbd[22508]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:14 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_notify_0 (call=1116, rc=0, cib-update=5647, confirmed=true) ok
May 20 12:39:14 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_pre_notify_stop_0 (190) confirmed on finley (rc=0)
May 20 12:39:14 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:39:14 finley crmd: [25840]: notice: run_graph: Transition 3585 (Complete=26, Pending=0, Fired=0, Skipped=4, Incomplete=4, Source=/var/lib/pengine/pe-input-4744.bz2): Stopped
May 20 12:39:14 finley crmd: [25840]: info: te_graph_trigger: Transition 3585 is now complete
May 20 12:39:14 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:39:14 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:14 finley crmd: [25840]: info: do_pe_invoke: Query 5648: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:15 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5648, ref=pe_calc-dc-1305887955-6197, seq=1744, quorate=1
May 20 12:39:15 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:15 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:15 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:15 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:15 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:15 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:15 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:15 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:15 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:15 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:15 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:39:15 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:15 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:15 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:15 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:15 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r0:0 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r1:0 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r2:1 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource ip_virtual0#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_target#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_lun0#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_lun1#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_lun2#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Demote drbd_r0:0#011(Master -> Stopped finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r0:0#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Demote drbd_r1:0#011(Master -> Stopped finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r1:0#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r2:1#011(godfrey)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_stop_0 comeplete before ms_drbd_r0_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_pre_notify_stop_0 comeplete before ms_drbd_r0_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_post_notify_stop_0 comeplete before ms_drbd_r0_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_stop_0 comeplete before ms_drbd_r1_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_pre_notify_stop_0 comeplete before ms_drbd_r1_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_post_notify_stop_0 comeplete before ms_drbd_r1_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:39:15 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3586: 52 actions in 52 synapses
May 20 12:39:15 finley crmd: [25840]: info: do_te_invoke: Processing graph 3586 (ref=pe_calc-dc-1305887955-6197) derived from /var/lib/pengine/pe-input-4745.bz2
May 20 12:39:15 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2127.17) : Transient attribute: removal
May 20 12:39:15 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 12:39:15 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:39:15 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:39:15 finley crmd: [25840]: notice: run_graph: Transition 3586 (Complete=0, Pending=0, Fired=0, Skipped=34, Incomplete=18, Source=/var/lib/pengine/pe-input-4745.bz2): Stopped
May 20 12:39:15 finley crmd: [25840]: info: te_graph_trigger: Transition 3586 is now complete
May 20 12:39:15 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:39:15 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:15 finley crmd: [25840]: info: do_pe_invoke: Query 5649: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:15 finley pengine: [25839]: info: process_pe_message: Transition 3586: PEngine Input stored in: /var/lib/pengine/pe-input-4745.bz2
May 20 12:39:15 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5649, ref=pe_calc-dc-1305887955-6198, seq=1744, quorate=1
May 20 12:39:15 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:15 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:15 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:15 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:15 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:15 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:15 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:15 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:15 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:15 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:15 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:39:15 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:15 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:15 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:15 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:15 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:15 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Slaves: [ godfrey ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:15 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 12:39:15 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:15 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r0:0 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r1:0 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource drbd_r2:1 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:15 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: master_color: Promoting drbd_r2:0 (Master finley)
May 20 12:39:15 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 1 instances of a possible 1 to master
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource ip_virtual0#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_target#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_lun0#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_lun1#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_lun2#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Demote drbd_r0:0#011(Master -> Stopped finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r0:0#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Demote drbd_r1:0#011(Master -> Stopped finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r1:0#011(finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Master finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r2:1#011(godfrey)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_stop_0 comeplete before ms_drbd_r0_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_pre_notify_stop_0 comeplete before ms_drbd_r0_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_post_notify_stop_0 comeplete before ms_drbd_r0_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_stop_0 comeplete before ms_drbd_r1_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_pre_notify_stop_0 comeplete before ms_drbd_r1_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_post_notify_stop_0 comeplete before ms_drbd_r1_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:15 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:39:15 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3587: 52 actions in 52 synapses
May 20 12:39:15 finley crmd: [25840]: info: do_te_invoke: Processing graph 3587 (ref=pe_calc-dc-1305887955-6198) derived from /var/lib/pengine/pe-input-4746.bz2
May 20 12:39:15 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
May 20 12:39:15 finley crmd: [25840]: info: te_rsc_command: Initiating action 17: stop iscsi0_lun2_stop_0 on finley (local)
May 20 12:39:15 finley lrmd: [25837]: info: cancel_op: operation monitor[1101] on ocf::iSCSILogicalUnit::iscsi0_lun2 for client 25840, its parameters: CRM_meta_interval=[10000] target_iqn=[iqn.2011-04.nl.powercraft:storage.iscsi0] path=[/dev/drbd2] lun=[3] crm_feature_set=[3.0.1] CRM_meta_name=[monitor] CRM_meta_timeout=[20000] implementation=[tgt]  cancelled
May 20 12:39:15 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=17:3587:0:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun2_stop_0 )
May 20 12:39:15 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1119: stop
May 20 12:39:15 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 47 fired and confirmed
May 20 12:39:15 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 76 fired and confirmed
May 20 12:39:15 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 93 fired and confirmed
May 20 12:39:15 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun2_monitor_10000 (call=1101, status=1, cib-update=0, confirmed=true) Cancelled
May 20 12:39:15 finley pengine: [25839]: info: process_pe_message: Transition 3587: PEngine Input stored in: /var/lib/pengine/pe-input-4746.bz2
May 20 12:39:15 finley crmd: [25840]: info: te_rsc_command: Initiating action 168: notify drbd_r0:0_pre_notify_demote_0 on finley (local)
May 20 12:39:15 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=168:3587:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_notify_0 )
May 20 12:39:15 finley lrmd: [25837]: info: rsc:drbd_r0:0:1120: notify
May 20 12:39:15 finley crmd: [25840]: info: te_rsc_command: Initiating action 175: notify drbd_r1:0_pre_notify_demote_0 on finley (local)
May 20 12:39:15 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=175:3587:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_notify_0 )
May 20 12:39:15 finley lrmd: [25837]: info: rsc:drbd_r1:0:1121: notify
May 20 12:39:15 finley crmd: [25840]: info: te_rsc_command: Initiating action 181: notify drbd_r2:0_pre_notify_stop_0 on finley (local)
May 20 12:39:15 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=181:3587:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_notify_0 )
May 20 12:39:15 finley crmd: [25840]: info: te_rsc_command: Initiating action 183: notify drbd_r2:1_pre_notify_stop_0 on godfrey
May 20 12:39:15 finley drbd[22540]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:15 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_notify_0 (call=1120, rc=0, cib-update=5650, confirmed=true) ok
May 20 12:39:15 finley drbd[22541]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:15 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_pre_notify_demote_0 (168) confirmed on finley (rc=0)
May 20 12:39:15 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 48 fired and confirmed
May 20 12:39:15 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_notify_0 (call=1121, rc=0, cib-update=5651, confirmed=true) ok
May 20 12:39:15 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_pre_notify_demote_0 (175) confirmed on finley (rc=0)
May 20 12:39:15 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 77 fired and confirmed
May 20 12:39:15 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:1_pre_notify_stop_0 (183) confirmed on godfrey (rc=0)
May 20 12:39:16 finley lrmd: [25837]: info: RA output: (iscsi0_lun2:stop:stdout) 
May 20 12:39:16 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun2_stop_0 (call=1119, rc=0, cib-update=5652, confirmed=true) ok
May 20 12:39:16 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_stop_0 (17) confirmed on finley (rc=0)
May 20 12:39:16 finley crmd: [25840]: info: te_rsc_command: Initiating action 16: stop iscsi0_lun1_stop_0 on finley (local)
May 20 12:39:16 finley lrmd: [25837]: info: cancel_op: operation monitor[1099] on ocf::iSCSILogicalUnit::iscsi0_lun1 for client 25840, its parameters: CRM_meta_interval=[10000] target_iqn=[iqn.2011-04.nl.powercraft:storage.iscsi0] path=[/dev/drbd1] lun=[2] crm_feature_set=[3.0.1] CRM_meta_name=[monitor] CRM_meta_timeout=[20000] implementation=[tgt]  cancelled
May 20 12:39:16 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=16:3587:0:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun1_stop_0 )
May 20 12:39:16 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1123: stop
May 20 12:39:16 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun1_monitor_10000 (call=1099, status=1, cib-update=0, confirmed=true) Cancelled
May 20 12:39:16 finley lrmd: [25837]: info: rsc:drbd_r2:0:1122: notify
May 20 12:39:16 finley drbd[22669]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:16 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_notify_0 (call=1122, rc=0, cib-update=5653, confirmed=true) ok
May 20 12:39:16 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_pre_notify_stop_0 (181) confirmed on finley (rc=0)
May 20 12:39:16 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 94 fired and confirmed
May 20 12:39:16 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 91 fired and confirmed
May 20 12:39:16 finley crmd: [25840]: info: te_rsc_command: Initiating action 84: stop drbd_r2:1_stop_0 on godfrey
May 20 12:39:16 finley crmd: [25840]: WARN: status_from_rc: Action 84 (drbd_r2:1_stop_0) on godfrey failed (target: 0 vs. rc: 6): Error
May 20 12:39:16 finley crmd: [25840]: WARN: update_failcount: Updating failcount for drbd_r2:1 on godfrey after failed stop: rc=6 (update=INFINITY, time=1305887956)
May 20 12:39:16 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r2:1_stop_0, magic=0:6;84:3587:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2127.23) : Event failed
May 20 12:39:16 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1
May 20 12:39:16 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:39:16 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:1_stop_0 (84) confirmed on godfrey (rc=4)
May 20 12:39:16 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 92 fired and confirmed
May 20 12:39:16 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 95 fired and confirmed
May 20 12:39:16 finley crmd: [25840]: info: te_rsc_command: Initiating action 182: notify drbd_r2:0_post_notify_stop_0 on finley (local)
May 20 12:39:16 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=182:3587:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_notify_0 )
May 20 12:39:16 finley lrmd: [25837]: info: rsc:drbd_r2:0:1124: notify
May 20 12:39:16 finley drbd[22690]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:16 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_notify_0 (call=1124, rc=0, cib-update=5654, confirmed=true) ok
May 20 12:39:17 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_post_notify_stop_0 (182) confirmed on finley (rc=0)
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 96 fired and confirmed
May 20 12:39:17 finley lrmd: [25837]: info: RA output: (iscsi0_lun1:stop:stdout) 
May 20 12:39:17 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun1_stop_0 (call=1123, rc=0, cib-update=5655, confirmed=true) ok
May 20 12:39:17 finley attrd: [25838]: info: find_hash_entry: Creating hash entry for fail-count-drbd_r2:1
May 20 12:39:17 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_stop_0 (16) confirmed on finley (rc=0)
May 20 12:39:17 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:39:17 finley crmd: [25840]: notice: run_graph: Transition 3587 (Complete=19, Pending=0, Fired=0, Skipped=19, Incomplete=14, Source=/var/lib/pengine/pe-input-4746.bz2): Stopped
May 20 12:39:17 finley crmd: [25840]: info: te_graph_trigger: Transition 3587 is now complete
May 20 12:39:17 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:39:17 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:17 finley crmd: [25840]: info: do_pe_invoke: Query 5656: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:17 finley attrd: [25838]: info: find_hash_entry: Creating hash entry for last-failure-drbd_r2:1
May 20 12:39:17 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5656, ref=pe_calc-dc-1305887957-6207, seq=1744, quorate=1
May 20 12:39:17 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2127.26) : Transient attribute: update
May 20 12:39:17 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2127.27) : Transient attribute: update
May 20 12:39:17 finley crmd: [25840]: info: do_pe_invoke: Query 5657: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:17 finley crmd: [25840]: info: do_pe_invoke: Query 5658: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:17 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:17 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:17 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:17 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:17 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:17 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:17 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:17 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:17 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:17 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:17 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:17 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:39:17 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:39:17 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:39:17 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:17 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:17 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r0:0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r1:0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r2:0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource ip_virtual0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_target#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_lun0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Demote drbd_r0:0#011(Master -> Stopped finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r0:0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Demote drbd_r1:0#011(Master -> Stopped finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r1:0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Demote drbd_r2:0#011(Master -> Stopped finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r2:0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_stop_0 comeplete before ms_drbd_r0_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_pre_notify_stop_0 comeplete before ms_drbd_r0_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_post_notify_stop_0 comeplete before ms_drbd_r0_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_stop_0 comeplete before ms_drbd_r1_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_pre_notify_stop_0 comeplete before ms_drbd_r1_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_post_notify_stop_0 comeplete before ms_drbd_r1_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_stop_0 comeplete before ms_drbd_r2_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_pre_notify_stop_0 comeplete before ms_drbd_r2_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_post_notify_stop_0 comeplete before ms_drbd_r2_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: info: process_pe_message: Transition 3588: PEngine Input stored in: /var/lib/pengine/pe-input-4747.bz2
May 20 12:39:17 finley iSCSITarget[22711]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:39:17 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5658, ref=pe_calc-dc-1305887957-6208, seq=1744, quorate=1
May 20 12:39:17 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305887957-6207 is obsolete
May 20 12:39:17 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:17 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:17 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:17 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:17 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:17 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:17 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:17 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:17 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:17 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:17 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:17 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:39:17 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:39:17 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:39:17 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:17 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:17 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Started finley
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:17 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:17 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 12:39:17 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:17 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r0:0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r1:0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource drbd_r2:0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource ip_virtual0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_target#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_lun0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Demote drbd_r0:0#011(Master -> Stopped finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r0:0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Demote drbd_r1:0#011(Master -> Stopped finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r1:0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Demote drbd_r2:0#011(Master -> Stopped finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r2:0#011(finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_stop_0 comeplete before ms_drbd_r0_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_pre_notify_stop_0 comeplete before ms_drbd_r0_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_post_notify_stop_0 comeplete before ms_drbd_r0_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_stop_0 comeplete before ms_drbd_r1_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_pre_notify_stop_0 comeplete before ms_drbd_r1_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_post_notify_stop_0 comeplete before ms_drbd_r1_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_stop_0 comeplete before ms_drbd_r2_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_pre_notify_stop_0 comeplete before ms_drbd_r2_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_post_notify_stop_0 comeplete before ms_drbd_r2_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:17 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:39:17 finley pengine: [25839]: info: process_pe_message: Transition 3589: PEngine Input stored in: /var/lib/pengine/pe-input-4748.bz2
May 20 12:39:17 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3589: 59 actions in 59 synapses
May 20 12:39:17 finley crmd: [25840]: info: do_te_invoke: Processing graph 3589 (ref=pe_calc-dc-1305887957-6208) derived from /var/lib/pengine/pe-input-4748.bz2
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 15 fired and confirmed
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 117 fired and confirmed
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 42 fired and confirmed
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 71 fired and confirmed
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 100 fired and confirmed
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 115 fired and confirmed
May 20 12:39:17 finley crmd: [25840]: info: te_rsc_command: Initiating action 166: notify drbd_r0:0_pre_notify_demote_0 on finley (local)
May 20 12:39:17 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=166:3589:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_notify_0 )
May 20 12:39:17 finley lrmd: [25837]: info: rsc:drbd_r0:0:1125: notify
May 20 12:39:17 finley crmd: [25840]: info: te_rsc_command: Initiating action 173: notify drbd_r1:0_pre_notify_demote_0 on finley (local)
May 20 12:39:17 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=173:3589:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_notify_0 )
May 20 12:39:17 finley lrmd: [25837]: info: rsc:drbd_r1:0:1126: notify
May 20 12:39:17 finley crmd: [25840]: info: te_rsc_command: Initiating action 180: notify drbd_r2:0_pre_notify_demote_0 on finley (local)
May 20 12:39:17 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=180:3589:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_notify_0 )
May 20 12:39:17 finley lrmd: [25837]: info: rsc:drbd_r2:0:1127: notify
May 20 12:39:17 finley crmd: [25840]: info: te_rsc_command: Initiating action 12: stop iscsi0_lun0_stop_0 on finley (local)
May 20 12:39:17 finley lrmd: [25837]: info: cancel_op: operation monitor[1097] on ocf::iSCSILogicalUnit::iscsi0_lun0 for client 25840, its parameters: CRM_meta_interval=[10000] target_iqn=[iqn.2011-04.nl.powercraft:storage.iscsi0] path=[/dev/drbd0] lun=[1] crm_feature_set=[3.0.1] CRM_meta_name=[monitor] CRM_meta_timeout=[20000] implementation=[tgt]  cancelled
May 20 12:39:17 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=12:3589:0:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun0_stop_0 )
May 20 12:39:17 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun0_monitor_10000 (call=1097, status=1, cib-update=0, confirmed=true) Cancelled
May 20 12:39:17 finley drbd[22745]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:17 finley drbd[22746]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:17 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_notify_0 (call=1125, rc=0, cib-update=5659, confirmed=true) ok
May 20 12:39:17 finley drbd[22747]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:17 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_notify_0 (call=1127, rc=0, cib-update=5660, confirmed=true) ok
May 20 12:39:17 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_pre_notify_demote_0 (166) confirmed on finley (rc=0)
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 43 fired and confirmed
May 20 12:39:17 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_pre_notify_demote_0 (180) confirmed on finley (rc=0)
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 101 fired and confirmed
May 20 12:39:17 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_notify_0 (call=1126, rc=0, cib-update=5661, confirmed=true) ok
May 20 12:39:17 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_pre_notify_demote_0 (173) confirmed on finley (rc=0)
May 20 12:39:17 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 72 fired and confirmed
May 20 12:39:18 finley crm_attribute: [22833]: info: Invoked: crm_attribute -N finley -n standby -v on -l forever 
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2127" num_updates="30" >
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="finley" >
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-finley" >
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: -           <nvpair value="off" id="nodes-finley-standby" />
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: -         </instance_attributes>
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: -       </node>
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:39:18 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=0) : Non-status change
May 20 12:39:18 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:39:18 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2128" num_updates="1" >
May 20 12:39:18 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="finley" >
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-finley" >
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: +           <nvpair value="on" id="nodes-finley-standby" />
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: +         </instance_attributes>
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: +       </node>
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:39:18 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:39:18 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crm_attribute/4, version=0.2128.1): ok (rc=0)
May 20 12:39:18 finley cib: [22834]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-43.raw
May 20 12:39:18 finley cib: [22834]: info: write_cib_contents: Wrote version 0.2128.0 of the CIB to disk (digest: a7e27abb1209207e42e125114a268159)
May 20 12:39:18 finley cib: [22834]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.rTlHBb (digest: /var/lib/heartbeat/crm/cib.NnurmB)
May 20 12:39:18 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1128: stop
May 20 12:39:19 finley lrmd: [25837]: info: RA output: (iscsi0_lun0:stop:stdout) 
May 20 12:39:19 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun0_stop_0 (call=1128, rc=0, cib-update=5662, confirmed=true) ok
May 20 12:39:19 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_stop_0 (12) confirmed on finley (rc=0)
May 20 12:39:19 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:39:19 finley crmd: [25840]: notice: run_graph: Transition 3589 (Complete=13, Pending=0, Fired=0, Skipped=25, Incomplete=21, Source=/var/lib/pengine/pe-input-4748.bz2): Stopped
May 20 12:39:19 finley crmd: [25840]: info: te_graph_trigger: Transition 3589 is now complete
May 20 12:39:19 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:39:19 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:19 finley crmd: [25840]: info: do_pe_invoke: Query 5663: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:19 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5663, ref=pe_calc-dc-1305887959-6213, seq=1744, quorate=1
May 20 12:39:19 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:19 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:19 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:19 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:19 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:19 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:19 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:19 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:19 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:19 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:19 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:19 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:39:19 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:39:19 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:39:19 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:19 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:39:19 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:19 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:19 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:19 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:19 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:19 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Started finley
May 20 12:39:19 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Started finley
May 20 12:39:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:19 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:19 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:19 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:19 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:19 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:19 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:19 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:19 finley pengine: [25839]: notice: short_print:      Masters: [ finley ]
May 20 12:39:19 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:19 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:19 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 12:39:19 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:19 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource drbd_r0:0 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource drbd_r1:0 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource drbd_r2:0 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:19 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:19 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:19 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Stop resource ip_virtual0#011(finley)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Stop resource iscsi0_target#011(finley)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Demote drbd_r0:0#011(Master -> Stopped finley)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r0:0#011(finley)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Demote drbd_r1:0#011(Master -> Stopped finley)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r1:0#011(finley)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Demote drbd_r2:0#011(Master -> Stopped finley)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r2:0#011(finley)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Stop resource ping_nodes:0#011(finley)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:19 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:19 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_stop_0 comeplete before ms_drbd_r0_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:19 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_pre_notify_stop_0 comeplete before ms_drbd_r0_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:19 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_post_notify_stop_0 comeplete before ms_drbd_r0_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:19 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_stop_0 comeplete before ms_drbd_r1_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:19 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_pre_notify_stop_0 comeplete before ms_drbd_r1_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:19 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_post_notify_stop_0 comeplete before ms_drbd_r1_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:19 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_stop_0 comeplete before ms_drbd_r2_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:19 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_pre_notify_stop_0 comeplete before ms_drbd_r2_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:19 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_post_notify_stop_0 comeplete before ms_drbd_r2_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:19 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:39:19 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3590: 62 actions in 62 synapses
May 20 12:39:19 finley crmd: [25840]: info: do_te_invoke: Processing graph 3590 (ref=pe_calc-dc-1305887959-6213) derived from /var/lib/pengine/pe-input-4749.bz2
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 13 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 115 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 40 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 69 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 98 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 105 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 113 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: te_rsc_command: Initiating action 165: notify drbd_r0:0_pre_notify_demote_0 on finley (local)
May 20 12:39:19 finley pengine: [25839]: info: process_pe_message: Transition 3590: PEngine Input stored in: /var/lib/pengine/pe-input-4749.bz2
May 20 12:39:19 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=165:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_notify_0 )
May 20 12:39:19 finley lrmd: [25837]: info: rsc:drbd_r0:0:1129: notify
May 20 12:39:19 finley crmd: [25840]: info: te_rsc_command: Initiating action 172: notify drbd_r1:0_pre_notify_demote_0 on finley (local)
May 20 12:39:19 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=172:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_notify_0 )
May 20 12:39:19 finley lrmd: [25837]: info: rsc:drbd_r1:0:1130: notify
May 20 12:39:19 finley crmd: [25840]: info: te_rsc_command: Initiating action 179: notify drbd_r2:0_pre_notify_demote_0 on finley (local)
May 20 12:39:19 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=179:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_notify_0 )
May 20 12:39:19 finley lrmd: [25837]: info: rsc:drbd_r2:0:1131: notify
May 20 12:39:19 finley crmd: [25840]: info: te_rsc_command: Initiating action 102: stop ping_nodes:0_stop_0 on finley (local)
May 20 12:39:19 finley lrmd: [25837]: info: cancel_op: operation monitor[1076] on ocf::ping::ping_nodes:0 for client 25840, its parameters: CRM_meta_clone=[0] host_list=[192.168.24.1 192.168.24.17 192.168.24.18] attempts=[1] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[2] CRM_meta_notify=[false] dampen=[1] CRM_meta_globally_unique=[false] crm_feature_set=[3.0.1] timeout=[1] multiplier=[10] CRM_meta_name=[monitor] CRM_meta_interval=[1000] CRM_meta_timeout=[60000]  cancelled
May 20 12:39:19 finley lrmd: [25837]: info: flush_op: process for operation monitor[1076] on ocf::ping::ping_nodes:0 for client 25840 still running, flush delayed
May 20 12:39:19 finley lrmd: [25837]: info: on_msg_cancel_op: operation 1076 running, cancel pending
May 20 12:39:19 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=102:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=ping_nodes:0_stop_0 )
May 20 12:39:19 finley lrmd: [25837]: info: perform_op:2906: operation monitor[1076] on ocf::ping::ping_nodes:0 for client 25840, its parameters: CRM_meta_clone=[0] host_list=[192.168.24.1 192.168.24.17 192.168.24.18] attempts=[1] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[2] CRM_meta_notify=[false] dampen=[1] CRM_meta_globally_unique=[false] crm_feature_set=[3.0.1] timeout=[1] multiplier=[10] CRM_meta_name=[monitor] CRM_meta_interval=[1000] CRM_meta_timeout=[60000]  for rsc is already running.
May 20 12:39:19 finley lrmd: [25837]: info: perform_op:2916: postponing all ops on resource ping_nodes:0 by 1000 ms
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 111 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: te_rsc_command: Initiating action 10: stop iscsi0_target_stop_0 on finley (local)
May 20 12:39:19 finley lrmd: [25837]: info: cancel_op: operation monitor[1095] on ocf::iSCSITarget::iscsi0_target for client 25840, its parameters: CRM_meta_timeout=[20000] tid=[1] iqn=[iqn.2011-04.nl.powercraft:storage.iscsi0] additional_parameters=[DefaultTime2Retain=60 DefaultTime2Wait=5] crm_feature_set=[3.0.1] allowed_initiators=[192.168.24.1 192.168.24.17 192.168.24.18] CRM_meta_name=[monitor] CRM_meta_interval=[10000] implementation=[tgt]  cancelled
May 20 12:39:19 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=10:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_target_stop_0 )
May 20 12:39:19 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_target_monitor_10000 (call=1095, status=1, cib-update=0, confirmed=true) Cancelled
May 20 12:39:19 finley drbd[22867]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:19 finley drbd[22869]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:19 finley drbd[22871]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:19 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_notify_0 (call=1129, rc=0, cib-update=5664, confirmed=true) ok
May 20 12:39:19 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_pre_notify_demote_0 (165) confirmed on finley (rc=0)
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 41 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_notify_0 (call=1130, rc=0, cib-update=5665, confirmed=true) ok
May 20 12:39:19 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_notify_0 (call=1131, rc=0, cib-update=5666, confirmed=true) ok
May 20 12:39:19 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_pre_notify_demote_0 (172) confirmed on finley (rc=0)
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 70 fired and confirmed
May 20 12:39:19 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_pre_notify_demote_0 (179) confirmed on finley (rc=0)
May 20 12:39:19 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 99 fired and confirmed
May 20 12:39:20 finley lrmd: [25837]: info: perform_op:2906: operation monitor[1076] on ocf::ping::ping_nodes:0 for client 25840, its parameters: CRM_meta_clone=[0] host_list=[192.168.24.1 192.168.24.17 192.168.24.18] attempts=[1] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[2] CRM_meta_notify=[false] dampen=[1] CRM_meta_globally_unique=[false] crm_feature_set=[3.0.1] timeout=[1] multiplier=[10] CRM_meta_name=[monitor] CRM_meta_interval=[1000] CRM_meta_timeout=[60000]  for rsc is already running.
May 20 12:39:20 finley lrmd: [25837]: info: perform_op:2916: postponing all ops on resource ping_nodes:0 by 1000 ms
May 20 12:39:20 finley lrmd: [25837]: info: rsc:iscsi0_target:1133: stop
May 20 12:39:20 finley lrmd: [25837]: info: rsc:ping_nodes:0:1132: stop
May 20 12:39:20 finley crmd: [25840]: info: process_lrm_event: LRM operation ping_nodes:0_stop_0 (call=1132, rc=0, cib-update=5667, confirmed=true) ok
May 20 12:39:20 finley iSCSITarget[22939]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:39:20 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:0_stop_0 (102) confirmed on finley (rc=0)
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 106 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_target_stop_0 (call=1133, rc=0, cib-update=5668, confirmed=true) ok
May 20 12:39:20 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_stop_0 (10) confirmed on finley (rc=0)
May 20 12:39:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: stop ip_virtual0_stop_0 on finley (local)
May 20 12:39:20 finley lrmd: [25837]: info: cancel_op: operation monitor[1093] on ocf::IPaddr2::ip_virtual0 for client 25840, its parameters: CRM_meta_name=[monitor] cidr_netmask=[32] crm_feature_set=[3.0.1] CRM_meta_timeout=[20000] CRM_meta_interval=[10000] ip=[192.168.24.40]  cancelled
May 20 12:39:20 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=9:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=ip_virtual0_stop_0 )
May 20 12:39:20 finley lrmd: [25837]: info: rsc:ip_virtual0:1134: stop
May 20 12:39:20 finley crmd: [25840]: info: process_lrm_event: LRM operation ip_virtual0_monitor_10000 (call=1093, status=1, cib-update=0, confirmed=true) Cancelled
May 20 12:39:20 finley IPaddr2[22973]: INFO: IP status = ok, IP_CIP=
May 20 12:39:20 finley IPaddr2[22973]: INFO: ip -f inet addr delete 192.168.24.40/32 dev bond0
May 20 12:39:20 finley crmd: [25840]: info: process_lrm_event: LRM operation ip_virtual0_stop_0 (call=1134, rc=0, cib-update=5669, confirmed=true) ok
May 20 12:39:20 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_stop_0 (9) confirmed on finley (rc=0)
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 14 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 38 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 67 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 96 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 15: demote drbd_r0:0_demote_0 on finley (local)
May 20 12:39:20 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=15:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_demote_0 )
May 20 12:39:20 finley lrmd: [25837]: info: rsc:drbd_r0:0:1135: demote
May 20 12:39:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 44: demote drbd_r1:0_demote_0 on finley (local)
May 20 12:39:20 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=44:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_demote_0 )
May 20 12:39:20 finley lrmd: [25837]: info: rsc:drbd_r1:0:1136: demote
May 20 12:39:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 73: demote drbd_r2:0_demote_0 on finley (local)
May 20 12:39:20 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=73:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_demote_0 )
May 20 12:39:20 finley lrmd: [25837]: info: rsc:drbd_r2:0:1137: demote
May 20 12:39:20 finley drbd[23011]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:20 finley drbd[23013]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:20 finley drbd[23012]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:20 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_demote_0 (call=1135, rc=6, cib-update=5670, confirmed=true) not configured
May 20 12:39:20 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_demote_0 (call=1136, rc=6, cib-update=5671, confirmed=true) not configured
May 20 12:39:20 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_demote_0 (call=1137, rc=6, cib-update=5672, confirmed=true) not configured
May 20 12:39:20 finley crmd: [25840]: WARN: status_from_rc: Action 15 (drbd_r0:0_demote_0) on finley failed (target: 0 vs. rc: 6): Error
May 20 12:39:20 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r0:0_demote_0, magic=0:6;15:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2128.9) : Event failed
May 20 12:39:20 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1
May 20 12:39:20 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:39:20 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_demote_0 (15) confirmed on finley (rc=4)
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 39 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 42 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 166: notify drbd_r0:0_post_notify_demote_0 on finley (local)
May 20 12:39:20 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=166:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_notify_0 )
May 20 12:39:20 finley lrmd: [25837]: info: rsc:drbd_r0:0:1138: notify
May 20 12:39:20 finley crmd: [25840]: WARN: status_from_rc: Action 44 (drbd_r1:0_demote_0) on finley failed (target: 0 vs. rc: 6): Error
May 20 12:39:20 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r1:0_demote_0, magic=0:6;44:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2128.10) : Event failed
May 20 12:39:20 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_demote_0 (44) confirmed on finley (rc=4)
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 68 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 71 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 173: notify drbd_r1:0_post_notify_demote_0 on finley (local)
May 20 12:39:20 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=173:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_notify_0 )
May 20 12:39:20 finley lrmd: [25837]: info: rsc:drbd_r1:0:1139: notify
May 20 12:39:20 finley crmd: [25840]: WARN: status_from_rc: Action 73 (drbd_r2:0_demote_0) on finley failed (target: 0 vs. rc: 6): Error
May 20 12:39:20 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r2:0_demote_0, magic=0:6;73:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2128.11) : Event failed
May 20 12:39:20 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_demote_0 (73) confirmed on finley (rc=4)
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 97 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 100 fired and confirmed
May 20 12:39:20 finley crmd: [25840]: info: te_rsc_command: Initiating action 180: notify drbd_r2:0_post_notify_demote_0 on finley (local)
May 20 12:39:20 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=180:3590:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_notify_0 )
May 20 12:39:20 finley lrmd: [25837]: info: rsc:drbd_r2:0:1140: notify
May 20 12:39:21 finley drbd[23075]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:21 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_notify_0 (call=1138, rc=0, cib-update=5673, confirmed=true) ok
May 20 12:39:21 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_post_notify_demote_0 (166) confirmed on finley (rc=0)
May 20 12:39:21 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 43 fired and confirmed
May 20 12:39:21 finley drbd[23080]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:21 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_notify_0 (call=1139, rc=0, cib-update=5674, confirmed=true) ok
May 20 12:39:21 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_post_notify_demote_0 (173) confirmed on finley (rc=0)
May 20 12:39:21 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 72 fired and confirmed
May 20 12:39:21 finley drbd[23088]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:21 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_notify_0 (call=1140, rc=0, cib-update=5675, confirmed=true) ok
May 20 12:39:21 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_post_notify_demote_0 (180) confirmed on finley (rc=0)
May 20 12:39:21 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 101 fired and confirmed
May 20 12:39:21 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:39:21 finley crmd: [25840]: notice: run_graph: Transition 3590 (Complete=37, Pending=0, Fired=0, Skipped=16, Incomplete=9, Source=/var/lib/pengine/pe-input-4749.bz2): Stopped
May 20 12:39:21 finley crmd: [25840]: info: te_graph_trigger: Transition 3590 is now complete
May 20 12:39:21 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:39:21 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:21 finley crmd: [25840]: info: do_pe_invoke: Query 5676: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:21 finley cibadmin: [23159]: info: Invoked: cibadmin -Ql 
May 20 12:39:21 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5676, ref=pe_calc-dc-1305887961-6226, seq=1744, quorate=1
May 20 12:39:21 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:21 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:21 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:21 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:21 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:21 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:39:21 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:39:21 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:39:21 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:39:21 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:39:21 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:39:21 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:39:21 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:39:21 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:39:21 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:21 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:21 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:21 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:21 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley FAILED
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:21 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley FAILED
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:21 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley FAILED
May 20 12:39:21 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:21 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:21 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:21 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource drbd_r0:0 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource drbd_r1:0 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource drbd_r2:0 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r0:0#011(finley)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r1:0#011(finley)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r2:0#011(finley)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:21 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_stop_0 comeplete before ms_drbd_r0_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:21 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_pre_notify_stop_0 comeplete before ms_drbd_r0_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:21 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_post_notify_stop_0 comeplete before ms_drbd_r0_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:21 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_stop_0 comeplete before ms_drbd_r1_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:21 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_pre_notify_stop_0 comeplete before ms_drbd_r1_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:21 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_post_notify_stop_0 comeplete before ms_drbd_r1_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:21 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_stop_0 comeplete before ms_drbd_r2_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:21 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_pre_notify_stop_0 comeplete before ms_drbd_r2_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:21 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_post_notify_stop_0 comeplete before ms_drbd_r2_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:21 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:39:21 finley pengine: [25839]: info: process_pe_message: Transition 3591: PEngine Input stored in: /var/lib/pengine/pe-input-4750.bz2
May 20 12:39:21 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3591: 25 actions in 25 synapses
May 20 12:39:21 finley crmd: [25840]: info: do_te_invoke: Processing graph 3591 (ref=pe_calc-dc-1305887961-6226) derived from /var/lib/pengine/pe-input-4750.bz2
May 20 12:39:21 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
May 20 12:39:21 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 51 fired and confirmed
May 20 12:39:21 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 78 fired and confirmed
May 20 12:39:21 finley crmd: [25840]: info: te_rsc_command: Initiating action 157: notify drbd_r0:0_pre_notify_stop_0 on finley (local)
May 20 12:39:21 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=157:3591:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_notify_0 )
May 20 12:39:21 finley lrmd: [25837]: info: rsc:drbd_r0:0:1141: notify
May 20 12:39:21 finley crmd: [25840]: info: te_rsc_command: Initiating action 164: notify drbd_r1:0_pre_notify_stop_0 on finley (local)
May 20 12:39:21 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=164:3591:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_notify_0 )
May 20 12:39:21 finley lrmd: [25837]: info: rsc:drbd_r1:0:1142: notify
May 20 12:39:21 finley crmd: [25840]: info: te_rsc_command: Initiating action 171: notify drbd_r2:0_pre_notify_stop_0 on finley (local)
May 20 12:39:21 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=171:3591:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_notify_0 )
May 20 12:39:21 finley lrmd: [25837]: info: rsc:drbd_r2:0:1143: notify
May 20 12:39:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 12:39:21 finley attrd: [25838]: info: attrd_perform_update: Sent delete 3563: node=finley, attr=pingd, id=<n/a>, set=(null), section=status
May 20 12:39:21 finley drbd[23160]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:21 finley drbd[23162]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:21 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_notify_0 (call=1141, rc=0, cib-update=5677, confirmed=true) ok
May 20 12:39:21 finley drbd[23161]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:21 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=finley, magic=NA, cib=0.2128.15) : Transient attribute: removal
May 20 12:39:21 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 12:39:21 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:39:21 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_notify_0 (call=1143, rc=0, cib-update=5678, confirmed=true) ok
May 20 12:39:21 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_notify_0 (call=1142, rc=0, cib-update=5679, confirmed=true) ok
May 20 12:39:21 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_pre_notify_stop_0 (157) confirmed on finley (rc=0)
May 20 12:39:21 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_pre_notify_stop_0 (171) confirmed on finley (rc=0)
May 20 12:39:21 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_pre_notify_stop_0 (164) confirmed on finley (rc=0)
May 20 12:39:21 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:39:21 finley crmd: [25840]: notice: run_graph: Transition 3591 (Complete=6, Pending=0, Fired=0, Skipped=10, Incomplete=9, Source=/var/lib/pengine/pe-input-4750.bz2): Stopped
May 20 12:39:21 finley crmd: [25840]: info: te_graph_trigger: Transition 3591 is now complete
May 20 12:39:21 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:39:21 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:21 finley crmd: [25840]: info: do_pe_invoke: Query 5680: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:21 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5680, ref=pe_calc-dc-1305887961-6230, seq=1744, quorate=1
May 20 12:39:22 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:22 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:22 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:22 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:22 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:22 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:39:22 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:39:22 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:39:22 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:39:22 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:39:22 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:39:22 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:22 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:22 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley FAILED
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:22 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:22 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley FAILED
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:22 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:22 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley FAILED
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:22 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:22 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:22 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource drbd_r0:0 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource drbd_r1:0 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource drbd_r2:0 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r0:0#011(finley)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r1:0#011(finley)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Stop resource drbd_r2:0#011(finley)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_stop_0 comeplete before ms_drbd_r0_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:22 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_pre_notify_stop_0 comeplete before ms_drbd_r0_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:22 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r0:1_post_notify_stop_0 comeplete before ms_drbd_r0_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:22 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_stop_0 comeplete before ms_drbd_r1_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:22 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_pre_notify_stop_0 comeplete before ms_drbd_r1_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:22 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r1:1_post_notify_stop_0 comeplete before ms_drbd_r1_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:22 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_stop_0 comeplete before ms_drbd_r2_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:22 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_pre_notify_stop_0 comeplete before ms_drbd_r2_confirmed-pre_notify_stop_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:22 finley pengine: [25839]: WARN: should_dump_input: Ignoring requirement that drbd_r2:1_post_notify_stop_0 comeplete before ms_drbd_r2_confirmed-post_notify_stopped_0: unmanaged failed resources cannot prevent shutdown
May 20 12:39:22 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:39:22 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3592: 25 actions in 25 synapses
May 20 12:39:22 finley crmd: [25840]: info: do_te_invoke: Processing graph 3592 (ref=pe_calc-dc-1305887961-6230) derived from /var/lib/pengine/pe-input-4751.bz2
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 51 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 78 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_rsc_command: Initiating action 157: notify drbd_r0:0_pre_notify_stop_0 on finley (local)
May 20 12:39:22 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=157:3592:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_notify_0 )
May 20 12:39:22 finley lrmd: [25837]: info: rsc:drbd_r0:0:1144: notify
May 20 12:39:22 finley crmd: [25840]: info: te_rsc_command: Initiating action 164: notify drbd_r1:0_pre_notify_stop_0 on finley (local)
May 20 12:39:22 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=164:3592:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_notify_0 )
May 20 12:39:22 finley lrmd: [25837]: info: rsc:drbd_r1:0:1145: notify
May 20 12:39:22 finley crmd: [25840]: info: te_rsc_command: Initiating action 171: notify drbd_r2:0_pre_notify_stop_0 on finley (local)
May 20 12:39:22 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=171:3592:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_notify_0 )
May 20 12:39:22 finley lrmd: [25837]: info: rsc:drbd_r2:0:1146: notify
May 20 12:39:22 finley pengine: [25839]: info: process_pe_message: Transition 3592: PEngine Input stored in: /var/lib/pengine/pe-input-4751.bz2
May 20 12:39:22 finley drbd[23225]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:22 finley drbd[23224]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:22 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_notify_0 (call=1145, rc=0, cib-update=5681, confirmed=true) ok
May 20 12:39:22 finley drbd[23223]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:22 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_pre_notify_stop_0 (164) confirmed on finley (rc=0)
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 52 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 49 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_rsc_command: Initiating action 1: stop drbd_r1:0_stop_0 on finley (local)
May 20 12:39:22 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=1:3592:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r1:0_stop_0 )
May 20 12:39:22 finley lrmd: [25837]: info: rsc:drbd_r1:0:1147: stop
May 20 12:39:22 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_notify_0 (call=1144, rc=0, cib-update=5682, confirmed=true) ok
May 20 12:39:22 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_pre_notify_stop_0 (157) confirmed on finley (rc=0)
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_rsc_command: Initiating action 2: stop drbd_r0:0_stop_0 on finley (local)
May 20 12:39:22 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=2:3592:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r0:0_stop_0 )
May 20 12:39:22 finley lrmd: [25837]: info: rsc:drbd_r0:0:1148: stop
May 20 12:39:22 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_notify_0 (call=1146, rc=0, cib-update=5683, confirmed=true) ok
May 20 12:39:22 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_pre_notify_stop_0 (171) confirmed on finley (rc=0)
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 79 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 76 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_rsc_command: Initiating action 3: stop drbd_r2:0_stop_0 on finley (local)
May 20 12:39:22 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=3:3592:0:8f399f14-fe26-4279-b701-1947eb7b322d op=drbd_r2:0_stop_0 )
May 20 12:39:22 finley lrmd: [25837]: info: rsc:drbd_r2:0:1149: stop
May 20 12:39:22 finley cibadmin: [23310]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:22 finley drbd[23286]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:22 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r1:0_stop_0 (call=1147, rc=6, cib-update=5684, confirmed=true) not configured
May 20 12:39:22 finley crmd: [25840]: WARN: status_from_rc: Action 1 (drbd_r1:0_stop_0) on finley failed (target: 0 vs. rc: 6): Error
May 20 12:39:22 finley crmd: [25840]: WARN: update_failcount: Updating failcount for drbd_r1:0 on finley after failed stop: rc=6 (update=INFINITY, time=1305887962)
May 20 12:39:22 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r1:0_stop_0, magic=0:6;1:3592:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2128.22) : Event failed
May 20 12:39:22 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1
May 20 12:39:22 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:39:22 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_stop_0 (1) confirmed on finley (rc=4)
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 50 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 53 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 54 fired and confirmed
May 20 12:39:22 finley attrd: [25838]: info: find_hash_entry: Creating hash entry for fail-count-drbd_r1:0
May 20 12:39:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 12:39:22 finley attrd: [25838]: info: attrd_perform_update: Sent update 3566: fail-count-drbd_r1:0=INFINITY
May 20 12:39:22 finley attrd: [25838]: info: find_hash_entry: Creating hash entry for last-failure-drbd_r1:0
May 20 12:39:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 12:39:22 finley drbd[23292]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:22 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r2:0_stop_0 (call=1149, rc=6, cib-update=5685, confirmed=true) not configured
May 20 12:39:22 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=finley, magic=NA, cib=0.2128.23) : Transient attribute: update
May 20 12:39:22 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 1 to 1000000
May 20 12:39:22 finley crmd: [25840]: info: update_abort_priority: 'Event failed' abort superceeded
May 20 12:39:22 finley cibadmin: [23341]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:22 finley drbd[23289]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found 3.
May 20 12:39:22 finley crmd: [25840]: info: process_lrm_event: LRM operation drbd_r0:0_stop_0 (call=1148, rc=6, cib-update=5686, confirmed=true) not configured
May 20 12:39:22 finley crmd: [25840]: WARN: status_from_rc: Action 3 (drbd_r2:0_stop_0) on finley failed (target: 0 vs. rc: 6): Error
May 20 12:39:22 finley crmd: [25840]: WARN: update_failcount: Updating failcount for drbd_r2:0 on finley after failed stop: rc=6 (update=INFINITY, time=1305887962)
May 20 12:39:22 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r2:0_stop_0, magic=0:6;3:3592:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2128.24) : Event failed
May 20 12:39:22 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_stop_0 (3) confirmed on finley (rc=4)
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 77 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 80 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 81 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: WARN: status_from_rc: Action 2 (drbd_r0:0_stop_0) on finley failed (target: 0 vs. rc: 6): Error
May 20 12:39:22 finley crmd: [25840]: WARN: update_failcount: Updating failcount for drbd_r0:0 on finley after failed stop: rc=6 (update=INFINITY, time=1305887962)
May 20 12:39:22 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r0:0_stop_0, magic=0:6;2:3592:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2128.25) : Event failed
May 20 12:39:22 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_stop_0 (2) confirmed on finley (rc=4)
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
May 20 12:39:22 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:39:22 finley crmd: [25840]: notice: run_graph: Transition 3592 (Complete=24, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pengine/pe-input-4751.bz2): Stopped
May 20 12:39:22 finley crmd: [25840]: info: te_graph_trigger: Transition 3592 is now complete
May 20 12:39:22 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:39:22 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:22 finley crmd: [25840]: info: do_pe_invoke: Query 5687: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:22 finley attrd: [25838]: info: attrd_perform_update: Sent update 3569: last-failure-drbd_r1:0=1305887962
May 20 12:39:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 12:39:22 finley attrd: [25838]: info: attrd_perform_update: Sent update 3572: fail-count-drbd_r2:0=INFINITY
May 20 12:39:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 12:39:22 finley attrd: [25838]: info: attrd_perform_update: Sent update 3575: last-failure-drbd_r2:0=1305887962
May 20 12:39:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 12:39:22 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5687, ref=pe_calc-dc-1305887962-6237, seq=1744, quorate=1
May 20 12:39:22 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=finley, magic=NA, cib=0.2128.26) : Transient attribute: update
May 20 12:39:22 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=finley, magic=NA, cib=0.2128.27) : Transient attribute: update
May 20 12:39:22 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=finley, magic=NA, cib=0.2128.28) : Transient attribute: update
May 20 12:39:22 finley crmd: [25840]: info: do_pe_invoke: Query 5688: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:22 finley crmd: [25840]: info: do_pe_invoke: Query 5689: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:22 finley crmd: [25840]: info: do_pe_invoke: Query 5690: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:22 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:22 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:22 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:22 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:22 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:22 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:39:22 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:39:22 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:39:22 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:39:22 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:39:22 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:39:22 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:39:22 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:39:22 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:22 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:39:22 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:39:22 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:22 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:22 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:22 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:22 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:22 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:22 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:22 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:22 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:22 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:22 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:22 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:22 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:22 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:39:22 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:39:22 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:39:22 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:22 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:22 finley attrd: [25838]: info: attrd_perform_update: Sent update 3578: fail-count-drbd_r0:0=INFINITY
May 20 12:39:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 12:39:23 finley attrd: [25838]: info: attrd_perform_update: Sent update 3581: last-failure-drbd_r0:0=1305887962
May 20 12:39:23 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5690, ref=pe_calc-dc-1305887963-6238, seq=1744, quorate=1
May 20 12:39:23 finley crm_resource: [23354]: info: Invoked: crm_resource -W -r ip_virtual0 
May 20 12:39:23 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=finley, magic=NA, cib=0.2128.29) : Transient attribute: update
May 20 12:39:23 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=finley, magic=NA, cib=0.2128.30) : Transient attribute: update
May 20 12:39:23 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305887962-6237 is obsolete
May 20 12:39:23 finley crmd: [25840]: info: do_pe_invoke: Query 5691: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:23 finley crmd: [25840]: info: do_pe_invoke: Query 5692: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:23 finley pengine: [25839]: info: process_pe_message: Transition 3593: PEngine Input stored in: /var/lib/pengine/pe-input-4752.bz2
May 20 12:39:23 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:23 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:23 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:23 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:39:23 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:39:23 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:39:23 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:39:23 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:39:23 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:23 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:23 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:23 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:23 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:23 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:23 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:23 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305887963-6238 is obsolete
May 20 12:39:23 finley pengine: [25839]: info: process_pe_message: Transition 3594: PEngine Input stored in: /var/lib/pengine/pe-input-4753.bz2
May 20 12:39:23 finley crm_resource: [23354]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23354]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23354]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23354]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23354]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23354]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23354]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23354]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23354]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley cibadmin: [23356]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:23 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5692, ref=pe_calc-dc-1305887963-6239, seq=1744, quorate=1
May 20 12:39:23 finley cibadmin: [23358]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:23 finley pengine: [25839]: notice: unpack_config: On loss of CCM Quorum: Ignore
May 20 12:39:23 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:23 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:23 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:39:23 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:39:23 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:39:23 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:39:23 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:39:23 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:39:23 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:39:23 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:23 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:23 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:23 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:23 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:23 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:23 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:23 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:23 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:23 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:23 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:23 finley crm_resource: [23360]: info: Invoked: crm_resource -W -r iscsi0_target 
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:23 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:23 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:39:23 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3595: 0 actions in 0 synapses
May 20 12:39:23 finley crmd: [25840]: info: do_te_invoke: Processing graph 3595 (ref=pe_calc-dc-1305887963-6239) derived from /var/lib/pengine/pe-input-4754.bz2
May 20 12:39:23 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:39:23 finley crmd: [25840]: notice: run_graph: Transition 3595 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4754.bz2): Complete
May 20 12:39:23 finley crmd: [25840]: info: te_graph_trigger: Transition 3595 is now complete
May 20 12:39:23 finley crmd: [25840]: info: notify_crmd: Transition 3595 status: done - <null>
May 20 12:39:23 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:39:23 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:39:23 finley pengine: [25839]: info: process_pe_message: Transition 3595: PEngine Input stored in: /var/lib/pengine/pe-input-4754.bz2
May 20 12:39:23 finley crm_resource: [23360]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23360]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23360]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23360]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23360]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23360]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23360]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23360]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23360]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley cibadmin: [23362]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:23 finley cibadmin: [23364]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:23 finley crm_resource: [23366]: info: Invoked: crm_resource -W -r iscsi0_lun0 
May 20 12:39:23 finley crm_resource: [23366]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23366]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23366]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23366]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23366]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23366]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23366]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23366]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley crm_resource: [23366]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:23 finley cibadmin: [23368]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:23 finley cibadmin: [23370]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:23 finley crm_resource: [23372]: info: Invoked: crm_resource -W -r iscsi0_lun1 
May 20 12:39:24 finley crm_resource: [23372]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23372]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23372]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23372]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23372]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23372]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23372]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23372]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23372]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley cibadmin: [23374]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:24 finley cibadmin: [23376]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:24 finley crm_resource: [23378]: info: Invoked: crm_resource -W -r iscsi0_lun2 
May 20 12:39:24 finley crm_resource: [23378]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23378]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23378]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23378]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23378]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23378]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23378]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23378]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23378]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley cibadmin: [23380]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:24 finley cibadmin: [23382]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:24 finley crm_resource: [23384]: info: Invoked: crm_resource -W -r ms_drbd_r0 
May 20 12:39:24 finley crm_resource: [23384]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23384]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23384]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23384]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23384]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23384]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23384]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23384]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23384]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley cibadmin: [23386]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:24 finley cibadmin: [23388]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:24 finley crm_resource: [23390]: info: Invoked: crm_resource -W -r ms_drbd_r1 
May 20 12:39:24 finley crm_resource: [23390]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23390]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23390]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23390]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23390]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23390]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23390]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23390]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23390]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley cibadmin: [23392]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:24 finley cibadmin: [23394]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:24 finley crm_resource: [23396]: info: Invoked: crm_resource -W -r ms_drbd_r2 
May 20 12:39:24 finley crm_resource: [23396]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23396]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23396]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23396]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23396]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23396]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23396]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23396]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley crm_resource: [23396]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:24 finley cibadmin: [23398]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley cibadmin: [23400]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley crm_resource: [23402]: info: Invoked: crm_resource -W -r ping_clone 
May 20 12:39:25 finley crm_resource: [23402]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23402]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23402]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23402]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23402]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23402]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23402]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23402]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23402]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley cibadmin: [23404]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley cibadmin: [23406]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley cibadmin: [23408]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley cibadmin: [23410]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley crm_resource: [23412]: info: Invoked: crm_resource -W -r ip_virtual0 
May 20 12:39:25 finley crm_resource: [23412]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23412]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23412]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23412]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23412]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23412]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23412]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23412]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23412]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley cibadmin: [23414]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley cibadmin: [23416]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley crm_resource: [23418]: info: Invoked: crm_resource -W -r iscsi0_target 
May 20 12:39:25 finley crm_resource: [23418]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23418]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23418]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23418]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23418]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23418]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23418]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23418]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23418]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley cibadmin: [23420]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley cibadmin: [23422]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:25 finley crm_resource: [23424]: info: Invoked: crm_resource -W -r iscsi0_lun0 
May 20 12:39:25 finley crm_resource: [23424]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23424]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23424]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23424]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23424]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23424]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23424]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23424]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley crm_resource: [23424]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:25 finley cibadmin: [23426]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:26 finley cibadmin: [23428]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:26 finley crm_resource: [23430]: info: Invoked: crm_resource -W -r iscsi0_lun1 
May 20 12:39:26 finley crm_resource: [23430]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23430]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23430]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23430]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23430]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23430]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23430]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23430]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23430]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:26 finley cibadmin: [23432]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:26 finley cibadmin: [23434]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:26 finley crm_resource: [23436]: info: Invoked: crm_resource -W -r iscsi0_lun2 
May 20 12:39:26 finley crm_resource: [23436]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23436]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23436]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23436]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23436]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23436]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23436]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23436]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23436]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:26 finley cibadmin: [23438]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:26 finley cibadmin: [23440]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:26 finley crm_resource: [23442]: info: Invoked: crm_resource -W -r ms_drbd_r0 
May 20 12:39:26 finley crm_resource: [23442]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23442]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23442]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23442]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23442]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23442]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23442]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23442]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23442]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:26 finley cibadmin: [23444]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:26 finley cibadmin: [23446]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:26 finley crm_resource: [23448]: info: Invoked: crm_resource -W -r ms_drbd_r1 
May 20 12:39:26 finley crm_resource: [23448]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:26 finley crm_resource: [23448]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23448]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23448]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23448]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23448]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23448]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23448]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23448]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:27 finley cibadmin: [23450]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:27 finley cibadmin: [23452]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:27 finley crm_resource: [23454]: info: Invoked: crm_resource -W -r ms_drbd_r2 
May 20 12:39:27 finley crm_resource: [23454]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23454]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23454]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23454]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23454]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23454]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23454]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23454]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23454]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:27 finley cibadmin: [23456]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:27 finley cibadmin: [23458]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:27 finley crm_resource: [23460]: info: Invoked: crm_resource -W -r ping_clone 
May 20 12:39:27 finley crm_resource: [23460]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23460]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23460]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23460]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23460]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23460]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23460]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23460]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:27 finley crm_resource: [23460]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:27 finley cibadmin: [23462]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:27 finley cibadmin: [23464]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:28 finley cibadmin: [23466]: info: Invoked: cibadmin -Ql 
May 20 12:39:29 finley cibadmin: [23549]: info: Invoked: cibadmin -p -R 
May 20 12:39:29 finley cib: [25836]: info: cib_replace_notify: Replaced: 0.2128.30 -> 0.2129.1 from <null>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2128" num_updates="30" >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 12:39:29 finley attrd: [25838]: info: do_cib_replaced: Sending full refresh
May 20 12:39:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-no-quorum-policy" name="no-quorum-policy" value="ignore" __crm_diff_marker__="removed:top" />
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" __crm_diff_marker__="removed:top" />
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="openais" __crm_diff_marker__="removed:top" />
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-expected-quorum-votes" name="expected-quorum-votes" value="3" __crm_diff_marker__="removed:top" />
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1305831876" __crm_diff_marker__="removed:top" />
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2129" num_updates="1" />
May 20 12:39:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_replace for section 'all' (origin=local/cibadmin/2, version=0.2129.1): ok (rc=0)
May 20 12:39:29 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 12:39:29 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:39:29 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:39:29 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:29 finley crmd: [25840]: info: do_pe_invoke: Query 5695: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:29 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_cib_replaced ]
May 20 12:39:29 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 12:39:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5693, version=0.2129.1): ok (rc=0)
May 20 12:39:29 finley cibadmin: [23551]: info: Invoked: cibadmin -Ql 
May 20 12:39:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 12:39:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 12:39:29 finley crmd: [25840]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ]
May 20 12:39:29 finley crmd: [25840]: info: do_dc_takeover: Taking over DC status for this partition
May 20 12:39:29 finley cib: [25836]: info: cib_process_readwrite: We are now in R/O mode
May 20 12:39:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_slave_all for section 'all' (origin=local/crmd/5696, version=0.2129.1): ok (rc=0)
May 20 12:39:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 12:39:29 finley cib: [25836]: info: cib_process_readwrite: We are now in R/W mode
May 20 12:39:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/5697, version=0.2129.1): ok (rc=0)
May 20 12:39:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5698, version=0.2129.1): ok (rc=0)
May 20 12:39:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 12:39:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2129" num_updates="1" />
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2130" num_updates="1" >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" __crm_diff_marker__="added:top" />
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:39:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5701, version=0.2130.1): ok (rc=0)
May 20 12:39:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 12:39:29 finley crmd: [25840]: info: do_dc_join_offer_all: join-33: Waiting on 3 outstanding join acks
May 20 12:39:29 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2130" num_updates="1" />
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2131" num_updates="1" >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="openais" __crm_diff_marker__="added:top" />
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:39:29 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:39:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5704, version=0.2131.1): ok (rc=0)
May 20 12:39:29 finley cib: [23552]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-44.raw
May 20 12:39:29 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:39:29 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 12:39:29 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=2 to corosync
May 20 12:39:29 finley corosync[25820]:   [pcmk  ] info: update_expected_votes: Cannot update expected quorum votes 3 -> 2: value cannot be less that the current number of votes
May 20 12:39:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 12:39:29 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:39:29 finley cib: [23552]: info: write_cib_contents: Wrote version 0.2129.0 of the CIB to disk (digest: a3a4c002b4c3ae3ea1f5b11d6cbcaeab)
May 20 12:39:30 finley cib: [23552]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.5Ymd2w (digest: /var/lib/heartbeat/crm/cib.lKUtdi)
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2131" num_updates="1" />
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2132" num_updates="1" >
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-expected-quorum-votes" name="expected-quorum-votes" value="3" __crm_diff_marker__="added:top" />
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:39:30 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:39:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5708, version=0.2132.1): ok (rc=0)
May 20 12:39:30 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:39:30 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 12:39:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5710, version=0.2132.1): ok (rc=0)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 12:39:30 finley cib: [23553]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-45.raw
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 12:39:30 finley cib: [23553]: info: write_cib_contents: Wrote version 0.2132.0 of the CIB to disk (digest: 64816afd470311db47b8757441acfc97)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 12:39:30 finley cib: [23553]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.GbHSmy (digest: /var/lib/heartbeat/crm/cib.5w5NSk)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 12:39:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 12:39:31 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 12:39:32 finley crmd: [25840]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 12:39:32 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes responded to the join offer.
May 20 12:39:32 finley crmd: [25840]: info: do_dc_join_finalize: join-33: Syncing the CIB from finley to the rest of the cluster
May 20 12:39:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/5712, version=0.2132.1): ok (rc=0)
May 20 12:39:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5713, version=0.2132.1): ok (rc=0)
May 20 12:39:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5714, version=0.2132.1): ok (rc=0)
May 20 12:39:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5715, version=0.2132.1): ok (rc=0)
May 20 12:39:33 finley crmd: [25840]: info: do_dc_join_ack: join-33: Updating node state to member for godfrey
May 20 12:39:33 finley crmd: [25840]: info: do_dc_join_ack: join-33: Updating node state to member for finley
May 20 12:39:33 finley crmd: [25840]: info: do_dc_join_ack: join-33: Updating node state to member for ebony
May 20 12:39:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']/lrm (origin=local/crmd/5716, version=0.2132.2): ok (rc=0)
May 20 12:39:34 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='godfrey']/lrm": ok (rc=0)
May 20 12:39:34 finley crmd: [25840]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 12:39:34 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:34 finley crmd: [25840]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
May 20 12:39:34 finley crmd: [25840]: info: crm_update_quorum: Updating quorum status to true (call=5724)
May 20 12:39:34 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
May 20 12:39:34 finley crmd: [25840]: info: do_pe_invoke: Query 5725: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']/lrm (origin=local/crmd/5718, version=0.2132.4): ok (rc=0)
May 20 12:39:34 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:0;12:5:7:b91d50c5-2309-4f96-ae7b-3bf7b28386fa, cib=0.2132.4) : Resource op removal
May 20 12:39:34 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='finley']/lrm": ok (rc=0)
May 20 12:39:34 finley crmd: [25840]: info: do_pe_invoke: Query 5726: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:34 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 15 resources updated: Skipping all resource events
May 20 12:39:34 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2132.5) : LRM Refresh
May 20 12:39:34 finley crmd: [25840]: info: do_pe_invoke: Query 5727: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/lrm (origin=local/crmd/5720, version=0.2132.6): ok (rc=0)
May 20 12:39:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;16:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2132.6) : Resource op removal
May 20 12:39:35 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='ebony']/lrm": ok (rc=0)
May 20 12:39:35 finley crmd: [25840]: info: do_pe_invoke: Query 5728: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:35 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 9 resources updated: Skipping all resource events
May 20 12:39:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2132.7) : LRM Refresh
May 20 12:39:35 finley crmd: [25840]: info: do_pe_invoke: Query 5729: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5722, version=0.2132.7): ok (rc=0)
May 20 12:39:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5724, version=0.2132.7): ok (rc=0)
May 20 12:39:35 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5729, ref=pe_calc-dc-1305887975-6249, seq=1744, quorate=1
May 20 12:39:35 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:39:35 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:39:35 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:39:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:39:35 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:39:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:39:35 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:39:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:39:35 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:39:35 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:39:35 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:39:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:39:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:39:35 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:39:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:39:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:39:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:39:35 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:39:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:39:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:39:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:39:35 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:39:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:39:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:39:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:39:35 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:39:35 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:39:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:39:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:39:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:39:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:39:35 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:39:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:39:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:39:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:39:35 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:39:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:39:35 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:39:35 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:39:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:39:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:39:35 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:39:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:39:35 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:39:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:39:35 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:39:35 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:39:35 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:39:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:39:35 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:39:35 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3596: 0 actions in 0 synapses
May 20 12:39:35 finley crmd: [25840]: info: do_te_invoke: Processing graph 3596 (ref=pe_calc-dc-1305887975-6249) derived from /var/lib/pengine/pe-input-4755.bz2
May 20 12:39:35 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:39:35 finley crmd: [25840]: notice: run_graph: Transition 3596 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4755.bz2): Complete
May 20 12:39:35 finley crmd: [25840]: info: te_graph_trigger: Transition 3596 is now complete
May 20 12:39:35 finley crmd: [25840]: info: notify_crmd: Transition 3596 status: done - <null>
May 20 12:39:35 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:39:35 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:39:35 finley pengine: [25839]: info: process_pe_message: Transition 3596: PEngine Input stored in: /var/lib/pengine/pe-input-4755.bz2
May 20 12:39:37 finley attrd: [25838]: info: attrd_local_callback: Sending full refresh (origin=crmd)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 12:39:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 12:39:38 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 12:39:53 finley cibadmin: [23630]: info: Invoked: cibadmin -Ql 
May 20 12:39:53 finley cibadmin: [23632]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:53 finley cibadmin: [23634]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:53 finley crm_resource: [23636]: info: Invoked: crm_resource -W -r ip_virtual0 
May 20 12:39:53 finley crm_resource: [23636]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:53 finley crm_resource: [23636]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:53 finley crm_resource: [23636]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:53 finley crm_resource: [23636]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:53 finley crm_resource: [23636]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:53 finley crm_resource: [23636]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:53 finley crm_resource: [23636]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:53 finley crm_resource: [23636]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:53 finley crm_resource: [23636]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley cibadmin: [23638]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley cibadmin: [23640]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley crm_resource: [23642]: info: Invoked: crm_resource -W -r iscsi0_target 
May 20 12:39:54 finley crm_resource: [23642]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23642]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23642]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23642]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23642]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23642]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23642]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23642]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23642]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley cibadmin: [23644]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley cibadmin: [23646]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley crm_resource: [23648]: info: Invoked: crm_resource -W -r iscsi0_lun0 
May 20 12:39:54 finley crm_resource: [23648]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23648]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23648]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23648]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23648]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23648]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23648]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23648]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23648]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley cibadmin: [23650]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley cibadmin: [23652]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley crm_resource: [23654]: info: Invoked: crm_resource -W -r iscsi0_lun1 
May 20 12:39:54 finley crm_resource: [23654]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23654]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23654]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23654]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23654]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23654]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23654]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23654]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23654]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley cibadmin: [23656]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley cibadmin: [23658]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley crm_resource: [23660]: info: Invoked: crm_resource -W -r iscsi0_lun2 
May 20 12:39:54 finley crm_resource: [23660]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23660]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23660]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23660]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23660]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23660]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23660]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23660]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley crm_resource: [23660]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:54 finley cibadmin: [23662]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley cibadmin: [23664]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:54 finley crm_resource: [23666]: info: Invoked: crm_resource -W -r ms_drbd_r0 
May 20 12:39:55 finley crm_resource: [23666]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23666]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23666]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23666]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23666]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23666]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23666]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23666]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23666]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley cibadmin: [23668]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley cibadmin: [23670]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley crm_resource: [23672]: info: Invoked: crm_resource -W -r ms_drbd_r1 
May 20 12:39:55 finley crm_resource: [23672]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23672]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23672]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23672]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23672]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23672]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23672]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23672]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23672]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley cibadmin: [23674]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley cibadmin: [23676]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley crm_resource: [23678]: info: Invoked: crm_resource -W -r ms_drbd_r2 
May 20 12:39:55 finley crm_resource: [23678]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23678]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23678]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23678]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23678]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23678]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23678]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23678]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23678]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley cibadmin: [23680]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley cibadmin: [23682]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley crm_resource: [23684]: info: Invoked: crm_resource -W -r ping_clone 
May 20 12:39:55 finley crm_resource: [23684]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23684]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23684]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23684]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23684]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23684]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23684]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23684]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23684]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley cibadmin: [23686]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley cibadmin: [23688]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley cibadmin: [23690]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley cibadmin: [23692]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:55 finley crm_resource: [23694]: info: Invoked: crm_resource -W -r ip_virtual0 
May 20 12:39:55 finley crm_resource: [23694]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23694]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23694]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23694]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23694]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23694]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23694]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23694]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:55 finley crm_resource: [23694]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley cibadmin: [23696]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:56 finley cibadmin: [23698]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:56 finley crm_resource: [23700]: info: Invoked: crm_resource -W -r iscsi0_target 
May 20 12:39:56 finley crm_resource: [23700]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23700]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23700]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23700]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23700]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23700]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23700]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23700]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23700]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley cibadmin: [23702]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:56 finley cibadmin: [23704]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:56 finley crm_resource: [23706]: info: Invoked: crm_resource -W -r iscsi0_lun0 
May 20 12:39:56 finley crm_resource: [23706]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23706]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23706]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23706]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23706]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23706]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23706]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23706]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23706]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley cibadmin: [23708]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:56 finley cibadmin: [23710]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:56 finley crm_resource: [23712]: info: Invoked: crm_resource -W -r iscsi0_lun1 
May 20 12:39:56 finley crm_resource: [23712]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23712]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23712]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23712]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23712]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23712]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23712]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23712]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23712]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley cibadmin: [23714]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:56 finley cibadmin: [23716]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:56 finley crm_resource: [23718]: info: Invoked: crm_resource -W -r iscsi0_lun2 
May 20 12:39:56 finley crm_resource: [23718]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23718]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23718]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23718]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23718]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23718]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23718]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23718]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley crm_resource: [23718]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:56 finley cibadmin: [23720]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:56 finley cibadmin: [23722]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:57 finley crm_resource: [23724]: info: Invoked: crm_resource -W -r ms_drbd_r0 
May 20 12:39:57 finley crm_resource: [23724]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23724]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23724]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23724]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23724]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23724]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23724]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23724]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23724]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley cibadmin: [23726]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:57 finley cibadmin: [23728]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:57 finley crm_resource: [23731]: info: Invoked: crm_resource -W -r ms_drbd_r1 
May 20 12:39:57 finley crm_resource: [23731]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23731]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23731]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23731]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23731]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23731]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23731]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23731]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23731]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley cibadmin: [23733]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:57 finley cibadmin: [23735]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:57 finley crm_resource: [23737]: info: Invoked: crm_resource -W -r ms_drbd_r2 
May 20 12:39:57 finley crm_resource: [23737]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23737]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23737]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23737]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23737]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23737]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23737]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23737]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23737]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley cibadmin: [23739]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:57 finley cibadmin: [23741]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:57 finley crm_resource: [23743]: info: Invoked: crm_resource -W -r ping_clone 
May 20 12:39:57 finley crm_resource: [23743]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23743]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23743]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23743]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23743]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23743]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23743]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23743]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley crm_resource: [23743]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:39:57 finley cibadmin: [23745]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:57 finley cibadmin: [23747]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:39:58 finley cibadmin: [23749]: info: Invoked: cibadmin -Ql 
May 20 12:39:59 finley cibadmin: [23832]: info: Invoked: cibadmin -p -R 
May 20 12:39:59 finley cib: [25836]: info: cib_replace_notify: Replaced: 0.2132.7 -> 0.2133.1 from <null>
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2132" num_updates="7" >
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 12:39:59 finley attrd: [25838]: info: do_cib_replaced: Sending full refresh
May 20 12:39:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" __crm_diff_marker__="removed:top" />
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="openais" __crm_diff_marker__="removed:top" />
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-expected-quorum-votes" name="expected-quorum-votes" value="3" __crm_diff_marker__="removed:top" />
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2133" num_updates="1" />
May 20 12:39:59 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_replace for section 'all' (origin=local/cibadmin/2, version=0.2133.1): ok (rc=0)
May 20 12:39:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 12:39:59 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 12:39:59 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:39:59 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:39:59 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:39:59 finley crmd: [25840]: info: do_pe_invoke: Query 5732: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:39:59 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_cib_replaced ]
May 20 12:39:59 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 12:39:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 12:39:59 finley cibadmin: [23834]: info: Invoked: cibadmin -Ql 
May 20 12:39:59 finley cib: [23835]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-46.raw
May 20 12:39:59 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5730, version=0.2133.1): ok (rc=0)
May 20 12:39:59 finley crmd: [25840]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ]
May 20 12:39:59 finley crmd: [25840]: info: do_dc_takeover: Taking over DC status for this partition
May 20 12:39:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 12:39:59 finley cib: [25836]: info: cib_process_readwrite: We are now in R/O mode
May 20 12:39:59 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_slave_all for section 'all' (origin=local/crmd/5733, version=0.2133.1): ok (rc=0)
May 20 12:39:59 finley cib: [25836]: info: cib_process_readwrite: We are now in R/W mode
May 20 12:39:59 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/5734, version=0.2133.1): ok (rc=0)
May 20 12:39:59 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5735, version=0.2133.1): ok (rc=0)
May 20 12:39:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2133" num_updates="1" />
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2134" num_updates="1" >
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" __crm_diff_marker__="added:top" />
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:39:59 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:39:59 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5738, version=0.2134.1): ok (rc=0)
May 20 12:39:59 finley crmd: [25840]: info: do_dc_join_offer_all: join-34: Waiting on 3 outstanding join acks
May 20 12:39:59 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2134" num_updates="1" />
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2135" num_updates="1" >
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="openais" __crm_diff_marker__="added:top" />
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:40:00 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5741, version=0.2135.1): ok (rc=0)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 12:40:00 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 12:40:00 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 12:40:00 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=2 to corosync
May 20 12:40:00 finley corosync[25820]:   [pcmk  ] info: update_expected_votes: Cannot update expected quorum votes 3 -> 2: value cannot be less that the current number of votes
May 20 12:40:00 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 12:40:00 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2135" num_updates="1" />
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2136" num_updates="1" >
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-expected-quorum-votes" name="expected-quorum-votes" value="3" __crm_diff_marker__="added:top" />
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:40:00 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:40:00 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5745, version=0.2136.1): ok (rc=0)
May 20 12:40:00 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:40:00 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5748, version=0.2136.1): ok (rc=0)
May 20 12:40:00 finley cib: [23835]: info: write_cib_contents: Wrote version 0.2133.0 of the CIB to disk (digest: 62dce2070824941f04a96c8d5be24517)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 12:40:00 finley cib: [23835]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.4ulPLo (digest: /var/lib/heartbeat/crm/cib.vXHHG1)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 12:40:00 finley cib: [23837]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-47.raw
May 20 12:40:00 finley cib: [23837]: info: write_cib_contents: Wrote version 0.2136.0 of the CIB to disk (digest: 09a935b4d4a24467b9d063a188932566)
May 20 12:40:00 finley cib: [23837]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.e4oWKq (digest: /var/lib/heartbeat/crm/cib.xEzVE5)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 12:40:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 12:40:01 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 12:40:01 finley crmd: [25840]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 12:40:01 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes responded to the join offer.
May 20 12:40:01 finley crmd: [25840]: info: do_dc_join_finalize: join-34: Syncing the CIB from finley to the rest of the cluster
May 20 12:40:01 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 12:40:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/5749, version=0.2136.1): ok (rc=0)
May 20 12:40:01 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 12:40:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5750, version=0.2136.1): ok (rc=0)
May 20 12:40:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5751, version=0.2136.1): ok (rc=0)
May 20 12:40:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5752, version=0.2136.1): ok (rc=0)
May 20 12:40:01 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 12:40:01 finley crmd: [25840]: info: do_dc_join_ack: join-34: Updating node state to member for godfrey
May 20 12:40:01 finley crmd: [25840]: info: do_dc_join_ack: join-34: Updating node state to member for finley
May 20 12:40:02 finley crmd: [25840]: info: do_dc_join_ack: join-34: Updating node state to member for ebony
May 20 12:40:02 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']/lrm (origin=local/crmd/5753, version=0.2136.2): ok (rc=0)
May 20 12:40:02 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='godfrey']/lrm": ok (rc=0)
May 20 12:40:03 finley crmd: [25840]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 12:40:03 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:40:03 finley crmd: [25840]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
May 20 12:40:03 finley crmd: [25840]: info: crm_update_quorum: Updating quorum status to true (call=5761)
May 20 12:40:03 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
May 20 12:40:03 finley crmd: [25840]: info: do_pe_invoke: Query 5762: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']/lrm (origin=local/crmd/5755, version=0.2136.4): ok (rc=0)
May 20 12:40:03 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:0;12:5:7:b91d50c5-2309-4f96-ae7b-3bf7b28386fa, cib=0.2136.4) : Resource op removal
May 20 12:40:03 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='finley']/lrm": ok (rc=0)
May 20 12:40:03 finley crmd: [25840]: info: do_pe_invoke: Query 5763: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:03 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 15 resources updated: Skipping all resource events
May 20 12:40:03 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2136.5) : LRM Refresh
May 20 12:40:03 finley crmd: [25840]: info: do_pe_invoke: Query 5764: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/lrm (origin=local/crmd/5757, version=0.2136.6): ok (rc=0)
May 20 12:40:03 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:5;22:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2136.6) : Resource op removal
May 20 12:40:03 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='ebony']/lrm": ok (rc=0)
May 20 12:40:03 finley crmd: [25840]: info: do_pe_invoke: Query 5765: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 12:40:03 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 9 resources updated: Skipping all resource events
May 20 12:40:03 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2136.7) : LRM Refresh
May 20 12:40:03 finley crmd: [25840]: info: do_pe_invoke: Query 5766: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5759, version=0.2136.7): ok (rc=0)
May 20 12:40:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5761, version=0.2136.7): ok (rc=0)
May 20 12:40:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 12:40:04 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 12:40:04 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 12:40:04 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 12:40:04 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 12:40:04 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 12:40:04 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5766, ref=pe_calc-dc-1305888004-6259, seq=1744, quorate=1
May 20 12:40:04 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 12:40:04 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 12:40:04 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 12:40:04 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:40:04 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:40:04 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:40:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:40:04 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:40:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:40:04 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:40:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:40:04 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:40:04 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:40:04 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:40:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:40:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:40:04 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:40:04 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:40:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:40:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:40:04 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:40:04 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:40:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:40:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:40:04 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:40:04 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:40:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:40:04 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:40:04 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:40:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:40:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:40:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:40:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:40:04 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:04 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:04 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:40:04 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:04 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:40:04 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:04 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:04 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:40:04 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:40:04 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:40:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:04 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:40:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:04 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:40:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:04 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:04 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:04 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:40:04 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:40:04 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:40:04 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3597: 0 actions in 0 synapses
May 20 12:40:04 finley crmd: [25840]: info: do_te_invoke: Processing graph 3597 (ref=pe_calc-dc-1305888004-6259) derived from /var/lib/pengine/pe-input-4756.bz2
May 20 12:40:04 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:40:04 finley crmd: [25840]: notice: run_graph: Transition 3597 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4756.bz2): Complete
May 20 12:40:04 finley crmd: [25840]: info: te_graph_trigger: Transition 3597 is now complete
May 20 12:40:04 finley crmd: [25840]: info: notify_crmd: Transition 3597 status: done - <null>
May 20 12:40:04 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:40:04 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:40:04 finley pengine: [25839]: info: process_pe_message: Transition 3597: PEngine Input stored in: /var/lib/pengine/pe-input-4756.bz2
May 20 12:40:04 finley cibadmin: [23914]: info: Invoked: cibadmin -Ql -o nodes 
May 20 12:40:04 finley cibadmin: [23916]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:40:04 finley cibadmin: [23918]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:40:04 finley crm_resource: [23920]: info: Invoked: crm_resource -C -r rg_iscsi -H godfrey 
May 20 12:40:05 finley crm_resource: [23920]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:05 finley crm_resource: [23920]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:05 finley crm_resource: [23920]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:05 finley crm_resource: [23920]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:05 finley crm_resource: [23920]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:05 finley crm_resource: [23920]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:05 finley crm_resource: [23920]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:05 finley crm_resource: [23920]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:05 finley crm_resource: [23920]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:05 finley cibadmin: [23922]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='ip_virtual0'] (origin=godfrey/crmd/50, version=0.2136.8): ok (rc=0)
May 20 12:40:05 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;10:3515:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2136.8) : Resource op removal
May 20 12:40:05 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:40:05 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:40:05 finley crmd: [25840]: info: do_pe_invoke: Query 5767: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2136" num_updates="8" />
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2137" num_updates="1" >
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1305888005" __crm_diff_marker__="added:top" />
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:40:05 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:40:05 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 12:40:05 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/53, version=0.2137.1): ok (rc=0)
May 20 12:40:05 finley crmd: [25840]: info: do_pe_invoke: Query 5768: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_target'] (origin=godfrey/crmd/54, version=0.2137.2): ok (rc=0)
May 20 12:40:05 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:7;11:3515:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2137.2) : Resource op removal
May 20 12:40:05 finley crmd: [25840]: info: do_pe_invoke: Query 5770: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/57, version=0.2137.2): ok (rc=0)
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun0'] (origin=godfrey/crmd/58, version=0.2137.3): ok (rc=0)
May 20 12:40:05 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:7;12:3515:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2137.3) : Resource op removal
May 20 12:40:05 finley crmd: [25840]: info: do_pe_invoke: Query 5771: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/61, version=0.2137.3): ok (rc=0)
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun1'] (origin=godfrey/crmd/62, version=0.2137.4): ok (rc=0)
May 20 12:40:05 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:7;13:3515:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2137.4) : Resource op removal
May 20 12:40:05 finley crmd: [25840]: info: do_pe_invoke: Query 5772: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/65, version=0.2137.4): ok (rc=0)
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun2'] (origin=godfrey/crmd/66, version=0.2137.5): ok (rc=0)
May 20 12:40:05 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:7;14:3515:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2137.5) : Resource op removal
May 20 12:40:05 finley crmd: [25840]: info: do_pe_invoke: Query 5773: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/69, version=0.2137.5): ok (rc=0)
May 20 12:40:05 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 12:40:05 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 12:40:05 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:40:05 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:40:06 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5775, version=0.2137.5): ok (rc=0)
May 20 12:40:06 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5773, ref=pe_calc-dc-1305888006-6261, seq=1744, quorate=1
May 20 12:40:06 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:40:06 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:40:06 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:40:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:40:06 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:40:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:40:06 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:40:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:40:06 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:40:06 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:40:06 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:40:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:40:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:40:06 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:40:06 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:40:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:40:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:40:06 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:40:06 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:40:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:40:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:40:06 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:40:06 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:40:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:40:06 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:40:06 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:40:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:40:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:40:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:40:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:40:06 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:06 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:06 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:40:06 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:06 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:40:06 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:06 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:06 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:40:06 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:40:06 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:40:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:06 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:40:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:06 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:40:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:06 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:06 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:06 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:40:06 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:40:06 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:40:06 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3598: 7 actions in 7 synapses
May 20 12:40:06 finley crmd: [25840]: info: do_te_invoke: Processing graph 3598 (ref=pe_calc-dc-1305888006-6261) derived from /var/lib/pengine/pe-input-4757.bz2
May 20 12:40:06 finley crmd: [25840]: info: te_rsc_command: Initiating action 4: monitor ip_virtual0_monitor_0 on godfrey
May 20 12:40:06 finley crmd: [25840]: info: te_rsc_command: Initiating action 5: monitor iscsi0_target_monitor_0 on godfrey
May 20 12:40:06 finley crmd: [25840]: info: te_rsc_command: Initiating action 6: monitor iscsi0_lun0_monitor_0 on godfrey
May 20 12:40:06 finley crmd: [25840]: info: te_rsc_command: Initiating action 7: monitor iscsi0_lun1_monitor_0 on godfrey
May 20 12:40:06 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: monitor iscsi0_lun2_monitor_0 on godfrey
May 20 12:40:06 finley cib: [23923]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-48.raw
May 20 12:40:06 finley pengine: [25839]: info: process_pe_message: Transition 3598: PEngine Input stored in: /var/lib/pengine/pe-input-4757.bz2
May 20 12:40:06 finley cib: [23923]: info: write_cib_contents: Wrote version 0.2137.0 of the CIB to disk (digest: 45a0870cc02ecf5d691d5e62abaa9543)
May 20 12:40:06 finley cib: [23923]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.qHJf4A (digest: /var/lib/heartbeat/crm/cib.70byhq)
May 20 12:40:06 finley cibadmin: [23925]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:40:06 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (4) confirmed on godfrey (rc=0)
May 20 12:40:06 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (6) confirmed on godfrey (rc=0)
May 20 12:40:06 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (5) confirmed on godfrey (rc=0)
May 20 12:40:06 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (7) confirmed on godfrey (rc=0)
May 20 12:40:06 finley crm_resource: [23927]: info: Invoked: crm_resource -C -r rg_iscsi -H finley 
May 20 12:40:06 finley crm_resource: [23927]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:06 finley crm_resource: [23927]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:06 finley crm_resource: [23927]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:06 finley crm_resource: [23927]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:06 finley crm_resource: [23927]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:06 finley crm_resource: [23927]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:06 finley crm_resource: [23927]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:06 finley crm_resource: [23927]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:06 finley crm_resource: [23927]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:06 finley crmd: [25840]: info: do_lrm_invoke: Removing resource ip_virtual0 from the LRM
May 20 12:40:06 finley crmd: [25840]: info: do_lrm_invoke: Resource 'ip_virtual0' deleted for 23927_crm_resource on finley
May 20 12:40:06 finley crmd: [25840]: info: notify_deleted: Notifying 23927_crm_resource on finley that ip_virtual0 was deleted
May 20 12:40:06 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op ip_virtual0_delete_60000 from 0:0:crm-resource-23927: lrm_invoke-lrmd-1305888006-6268
May 20 12:40:06 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='ip_virtual0'] (origin=local/crmd/5776, version=0.2137.10): ok (rc=0)
May 20 12:40:06 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_target from the LRM
May 20 12:40:06 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_target' deleted for 23927_crm_resource on finley
May 20 12:40:06 finley crmd: [25840]: info: notify_deleted: Notifying 23927_crm_resource on finley that iscsi0_target was deleted
May 20 12:40:06 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_target_delete_60000 from 0:0:crm-resource-23927: lrm_invoke-lrmd-1305888006-6269
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2137" num_updates="10" >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305888005" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2138" num_updates="1" >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305888006" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5778, version=0.2138.1): ok (rc=0)
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_target'] (origin=local/crmd/5779, version=0.2138.2): ok (rc=0)
May 20 12:40:07 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun0 from the LRM
May 20 12:40:07 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun0' deleted for 23927_crm_resource on finley
May 20 12:40:07 finley crmd: [25840]: info: notify_deleted: Notifying 23927_crm_resource on finley that iscsi0_lun0 was deleted
May 20 12:40:07 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun0_delete_60000 from 0:0:crm-resource-23927: lrm_invoke-lrmd-1305888007-6270
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5781, version=0.2138.2): ok (rc=0)
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun0'] (origin=local/crmd/5782, version=0.2138.3): ok (rc=0)
May 20 12:40:07 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;11:3496:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2137.10) : Resource op removal
May 20 12:40:07 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 12:40:07 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:40:07 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=0) : Non-status change
May 20 12:40:07 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:40:07 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:7;12:3496:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2138.2) : Resource op removal
May 20 12:40:07 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:7;13:3496:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2138.3) : Resource op removal
May 20 12:40:07 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun1 from the LRM
May 20 12:40:07 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun1' deleted for 23927_crm_resource on finley
May 20 12:40:07 finley crmd: [25840]: info: notify_deleted: Notifying 23927_crm_resource on finley that iscsi0_lun1 was deleted
May 20 12:40:07 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun1_delete_60000 from 0:0:crm-resource-23927: lrm_invoke-lrmd-1305888007-6271
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2138" num_updates="3" >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305888006" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2139" num_updates="1" >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305888007" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:40:07 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5784, version=0.2139.1): ok (rc=0)
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun1'] (origin=local/crmd/5786, version=0.2139.2): ok (rc=0)
May 20 12:40:07 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun2 from the LRM
May 20 12:40:07 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun2' deleted for 23927_crm_resource on finley
May 20 12:40:07 finley crmd: [25840]: info: notify_deleted: Notifying 23927_crm_resource on finley that iscsi0_lun2 was deleted
May 20 12:40:07 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun2_delete_60000 from 0:0:crm-resource-23927: lrm_invoke-lrmd-1305888007-6272
May 20 12:40:07 finley cibadmin: [23929]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5788, version=0.2139.2): ok (rc=0)
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun2'] (origin=local/crmd/5789, version=0.2139.3): ok (rc=0)
May 20 12:40:07 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=0) : Non-status change
May 20 12:40:07 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:40:07 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 12:40:07 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 12:40:07 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:7;14:3496:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2139.2) : Resource op removal
May 20 12:40:07 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:7;15:3496:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2139.3) : Resource op removal
May 20 12:40:07 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5791, version=0.2139.4): ok (rc=0)
May 20 12:40:07 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:40:07 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (8) confirmed on godfrey (rc=0)
May 20 12:40:07 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 12:40:07 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 12:40:07 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5794, version=0.2139.4): ok (rc=0)
May 20 12:40:07 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:40:07 finley crmd: [25840]: info: te_rsc_command: Initiating action 3: probe_complete probe_complete on godfrey - no waiting
May 20 12:40:07 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:40:07 finley crmd: [25840]: notice: run_graph: Transition 3598 (Complete=6, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pengine/pe-input-4757.bz2): Stopped
May 20 12:40:07 finley crmd: [25840]: info: te_graph_trigger: Transition 3598 is now complete
May 20 12:40:07 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:40:07 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:40:07 finley crmd: [25840]: info: do_pe_invoke: Query 5797: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5796, version=0.2139.4): ok (rc=0)
May 20 12:40:07 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5797, ref=pe_calc-dc-1305888007-6274, seq=1744, quorate=1
May 20 12:40:07 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:40:07 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:40:07 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:40:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:40:07 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:40:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:40:07 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:40:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:40:07 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:40:07 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:40:07 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:40:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:40:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:40:07 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:40:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:40:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:40:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:40:07 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:40:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:40:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:40:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:40:07 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:40:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:40:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:40:07 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:40:07 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:40:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:40:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:40:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:40:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:40:07 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:40:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:40:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:07 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:40:07 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:40:07 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:40:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:07 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:40:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:07 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:40:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:07 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:07 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:07 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:40:07 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:40:07 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:40:07 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3599: 7 actions in 7 synapses
May 20 12:40:07 finley crmd: [25840]: info: do_te_invoke: Processing graph 3599 (ref=pe_calc-dc-1305888007-6274) derived from /var/lib/pengine/pe-input-4758.bz2
May 20 12:40:07 finley crmd: [25840]: info: te_rsc_command: Initiating action 5: monitor ip_virtual0_monitor_0 on finley (local)
May 20 12:40:07 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=5:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d op=ip_virtual0_monitor_0 )
May 20 12:40:07 finley lrmd: [25837]: info: rsc:ip_virtual0:1150: probe
May 20 12:40:07 finley crmd: [25840]: info: te_rsc_command: Initiating action 6: monitor iscsi0_target_monitor_0 on finley (local)
May 20 12:40:07 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=6:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_target_monitor_0 )
May 20 12:40:07 finley lrmd: [25837]: info: rsc:iscsi0_target:1151: probe
May 20 12:40:07 finley crmd: [25840]: info: te_rsc_command: Initiating action 7: monitor iscsi0_lun0_monitor_0 on finley (local)
May 20 12:40:08 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=7:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun0_monitor_0 )
May 20 12:40:08 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1152: probe
May 20 12:40:08 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: monitor iscsi0_lun1_monitor_0 on finley (local)
May 20 12:40:08 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=8:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun1_monitor_0 )
May 20 12:40:08 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1153: probe
May 20 12:40:08 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: monitor iscsi0_lun2_monitor_0 on finley (local)
May 20 12:40:08 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=9:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun2_monitor_0 )
May 20 12:40:08 finley crmd: [25840]: info: process_lrm_event: LRM operation ip_virtual0_monitor_0 (call=1150, rc=7, cib-update=5798, confirmed=true) not running
May 20 12:40:08 finley cibadmin: [24009]: info: Invoked: cibadmin -Ql -o resources 
May 20 12:40:08 finley iSCSITarget[23931]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 12:40:08 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (5) confirmed on finley (rc=0)
May 20 12:40:08 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_target_monitor_0 (call=1151, rc=7, cib-update=5799, confirmed=true) not running
May 20 12:40:08 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun1_monitor_0 (call=1153, rc=7, cib-update=5800, confirmed=true) not running
May 20 12:40:08 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun0_monitor_0 (call=1152, rc=7, cib-update=5801, confirmed=true) not running
May 20 12:40:08 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (6) confirmed on finley (rc=0)
May 20 12:40:08 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (8) confirmed on finley (rc=0)
May 20 12:40:08 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (7) confirmed on finley (rc=0)
May 20 12:40:08 finley pengine: [25839]: info: process_pe_message: Transition 3599: PEngine Input stored in: /var/lib/pengine/pe-input-4758.bz2
May 20 12:40:08 finley cib: [24032]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-49.raw
May 20 12:40:08 finley cib: [24032]: info: write_cib_contents: Wrote version 0.2139.0 of the CIB to disk (digest: 18473e9280e9249cb8fca8f80e6e2a28)
May 20 12:40:08 finley cib: [24032]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.DkzJiF (digest: /var/lib/heartbeat/crm/cib.RmUvKy)
May 20 12:40:08 finley attrd: [25838]: info: attrd_local_callback: Sending full refresh (origin=crmd)
May 20 12:40:08 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 12:40:08 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 12:40:08 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 12:40:09 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1154: probe
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 12:40:09 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun2_monitor_0 (call=1154, rc=7, cib-update=5802, confirmed=true) not running
May 20 12:40:09 finley crm_resource: [24058]: info: Invoked: crm_resource -C -r rg_iscsi -H ebony 
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 12:40:09 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (9) confirmed on finley (rc=0)
May 20 12:40:09 finley crmd: [25840]: info: te_rsc_command: Initiating action 4: probe_complete probe_complete on finley (local) - no waiting
May 20 12:40:09 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 2 fired and confirmed
May 20 12:40:09 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:40:09 finley crmd: [25840]: notice: run_graph: Transition 3599 (Complete=7, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4758.bz2): Complete
May 20 12:40:09 finley crmd: [25840]: info: te_graph_trigger: Transition 3599 is now complete
May 20 12:40:09 finley crmd: [25840]: info: notify_crmd: Transition 3599 status: done - <null>
May 20 12:40:09 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:40:09 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 12:40:09 finley crm_resource: [24058]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:09 finley crm_resource: [24058]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:09 finley crm_resource: [24058]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:09 finley crm_resource: [24058]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:09 finley crm_resource: [24058]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:09 finley crm_resource: [24058]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:09 finley crm_resource: [24058]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:09 finley crm_resource: [24058]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:09 finley crm_resource: [24058]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 12:40:09 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 12:40:10 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 12:40:11 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='ip_virtual0'] (origin=ebony/crmd/25, version=0.2139.10): ok (rc=0)
May 20 12:40:11 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;16:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2139.10) : Resource op removal
May 20 12:40:11 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:40:11 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:40:11 finley crmd: [25840]: info: do_pe_invoke: Query 5803: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:11 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5803, ref=pe_calc-dc-1305888011-6282, seq=1744, quorate=1
May 20 12:40:11 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:40:11 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:40:11 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:40:11 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:40:11 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:40:11 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:40:11 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:40:11 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:40:11 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:40:11 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:40:11 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:40:11 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:40:11 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:40:11 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:40:11 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:40:11 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:40:11 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:40:11 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:40:11 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:11 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:40:11 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:40:11 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:11 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:40:11 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:40:11 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:11 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:40:11 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:40:11 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:40:11 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:40:11 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:40:11 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:40:11 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:40:11 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:40:11 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:11 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:11 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:40:11 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:11 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:40:11 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:11 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:11 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:40:11 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:40:11 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:11 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:40:11 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:11 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:40:11 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:11 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:40:11 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:11 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:11 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:11 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:11 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:40:11 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:40:11 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:40:11 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3600: 3 actions in 3 synapses
May 20 12:40:11 finley crmd: [25840]: info: do_te_invoke: Processing graph 3600 (ref=pe_calc-dc-1305888011-6282) derived from /var/lib/pengine/pe-input-4759.bz2
May 20 12:40:11 finley crmd: [25840]: info: te_rsc_command: Initiating action 6: monitor ip_virtual0_monitor_0 on ebony
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2139" num_updates="10" >
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305888007" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2140" num_updates="1" >
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:40:11 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=0) : Non-status change
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:40:11 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 12:40:11 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:11 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305888010" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:11 finley pengine: [25839]: info: process_pe_message: Transition 3600: PEngine Input stored in: /var/lib/pengine/pe-input-4759.bz2
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:40:11 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:40:11 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/27, version=0.2140.1): ok (rc=0)
May 20 12:40:11 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 12:40:11 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 12:40:11 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:40:11 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:40:11 finley cib: [24059]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-50.raw
May 20 12:40:11 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5806, version=0.2140.1): ok (rc=0)
May 20 12:40:12 finley cib: [24059]: info: write_cib_contents: Wrote version 0.2140.0 of the CIB to disk (digest: c533f0bd0a2955ef02b47ead6a1ff780)
May 20 12:40:12 finley cib: [24059]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.850kmL (digest: /var/lib/heartbeat/crm/cib.HSEIRK)
May 20 12:40:12 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='iscsi0_target'] (origin=ebony/crmd/28, version=0.2140.2): ok (rc=0)
May 20 12:40:12 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:5;17:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2140.2) : Resource op removal
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2140" num_updates="2" >
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305888010" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2141" num_updates="1" >
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:12 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=0) : Non-status change
May 20 12:40:12 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305888012" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:40:12 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:40:12 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/30, version=0.2141.1): ok (rc=0)
May 20 12:40:12 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 12:40:12 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 12:40:12 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:40:12 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:40:12 finley cib: [24060]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-51.raw
May 20 12:40:12 finley cib: [24060]: info: write_cib_contents: Wrote version 0.2141.0 of the CIB to disk (digest: 5da347e40632869a4da2d0b26afa18b9)
May 20 12:40:12 finley cib: [24060]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.5H22cM (digest: /var/lib/heartbeat/crm/cib.LWH8yM)
May 20 12:40:12 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5809, version=0.2141.1): ok (rc=0)
May 20 12:40:12 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='iscsi0_lun0'] (origin=ebony/crmd/31, version=0.2141.2): ok (rc=0)
May 20 12:40:12 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:5;18:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2141.2) : Resource op removal
May 20 12:40:12 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/33, version=0.2141.2): ok (rc=0)
May 20 12:40:12 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='iscsi0_lun1'] (origin=ebony/crmd/34, version=0.2141.3): ok (rc=0)
May 20 12:40:12 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:5;19:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2141.3) : Resource op removal
May 20 12:40:13 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/36, version=0.2141.3): ok (rc=0)
May 20 12:40:13 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='iscsi0_lun2'] (origin=ebony/crmd/37, version=0.2141.4): ok (rc=0)
May 20 12:40:13 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:5;20:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2141.4) : Resource op removal
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2141" num_updates="4" >
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305888012" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2142" num_updates="1" >
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305888013" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 12:40:13 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=0) : Non-status change
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 12:40:13 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:40:13 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:40:13 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/39, version=0.2142.1): ok (rc=0)
May 20 12:40:13 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 12:40:13 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 12:40:13 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 12:40:13 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 12:40:13 finley cib: [24061]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-52.raw
May 20 12:40:13 finley cib: [24061]: info: write_cib_contents: Wrote version 0.2142.0 of the CIB to disk (digest: 08d1080750f90dde71f60a22bbf7c74c)
May 20 12:40:13 finley cib: [24061]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.mf7zyO (digest: /var/lib/heartbeat/crm/cib.xXedgR)
May 20 12:40:13 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5812, version=0.2142.1): ok (rc=0)
May 20 12:40:14 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (6) confirmed on ebony (rc=0)
May 20 12:40:14 finley crmd: [25840]: info: te_rsc_command: Initiating action 5: probe_complete probe_complete on ebony - no waiting
May 20 12:40:14 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:40:14 finley crmd: [25840]: notice: run_graph: Transition 3600 (Complete=2, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pengine/pe-input-4759.bz2): Stopped
May 20 12:40:14 finley crmd: [25840]: info: te_graph_trigger: Transition 3600 is now complete
May 20 12:40:14 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:40:14 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:40:14 finley crmd: [25840]: info: do_pe_invoke: Query 5813: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:14 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5813, ref=pe_calc-dc-1305888014-6285, seq=1744, quorate=1
May 20 12:40:14 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:40:14 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:40:14 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:40:14 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:40:14 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:40:14 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:40:14 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:40:14 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:40:14 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:40:14 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:40:14 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:40:14 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:40:14 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:40:14 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:40:14 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:40:14 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:40:14 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:40:14 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:40:14 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:14 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:40:14 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:40:14 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:40:14 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:40:14 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:14 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:40:14 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:40:14 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:40:14 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:14 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:40:14 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:40:14 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:14 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:40:14 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:40:14 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:40:14 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:40:14 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:40:14 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:40:14 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:40:14 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:40:14 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:40:14 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:40:14 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:14 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:14 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:40:14 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:14 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:40:14 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:14 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:14 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:40:14 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:40:14 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:14 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:40:14 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:14 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:40:14 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:14 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:40:14 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:14 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:14 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:14 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:14 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:40:14 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:40:14 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:40:14 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3601: 6 actions in 6 synapses
May 20 12:40:14 finley crmd: [25840]: info: do_te_invoke: Processing graph 3601 (ref=pe_calc-dc-1305888014-6285) derived from /var/lib/pengine/pe-input-4760.bz2
May 20 12:40:14 finley crmd: [25840]: info: te_rsc_command: Initiating action 6: monitor iscsi0_target_monitor_0 on ebony
May 20 12:40:14 finley crmd: [25840]: info: te_rsc_command: Initiating action 7: monitor iscsi0_lun0_monitor_0 on ebony
May 20 12:40:14 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: monitor iscsi0_lun1_monitor_0 on ebony
May 20 12:40:14 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: monitor iscsi0_lun2_monitor_0 on ebony
May 20 12:40:14 finley pengine: [25839]: info: process_pe_message: Transition 3601: PEngine Input stored in: /var/lib/pengine/pe-input-4760.bz2
May 20 12:40:15 finley crmd: [25840]: WARN: status_from_rc: Action 6 (iscsi0_target_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:40:15 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:5;6:3601:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2142.3) : Event failed
May 20 12:40:15 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1
May 20 12:40:15 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:40:15 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (6) confirmed on ebony (rc=4)
May 20 12:40:16 finley crmd: [25840]: WARN: status_from_rc: Action 8 (iscsi0_lun1_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:40:16 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:5;8:3601:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2142.4) : Event failed
May 20 12:40:16 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (8) confirmed on ebony (rc=4)
May 20 12:40:16 finley crmd: [25840]: WARN: status_from_rc: Action 7 (iscsi0_lun0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:40:16 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:5;7:3601:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2142.5) : Event failed
May 20 12:40:16 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (7) confirmed on ebony (rc=4)
May 20 12:40:16 finley crmd: [25840]: WARN: status_from_rc: Action 9 (iscsi0_lun2_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 12:40:16 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:5;9:3601:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2142.6) : Event failed
May 20 12:40:16 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (9) confirmed on ebony (rc=4)
May 20 12:40:16 finley crmd: [25840]: info: te_rsc_command: Initiating action 5: probe_complete probe_complete on ebony - no waiting
May 20 12:40:16 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:40:16 finley crmd: [25840]: notice: run_graph: Transition 3601 (Complete=5, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pengine/pe-input-4760.bz2): Stopped
May 20 12:40:16 finley crmd: [25840]: info: te_graph_trigger: Transition 3601 is now complete
May 20 12:40:16 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:40:16 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:40:16 finley crmd: [25840]: info: do_pe_invoke: Query 5814: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:16 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5814, ref=pe_calc-dc-1305888016-6291, seq=1744, quorate=1
May 20 12:40:16 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:40:16 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:40:16 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:40:16 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:40:16 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:40:16 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:40:16 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:40:16 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:40:16 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:40:16 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 12:40:16 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:40:16 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:40:16 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:40:16 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:40:16 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:40:16 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:40:16 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:40:16 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:40:16 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:16 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:40:16 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:40:16 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:16 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:40:16 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:40:16 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:16 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:40:16 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:40:16 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:40:16 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:40:16 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:40:16 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:40:16 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:40:16 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:40:16 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:16 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:16 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:40:16 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:16 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:40:16 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:16 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:16 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:40:16 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:40:16 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:16 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:40:16 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:16 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:40:16 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:16 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:40:16 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:16 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:16 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:16 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:16 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:40:16 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:40:16 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:40:16 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3602: 0 actions in 0 synapses
May 20 12:40:16 finley crmd: [25840]: info: do_te_invoke: Processing graph 3602 (ref=pe_calc-dc-1305888016-6291) derived from /var/lib/pengine/pe-input-4761.bz2
May 20 12:40:16 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:40:16 finley crmd: [25840]: notice: run_graph: Transition 3602 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4761.bz2): Complete
May 20 12:40:16 finley crmd: [25840]: info: te_graph_trigger: Transition 3602 is now complete
May 20 12:40:16 finley crmd: [25840]: info: notify_crmd: Transition 3602 status: done - <null>
May 20 12:40:16 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:40:16 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:40:16 finley pengine: [25839]: info: process_pe_message: Transition 3602: PEngine Input stored in: /var/lib/pengine/pe-input-4761.bz2
May 20 12:40:45 finley crm_attribute: [24087]: info: Invoked: crm_attribute -N finley -n standby -v off -l forever 
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2142" num_updates="6" >
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="finley" >
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-finley" >
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: -           <nvpair value="on" id="nodes-finley-standby" />
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: -         </instance_attributes>
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: -       </node>
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:40:45 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2143" num_updates="1" >
May 20 12:40:45 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="finley" >
May 20 12:40:45 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-finley" >
May 20 12:40:45 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: +           <nvpair value="off" id="nodes-finley-standby" />
May 20 12:40:45 finley crmd: [25840]: info: do_pe_invoke: Query 5815: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: +         </instance_attributes>
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: +       </node>
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:40:45 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:40:45 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crm_attribute/4, version=0.2143.1): ok (rc=0)
May 20 12:40:45 finley cib: [24088]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-53.raw
May 20 12:40:45 finley cib: [24088]: info: write_cib_contents: Wrote version 0.2143.0 of the CIB to disk (digest: 5f4e84be521476dfe79cedbcb9b352d2)
May 20 12:40:45 finley cib: [24088]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.VilQKK (digest: /var/lib/heartbeat/crm/cib.HgqJEJ)
May 20 12:40:45 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5815, ref=pe_calc-dc-1305888045-6292, seq=1744, quorate=1
May 20 12:40:45 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:40:45 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:40:45 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:40:45 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:40:45 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:40:45 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:40:45 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:40:45 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:40:45 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:40:45 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:40:45 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:40:45 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:40:45 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:40:45 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:40:45 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:40:45 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:40:45 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:40:45 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:45 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:40:45 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:40:45 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:45 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:40:45 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:40:45 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:45 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:40:45 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:40:45 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:40:45 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:40:45 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:40:45 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:40:45 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:40:45 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:40:45 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:45 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:45 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:40:45 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:45 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:40:45 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:45 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:45 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:40:45 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:40:45 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:45 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:40:45 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:45 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:40:45 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:45 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:40:45 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:45 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:45 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:45 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:45 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:45 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:0 on finley
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Start ping_nodes:0#011(finley)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:40:45 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:40:45 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:40:45 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3603: 4 actions in 4 synapses
May 20 12:40:45 finley crmd: [25840]: info: do_te_invoke: Processing graph 3603 (ref=pe_calc-dc-1305888045-6292) derived from /var/lib/pengine/pe-input-4762.bz2
May 20 12:40:45 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 102 fired and confirmed
May 20 12:40:45 finley crmd: [25840]: info: te_rsc_command: Initiating action 100: start ping_nodes:0_start_0 on finley (local)
May 20 12:40:45 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=100:3603:0:8f399f14-fe26-4279-b701-1947eb7b322d op=ping_nodes:0_start_0 )
May 20 12:40:45 finley lrmd: [25837]: info: rsc:ping_nodes:0:1155: start
May 20 12:40:45 finley pengine: [25839]: info: process_pe_message: Transition 3603: PEngine Input stored in: /var/lib/pengine/pe-input-4762.bz2
May 20 12:40:46 finley crmd: [25840]: info: process_lrm_event: LRM operation ping_nodes:0_start_0 (call=1155, rc=0, cib-update=5816, confirmed=true) ok
May 20 12:40:46 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:0_start_0 (100) confirmed on finley (rc=0)
May 20 12:40:46 finley crmd: [25840]: info: te_rsc_command: Initiating action 101: monitor ping_nodes:0_monitor_1000 on finley (local)
May 20 12:40:46 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=101:3603:0:8f399f14-fe26-4279-b701-1947eb7b322d op=ping_nodes:0_monitor_1000 )
May 20 12:40:46 finley lrmd: [25837]: info: rsc:ping_nodes:0:1156: monitor
May 20 12:40:46 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 103 fired and confirmed
May 20 12:40:47 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (20)
May 20 12:40:47 finley attrd: [25838]: info: attrd_perform_update: Sent update 4084: pingd=20
May 20 12:40:47 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=finley, magic=NA, cib=0.2143.3) : Transient attribute: update
May 20 12:40:47 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 12:40:47 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:40:47 finley crmd: [25840]: info: process_lrm_event: LRM operation ping_nodes:0_monitor_1000 (call=1156, rc=0, cib-update=5817, confirmed=false) ok
May 20 12:40:47 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:0_monitor_1000 (101) confirmed on finley (rc=0)
May 20 12:40:47 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:40:47 finley crmd: [25840]: notice: run_graph: Transition 3603 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4762.bz2): Complete
May 20 12:40:47 finley crmd: [25840]: info: te_graph_trigger: Transition 3603 is now complete
May 20 12:40:47 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:40:47 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:40:47 finley crmd: [25840]: info: do_pe_invoke: Query 5818: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:40:48 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5818, ref=pe_calc-dc-1305888048-6295, seq=1744, quorate=1
May 20 12:40:48 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:40:48 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 12:40:48 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:40:48 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:40:48 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:40:48 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:40:48 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:40:48 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:40:48 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:40:48 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:40:48 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:40:48 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:40:48 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:40:48 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:40:48 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:40:48 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:40:48 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:40:48 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:48 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:40:48 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:40:48 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:40:48 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:40:48 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:40:48 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:40:48 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:40:48 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:40:48 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:40:48 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:40:48 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:40:48 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:40:48 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:40:48 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:40:48 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:40:48 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:40:48 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:48 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:40:48 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:48 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:40:48 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:40:48 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:40:48 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:40:48 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:40:48 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 12:40:48 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:40:48 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:40:48 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:40:48 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:40:48 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:40:48 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:40:48 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:40:48 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:40:48 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:40:48 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:48 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 12:40:48 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:40:48 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:40:48 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3604: 0 actions in 0 synapses
May 20 12:40:48 finley crmd: [25840]: info: do_te_invoke: Processing graph 3604 (ref=pe_calc-dc-1305888048-6295) derived from /var/lib/pengine/pe-input-4763.bz2
May 20 12:40:48 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:40:48 finley crmd: [25840]: notice: run_graph: Transition 3604 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4763.bz2): Complete
May 20 12:40:48 finley crmd: [25840]: info: te_graph_trigger: Transition 3604 is now complete
May 20 12:40:48 finley crmd: [25840]: info: notify_crmd: Transition 3604 status: done - <null>
May 20 12:40:48 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:40:48 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:40:48 finley pengine: [25839]: info: process_pe_message: Transition 3604: PEngine Input stored in: /var/lib/pengine/pe-input-4763.bz2
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2143" num_updates="4" >
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="godfrey" >
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-godfrey" >
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: -           <nvpair value="on" id="nodes-godfrey-standby" />
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: -         </instance_attributes>
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: -       </node>
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2144" num_updates="1" >
May 20 12:41:01 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 12:41:01 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="godfrey" >
May 20 12:41:01 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-godfrey" >
May 20 12:41:01 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: +           <nvpair value="off" id="nodes-godfrey-standby" />
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: +         </instance_attributes>
May 20 12:41:01 finley crmd: [25840]: info: do_pe_invoke: Query 5819: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: +       </node>
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 12:41:01 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 12:41:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=godfrey/crm_attribute/4, version=0.2144.1): ok (rc=0)
May 20 12:41:01 finley cib: [24205]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-54.raw
May 20 12:41:01 finley cib: [24205]: info: write_cib_contents: Wrote version 0.2144.0 of the CIB to disk (digest: de656a39b11c05f2ecffafea852a2d51)
May 20 12:41:01 finley cib: [24205]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.goj1dd (digest: /var/lib/heartbeat/crm/cib.Bzp5AE)
May 20 12:41:01 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5819, ref=pe_calc-dc-1305888061-6296, seq=1744, quorate=1
May 20 12:41:01 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:41:01 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:41:01 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:41:01 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:41:01 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:41:01 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:41:01 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:41:01 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:41:01 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:41:01 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:41:01 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:41:01 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:41:01 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:41:01 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:41:01 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:41:01 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:41:01 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:41:01 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:41:01 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:41:01 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:41:01 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:41:01 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:41:01 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:41:01 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:41:01 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:41:01 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:41:01 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:41:01 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:41:01 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:41:01 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:41:01 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:41:01 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:41:01 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:41:01 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:41:01 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:41:01 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:41:01 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:41:01 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:41:01 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:41:01 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:41:01 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:41:01 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 12:41:01 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:41:01 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:41:01 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:41:01 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:41:01 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:41:01 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:41:01 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:41:01 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:41:01 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:41:01 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:41:01 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:41:01 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:41:01 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:41:01 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:41:01 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:41:01 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:41:01 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:41:01 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:41:01 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:41:01 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:41:01 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:41:01 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:41:01 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:41:01 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:41:01 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:41:01 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:1 on godfrey
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Start ping_nodes:1#011(godfrey)
May 20 12:41:01 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:41:01 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:41:01 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3605: 4 actions in 4 synapses
May 20 12:41:01 finley crmd: [25840]: info: do_te_invoke: Processing graph 3605 (ref=pe_calc-dc-1305888061-6296) derived from /var/lib/pengine/pe-input-4764.bz2
May 20 12:41:01 finley pengine: [25839]: info: process_pe_message: Transition 3605: PEngine Input stored in: /var/lib/pengine/pe-input-4764.bz2
May 20 12:41:01 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 105 fired and confirmed
May 20 12:41:01 finley crmd: [25840]: info: te_rsc_command: Initiating action 103: start ping_nodes:1_start_0 on godfrey
May 20 12:41:02 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:1_start_0 (103) confirmed on godfrey (rc=0)
May 20 12:41:02 finley crmd: [25840]: info: te_rsc_command: Initiating action 104: monitor ping_nodes:1_monitor_1000 on godfrey
May 20 12:41:02 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 106 fired and confirmed
May 20 12:41:03 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2144.3) : Transient attribute: update
May 20 12:41:03 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 12:41:03 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 12:41:03 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:1_monitor_1000 (104) confirmed on godfrey (rc=0)
May 20 12:41:03 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:41:03 finley crmd: [25840]: notice: run_graph: Transition 3605 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4764.bz2): Complete
May 20 12:41:03 finley crmd: [25840]: info: te_graph_trigger: Transition 3605 is now complete
May 20 12:41:03 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:41:03 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:41:03 finley crmd: [25840]: info: do_pe_invoke: Query 5820: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:41:03 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5820, ref=pe_calc-dc-1305888063-6299, seq=1744, quorate=1
May 20 12:41:03 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:41:03 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:41:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:41:03 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:41:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:41:03 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:41:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:41:03 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:41:03 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:41:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:41:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:41:03 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:41:03 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:41:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:41:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:41:03 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:41:03 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:41:03 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:41:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:41:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:41:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:41:03 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:41:03 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:41:03 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:41:03 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:41:03 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:41:03 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:41:03 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:41:03 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:41:03 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:41:03 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:41:03 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:41:03 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:41:03 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:41:03 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:41:03 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:41:03 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:41:03 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:41:03 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:41:03 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:41:03 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:41:03 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 12:41:03 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:41:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:41:03 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:41:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:41:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:41:03 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:41:03 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:41:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:41:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:41:03 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:41:03 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:41:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:41:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:41:03 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:41:03 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:41:03 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:41:03 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:41:03 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:41:03 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:41:03 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:41:03 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:41:03 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:41:03 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:41:03 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:41:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:41:03 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:41:03 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:41:03 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3606: 0 actions in 0 synapses
May 20 12:41:03 finley crmd: [25840]: info: do_te_invoke: Processing graph 3606 (ref=pe_calc-dc-1305888063-6299) derived from /var/lib/pengine/pe-input-4765.bz2
May 20 12:41:03 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:41:03 finley crmd: [25840]: notice: run_graph: Transition 3606 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4765.bz2): Complete
May 20 12:41:03 finley crmd: [25840]: info: te_graph_trigger: Transition 3606 is now complete
May 20 12:41:03 finley crmd: [25840]: info: notify_crmd: Transition 3606 status: done - <null>
May 20 12:41:03 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:41:03 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:41:03 finley pengine: [25839]: info: process_pe_message: Transition 3606: PEngine Input stored in: /var/lib/pengine/pe-input-4765.bz2
May 20 12:45:01 finley /USR/SBIN/CRON[25631]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 12:49:11 finley cib: [25836]: info: cib_stats: Processed 1022 operations (18864.00us average, 3% utilization) in the last 10min
May 20 12:55:01 finley /USR/SBIN/CRON[29264]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 12:55:08 finley smartd[1692]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 109 to 108
May 20 12:56:03 finley crmd: [25840]: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped!
May 20 12:56:03 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
May 20 12:56:03 finley crmd: [25840]: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED
May 20 12:56:03 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 12:56:03 finley crmd: [25840]: info: do_pe_invoke: Query 5821: Requesting the current CIB: S_POLICY_ENGINE
May 20 12:56:03 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5821, ref=pe_calc-dc-1305888963-6300, seq=1744, quorate=1
May 20 12:56:03 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 12:56:03 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 12:56:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 12:56:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 12:56:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:56:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 12:56:03 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 12:56:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 12:56:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:56:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 12:56:03 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 12:56:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:56:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 12:56:03 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 12:56:04 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 12:56:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:56:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 12:56:04 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 12:56:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 12:56:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 12:56:04 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 12:56:04 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 12:56:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:56:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 12:56:04 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 12:56:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 12:56:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 12:56:04 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 12:56:04 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:56:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 12:56:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:56:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 12:56:04 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 12:56:04 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 12:56:04 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 12:56:04 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 12:56:04 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 12:56:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 12:56:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 12:56:04 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 12:56:04 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 12:56:04 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 12:56:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 12:56:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 12:56:04 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 12:56:04 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 12:56:04 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 12:56:04 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:56:04 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 12:56:04 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:56:04 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 12:56:04 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 12:56:04 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 12:56:04 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 12:56:04 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 12:56:04 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 12:56:04 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 12:56:04 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:56:04 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 12:56:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 12:56:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 12:56:04 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:56:04 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 12:56:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 12:56:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 12:56:04 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:56:04 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 12:56:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 12:56:04 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 12:56:04 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 12:56:04 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 12:56:04 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 12:56:04 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 12:56:04 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 12:56:04 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 12:56:04 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 12:56:04 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 12:56:04 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 12:56:04 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 12:56:04 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:56:04 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 12:56:04 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 12:56:04 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 12:56:04 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3607: 0 actions in 0 synapses
May 20 12:56:04 finley crmd: [25840]: info: do_te_invoke: Processing graph 3607 (ref=pe_calc-dc-1305888963-6300) derived from /var/lib/pengine/pe-input-4766.bz2
May 20 12:56:04 finley crmd: [25840]: info: run_graph: ====================================================
May 20 12:56:04 finley crmd: [25840]: notice: run_graph: Transition 3607 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4766.bz2): Complete
May 20 12:56:04 finley crmd: [25840]: info: te_graph_trigger: Transition 3607 is now complete
May 20 12:56:04 finley crmd: [25840]: info: notify_crmd: Transition 3607 status: done - <null>
May 20 12:56:04 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 12:56:04 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 12:56:04 finley pengine: [25839]: info: process_pe_message: Transition 3607: PEngine Input stored in: /var/lib/pengine/pe-input-4766.bz2
May 20 12:59:11 finley cib: [25836]: info: cib_stats: Processed 1 operations (40000.00us average, 0% utilization) in the last 10min
May 20 13:00:19 finley lrmd: [25837]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 1000 ms (> 100 ms) before being called (GSource: 0x10d4f20)
May 20 13:00:19 finley lrmd: [25837]: info: G_SIG_dispatch: started at 2027716784 should have started at 2027716684
May 20 13:02:01 finley /USR/SBIN/CRON[31763]: (logcheck) CMD (   if [ -x /usr/sbin/logcheck ]; then nice -n10 /usr/sbin/logcheck; fi)
May 20 13:02:06 finley postfix/pickup[4779]: BDB2D61D0A: uid=104 from=<logcheck>
May 20 13:02:06 finley postfix/cleanup[340]: BDB2D61D0A: message-id=<20110520110206.BDB2D61D0A@finley.localdomain>
May 20 13:02:06 finley postfix/qmgr[6400]: BDB2D61D0A: from=<logcheck@finley.powercraft.nl>, size=547325, nrcpt=1 (queue active)
May 20 13:02:06 finley postfix/cleanup[340]: C930561D0B: message-id=<20110520110206.BDB2D61D0A@finley.localdomain>
May 20 13:02:06 finley postfix/local[344]: BDB2D61D0A: to=<logcheck@finley.powercraft.nl>, orig_to=<logcheck>, relay=local, delay=0.1, delays=0.07/0.01/0/0.02, dsn=2.0.0, status=sent (forwarded as C930561D0B)
May 20 13:02:06 finley postfix/qmgr[6400]: C930561D0B: from=<logcheck@finley.powercraft.nl>, size=547469, nrcpt=1 (queue active)
May 20 13:02:06 finley postfix/qmgr[6400]: BDB2D61D0A: removed
May 20 13:02:07 finley postfix/smtp[345]: C930561D0B: to=<jelledejong@powercraft.nl>, orig_to=<logcheck>, relay=secure.powercraft.nl[84.245.3.195]:587, delay=0.42, delays=0.02/0.03/0.24/0.14, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 1D121213E158)
May 20 13:02:07 finley postfix/qmgr[6400]: C930561D0B: removed
May 20 13:05:01 finley /USR/SBIN/CRON[1418]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 13:08:25 finley cibadmin: [2657]: info: Invoked: cibadmin -Ql 
May 20 13:08:25 finley cibadmin: [2660]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:25 finley cibadmin: [2662]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:25 finley crm_resource: [2664]: info: Invoked: crm_resource -W -r ip_virtual0 
May 20 13:08:26 finley crm_resource: [2664]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2664]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2664]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2664]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2664]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2664]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2664]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2664]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2664]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley cibadmin: [2676]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley cibadmin: [2678]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley crm_resource: [2680]: info: Invoked: crm_resource -W -r iscsi0_target 
May 20 13:08:26 finley crm_resource: [2680]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2680]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2680]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2680]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2680]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2680]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2680]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2680]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2680]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley cibadmin: [2682]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley cibadmin: [2684]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley crm_resource: [2686]: info: Invoked: crm_resource -W -r iscsi0_lun0 
May 20 13:08:26 finley crm_resource: [2686]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2686]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2686]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2686]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2686]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2686]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2686]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2686]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2686]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley cibadmin: [2688]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley cibadmin: [2690]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley crm_resource: [2692]: info: Invoked: crm_resource -W -r iscsi0_lun1 
May 20 13:08:26 finley crm_resource: [2692]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2692]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2692]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2692]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2692]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2692]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2692]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2692]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2692]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley cibadmin: [2694]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley cibadmin: [2696]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley crm_resource: [2698]: info: Invoked: crm_resource -W -r iscsi0_lun2 
May 20 13:08:26 finley crm_resource: [2698]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2698]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2698]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2698]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2698]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2698]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2698]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2698]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley crm_resource: [2698]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:26 finley cibadmin: [2700]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley cibadmin: [2702]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:26 finley crm_resource: [2704]: info: Invoked: crm_resource -W -r ms_drbd_r0 
May 20 13:08:27 finley crm_resource: [2704]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2704]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2704]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2704]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2704]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2704]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2704]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2704]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2704]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley cibadmin: [2708]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:27 finley cibadmin: [2710]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:27 finley crm_resource: [2712]: info: Invoked: crm_resource -W -r ms_drbd_r1 
May 20 13:08:27 finley crm_resource: [2712]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2712]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2712]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2712]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2712]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2712]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2712]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2712]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2712]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley cibadmin: [2714]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:27 finley cibadmin: [2716]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:27 finley crm_resource: [2718]: info: Invoked: crm_resource -W -r ms_drbd_r2 
May 20 13:08:27 finley crm_resource: [2718]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2718]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2718]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2718]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2718]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2718]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2718]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2718]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2718]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley cibadmin: [2720]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:27 finley cibadmin: [2722]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:27 finley crm_resource: [2724]: info: Invoked: crm_resource -W -r ping_clone 
May 20 13:08:27 finley crm_resource: [2724]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2724]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2724]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2724]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2724]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2724]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2724]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2724]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley crm_resource: [2724]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:27 finley cibadmin: [2726]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:27 finley cibadmin: [2728]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:27 finley cibadmin: [2730]: info: Invoked: cibadmin -Ql 
May 20 13:08:28 finley crm_shadow: [2752]: info: Invoked: crm_shadow -c __crmshell.2633 
May 20 13:08:28 finley cibadmin: [2754]: info: Invoked: cibadmin -p -R -o crm_config 
May 20 13:08:28 finley cibadmin: [2756]: info: Invoked: cibadmin -p -R -o rsc_defaults 
May 20 13:08:28 finley cibadmin: [2758]: info: Invoked: cibadmin -p -U 
May 20 13:08:28 finley crm_shadow: [2760]: info: Invoked: crm_shadow -C __crmshell.2633 --force 
May 20 13:08:29 finley cib: [25836]: info: cib_replace_notify: Replaced: 0.2144.4 -> 0.2146.1 from <null>
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: - <cib epoch="2144" num_updates="4" admin_epoch="0" />
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: + <cib epoch="2146" num_updates="1" admin_epoch="0" >
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:08:29 finley attrd: [25838]: info: do_cib_replaced: Sending full refresh
May 20 13:08:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +     <constraints >
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +       <rsc_location id="drbd_r0-not-on-ebony" rsc="ms_drbd_r0" __crm_diff_marker__="added:top" >
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +         <rule id="drbd_r0-not-on-ebony-rule" score="-INFINITY" >
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +           <expression attribute="#uname" id="drbd_r0-not-on-ebony-expression" operation="eq" value="ebony" />
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +         </rule>
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +       </rsc_location>
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +       <rsc_location id="drbd_r1-not-on-ebony" rsc="ms_drbd_r1" __crm_diff_marker__="added:top" >
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +         <rule id="drbd_r1-not-on-ebony-rule" score="-INFINITY" >
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +           <expression attribute="#uname" id="drbd_r1-not-on-ebony-expression" operation="eq" value="ebony" />
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +         </rule>
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +       </rsc_location>
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +       <rsc_location id="drbd_r2-not-on-ebony" rsc="ms_drbd_r2" __crm_diff_marker__="added:top" >
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +         <rule id="drbd_r2-not-on-ebony-rule" score="-INFINITY" >
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +           <expression attribute="#uname" id="drbd_r2-not-on-ebony-expression" operation="eq" value="ebony" />
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +         </rule>
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +       </rsc_location>
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +     </constraints>
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:08:29 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:08:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_replace for section 'all' (origin=local/crm_shadow/2, version=0.2146.1): ok (rc=0)
May 20 13:08:29 finley crm_shadow: [2764]: info: Invoked: crm_shadow -D __crmshell.2633 --force 
May 20 13:08:29 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:08:29 finley crmd: [25840]: info: need_abort: Aborting on change to epoch
May 20 13:08:29 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:08:29 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:08:29 finley crmd: [25840]: info: do_pe_invoke: Query 5824: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:29 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_cib_replaced ]
May 20 13:08:29 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 13:08:29 finley cibadmin: [2766]: info: Invoked: cibadmin -Ql 
May 20 13:08:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5822, version=0.2146.1): ok (rc=0)
May 20 13:08:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:08:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:08:29 finley cib: [2767]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-55.raw
May 20 13:08:29 finley cib: [2767]: info: write_cib_contents: Wrote version 0.2146.0 of the CIB to disk (digest: c2450a0aee4b0ea1de0282043d2e224d)
May 20 13:08:29 finley cib: [2767]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.I2ZjNz (digest: /var/lib/heartbeat/crm/cib.VlQGJn)
May 20 13:08:29 finley crmd: [25840]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ]
May 20 13:08:29 finley crmd: [25840]: info: do_dc_takeover: Taking over DC status for this partition
May 20 13:08:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:08:29 finley cib: [25836]: info: cib_process_readwrite: We are now in R/O mode
May 20 13:08:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_slave_all for section 'all' (origin=local/crmd/5825, version=0.2146.1): ok (rc=0)
May 20 13:08:29 finley cib: [25836]: info: cib_process_readwrite: We are now in R/W mode
May 20 13:08:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/5826, version=0.2146.1): ok (rc=0)
May 20 13:08:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5827, version=0.2146.1): ok (rc=0)
May 20 13:08:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5829, version=0.2146.1): ok (rc=0)
May 20 13:08:29 finley crmd: [25840]: info: do_dc_join_offer_all: join-35: Waiting on 3 outstanding join acks
May 20 13:08:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:08:29 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 13:08:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5831, version=0.2146.1): ok (rc=0)
May 20 13:08:29 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:08:29 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:08:29 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:08:29 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 13:08:29 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 13:08:29 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:08:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5834, version=0.2146.1): ok (rc=0)
May 20 13:08:30 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:08:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5837, version=0.2146.1): ok (rc=0)
May 20 13:08:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:08:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:08:30 finley crmd: [25840]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:08:30 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes responded to the join offer.
May 20 13:08:30 finley crmd: [25840]: info: do_dc_join_finalize: join-35: Syncing the CIB from finley to the rest of the cluster
May 20 13:08:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/5838, version=0.2146.1): ok (rc=0)
May 20 13:08:30 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:08:30 finley crmd: [25840]: info: do_dc_join_ack: join-35: Updating node state to member for godfrey
May 20 13:08:30 finley crmd: [25840]: info: do_dc_join_ack: join-35: Updating node state to member for finley
May 20 13:08:30 finley crmd: [25840]: info: do_dc_join_ack: join-35: Updating node state to member for ebony
May 20 13:08:31 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5839, version=0.2146.1): ok (rc=0)
May 20 13:08:31 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5840, version=0.2146.1): ok (rc=0)
May 20 13:08:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5841, version=0.2146.1): ok (rc=0)
May 20 13:08:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']/lrm (origin=local/crmd/5842, version=0.2146.2): ok (rc=0)
May 20 13:08:32 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='godfrey']/lrm": ok (rc=0)
May 20 13:08:32 finley crmd: [25840]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:08:32 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:08:32 finley crmd: [25840]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
May 20 13:08:32 finley crmd: [25840]: info: crm_update_quorum: Updating quorum status to true (call=5850)
May 20 13:08:32 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
May 20 13:08:32 finley crmd: [25840]: info: do_pe_invoke: Query 5851: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:32 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:08:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']/lrm (origin=local/crmd/5844, version=0.2146.4): ok (rc=0)
May 20 13:08:32 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:0;12:5:7:b91d50c5-2309-4f96-ae7b-3bf7b28386fa, cib=0.2146.4) : Resource op removal
May 20 13:08:32 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='finley']/lrm": ok (rc=0)
May 20 13:08:32 finley crmd: [25840]: info: do_pe_invoke: Query 5852: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:32 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 15 resources updated: Skipping all resource events
May 20 13:08:32 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2146.5) : LRM Refresh
May 20 13:08:32 finley crmd: [25840]: info: do_pe_invoke: Query 5853: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/lrm (origin=local/crmd/5846, version=0.2146.6): ok (rc=0)
May 20 13:08:32 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:5;22:3579:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2146.6) : Resource op removal
May 20 13:08:32 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='ebony']/lrm": ok (rc=0)
May 20 13:08:32 finley crmd: [25840]: info: do_pe_invoke: Query 5854: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:32 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 9 resources updated: Skipping all resource events
May 20 13:08:32 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2146.7) : LRM Refresh
May 20 13:08:32 finley crmd: [25840]: info: do_pe_invoke: Query 5855: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5848, version=0.2146.7): ok (rc=0)
May 20 13:08:32 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:08:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5850, version=0.2146.7): ok (rc=0)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:08:33 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5855, ref=pe_calc-dc-1305889713-6310, seq=1744, quorate=1
May 20 13:08:33 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:08:33 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:08:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:08:33 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:08:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:08:33 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:08:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:08:33 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:08:33 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:08:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:08:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:08:33 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:08:33 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:08:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:08:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:08:33 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:08:33 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:08:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:08:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:08:33 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:08:33 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:08:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:08:33 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:08:33 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:08:33 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:08:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:08:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:08:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:08:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:08:33 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:33 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:33 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:08:33 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:33 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:08:33 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:33 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:33 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:08:33 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:08:33 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 13:08:33 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:33 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:08:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:08:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:33 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:33 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:08:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:08:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:33 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:33 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:08:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:08:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:33 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:08:33 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:08:33 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:08:33 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:08:33 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:08:33 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:08:33 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:08:33 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:33 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:33 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:33 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:08:33 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:08:33 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:08:33 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3608: 0 actions in 0 synapses
May 20 13:08:33 finley crmd: [25840]: info: do_te_invoke: Processing graph 3608 (ref=pe_calc-dc-1305889713-6310) derived from /var/lib/pengine/pe-input-4767.bz2
May 20 13:08:33 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:08:33 finley crmd: [25840]: notice: run_graph: Transition 3608 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4767.bz2): Complete
May 20 13:08:33 finley crmd: [25840]: info: te_graph_trigger: Transition 3608 is now complete
May 20 13:08:33 finley crmd: [25840]: info: notify_crmd: Transition 3608 status: done - <null>
May 20 13:08:33 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:08:33 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:08:33 finley pengine: [25839]: info: process_pe_message: Transition 3608: PEngine Input stored in: /var/lib/pengine/pe-input-4767.bz2
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (20)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:08:33 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:08:34 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:08:34 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:08:34 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:08:34 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:08:34 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_local_callback: Sending full refresh (origin=crmd)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:08:36 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (20)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:08:37 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2146" num_updates="7" >
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="godfrey" >
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-godfrey" >
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: -           <nvpair value="off" id="nodes-godfrey-standby" />
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: -         </instance_attributes>
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: -       </node>
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:08:45 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2147" num_updates="1" >
May 20 13:08:45 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="godfrey" >
May 20 13:08:45 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-godfrey" >
May 20 13:08:45 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: +           <nvpair value="on" id="nodes-godfrey-standby" />
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: +         </instance_attributes>
May 20 13:08:45 finley crmd: [25840]: info: do_pe_invoke: Query 5856: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: +       </node>
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:08:45 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:08:45 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=godfrey/crm_attribute/4, version=0.2147.1): ok (rc=0)
May 20 13:08:46 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5856, ref=pe_calc-dc-1305889725-6311, seq=1744, quorate=1
May 20 13:08:46 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:08:46 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:08:46 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:08:46 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:08:46 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:08:46 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:08:46 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:08:46 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:08:46 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:08:46 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:08:46 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:08:46 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:08:46 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:08:46 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:08:46 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:08:46 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:08:46 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:08:46 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:46 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:08:46 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:08:46 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:46 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:08:46 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:08:46 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:46 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:08:46 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:08:46 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:08:46 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:08:46 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:08:46 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:08:46 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:08:46 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:08:46 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:08:46 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:46 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:46 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:08:46 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:46 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:08:46 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:46 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:46 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:08:46 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:08:46 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 13:08:46 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:46 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:08:46 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:46 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:08:46 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:46 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:08:46 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:46 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:46 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:46 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:46 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Stop resource ping_nodes:1#011(godfrey)
May 20 13:08:46 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:08:46 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:08:46 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3609: 4 actions in 4 synapses
May 20 13:08:46 finley crmd: [25840]: info: do_te_invoke: Processing graph 3609 (ref=pe_calc-dc-1305889725-6311) derived from /var/lib/pengine/pe-input-4768.bz2
May 20 13:08:46 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 107 fired and confirmed
May 20 13:08:46 finley crmd: [25840]: info: te_rsc_command: Initiating action 104: stop ping_nodes:1_stop_0 on godfrey
May 20 13:08:46 finley cib: [2899]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-56.raw
May 20 13:08:46 finley cib: [2899]: info: write_cib_contents: Wrote version 0.2147.0 of the CIB to disk (digest: 6eefc14c919df5604596d6b07d23fd4d)
May 20 13:08:46 finley pengine: [25839]: info: process_pe_message: Transition 3609: PEngine Input stored in: /var/lib/pengine/pe-input-4768.bz2
May 20 13:08:46 finley cib: [2899]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.MmMbT3 (digest: /var/lib/heartbeat/crm/cib.9GjqVl)
May 20 13:08:46 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:1_stop_0 (104) confirmed on godfrey (rc=0)
May 20 13:08:46 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 108 fired and confirmed
May 20 13:08:46 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 3 fired and confirmed
May 20 13:08:46 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:08:46 finley crmd: [25840]: notice: run_graph: Transition 3609 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4768.bz2): Complete
May 20 13:08:46 finley crmd: [25840]: info: te_graph_trigger: Transition 3609 is now complete
May 20 13:08:46 finley crmd: [25840]: info: notify_crmd: Transition 3609 status: done - <null>
May 20 13:08:46 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:08:46 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:08:47 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=1, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2147.3) : Transient attribute: removal
May 20 13:08:47 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:08:47 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:08:47 finley crmd: [25840]: info: do_pe_invoke: Query 5857: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:47 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5857, ref=pe_calc-dc-1305889727-6313, seq=1744, quorate=1
May 20 13:08:47 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:08:47 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:08:47 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:08:47 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:08:47 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:08:47 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:08:47 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:08:47 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:08:47 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:08:47 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:08:47 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:08:47 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:08:47 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:08:47 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:08:47 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:08:47 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:08:47 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:08:47 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:47 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:08:47 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:08:47 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:47 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:08:47 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:08:47 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:47 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:08:47 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:08:47 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:08:47 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:08:47 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:08:47 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:08:47 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:08:47 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:08:47 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:08:47 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:47 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:47 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:08:47 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:47 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:08:47 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:47 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:47 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:08:47 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:08:47 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 13:08:47 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:47 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:08:47 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:47 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:08:47 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:47 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:08:47 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:47 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:47 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:47 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:47 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:08:47 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:08:47 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:08:47 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3610: 0 actions in 0 synapses
May 20 13:08:47 finley crmd: [25840]: info: do_te_invoke: Processing graph 3610 (ref=pe_calc-dc-1305889727-6313) derived from /var/lib/pengine/pe-input-4769.bz2
May 20 13:08:47 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:08:47 finley crmd: [25840]: notice: run_graph: Transition 3610 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4769.bz2): Complete
May 20 13:08:47 finley crmd: [25840]: info: te_graph_trigger: Transition 3610 is now complete
May 20 13:08:47 finley crmd: [25840]: info: notify_crmd: Transition 3610 status: done - <null>
May 20 13:08:47 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:08:47 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:08:47 finley pengine: [25839]: info: process_pe_message: Transition 3610: PEngine Input stored in: /var/lib/pengine/pe-input-4769.bz2
May 20 13:08:52 finley crm_attribute: [2962]: info: Invoked: crm_attribute -N finley -n standby -v on -l forever 
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2147" num_updates="3" >
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="finley" >
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-finley" >
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: -           <nvpair value="off" id="nodes-finley-standby" />
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: -         </instance_attributes>
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: -       </node>
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2148" num_updates="1" >
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 13:08:52 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="finley" >
May 20 13:08:52 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-finley" >
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: +           <nvpair value="on" id="nodes-finley-standby" />
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: +         </instance_attributes>
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: +       </node>
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:08:52 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:08:52 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:08:52 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crm_attribute/4, version=0.2148.1): ok (rc=0)
May 20 13:08:52 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:08:52 finley crmd: [25840]: info: do_pe_invoke: Query 5858: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:52 finley cib: [2963]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-57.raw
May 20 13:08:52 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5858, ref=pe_calc-dc-1305889732-6314, seq=1744, quorate=1
May 20 13:08:52 finley cib: [2963]: info: write_cib_contents: Wrote version 0.2148.0 of the CIB to disk (digest: 18e446c19708cf08fdf775a71631f72c)
May 20 13:08:52 finley cib: [2963]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.MT8F6e (digest: /var/lib/heartbeat/crm/cib.pO2omI)
May 20 13:08:52 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:08:52 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:08:52 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:08:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:08:52 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:08:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:08:52 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:08:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:08:52 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:08:52 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:08:52 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:08:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:08:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:08:52 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:08:52 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:08:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:08:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:08:52 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:08:52 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:52 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:08:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:08:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:08:52 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:08:52 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:52 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:08:52 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:08:52 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:08:52 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:08:52 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:08:52 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:08:52 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:08:52 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:08:52 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:08:52 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:52 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:52 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:08:52 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:52 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:08:52 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:52 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:52 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:08:52 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:08:52 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 13:08:52 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:08:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:52 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:08:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:52 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:08:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:52 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:52 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:52 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Stop resource ping_nodes:0#011(finley)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:08:52 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:08:52 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:08:52 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3611: 4 actions in 4 synapses
May 20 13:08:52 finley crmd: [25840]: info: do_te_invoke: Processing graph 3611 (ref=pe_calc-dc-1305889732-6314) derived from /var/lib/pengine/pe-input-4770.bz2
May 20 13:08:52 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 104 fired and confirmed
May 20 13:08:52 finley crmd: [25840]: info: te_rsc_command: Initiating action 101: stop ping_nodes:0_stop_0 on finley (local)
May 20 13:08:52 finley lrmd: [25837]: info: cancel_op: operation monitor[1156] on ocf::ping::ping_nodes:0 for client 25840, its parameters: CRM_meta_clone=[0] host_list=[192.168.24.1 192.168.24.17 192.168.24.18] attempts=[1] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[3] CRM_meta_notify=[false] dampen=[1] CRM_meta_globally_unique=[false] crm_feature_set=[3.0.1] timeout=[1] multiplier=[10] CRM_meta_name=[monitor] CRM_meta_interval=[1000] CRM_meta_timeout=[60000]  cancelled
May 20 13:08:52 finley lrmd: [25837]: info: flush_op: process for operation monitor[1156] on ocf::ping::ping_nodes:0 for client 25840 still running, flush delayed
May 20 13:08:52 finley lrmd: [25837]: info: on_msg_cancel_op: operation 1156 running, cancel pending
May 20 13:08:52 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=101:3611:0:8f399f14-fe26-4279-b701-1947eb7b322d op=ping_nodes:0_stop_0 )
May 20 13:08:52 finley lrmd: [25837]: info: perform_op:2906: operation monitor[1156] on ocf::ping::ping_nodes:0 for client 25840, its parameters: CRM_meta_clone=[0] host_list=[192.168.24.1 192.168.24.17 192.168.24.18] attempts=[1] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[3] CRM_meta_notify=[false] dampen=[1] CRM_meta_globally_unique=[false] crm_feature_set=[3.0.1] timeout=[1] multiplier=[10] CRM_meta_name=[monitor] CRM_meta_interval=[1000] CRM_meta_timeout=[60000]  for rsc is already running.
May 20 13:08:52 finley lrmd: [25837]: info: perform_op:2916: postponing all ops on resource ping_nodes:0 by 1000 ms
May 20 13:08:52 finley pengine: [25839]: info: process_pe_message: Transition 3611: PEngine Input stored in: /var/lib/pengine/pe-input-4770.bz2
May 20 13:08:53 finley lrmd: [25837]: info: perform_op:2906: operation monitor[1156] on ocf::ping::ping_nodes:0 for client 25840, its parameters: CRM_meta_clone=[0] host_list=[192.168.24.1 192.168.24.17 192.168.24.18] attempts=[1] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[3] CRM_meta_notify=[false] dampen=[1] CRM_meta_globally_unique=[false] crm_feature_set=[3.0.1] timeout=[1] multiplier=[10] CRM_meta_name=[monitor] CRM_meta_interval=[1000] CRM_meta_timeout=[60000]  for rsc is already running.
May 20 13:08:53 finley lrmd: [25837]: info: perform_op:2916: postponing all ops on resource ping_nodes:0 by 1000 ms
May 20 13:08:53 finley lrmd: [25837]: info: rsc:ping_nodes:0:1157: stop
May 20 13:08:53 finley crmd: [25840]: info: process_lrm_event: LRM operation ping_nodes:0_stop_0 (call=1157, rc=0, cib-update=5859, confirmed=true) ok
May 20 13:08:53 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:0_stop_0 (101) confirmed on finley (rc=0)
May 20 13:08:53 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 105 fired and confirmed
May 20 13:08:53 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 2 fired and confirmed
May 20 13:08:53 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:08:53 finley crmd: [25840]: notice: run_graph: Transition 3611 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4770.bz2): Complete
May 20 13:08:53 finley crmd: [25840]: info: te_graph_trigger: Transition 3611 is now complete
May 20 13:08:53 finley crmd: [25840]: info: notify_crmd: Transition 3611 status: done - <null>
May 20 13:08:53 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:08:53 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:08:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 13:08:54 finley attrd: [25838]: info: attrd_perform_update: Sent delete 4346: node=finley, attr=pingd, id=<n/a>, set=(null), section=status
May 20 13:08:54 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=1, tag=transient_attributes, id=finley, magic=NA, cib=0.2148.3) : Transient attribute: removal
May 20 13:08:54 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:08:54 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:08:54 finley crmd: [25840]: info: do_pe_invoke: Query 5860: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:08:54 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5860, ref=pe_calc-dc-1305889734-6316, seq=1744, quorate=1
May 20 13:08:54 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:08:54 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:08:54 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:08:54 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:08:54 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:08:54 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:08:54 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:08:54 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:08:54 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:08:54 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:08:54 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:08:54 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:08:54 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:08:54 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:08:54 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:08:54 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:08:54 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:08:54 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:08:54 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:54 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:08:54 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:08:54 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:54 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:08:54 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:08:54 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:08:54 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:08:54 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:08:54 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:08:54 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:08:54 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:08:54 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:08:54 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:08:54 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:08:54 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:08:54 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:54 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:08:54 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:54 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:08:54 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:08:54 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:08:54 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:08:54 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:08:54 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:08:54 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:08:54 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:08:54 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:08:54 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:08:54 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:08:54 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:08:54 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:08:54 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:08:54 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:54 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:08:54 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:08:54 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:08:54 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3612: 0 actions in 0 synapses
May 20 13:08:54 finley crmd: [25840]: info: do_te_invoke: Processing graph 3612 (ref=pe_calc-dc-1305889734-6316) derived from /var/lib/pengine/pe-input-4771.bz2
May 20 13:08:54 finley cibadmin: [3002]: info: Invoked: cibadmin -Ql 
May 20 13:08:54 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:08:54 finley crmd: [25840]: notice: run_graph: Transition 3612 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4771.bz2): Complete
May 20 13:08:54 finley crmd: [25840]: info: te_graph_trigger: Transition 3612 is now complete
May 20 13:08:54 finley crmd: [25840]: info: notify_crmd: Transition 3612 status: done - <null>
May 20 13:08:54 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:08:54 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:08:54 finley pengine: [25839]: info: process_pe_message: Transition 3612: PEngine Input stored in: /var/lib/pengine/pe-input-4771.bz2
May 20 13:08:55 finley cibadmin: [3004]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:55 finley cibadmin: [3006]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:55 finley crm_resource: [3008]: info: Invoked: crm_resource -W -r ip_virtual0 
May 20 13:08:55 finley crm_resource: [3008]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3008]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3008]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3008]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3008]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3008]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3008]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3008]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3008]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:55 finley cibadmin: [3010]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:55 finley cibadmin: [3012]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:55 finley crm_resource: [3014]: info: Invoked: crm_resource -W -r iscsi0_target 
May 20 13:08:55 finley crm_resource: [3014]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3014]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3014]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3014]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3014]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3014]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3014]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3014]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3014]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:55 finley cibadmin: [3016]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:55 finley cibadmin: [3018]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:55 finley crm_resource: [3020]: info: Invoked: crm_resource -W -r iscsi0_lun0 
May 20 13:08:55 finley crm_resource: [3020]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3020]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3020]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3020]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3020]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3020]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3020]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3020]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:55 finley crm_resource: [3020]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:55 finley cibadmin: [3022]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley cibadmin: [3024]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley crm_resource: [3026]: info: Invoked: crm_resource -W -r iscsi0_lun1 
May 20 13:08:56 finley crm_resource: [3026]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3026]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3026]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3026]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3026]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3026]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3026]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3026]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3026]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley cibadmin: [3028]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley cibadmin: [3030]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley crm_resource: [3032]: info: Invoked: crm_resource -W -r iscsi0_lun2 
May 20 13:08:56 finley crm_resource: [3032]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3032]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3032]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3032]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3032]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3032]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3032]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3032]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3032]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley cibadmin: [3034]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley cibadmin: [3036]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley crm_resource: [3038]: info: Invoked: crm_resource -W -r ms_drbd_r0 
May 20 13:08:56 finley crm_resource: [3038]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3038]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3038]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3038]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3038]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3038]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3038]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3038]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3038]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley cibadmin: [3040]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley cibadmin: [3042]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley crm_resource: [3044]: info: Invoked: crm_resource -W -r ms_drbd_r1 
May 20 13:08:56 finley crm_resource: [3044]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3044]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3044]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3044]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3044]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3044]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3044]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3044]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley crm_resource: [3044]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:56 finley cibadmin: [3046]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley cibadmin: [3048]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:56 finley crm_resource: [3050]: info: Invoked: crm_resource -W -r ms_drbd_r2 
May 20 13:08:57 finley crm_resource: [3050]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3050]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3050]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3050]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3050]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3050]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3050]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3050]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3050]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley cibadmin: [3052]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley cibadmin: [3054]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley crm_resource: [3056]: info: Invoked: crm_resource -W -r ping_clone 
May 20 13:08:57 finley crm_resource: [3056]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3056]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3056]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3056]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3056]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3056]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3056]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3056]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3056]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley cibadmin: [3058]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley cibadmin: [3060]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley cibadmin: [3062]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley cibadmin: [3064]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley crm_resource: [3066]: info: Invoked: crm_resource -W -r ip_virtual0 
May 20 13:08:57 finley crm_resource: [3066]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3066]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3066]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3066]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3066]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3066]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3066]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3066]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3066]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley cibadmin: [3068]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley cibadmin: [3070]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley crm_resource: [3072]: info: Invoked: crm_resource -W -r iscsi0_target 
May 20 13:08:57 finley crm_resource: [3072]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3072]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3072]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3072]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3072]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3072]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3072]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3072]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3072]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley cibadmin: [3074]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley cibadmin: [3076]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:57 finley crm_resource: [3078]: info: Invoked: crm_resource -W -r iscsi0_lun0 
May 20 13:08:57 finley crm_resource: [3078]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3078]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3078]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3078]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3078]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3078]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3078]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3078]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley crm_resource: [3078]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:57 finley cibadmin: [3080]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley cibadmin: [3082]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley crm_resource: [3084]: info: Invoked: crm_resource -W -r iscsi0_lun1 
May 20 13:08:58 finley crm_resource: [3084]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3084]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3084]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3084]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3084]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3084]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3084]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3084]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3084]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley cibadmin: [3086]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley cibadmin: [3088]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley crm_resource: [3090]: info: Invoked: crm_resource -W -r iscsi0_lun2 
May 20 13:08:58 finley crm_resource: [3090]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3090]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3090]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3090]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3090]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3090]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3090]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3090]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3090]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley cibadmin: [3092]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley cibadmin: [3094]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley crm_resource: [3096]: info: Invoked: crm_resource -W -r ms_drbd_r0 
May 20 13:08:58 finley crm_resource: [3096]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3096]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3096]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3096]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3096]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3096]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3096]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3096]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3096]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley cibadmin: [3098]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley cibadmin: [3100]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley crm_resource: [3102]: info: Invoked: crm_resource -W -r ms_drbd_r1 
May 20 13:08:58 finley crm_resource: [3102]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3102]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3102]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3102]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3102]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3102]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3102]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3102]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley crm_resource: [3102]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:58 finley cibadmin: [3104]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley cibadmin: [3106]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:58 finley crm_resource: [3108]: info: Invoked: crm_resource -W -r ms_drbd_r2 
May 20 13:08:59 finley crm_resource: [3108]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3108]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3108]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3108]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3108]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3108]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3108]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3108]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3108]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:59 finley cibadmin: [3110]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:59 finley cibadmin: [3112]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:59 finley crm_resource: [3114]: info: Invoked: crm_resource -W -r ping_clone 
May 20 13:08:59 finley crm_resource: [3114]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3114]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3114]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3114]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3114]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3114]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3114]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3114]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:59 finley crm_resource: [3114]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:08:59 finley cibadmin: [3116]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:59 finley cibadmin: [3118]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:08:59 finley cibadmin: [3120]: info: Invoked: cibadmin -Ql 
May 20 13:09:00 finley cibadmin: [3203]: info: Invoked: cibadmin -p -R 
May 20 13:09:00 finley cib: [25836]: info: cib_replace_notify: Replaced: 0.2148.3 -> 0.2149.1 from <null>
May 20 13:09:00 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2148" num_updates="3" >
May 20 13:09:00 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:09:00 finley attrd: [25838]: info: do_cib_replaced: Sending full refresh
May 20 13:09:00 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:09:01 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" __crm_diff_marker__="removed:top" />
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="openais" __crm_diff_marker__="removed:top" />
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-expected-quorum-votes" name="expected-quorum-votes" value="3" __crm_diff_marker__="removed:top" />
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1305888013" __crm_diff_marker__="removed:top" />
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:09:01 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2149" num_updates="1" />
May 20 13:09:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_replace for section 'all' (origin=local/cibadmin/2, version=0.2149.1): ok (rc=0)
May 20 13:09:01 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:09:01 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:09:01 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:09:01 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:09:01 finley crmd: [25840]: info: do_pe_invoke: Query 5863: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:09:01 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_cib_replaced ]
May 20 13:09:01 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 13:09:01 finley cibadmin: [3205]: info: Invoked: cibadmin -Ql 
May 20 13:09:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5861, version=0.2149.1): ok (rc=0)
May 20 13:09:01 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:09:01 finley crmd: [25840]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ]
May 20 13:09:01 finley crmd: [25840]: info: do_dc_takeover: Taking over DC status for this partition
May 20 13:09:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync_one for section 'all' (origin=godfrey/godfrey/(null), version=0.2149.1): ok (rc=0)
May 20 13:09:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync_one for section 'all' (origin=ebony/ebony/(null), version=0.2149.1): ok (rc=0)
May 20 13:09:02 finley cib: [25836]: info: cib_process_readwrite: We are now in R/O mode
May 20 13:09:02 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_slave_all for section 'all' (origin=local/crmd/5864, version=0.2149.1): ok (rc=0)
May 20 13:09:02 finley cib: [25836]: info: cib_process_readwrite: We are now in R/W mode
May 20 13:09:02 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/5865, version=0.2149.1): ok (rc=0)
May 20 13:09:02 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5866, version=0.2149.1): ok (rc=0)
May 20 13:09:02 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:09:02 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2149" num_updates="1" />
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2150" num_updates="1" >
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" __crm_diff_marker__="added:top" />
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:09:02 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5869, version=0.2150.1): ok (rc=0)
May 20 13:09:02 finley crmd: [25840]: info: do_dc_join_offer_all: join-36: Waiting on 3 outstanding join acks
May 20 13:09:02 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:09:02 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2150" num_updates="1" />
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2151" num_updates="1" >
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="openais" __crm_diff_marker__="added:top" />
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:09:02 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:09:02 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5872, version=0.2151.1): ok (rc=0)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:09:03 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:09:03 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:09:03 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=2 to corosync
May 20 13:09:03 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 13:09:03 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 13:09:03 finley corosync[25820]:   [pcmk  ] info: update_expected_votes: Cannot update expected quorum votes 3 -> 2: value cannot be less that the current number of votes
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2151" num_updates="1" />
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2152" num_updates="1" >
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-expected-quorum-votes" name="expected-quorum-votes" value="3" __crm_diff_marker__="added:top" />
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:09:03 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:09:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5876, version=0.2152.1): ok (rc=0)
May 20 13:09:03 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:09:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5879, version=0.2152.1): ok (rc=0)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:09:03 finley cib: [3206]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-58.raw
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:09:03 finley cib: [3206]: info: write_cib_contents: Wrote version 0.2152.0 of the CIB to disk (digest: 3937e2df2d7a793631f02d8600d869ac)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:09:03 finley cib: [3206]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.FEBpHz (digest: /var/lib/heartbeat/crm/cib.Nj7Rxn)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:09:03 finley crmd: [25840]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:09:03 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes responded to the join offer.
May 20 13:09:03 finley crmd: [25840]: info: do_dc_join_finalize: join-36: Syncing the CIB from finley to the rest of the cluster
May 20 13:09:03 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:09:04 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/5880, version=0.2152.1): ok (rc=0)
May 20 13:09:04 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:09:04 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5881, version=0.2152.1): ok (rc=0)
May 20 13:09:04 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5882, version=0.2152.1): ok (rc=0)
May 20 13:09:04 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5883, version=0.2152.1): ok (rc=0)
May 20 13:09:04 finley crmd: [25840]: info: do_dc_join_ack: join-36: Updating node state to member for godfrey
May 20 13:09:04 finley crmd: [25840]: info: do_dc_join_ack: join-36: Updating node state to member for finley
May 20 13:09:04 finley crmd: [25840]: info: do_dc_join_ack: join-36: Updating node state to member for ebony
May 20 13:09:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']/lrm (origin=local/crmd/5884, version=0.2152.2): ok (rc=0)
May 20 13:09:05 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='godfrey']/lrm": ok (rc=0)
May 20 13:09:05 finley crmd: [25840]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:09:05 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:09:05 finley crmd: [25840]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
May 20 13:09:05 finley crmd: [25840]: info: crm_update_quorum: Updating quorum status to true (call=5892)
May 20 13:09:05 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
May 20 13:09:05 finley crmd: [25840]: info: do_pe_invoke: Query 5893: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:09:05 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']/lrm (origin=local/crmd/5886, version=0.2152.4): ok (rc=0)
May 20 13:09:06 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:0;12:5:7:b91d50c5-2309-4f96-ae7b-3bf7b28386fa, cib=0.2152.4) : Resource op removal
May 20 13:09:06 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='finley']/lrm": ok (rc=0)
May 20 13:09:06 finley crmd: [25840]: info: do_pe_invoke: Query 5894: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:09:06 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 15 resources updated: Skipping all resource events
May 20 13:09:06 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2152.5) : LRM Refresh
May 20 13:09:06 finley crmd: [25840]: info: do_pe_invoke: Query 5895: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:09:06 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/lrm (origin=local/crmd/5888, version=0.2152.6): ok (rc=0)
May 20 13:09:06 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;6:3600:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2152.6) : Resource op removal
May 20 13:09:06 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='ebony']/lrm": ok (rc=0)
May 20 13:09:06 finley crmd: [25840]: info: do_pe_invoke: Query 5896: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:09:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:09:06 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 9 resources updated: Skipping all resource events
May 20 13:09:06 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2152.7) : LRM Refresh
May 20 13:09:06 finley crmd: [25840]: info: do_pe_invoke: Query 5897: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:09:06 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5890, version=0.2152.7): ok (rc=0)
May 20 13:09:06 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5892, version=0.2152.7): ok (rc=0)
May 20 13:09:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:09:06 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5897, ref=pe_calc-dc-1305889746-6326, seq=1744, quorate=1
May 20 13:09:06 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:09:06 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:09:06 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:09:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:09:06 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:09:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:09:06 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:09:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:09:06 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:09:06 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:09:06 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:09:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:09:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:09:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:09:06 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:09:06 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:09:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:09:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:09:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:09:06 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:09:06 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:09:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 13:09:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:09:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:09:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:09:06 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:09:06 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:09:06 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:09:06 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:09:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:09:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:09:06 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:09:06 finley pengine: [25839]: info: determine_online_status: Node ebony is standby
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:09:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:09:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:09:06 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:09:06 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:09:06 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:09:06 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:09:06 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:09:06 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:09:06 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:09:06 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:09:06 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:09:06 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:09:06 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:09:06 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:09:06 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:09:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:09:06 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:09:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:09:06 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:09:06 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:09:06 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:09:06 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:09:06 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:09:06 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:09:06 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:09:06 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:09:06 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3613: 0 actions in 0 synapses
May 20 13:09:06 finley crmd: [25840]: info: do_te_invoke: Processing graph 3613 (ref=pe_calc-dc-1305889746-6326) derived from /var/lib/pengine/pe-input-4772.bz2
May 20 13:09:06 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:09:06 finley crmd: [25840]: notice: run_graph: Transition 3613 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4772.bz2): Complete
May 20 13:09:06 finley crmd: [25840]: info: te_graph_trigger: Transition 3613 is now complete
May 20 13:09:06 finley crmd: [25840]: info: notify_crmd: Transition 3613 status: done - <null>
May 20 13:09:06 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:09:06 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:09:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:09:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:09:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:09:07 finley pengine: [25839]: info: process_pe_message: Transition 3613: PEngine Input stored in: /var/lib/pengine/pe-input-4772.bz2
May 20 13:09:07 finley cibadmin: [3263]: info: Invoked: cibadmin -Ql 
May 20 13:09:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:09:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:09:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_local_callback: Sending full refresh (origin=crmd)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:09:11 finley cib: [25836]: info: cib_stats: Processed 863 operations (16975.00us average, 2% utilization) in the last 10min
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:09:11 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:09:12 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:10:18 finley crmd: [25840]: info: handle_shutdown_request: Creating shutdown request for ebony (state=S_IDLE)
May 20 13:10:18 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=ebony, magic=NA, cib=0.2152.9) : Transient attribute: update
May 20 13:10:18 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:10:18 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:10:18 finley crmd: [25840]: info: do_pe_invoke: Query 5899: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:18 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5899, ref=pe_calc-dc-1305889818-6327, seq=1744, quorate=1
May 20 13:10:18 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:10:18 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:10:18 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:10:18 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:10:18 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:10:18 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:10:18 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:10:18 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:10:18 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:10:18 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:10:18 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:10:18 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:10:18 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:10:18 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:10:18 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:10:18 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:10:18 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:10:18 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:10:18 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:10:18 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:10:18 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:18 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:10:18 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:10:18 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:10:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:10:18 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:10:18 finley pengine: [25839]: info: determine_online_status: Node ebony is shutting down
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:10:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:10:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:2
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:10:18 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:10:18 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:10:18 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:18 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:10:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:18 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:10:18 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:18 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:18 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:10:18 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:10:18 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:18 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:10:18 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:10:18 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:10:18 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:18 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:18 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:18 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:18 finley pengine: [25839]: info: stage6: Scheduling Node ebony for shutdown
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:10:18 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:10:18 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:10:18 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3614: 1 actions in 1 synapses
May 20 13:10:18 finley crmd: [25840]: info: do_te_invoke: Processing graph 3614 (ref=pe_calc-dc-1305889818-6327) derived from /var/lib/pengine/pe-input-4773.bz2
May 20 13:10:18 finley crmd: [25840]: info: te_crm_command: Executing crm-event (106): do_shutdown on ebony
May 20 13:10:18 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:10:18 finley crmd: [25840]: notice: run_graph: Transition 3614 (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4773.bz2): Complete
May 20 13:10:18 finley crmd: [25840]: info: te_graph_trigger: Transition 3614 is now complete
May 20 13:10:18 finley crmd: [25840]: info: notify_crmd: Transition 3614 status: done - <null>
May 20 13:10:18 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:10:18 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:10:18 finley pengine: [25839]: info: process_pe_message: Transition 3614: PEngine Input stored in: /var/lib/pengine/pe-input-4773.bz2
May 20 13:10:19 finley cib: [25836]: info: cib_process_shutdown_req: Shutdown REQ from ebony
May 20 13:10:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_shutdown_req for section 'all' (origin=ebony/ebony/(null), version=0.2152.9): ok (rc=0)
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: update_member: Node ebony now has process list: 00000000000000000000000000000002 (2)
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1744 to 2 children
May 20 13:10:20 finley crmd: [25840]: info: ais_dispatch: Membership 1744: quorum retained
May 20 13:10:20 finley crmd: [25840]: info: crm_update_peer: Node ebony: id=18393280 state=member addr=r(0) ip(192.168.24.1)  votes=1 born=1744 seen=1744 proc=00000000000000000000000000000002 (new)
May 20 13:10:20 finley cib: [25836]: info: ais_dispatch: Membership 1744: quorum retained
May 20 13:10:20 finley cib: [25836]: info: crm_update_peer: Node ebony: id=18393280 state=member addr=r(0) ip(192.168.24.1)  votes=1 born=1744 seen=1744 proc=00000000000000000000000000000002 (new)
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 1748: memb=2, new=0, lost=1
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: finley 186165440
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: godfrey 270051520
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: lost: ebony 18393280
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 1748: memb=2, new=0, lost=0
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: finley 186165440
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: godfrey 270051520
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: ais_mark_unseen_peer_dead: Node ebony was not seen in the previous transition
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: update_member: Node 18393280/ebony is now: lost
May 20 13:10:20 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1748 to 2 children
May 20 13:10:20 finley corosync[25820]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
May 20 13:10:20 finley corosync[25820]:   [MAIN  ] Completed service synchronization, ready to provide service.
May 20 13:10:20 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5900, version=0.2152.9): ok (rc=0)
May 20 13:10:20 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:10:20 finley cib: [25836]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:10:20 finley cib: [25836]: info: crm_update_peer: Node ebony: id=18393280 state=lost (new) addr=r(0) ip(192.168.24.1)  votes=1 born=1744 seen=1744 proc=00000000000000000000000000000002
May 20 13:10:20 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:10:20 finley crmd: [25840]: info: ais_status_callback: status: ebony is now lost (was member)
May 20 13:10:20 finley crmd: [25840]: info: crm_update_peer: Node ebony: id=18393280 state=lost (new) addr=r(0) ip(192.168.24.1)  votes=1 born=1744 seen=1744 proc=00000000000000000000000000000002
May 20 13:10:20 finley crmd: [25840]: info: erase_node_from_join: Removed node ebony from join calculations: welcomed=0 itegrated=0 finalized=0 confirmed=1
May 20 13:10:20 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5903, version=0.2152.10): ok (rc=0)
May 20 13:10:20 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5904, version=0.2152.10): ok (rc=0)
May 20 13:10:20 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:10:20 finley crmd: [25840]: info: te_graph_trigger: Transition 3614 is now complete
May 20 13:10:20 finley crmd: [25840]: info: notify_crmd: Transition 3614 status: done - <null>
May 20 13:10:20 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5907, version=0.2152.11): ok (rc=0)
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='ip_virtual0'] (origin=godfrey/crmd/84, version=0.2152.12): ok (rc=0)
May 20 13:10:34 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;4:3598:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2152.12) : Resource op removal
May 20 13:10:34 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:10:34 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:10:34 finley crmd: [25840]: info: do_pe_invoke: Query 5908: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2152" num_updates="12" />
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2153" num_updates="1" >
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1305889834" __crm_diff_marker__="added:top" />
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:10:34 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/87, version=0.2153.1): ok (rc=0)
May 20 13:10:34 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:10:34 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:10:34 finley crmd: [25840]: info: do_pe_invoke: Query 5909: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:34 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:10:34 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:10:34 finley crmd: [25840]: info: do_lrm_invoke: Removing resource ip_virtual0 from the LRM
May 20 13:10:34 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:10:34 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:10:34 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:10:34 finley crmd: [25840]: info: do_lrm_invoke: Resource 'ip_virtual0' deleted for 16847_crm_resource on godfrey
May 20 13:10:34 finley crmd: [25840]: info: notify_deleted: Notifying 16847_crm_resource on godfrey that ip_virtual0 was deleted
May 20 13:10:34 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op ip_virtual0_delete_60000 from 0:0:crm-resource-16847: lrm_invoke-lrmd-1305889834-6331
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_target'] (origin=godfrey/crmd/88, version=0.2153.2): ok (rc=0)
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/91, version=0.2153.2): ok (rc=0)
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun0'] (origin=godfrey/crmd/92, version=0.2153.3): ok (rc=0)
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/95, version=0.2153.3): ok (rc=0)
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun1'] (origin=godfrey/crmd/96, version=0.2153.4): ok (rc=0)
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/99, version=0.2153.4): ok (rc=0)
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun2'] (origin=godfrey/crmd/100, version=0.2153.5): ok (rc=0)
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/103, version=0.2153.5): ok (rc=0)
May 20 13:10:34 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='ip_virtual0'] (origin=local/crmd/5911, version=0.2153.6): ok (rc=0)
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:7;5:3598:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2153.2) : Resource op removal
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:7;6:3598:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2153.3) : Resource op removal
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:7;7:3598:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2153.4) : Resource op removal
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:7;8:3598:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2153.5) : Resource op removal
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5909, ref=pe_calc-dc-1305889834-6332, seq=1748, quorate=1
May 20 13:10:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5913, version=0.2153.6): ok (rc=0)
May 20 13:10:35 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:10:35 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;5:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2153.6) : Resource op removal
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5914: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5915: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5916: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5917: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5918: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:10:35 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_target from the LRM
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:10:35 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_target' deleted for 16847_crm_resource on godfrey
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:35 finley crmd: [25840]: info: notify_deleted: Notifying 16847_crm_resource on godfrey that iscsi0_target was deleted
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:35 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_target_delete_60000 from 0:0:crm-resource-16847: lrm_invoke-lrmd-1305889835-6333
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:10:35 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:10:35 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:10:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:10:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:10:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:10:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:10:35 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:10:35 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:10:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:10:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:10:35 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:10:35 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: info: process_pe_message: Transition 3615: PEngine Input stored in: /var/lib/pengine/pe-input-4774.bz2
May 20 13:10:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_target'] (origin=local/crmd/5919, version=0.2153.7): ok (rc=0)
May 20 13:10:35 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun0 from the LRM
May 20 13:10:35 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun0' deleted for 16847_crm_resource on godfrey
May 20 13:10:35 finley crmd: [25840]: info: notify_deleted: Notifying 16847_crm_resource on godfrey that iscsi0_lun0 was deleted
May 20 13:10:35 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun0_delete_60000 from 0:0:crm-resource-16847: lrm_invoke-lrmd-1305889835-6334
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2153" num_updates="7" >
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305889834" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2154" num_updates="1" >
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305889835" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:10:35 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:10:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5921, version=0.2154.1): ok (rc=0)
May 20 13:10:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun0'] (origin=local/crmd/5922, version=0.2154.2): ok (rc=0)
May 20 13:10:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5924, version=0.2154.2): ok (rc=0)
May 20 13:10:35 finley cib: [3265]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-59.raw
May 20 13:10:35 finley cib: [3265]: info: write_cib_contents: Wrote version 0.2154.0 of the CIB to disk (digest: 618b7ca2b4a2a90a7b2c16323f4ca49b)
May 20 13:10:35 finley cib: [3265]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.sVYeWg (digest: /var/lib/heartbeat/crm/cib.FuLw1L)
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5918, ref=pe_calc-dc-1305889835-6335, seq=1748, quorate=1
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:7;6:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2153.7) : Resource op removal
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:10:35 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:7;7:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2154.2) : Resource op removal
May 20 13:10:35 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305889834-6332 is obsolete
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5925: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5926: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5927: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun1 from the LRM
May 20 13:10:35 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun1' deleted for 16847_crm_resource on godfrey
May 20 13:10:35 finley crmd: [25840]: info: notify_deleted: Notifying 16847_crm_resource on godfrey that iscsi0_lun1 was deleted
May 20 13:10:35 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun1_delete_60000 from 0:0:crm-resource-16847: lrm_invoke-lrmd-1305889835-6336
May 20 13:10:35 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:10:35 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:10:35 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:10:35 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:10:35 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:10:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:10:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:10:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:10:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:10:35 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:10:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:10:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:10:35 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:10:35 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:10:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:10:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:10:35 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:10:35 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:10:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:10:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun1'] (origin=local/crmd/5928, version=0.2154.3): ok (rc=0)
May 20 13:10:35 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun2 from the LRM
May 20 13:10:35 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun2' deleted for 16847_crm_resource on godfrey
May 20 13:10:35 finley crmd: [25840]: info: notify_deleted: Notifying 16847_crm_resource on godfrey that iscsi0_lun2 was deleted
May 20 13:10:35 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun2_delete_60000 from 0:0:crm-resource-16847: lrm_invoke-lrmd-1305889835-6337
May 20 13:10:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5930, version=0.2154.3): ok (rc=0)
May 20 13:10:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun2'] (origin=local/crmd/5932, version=0.2154.4): ok (rc=0)
May 20 13:10:35 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5934, version=0.2154.4): ok (rc=0)
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5927, ref=pe_calc-dc-1305889835-6338, seq=1748, quorate=1
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:7;8:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2154.3) : Resource op removal
May 20 13:10:35 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:10:35 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:10:35 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:7;9:3599:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2154.4) : Resource op removal
May 20 13:10:35 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:10:35 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:10:35 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305889835-6335 is obsolete
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5937: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley crmd: [25840]: info: do_pe_invoke: Query 5938: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:10:35 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:10:36 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5936, version=0.2154.4): ok (rc=0)
May 20 13:10:36 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:10:36 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5938, ref=pe_calc-dc-1305889836-6339, seq=1748, quorate=1
May 20 13:10:36 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5940, version=0.2154.4): ok (rc=0)
May 20 13:10:36 finley pengine: [25839]: info: process_pe_message: Transition 3616: PEngine Input stored in: /var/lib/pengine/pe-input-4775.bz2
May 20 13:10:36 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:10:36 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:10:36 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:10:36 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:10:36 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:10:36 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:10:36 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:36 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:10:36 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:36 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:10:36 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:10:36 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:10:36 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:10:36 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:10:36 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:10:36 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:10:36 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:10:36 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305889835-6338 is obsolete
May 20 13:10:36 finley pengine: [25839]: info: process_pe_message: Transition 3617: PEngine Input stored in: /var/lib/pengine/pe-input-4776.bz2
May 20 13:10:36 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:10:36 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:10:36 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:10:36 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:10:36 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:10:36 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:10:36 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:36 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:10:36 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:10:36 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:10:36 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:10:36 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:10:36 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:10:36 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:10:36 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:10:36 finley pengine: [25839]: info: unpack_status: Node ebony is in standby-mode
May 20 13:10:36 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:10:36 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:10:36 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:10:36 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:10:36 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:10:36 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:10:36 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:10:36 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:10:36 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:10:36 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:10:36 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3618: 13 actions in 13 synapses
May 20 13:10:36 finley crmd: [25840]: info: do_te_invoke: Processing graph 3618 (ref=pe_calc-dc-1305889836-6339) derived from /var/lib/pengine/pe-input-4777.bz2
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 4: monitor ip_virtual0_monitor_0 on godfrey
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 10: monitor ip_virtual0_monitor_0 on finley (local)
May 20 13:10:36 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=10:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d op=ip_virtual0_monitor_0 )
May 20 13:10:36 finley pengine: [25839]: info: process_pe_message: Transition 3618: PEngine Input stored in: /var/lib/pengine/pe-input-4777.bz2
May 20 13:10:36 finley lrmd: [25837]: info: rsc:ip_virtual0:1158: probe
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 5: monitor iscsi0_target_monitor_0 on godfrey
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 11: monitor iscsi0_target_monitor_0 on finley (local)
May 20 13:10:36 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=11:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_target_monitor_0 )
May 20 13:10:36 finley lrmd: [25837]: info: rsc:iscsi0_target:1159: probe
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 6: monitor iscsi0_lun0_monitor_0 on godfrey
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 12: monitor iscsi0_lun0_monitor_0 on finley (local)
May 20 13:10:36 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=12:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun0_monitor_0 )
May 20 13:10:36 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1160: probe
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 7: monitor iscsi0_lun1_monitor_0 on godfrey
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 13: monitor iscsi0_lun1_monitor_0 on finley (local)
May 20 13:10:36 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=13:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun1_monitor_0 )
May 20 13:10:36 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1161: probe
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: monitor iscsi0_lun2_monitor_0 on godfrey
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 14: monitor iscsi0_lun2_monitor_0 on finley (local)
May 20 13:10:36 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=14:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun2_monitor_0 )
May 20 13:10:36 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (4) confirmed on godfrey (rc=0)
May 20 13:10:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (5) confirmed on godfrey (rc=0)
May 20 13:10:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (6) confirmed on godfrey (rc=0)
May 20 13:10:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (7) confirmed on godfrey (rc=0)
May 20 13:10:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (8) confirmed on godfrey (rc=0)
May 20 13:10:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 3: probe_complete probe_complete on godfrey - no waiting
May 20 13:10:36 finley crmd: [25840]: info: process_lrm_event: LRM operation ip_virtual0_monitor_0 (call=1158, rc=7, cib-update=5941, confirmed=true) not running
May 20 13:10:36 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (10) confirmed on finley (rc=0)
May 20 13:10:36 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun1_monitor_0 (call=1161, rc=7, cib-update=5942, confirmed=true) not running
May 20 13:10:36 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun0_monitor_0 (call=1160, rc=7, cib-update=5943, confirmed=true) not running
May 20 13:10:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (13) confirmed on finley (rc=0)
May 20 13:10:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (12) confirmed on finley (rc=0)
May 20 13:10:36 finley iSCSITarget[3267]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 13:10:36 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_target_monitor_0 (call=1159, rc=7, cib-update=5944, confirmed=true) not running
May 20 13:10:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (11) confirmed on finley (rc=0)
May 20 13:10:37 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1162: probe
May 20 13:10:37 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun2_monitor_0 (call=1162, rc=7, cib-update=5945, confirmed=true) not running
May 20 13:10:37 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (14) confirmed on finley (rc=0)
May 20 13:10:37 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: probe_complete probe_complete on finley (local) - no waiting
May 20 13:10:37 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 2 fired and confirmed
May 20 13:10:37 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:10:37 finley crmd: [25840]: notice: run_graph: Transition 3618 (Complete=13, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4777.bz2): Complete
May 20 13:10:37 finley crmd: [25840]: info: te_graph_trigger: Transition 3618 is now complete
May 20 13:10:37 finley crmd: [25840]: info: notify_crmd: Transition 3618 status: done - <null>
May 20 13:10:37 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:10:37 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:11:09 finley cibadmin: [3413]: info: Invoked: cibadmin -Ql 
May 20 13:11:17 finley cibadmin: [3417]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:11:17 finley cibadmin: [3419]: info: Invoked: cibadmin -Ql 
May 20 13:11:18 finley crm_shadow: [3423]: info: Invoked: crm_shadow -c __crmshell.3391 
May 20 13:11:18 finley cibadmin: [3425]: info: Invoked: cibadmin -p -D 
May 20 13:11:18 finley crm_shadow: [3427]: info: Invoked: crm_shadow -C __crmshell.3391 --force 
May 20 13:11:18 finley cib: [25836]: info: cib_replace_notify: Replaced: 0.2154.14 -> 0.2156.1 from <null>
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: - <cib epoch="2154" num_updates="14" admin_epoch="0" >
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="ebony" type="normal" uname="ebony" __crm_diff_marker__="removed:top" >
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-ebony" >
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: -           <nvpair id="nodes-ebony-standby" name="standby" value="on" />
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: -         </instance_attributes>
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: -       </node>
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:11:18 finley attrd: [25838]: info: do_cib_replaced: Sending full refresh
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: + <cib epoch="2156" num_updates="1" admin_epoch="0" />
May 20 13:11:18 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:11:18 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_replace for section 'all' (origin=local/crm_shadow/2, version=0.2156.1): ok (rc=0)
May 20 13:11:18 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:11:18 finley crmd: [25840]: info: need_abort: Aborting on change to epoch
May 20 13:11:18 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:11:18 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:11:18 finley crmd: [25840]: info: do_pe_invoke: Query 5948: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:18 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_cib_replaced ]
May 20 13:11:18 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 13:11:18 finley crmd: [25840]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ]
May 20 13:11:18 finley crmd: [25840]: info: do_dc_takeover: Taking over DC status for this partition
May 20 13:11:18 finley crm_shadow: [3429]: info: Invoked: crm_shadow -D __crmshell.3391 --force 
May 20 13:11:18 finley cibadmin: [3431]: info: Invoked: cibadmin -Ql 
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2156" num_updates="1" />
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2157" num_updates="1" >
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="ebony" uname="ebony" type="normal" __crm_diff_marker__="added:top" />
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:11:18 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:11:18 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5946, version=0.2157.1): ok (rc=0)
May 20 13:11:19 finley cib: [25836]: info: cib_process_readwrite: We are now in R/O mode
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_slave_all for section 'all' (origin=local/crmd/5949, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley cib: [25836]: info: cib_process_readwrite: We are now in R/W mode
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/5950, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5951, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5953, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley crmd: [25840]: info: join_make_offer: Making join offers based on membership 1748
May 20 13:11:19 finley crmd: [25840]: info: do_dc_join_offer_all: join-37: Waiting on 2 outstanding join acks
May 20 13:11:19 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:11:19 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5955, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:11:19 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:11:19 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:11:19 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 13:11:19 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5958, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:11:19 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:11:19 finley crmd: [25840]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:11:19 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes responded to the join offer.
May 20 13:11:19 finley crmd: [25840]: info: do_dc_join_finalize: join-37: Syncing the CIB from finley to the rest of the cluster
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5961, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/5962, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5963, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5964, version=0.2157.2): ok (rc=0)
May 20 13:11:19 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:11:19 finley crmd: [25840]: info: do_dc_join_ack: join-37: Updating node state to member for godfrey
May 20 13:11:19 finley crmd: [25840]: info: do_dc_join_ack: join-37: Updating node state to member for finley
May 20 13:11:20 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']/lrm (origin=local/crmd/5965, version=0.2157.3): ok (rc=0)
May 20 13:11:20 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='godfrey']/lrm": ok (rc=0)
May 20 13:11:20 finley crmd: [25840]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:11:20 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:11:20 finley crmd: [25840]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
May 20 13:11:20 finley crmd: [25840]: info: crm_update_quorum: Updating quorum status to true (call=5971)
May 20 13:11:20 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
May 20 13:11:20 finley crmd: [25840]: info: do_pe_invoke: Query 5972: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:20 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']/lrm (origin=local/crmd/5967, version=0.2157.5): ok (rc=0)
May 20 13:11:20 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:0;12:5:7:b91d50c5-2309-4f96-ae7b-3bf7b28386fa, cib=0.2157.5) : Resource op removal
May 20 13:11:20 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='finley']/lrm": ok (rc=0)
May 20 13:11:20 finley crmd: [25840]: info: do_pe_invoke: Query 5973: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:20 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 15 resources updated: Skipping all resource events
May 20 13:11:20 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2157.6) : LRM Refresh
May 20 13:11:20 finley crmd: [25840]: info: do_pe_invoke: Query 5974: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:20 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/5969, version=0.2157.6): ok (rc=0)
May 20 13:11:20 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:11:21 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/5971, version=0.2157.6): ok (rc=0)
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:11:21 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5974, ref=pe_calc-dc-1305889881-6359, seq=1748, quorate=1
May 20 13:11:21 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:11:21 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:11:21 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:11:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:11:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:11:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:11:21 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:11:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:11:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:11:21 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:11:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:11:21 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:11:21 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:11:21 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:11:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:11:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:11:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:11:21 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:11:21 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:11:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:11:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:11:21 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:11:21 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:11:21 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:11:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:11:21 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:21 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:11:21 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:11:21 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:11:21 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:11:21 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:21 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:11:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:21 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:11:21 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:21 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:21 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:11:21 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:11:21 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:21 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:11:21 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:11:21 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:11:21 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:21 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:21 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:21 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:11:21 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:11:21 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:11:21 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3619: 0 actions in 0 synapses
May 20 13:11:21 finley crmd: [25840]: info: do_te_invoke: Processing graph 3619 (ref=pe_calc-dc-1305889881-6359) derived from /var/lib/pengine/pe-input-4778.bz2
May 20 13:11:21 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:11:21 finley crmd: [25840]: notice: run_graph: Transition 3619 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4778.bz2): Complete
May 20 13:11:21 finley crmd: [25840]: info: te_graph_trigger: Transition 3619 is now complete
May 20 13:11:21 finley crmd: [25840]: info: notify_crmd: Transition 3619 status: done - <null>
May 20 13:11:21 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:11:21 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:11:21 finley pengine: [25839]: info: process_pe_message: Transition 3619: PEngine Input stored in: /var/lib/pengine/pe-input-4778.bz2
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:11:21 finley cib: [3466]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-60.raw
May 20 13:11:21 finley cib: [3466]: info: write_cib_contents: Wrote version 0.2157.0 of the CIB to disk (digest: cfa7eb9a3a4d01a4918aed3e5db04682)
May 20 13:11:21 finley cib: [3466]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.XZdNUC (digest: /var/lib/heartbeat/crm/cib.pmeDYt)
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:11:21 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:11:22 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:11:23 finley attrd: [25838]: info: attrd_local_callback: Sending full refresh (origin=crmd)
May 20 13:11:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:11:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:11:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:11:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:11:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:11:23 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:11:24 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:11:25 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:11:25 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:11:25 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:11:25 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:11:25 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='ip_virtual0'] (origin=godfrey/crmd/112, version=0.2157.7): ok (rc=0)
May 20 13:11:29 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;4:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2157.7) : Resource op removal
May 20 13:11:29 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:11:29 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:11:29 finley crmd: [25840]: info: do_pe_invoke: Query 5975: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2157" num_updates="7" >
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305889835" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2158" num_updates="1" >
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305889889" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:11:29 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:11:29 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:11:29 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/114, version=0.2158.1): ok (rc=0)
May 20 13:11:29 finley crmd: [25840]: info: do_pe_invoke: Query 5976: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:29 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:11:29 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:11:29 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:11:29 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:11:29 finley attrd: [25838]: info: attrd_ais_dispatch: Update relayed from godfrey
May 20 13:11:29 finley crmd: [25840]: info: do_lrm_invoke: Removing resource ip_virtual0 from the LRM
May 20 13:11:29 finley crmd: [25840]: info: do_lrm_invoke: Resource 'ip_virtual0' deleted for 17032_crm_resource on godfrey
May 20 13:11:29 finley crmd: [25840]: info: notify_deleted: Notifying 17032_crm_resource on godfrey that ip_virtual0 was deleted
May 20 13:11:29 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op ip_virtual0_delete_60000 from 0:0:crm-resource-17032: lrm_invoke-lrmd-1305889889-6360
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_target'] (origin=godfrey/crmd/115, version=0.2158.2): ok (rc=0)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/117, version=0.2158.2): ok (rc=0)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun0'] (origin=godfrey/crmd/118, version=0.2158.3): ok (rc=0)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/120, version=0.2158.3): ok (rc=0)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun1'] (origin=godfrey/crmd/121, version=0.2158.4): ok (rc=0)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/123, version=0.2158.4): ok (rc=0)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun2'] (origin=godfrey/crmd/124, version=0.2158.5): ok (rc=0)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/126, version=0.2158.5): ok (rc=0)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='ip_virtual0'] (origin=local/crmd/5978, version=0.2158.6): ok (rc=0)
May 20 13:11:29 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_target from the LRM
May 20 13:11:29 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_target' deleted for 17032_crm_resource on godfrey
May 20 13:11:29 finley crmd: [25840]: info: notify_deleted: Notifying 17032_crm_resource on godfrey that iscsi0_target was deleted
May 20 13:11:29 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_target_delete_60000 from 0:0:crm-resource-17032: lrm_invoke-lrmd-1305889889-6361
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5980, version=0.2158.6): ok (rc=0)
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_target'] (origin=local/crmd/5981, version=0.2158.7): ok (rc=0)
May 20 13:11:29 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:7;5:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2158.2) : Resource op removal
May 20 13:11:29 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:7;6:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2158.3) : Resource op removal
May 20 13:11:29 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:7;7:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2158.4) : Resource op removal
May 20 13:11:29 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:7;8:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2158.5) : Resource op removal
May 20 13:11:29 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5983, version=0.2158.7): ok (rc=0)
May 20 13:11:29 finley cib: [3467]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-61.raw
May 20 13:11:29 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5976, ref=pe_calc-dc-1305889889-6362, seq=1748, quorate=1
May 20 13:11:29 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:11:29 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:11:29 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;10:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2158.6) : Resource op removal
May 20 13:11:29 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:7;11:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2158.7) : Resource op removal
May 20 13:11:29 finley crmd: [25840]: info: do_pe_invoke: Query 5984: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:29 finley crmd: [25840]: info: do_pe_invoke: Query 5985: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:29 finley crmd: [25840]: info: do_pe_invoke: Query 5986: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:29 finley crmd: [25840]: info: do_pe_invoke: Query 5987: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:29 finley crmd: [25840]: info: do_pe_invoke: Query 5988: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:29 finley crmd: [25840]: info: do_pe_invoke: Query 5989: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:29 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun0 from the LRM
May 20 13:11:29 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun0' deleted for 17032_crm_resource on godfrey
May 20 13:11:29 finley crmd: [25840]: info: notify_deleted: Notifying 17032_crm_resource on godfrey that iscsi0_lun0 was deleted
May 20 13:11:29 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun0_delete_60000 from 0:0:crm-resource-17032: lrm_invoke-lrmd-1305889889-6363
May 20 13:11:29 finley cib: [3467]: info: write_cib_contents: Wrote version 0.2158.0 of the CIB to disk (digest: b50d7767788683e48954cfbcbefb4e5a)
May 20 13:11:30 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:11:30 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:11:30 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:11:30 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:11:30 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:11:30 finley cib: [3467]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.6NU4WR (digest: /var/lib/heartbeat/crm/cib.TMFc3X)
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:11:30 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:11:30 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:30 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:11:30 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:30 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:11:30 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:11:30 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:11:30 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:11:30 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:11:30 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:11:30 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:11:30 finley cib: [25836]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 170 ms (> 100 ms) before being called (GSource: 0x11d34e0)
May 20 13:11:30 finley cib: [25836]: info: G_SIG_dispatch: started at 2027783840 should have started at 2027783823
May 20 13:11:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun0'] (origin=local/crmd/5990, version=0.2158.8): ok (rc=0)
May 20 13:11:30 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun1 from the LRM
May 20 13:11:30 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun1' deleted for 17032_crm_resource on godfrey
May 20 13:11:30 finley crmd: [25840]: info: notify_deleted: Notifying 17032_crm_resource on godfrey that iscsi0_lun1 was deleted
May 20 13:11:30 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun1_delete_60000 from 0:0:crm-resource-17032: lrm_invoke-lrmd-1305889890-6364
May 20 13:11:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5992, version=0.2158.8): ok (rc=0)
May 20 13:11:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun1'] (origin=local/crmd/5993, version=0.2158.9): ok (rc=0)
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2158" num_updates="9" >
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305889889" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2159" num_updates="1" >
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305889890" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:11:30 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:11:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/5995, version=0.2159.1): ok (rc=0)
May 20 13:11:30 finley pengine: [25839]: info: process_pe_message: Transition 3620: PEngine Input stored in: /var/lib/pengine/pe-input-4779.bz2
May 20 13:11:30 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5989, ref=pe_calc-dc-1305889890-6365, seq=1748, quorate=1
May 20 13:11:30 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:7;12:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2158.8) : Resource op removal
May 20 13:11:30 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:7;13:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2158.9) : Resource op removal
May 20 13:11:30 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:11:30 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:11:30 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305889889-6362 is obsolete
May 20 13:11:30 finley crmd: [25840]: info: do_pe_invoke: Query 5996: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:30 finley crmd: [25840]: info: do_pe_invoke: Query 5997: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:30 finley crmd: [25840]: info: do_pe_invoke: Query 5998: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:30 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun2 from the LRM
May 20 13:11:30 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun2' deleted for 17032_crm_resource on godfrey
May 20 13:11:30 finley crmd: [25840]: info: notify_deleted: Notifying 17032_crm_resource on godfrey that iscsi0_lun2 was deleted
May 20 13:11:30 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun2_delete_60000 from 0:0:crm-resource-17032: lrm_invoke-lrmd-1305889890-6366
May 20 13:11:30 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:11:30 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:11:30 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:11:30 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:11:30 finley cib: [3468]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-62.raw
May 20 13:11:30 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:30 finley cib: [3468]: info: write_cib_contents: Wrote version 0.2159.0 of the CIB to disk (digest: 9fdfbdc2db020b2eaeba2c13ad2281b1)
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:11:30 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:11:30 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:30 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:11:30 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:11:30 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:30 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:11:30 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:11:30 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:30 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:11:30 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:11:30 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:30 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:11:30 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:11:30 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:30 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:11:30 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:11:30 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:30 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:11:30 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:11:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun2'] (origin=local/crmd/5999, version=0.2159.2): ok (rc=0)
May 20 13:11:30 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:11:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6001, version=0.2159.2): ok (rc=0)
May 20 13:11:30 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:11:30 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6004, version=0.2159.2): ok (rc=0)
May 20 13:11:30 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=5998, ref=pe_calc-dc-1305889890-6367, seq=1748, quorate=1
May 20 13:11:30 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:7;14:3618:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2159.2) : Resource op removal
May 20 13:11:30 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:11:30 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:11:30 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305889890-6365 is obsolete
May 20 13:11:30 finley crmd: [25840]: info: do_pe_invoke: Query 6005: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:30 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:11:31 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:11:31 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6005, ref=pe_calc-dc-1305889891-6368, seq=1748, quorate=1
May 20 13:11:31 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6007, version=0.2159.2): ok (rc=0)
May 20 13:11:31 finley cib: [3468]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.VS8UhT (digest: /var/lib/heartbeat/crm/cib.P05SI0)
May 20 13:11:31 finley pengine: [25839]: info: process_pe_message: Transition 3621: PEngine Input stored in: /var/lib/pengine/pe-input-4780.bz2
May 20 13:11:31 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:11:31 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:11:31 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:11:31 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:11:31 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:11:31 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:11:31 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:31 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:11:31 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:31 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:11:31 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:11:31 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:11:31 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:11:31 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:11:31 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:11:31 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:11:31 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305889890-6367 is obsolete
May 20 13:11:31 finley pengine: [25839]: info: process_pe_message: Transition 3622: PEngine Input stored in: /var/lib/pengine/pe-input-4781.bz2
May 20 13:11:31 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:11:31 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:11:31 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:11:31 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:11:31 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:11:31 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:11:31 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:31 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:11:31 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:11:31 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:31 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:11:31 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:11:31 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:31 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:11:31 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:11:31 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:31 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:11:31 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:11:31 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:31 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:11:31 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:11:31 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:31 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:11:31 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:11:31 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:11:31 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3623: 13 actions in 13 synapses
May 20 13:11:31 finley crmd: [25840]: info: do_te_invoke: Processing graph 3623 (ref=pe_calc-dc-1305889891-6368) derived from /var/lib/pengine/pe-input-4782.bz2
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 4: monitor ip_virtual0_monitor_0 on godfrey
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 10: monitor ip_virtual0_monitor_0 on finley (local)
May 20 13:11:31 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=10:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d op=ip_virtual0_monitor_0 )
May 20 13:11:31 finley lrmd: [25837]: info: rsc:ip_virtual0:1163: probe
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 5: monitor iscsi0_target_monitor_0 on godfrey
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 11: monitor iscsi0_target_monitor_0 on finley (local)
May 20 13:11:31 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=11:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_target_monitor_0 )
May 20 13:11:31 finley lrmd: [25837]: info: rsc:iscsi0_target:1164: probe
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 6: monitor iscsi0_lun0_monitor_0 on godfrey
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 12: monitor iscsi0_lun0_monitor_0 on finley (local)
May 20 13:11:31 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=12:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun0_monitor_0 )
May 20 13:11:31 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1165: probe
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 7: monitor iscsi0_lun1_monitor_0 on godfrey
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 13: monitor iscsi0_lun1_monitor_0 on finley (local)
May 20 13:11:31 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=13:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun1_monitor_0 )
May 20 13:11:31 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1166: probe
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: monitor iscsi0_lun2_monitor_0 on godfrey
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 14: monitor iscsi0_lun2_monitor_0 on finley (local)
May 20 13:11:31 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=14:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun2_monitor_0 )
May 20 13:11:31 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (4) confirmed on godfrey (rc=0)
May 20 13:11:31 finley pengine: [25839]: info: process_pe_message: Transition 3623: PEngine Input stored in: /var/lib/pengine/pe-input-4782.bz2
May 20 13:11:31 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (5) confirmed on godfrey (rc=0)
May 20 13:11:31 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (6) confirmed on godfrey (rc=0)
May 20 13:11:31 finley iSCSITarget[3471]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 13:11:31 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_target_monitor_0 (call=1164, rc=7, cib-update=6008, confirmed=true) not running
May 20 13:11:31 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (7) confirmed on godfrey (rc=0)
May 20 13:11:31 finley crmd: [25840]: info: process_lrm_event: LRM operation ip_virtual0_monitor_0 (call=1163, rc=7, cib-update=6009, confirmed=true) not running
May 20 13:11:31 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (8) confirmed on godfrey (rc=0)
May 20 13:11:31 finley crmd: [25840]: info: te_rsc_command: Initiating action 3: probe_complete probe_complete on godfrey - no waiting
May 20 13:11:31 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (11) confirmed on finley (rc=0)
May 20 13:11:31 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun0_monitor_0 (call=1165, rc=7, cib-update=6010, confirmed=true) not running
May 20 13:11:31 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (10) confirmed on finley (rc=0)
May 20 13:11:31 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun1_monitor_0 (call=1166, rc=7, cib-update=6011, confirmed=true) not running
May 20 13:11:31 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (12) confirmed on finley (rc=0)
May 20 13:11:31 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (13) confirmed on finley (rc=0)
May 20 13:11:32 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1167: probe
May 20 13:11:32 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun2_monitor_0 (call=1167, rc=7, cib-update=6012, confirmed=true) not running
May 20 13:11:32 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (14) confirmed on finley (rc=0)
May 20 13:11:32 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: probe_complete probe_complete on finley (local) - no waiting
May 20 13:11:32 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 2 fired and confirmed
May 20 13:11:32 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:11:32 finley crmd: [25840]: notice: run_graph: Transition 3623 (Complete=13, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4782.bz2): Complete
May 20 13:11:32 finley crmd: [25840]: info: te_graph_trigger: Transition 3623 is now complete
May 20 13:11:32 finley crmd: [25840]: info: notify_crmd: Transition 3623 status: done - <null>
May 20 13:11:32 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:11:32 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:11:49 finley cib: [25836]: info: cib_replace_notify: Replaced: 0.2159.12 -> 0.2161.1 from godfrey
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: - <cib epoch="2159" num_updates="12" admin_epoch="0" >
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 13:11:49 finley attrd: [25838]: info: do_cib_replaced: Sending full refresh
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="ebony" uname="ebony" type="normal" __crm_diff_marker__="removed:top" />
May 20 13:11:49 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: + <cib epoch="2161" num_updates="1" admin_epoch="0" />
May 20 13:11:49 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_replace for section 'all' (origin=godfrey/crm_shadow/2, version=0.2161.1): ok (rc=0)
May 20 13:11:49 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:11:49 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:11:49 finley crmd: [25840]: info: need_abort: Aborting on change to epoch
May 20 13:11:49 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:11:49 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:11:49 finley crmd: [25840]: info: do_pe_invoke: Query 6015: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:49 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_cib_replaced ]
May 20 13:11:49 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 13:11:49 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:11:49 finley crmd: [25840]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ]
May 20 13:11:49 finley crmd: [25840]: info: do_dc_takeover: Taking over DC status for this partition
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2161" num_updates="1" />
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2162" num_updates="1" >
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="ebony" uname="ebony" type="normal" __crm_diff_marker__="added:top" />
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:11:49 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:11:49 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6013, version=0.2162.1): ok (rc=0)
May 20 13:11:49 finley cib: [25836]: info: cib_process_readwrite: We are now in R/O mode
May 20 13:11:49 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_slave_all for section 'all' (origin=local/crmd/6016, version=0.2162.1): ok (rc=0)
May 20 13:11:49 finley cib: [25836]: info: cib_process_readwrite: We are now in R/W mode
May 20 13:11:49 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/6017, version=0.2162.1): ok (rc=0)
May 20 13:11:49 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/6018, version=0.2162.1): ok (rc=0)
May 20 13:11:49 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:11:49 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6020, version=0.2162.1): ok (rc=0)
May 20 13:11:49 finley crmd: [25840]: info: do_dc_join_offer_all: join-38: Waiting on 2 outstanding join acks
May 20 13:11:49 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:11:49 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:11:49 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6022, version=0.2162.1): ok (rc=0)
May 20 13:11:49 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:11:49 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:11:49 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:11:49 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 13:11:49 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:11:49 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:11:50 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6025, version=0.2162.1): ok (rc=0)
May 20 13:11:50 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:11:50 finley crmd: [25840]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:11:50 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes responded to the join offer.
May 20 13:11:50 finley crmd: [25840]: info: do_dc_join_finalize: join-38: Syncing the CIB from finley to the rest of the cluster
May 20 13:11:50 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6028, version=0.2162.1): ok (rc=0)
May 20 13:11:50 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/6029, version=0.2162.1): ok (rc=0)
May 20 13:11:50 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:11:50 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6030, version=0.2162.1): ok (rc=0)
May 20 13:11:50 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6031, version=0.2162.1): ok (rc=0)
May 20 13:11:50 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:11:50 finley crmd: [25840]: info: do_dc_join_ack: join-38: Updating node state to member for godfrey
May 20 13:11:50 finley crmd: [25840]: info: do_dc_join_ack: join-38: Updating node state to member for finley
May 20 13:11:51 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']/lrm (origin=local/crmd/6032, version=0.2162.2): ok (rc=0)
May 20 13:11:51 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='godfrey']/lrm": ok (rc=0)
May 20 13:11:51 finley crmd: [25840]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:11:51 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:11:51 finley crmd: [25840]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
May 20 13:11:51 finley crmd: [25840]: info: crm_update_quorum: Updating quorum status to true (call=6038)
May 20 13:11:51 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
May 20 13:11:51 finley crmd: [25840]: info: do_pe_invoke: Query 6039: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:51 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']/lrm (origin=local/crmd/6034, version=0.2162.4): ok (rc=0)
May 20 13:11:51 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:0;12:5:7:b91d50c5-2309-4f96-ae7b-3bf7b28386fa, cib=0.2162.4) : Resource op removal
May 20 13:11:51 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='finley']/lrm": ok (rc=0)
May 20 13:11:51 finley crmd: [25840]: info: do_pe_invoke: Query 6040: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:51 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 15 resources updated: Skipping all resource events
May 20 13:11:51 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2162.5) : LRM Refresh
May 20 13:11:51 finley crmd: [25840]: info: do_pe_invoke: Query 6041: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:11:51 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6036, version=0.2162.5): ok (rc=0)
May 20 13:11:51 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:11:51 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/6038, version=0.2162.5): ok (rc=0)
May 20 13:11:51 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6041, ref=pe_calc-dc-1305889911-6388, seq=1748, quorate=1
May 20 13:11:51 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:11:52 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:11:52 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:11:52 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:11:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:11:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:11:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:11:52 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:11:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:11:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:11:52 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:11:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:11:52 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:11:52 finley pengine: [25839]: info: unpack_status: Node finley is in standby-mode
May 20 13:11:52 finley pengine: [25839]: info: determine_online_status: Node finley is standby
May 20 13:11:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:11:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:11:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:11:52 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:11:52 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:11:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:11:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:11:52 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:11:52 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:52 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:11:52 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:11:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:11:52 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:11:52 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:11:52 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:11:52 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:11:52 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:11:52 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:11:52 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:11:52 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:52 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:11:52 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:52 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:11:52 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:11:52 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:11:52 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:11:52 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:11:52 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:11:52 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:11:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:11:52 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:11:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:11:52 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:11:52 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:11:52 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:11:52 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:11:52 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource ping_nodes:0 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:52 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:11:52 finley cib: [3628]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-63.raw
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:11:52 finley cib: [3628]: info: write_cib_contents: Wrote version 0.2162.0 of the CIB to disk (digest: 0f00c9c0cea3040e9e49d7652957c5a3)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Stopped)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:11:52 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:11:52 finley cib: [3628]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.tvD3aw (digest: /var/lib/heartbeat/crm/cib.9569ug)
May 20 13:11:52 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:11:52 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3624: 0 actions in 0 synapses
May 20 13:11:52 finley crmd: [25840]: info: do_te_invoke: Processing graph 3624 (ref=pe_calc-dc-1305889911-6388) derived from /var/lib/pengine/pe-input-4783.bz2
May 20 13:11:52 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:11:52 finley crmd: [25840]: notice: run_graph: Transition 3624 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4783.bz2): Complete
May 20 13:11:52 finley crmd: [25840]: info: te_graph_trigger: Transition 3624 is now complete
May 20 13:11:52 finley crmd: [25840]: info: notify_crmd: Transition 3624 status: done - <null>
May 20 13:11:52 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:11:52 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:11:52 finley pengine: [25839]: info: process_pe_message: Transition 3624: PEngine Input stored in: /var/lib/pengine/pe-input-4783.bz2
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:11:52 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:11:53 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:11:53 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_local_callback: Sending full refresh (origin=crmd)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:11:54 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (<null>)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:11:55 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:12:00 finley crm_attribute: [3654]: info: Invoked: crm_attribute -N finley -n standby -v off -l forever 
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2162" num_updates="5" >
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="finley" >
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-finley" >
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: -           <nvpair value="on" id="nodes-finley-standby" />
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: -         </instance_attributes>
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: -       </node>
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:12:00 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2163" num_updates="1" >
May 20 13:12:00 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="finley" >
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-finley" >
May 20 13:12:00 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: +           <nvpair value="off" id="nodes-finley-standby" />
May 20 13:12:00 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: +         </instance_attributes>
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: +       </node>
May 20 13:12:00 finley crmd: [25840]: info: do_pe_invoke: Query 6042: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:12:00 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:12:00 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crm_attribute/4, version=0.2163.1): ok (rc=0)
May 20 13:12:00 finley cib: [3655]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-64.raw
May 20 13:12:00 finley cib: [3655]: info: write_cib_contents: Wrote version 0.2163.0 of the CIB to disk (digest: 6c6b931cfd799c4c1ded226071c08fe4)
May 20 13:12:00 finley cib: [3655]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.y0a2sL (digest: /var/lib/heartbeat/crm/cib.t4864K)
May 20 13:12:00 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6042, ref=pe_calc-dc-1305889920-6389, seq=1748, quorate=1
May 20 13:12:00 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:12:00 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:12:00 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:12:00 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:12:00 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:12:00 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:12:00 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:12:00 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:12:00 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:12:00 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:12:00 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:12:00 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:12:00 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:12:00 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:12:00 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:12:00 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:12:00 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:12:00 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:12:00 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:12:00 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:12:00 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:12:00 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:12:00 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:12:00 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:12:00 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:12:00 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:12:00 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:12:00 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:12:00 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:12:00 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:12:00 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:12:00 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:12:00 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:12:00 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:12:00 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:12:00 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:12:00 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:12:00 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:12:00 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:12:00 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:12:00 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:12:00 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:0 ping_nodes:1 ping_nodes:2 ]
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:12:00 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:12:00 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:12:00 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:12:00 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:12:00 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:12:00 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:12:00 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:12:00 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:12:00 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:12:00 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:12:00 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:0 on finley
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Start ping_nodes:0#011(finley)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:12:00 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:12:00 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:12:00 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3625: 4 actions in 4 synapses
May 20 13:12:00 finley crmd: [25840]: info: do_te_invoke: Processing graph 3625 (ref=pe_calc-dc-1305889920-6389) derived from /var/lib/pengine/pe-input-4784.bz2
May 20 13:12:00 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 101 fired and confirmed
May 20 13:12:00 finley crmd: [25840]: info: te_rsc_command: Initiating action 99: start ping_nodes:0_start_0 on finley (local)
May 20 13:12:00 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=99:3625:0:8f399f14-fe26-4279-b701-1947eb7b322d op=ping_nodes:0_start_0 )
May 20 13:12:00 finley pengine: [25839]: info: process_pe_message: Transition 3625: PEngine Input stored in: /var/lib/pengine/pe-input-4784.bz2
May 20 13:12:00 finley lrmd: [25837]: info: rsc:ping_nodes:0:1168: start
May 20 13:12:01 finley crmd: [25840]: info: process_lrm_event: LRM operation ping_nodes:0_start_0 (call=1168, rc=0, cib-update=6043, confirmed=true) ok
May 20 13:12:01 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:0_start_0 (99) confirmed on finley (rc=0)
May 20 13:12:01 finley crmd: [25840]: info: te_rsc_command: Initiating action 100: monitor ping_nodes:0_monitor_1000 on finley (local)
May 20 13:12:01 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=100:3625:0:8f399f14-fe26-4279-b701-1947eb7b322d op=ping_nodes:0_monitor_1000 )
May 20 13:12:01 finley lrmd: [25837]: info: rsc:ping_nodes:0:1169: monitor
May 20 13:12:01 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 102 fired and confirmed
May 20 13:12:02 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (20)
May 20 13:12:02 finley attrd: [25838]: info: attrd_perform_update: Sent update 5100: pingd=20
May 20 13:12:02 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=finley, magic=NA, cib=0.2163.3) : Transient attribute: update
May 20 13:12:02 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 13:12:02 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 13:12:02 finley crmd: [25840]: info: process_lrm_event: LRM operation ping_nodes:0_monitor_1000 (call=1169, rc=0, cib-update=6044, confirmed=false) ok
May 20 13:12:02 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:0_monitor_1000 (100) confirmed on finley (rc=0)
May 20 13:12:02 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:12:02 finley crmd: [25840]: notice: run_graph: Transition 3625 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4784.bz2): Complete
May 20 13:12:02 finley crmd: [25840]: info: te_graph_trigger: Transition 3625 is now complete
May 20 13:12:02 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:12:02 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:12:02 finley crmd: [25840]: info: do_pe_invoke: Query 6045: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:12:02 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6045, ref=pe_calc-dc-1305889922-6392, seq=1748, quorate=1
May 20 13:12:02 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:12:02 finley pengine: [25839]: info: unpack_status: Node godfrey is in standby-mode
May 20 13:12:02 finley pengine: [25839]: info: determine_online_status: Node godfrey is standby
May 20 13:12:02 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:12:02 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:12:02 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:12:02 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:12:02 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:12:02 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:12:02 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:12:02 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:12:02 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:12:02 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:12:02 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:12:02 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:12:02 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:12:02 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:12:02 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:12:02 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:12:02 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:12:02 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:12:02 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:12:02 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:12:02 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:12:02 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:12:02 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:12:02 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:12:02 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:12:02 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:12:02 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:12:02 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:12:02 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:12:02 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:12:02 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:12:02 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:12:02 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:12:02 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:12:02 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:12:02 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:12:02 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:12:02 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:12:02 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:12:02 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 13:12:02 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:12:02 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:12:02 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:12:02 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:12:02 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:12:02 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:12:02 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:12:02 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:12:02 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:12:02 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource ping_nodes:1 cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:12:02 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Stopped)
May 20 13:12:02 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:12:02 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:12:02 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3626: 0 actions in 0 synapses
May 20 13:12:02 finley crmd: [25840]: info: do_te_invoke: Processing graph 3626 (ref=pe_calc-dc-1305889922-6392) derived from /var/lib/pengine/pe-input-4785.bz2
May 20 13:12:02 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:12:02 finley crmd: [25840]: notice: run_graph: Transition 3626 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4785.bz2): Complete
May 20 13:12:02 finley crmd: [25840]: info: te_graph_trigger: Transition 3626 is now complete
May 20 13:12:02 finley crmd: [25840]: info: notify_crmd: Transition 3626 status: done - <null>
May 20 13:12:02 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:12:02 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:12:02 finley pengine: [25839]: info: process_pe_message: Transition 3626: PEngine Input stored in: /var/lib/pengine/pe-input-4785.bz2
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2163" num_updates="4" >
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: -     <nodes >
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: -       <node id="godfrey" >
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-godfrey" >
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: -           <nvpair value="on" id="nodes-godfrey-standby" />
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: -         </instance_attributes>
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: -       </node>
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: -     </nodes>
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:13:07 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2164" num_updates="1" >
May 20 13:13:07 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: +     <nodes >
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: +       <node id="godfrey" >
May 20 13:13:07 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-godfrey" >
May 20 13:13:07 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: +           <nvpair value="off" id="nodes-godfrey-standby" />
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: +         </instance_attributes>
May 20 13:13:07 finley crmd: [25840]: info: do_pe_invoke: Query 6046: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: +       </node>
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: +     </nodes>
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:13:07 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:13:07 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=godfrey/crm_attribute/4, version=0.2164.1): ok (rc=0)
May 20 13:13:07 finley cib: [4075]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-65.raw
May 20 13:13:07 finley cib: [4075]: info: write_cib_contents: Wrote version 0.2164.0 of the CIB to disk (digest: f0d8dc94e6ed9ddd51a08c8ed27cd188)
May 20 13:13:07 finley cib: [4075]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.KLT5SJ (digest: /var/lib/heartbeat/crm/cib.fQHeVH)
May 20 13:13:07 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6046, ref=pe_calc-dc-1305889987-6393, seq=1748, quorate=1
May 20 13:13:07 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:13:07 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:13:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:13:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:13:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:13:07 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:13:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:13:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:13:07 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:13:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:13:07 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:13:07 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:13:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:13:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:13:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:13:07 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:13:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:13:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:13:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:13:07 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:13:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:13:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:13:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:13:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:13:07 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:13:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:13:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:13:07 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:13:07 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:13:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:13:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:07 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:13:07 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:13:07 finley pengine: [25839]: notice: short_print:      Started: [ finley ]
May 20 13:13:07 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:1 ping_nodes:2 ]
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:07 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:13:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:13:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:07 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:07 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:13:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:13:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:07 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:07 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:13:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:13:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:07 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:13:07 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:13:07 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:13:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:13:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:13:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:13:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:13:07 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:07 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:07 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:07 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:07 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:1 on godfrey
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Start ping_nodes:1#011(godfrey)
May 20 13:13:07 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:13:07 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:13:07 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3627: 4 actions in 4 synapses
May 20 13:13:07 finley crmd: [25840]: info: do_te_invoke: Processing graph 3627 (ref=pe_calc-dc-1305889987-6393) derived from /var/lib/pengine/pe-input-4786.bz2
May 20 13:13:07 finley pengine: [25839]: info: process_pe_message: Transition 3627: PEngine Input stored in: /var/lib/pengine/pe-input-4786.bz2
May 20 13:13:07 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 104 fired and confirmed
May 20 13:13:07 finley crmd: [25840]: info: te_rsc_command: Initiating action 102: start ping_nodes:1_start_0 on godfrey
May 20 13:13:08 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:1_start_0 (102) confirmed on godfrey (rc=0)
May 20 13:13:08 finley crmd: [25840]: info: te_rsc_command: Initiating action 103: monitor ping_nodes:1_monitor_1000 on godfrey
May 20 13:13:08 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 105 fired and confirmed
May 20 13:13:09 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2164.3) : Transient attribute: update
May 20 13:13:09 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 13:13:09 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 13:13:10 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:1_monitor_1000 (103) confirmed on godfrey (rc=0)
May 20 13:13:10 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:13:10 finley crmd: [25840]: notice: run_graph: Transition 3627 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4786.bz2): Complete
May 20 13:13:10 finley crmd: [25840]: info: te_graph_trigger: Transition 3627 is now complete
May 20 13:13:10 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:13:10 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:13:10 finley crmd: [25840]: info: do_pe_invoke: Query 6047: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:10 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6047, ref=pe_calc-dc-1305889990-6396, seq=1748, quorate=1
May 20 13:13:10 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:13:10 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:13:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:13:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:13:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:1_stop_0 on godfrey: not configured (6)
May 20 13:13:10 finley pengine: [25839]: info: native_add_running: resource drbd_r1:1 isnt managed
May 20 13:13:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:13:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:13:10 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:13:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:13:10 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:13:10 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:13:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:13:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:13:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:13:10 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:13:10 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:13:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:13:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:13:10 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:13:10 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:13:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:13:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:13:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:13:10 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:13:10 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:13:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:13:10 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:13:10 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:10 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:10 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:13:10 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      drbd_r1:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:10 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:2 ]
May 20 13:13:10 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:10 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:10 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:13:10 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:13:10 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 13:13:10 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:10 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:13:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:13:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:10 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:10 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:13:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:13:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:1 allocated to 'nowhere': failed
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:10 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:10 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:13:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:13:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:10 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:13:10 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:13:10 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:13:10 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:13:10 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:13:10 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:13:10 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:13:10 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:10 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:10 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:10 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Slave unmanaged)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:13:10 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:13:10 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:13:10 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3628: 0 actions in 0 synapses
May 20 13:13:10 finley crmd: [25840]: info: do_te_invoke: Processing graph 3628 (ref=pe_calc-dc-1305889990-6396) derived from /var/lib/pengine/pe-input-4787.bz2
May 20 13:13:10 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:13:10 finley crmd: [25840]: notice: run_graph: Transition 3628 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4787.bz2): Complete
May 20 13:13:10 finley crmd: [25840]: info: te_graph_trigger: Transition 3628 is now complete
May 20 13:13:10 finley crmd: [25840]: info: notify_crmd: Transition 3628 status: done - <null>
May 20 13:13:10 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:13:10 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:13:10 finley pengine: [25839]: info: process_pe_message: Transition 3628: PEngine Input stored in: /var/lib/pengine/pe-input-4787.bz2
May 20 13:13:28 finley cibadmin: [4218]: info: Invoked: cibadmin -Ql -o nodes 
May 20 13:13:28 finley cibadmin: [4220]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:28 finley cibadmin: [4222]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:28 finley crm_resource: [4224]: info: Invoked: crm_resource -C -r rg_isci -H godfrey 
May 20 13:13:28 finley crm_resource: [4224]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4224]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4224]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4224]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4224]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4224]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4224]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4224]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4224]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:28 finley cibadmin: [4226]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:28 finley cibadmin: [4228]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:28 finley crm_resource: [4230]: info: Invoked: crm_resource -C -r rg_isci -H finley 
May 20 13:13:28 finley crm_resource: [4230]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4230]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4230]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4230]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4230]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4230]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4230]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4230]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4230]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:28 finley cibadmin: [4232]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:28 finley cibadmin: [4234]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:28 finley crm_resource: [4237]: info: Invoked: crm_resource -C -r rg_isci -H ebony 
May 20 13:13:28 finley crm_resource: [4237]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4237]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4237]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4237]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4237]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4237]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4237]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4237]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:28 finley crm_resource: [4237]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:32 finley cibadmin: [4283]: info: Invoked: cibadmin -Ql -o nodes 
May 20 13:13:32 finley cibadmin: [4285]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:32 finley cibadmin: [4287]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:32 finley crm_resource: [4289]: info: Invoked: crm_resource -C -r drbd_r1 -H godfrey 
May 20 13:13:32 finley crm_resource: [4289]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4289]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4289]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4289]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4289]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4289]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4289]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4289]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4289]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:32 finley cibadmin: [4300]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:32 finley cibadmin: [4303]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:32 finley crm_resource: [4305]: info: Invoked: crm_resource -C -r drbd_r1 -H finley 
May 20 13:13:32 finley crm_resource: [4305]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4305]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4305]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4305]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4305]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4305]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4305]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4305]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:32 finley crm_resource: [4305]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:32 finley cibadmin: [4307]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:32 finley cibadmin: [4309]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:33 finley crm_resource: [4311]: info: Invoked: crm_resource -C -r drbd_r1 -H ebony 
May 20 13:13:33 finley crm_resource: [4311]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:33 finley crm_resource: [4311]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:33 finley crm_resource: [4311]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:33 finley crm_resource: [4311]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:33 finley crm_resource: [4311]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:33 finley crm_resource: [4311]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:33 finley crm_resource: [4311]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:33 finley crm_resource: [4311]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:33 finley crm_resource: [4311]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:42 finley cibadmin: [4384]: info: Invoked: cibadmin -Ql -o nodes 
May 20 13:13:42 finley cibadmin: [4386]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:42 finley cibadmin: [4388]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:42 finley crm_resource: [4390]: info: Invoked: crm_resource -C -r drbd_r1:1 -H godfrey 
May 20 13:13:42 finley crm_resource: [4390]: ERROR: unpack_rsc_op: Hard error - drbd_r1:1_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:42 finley crm_resource: [4390]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:42 finley crm_resource: [4390]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:42 finley crm_resource: [4390]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:42 finley crm_resource: [4390]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:42 finley crm_resource: [4390]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:42 finley crm_resource: [4390]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:42 finley crm_resource: [4390]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:42 finley crm_resource: [4390]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:42 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='drbd_r1:1'] (origin=godfrey/crmd/137, version=0.2164.5): ok (rc=0)
May 20 13:13:42 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:1_start_0, magic=0:0;60:3519:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2164.5) : Resource op removal
May 20 13:13:42 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:13:42 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:13:42 finley crmd: [25840]: info: do_pe_invoke: Query 6048: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:42 finley cibadmin: [4392]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:42 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=1, tag=transient_attributes, id=godfrey, magic=NA, cib=0.2164.6) : Transient attribute: removal
May 20 13:13:42 finley crmd: [25840]: info: do_pe_invoke: Query 6049: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2164" num_updates="6" >
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305889890" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2165" num_updates="1" >
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305890022" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:13:42 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:13:42 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:13:42 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:13:42 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/139, version=0.2165.1): ok (rc=0)
May 20 13:13:42 finley crmd: [25840]: info: do_pe_invoke: Query 6050: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:43 finley cib: [4403]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-66.raw
May 20 13:13:43 finley cib: [4403]: info: write_cib_contents: Wrote version 0.2165.0 of the CIB to disk (digest: bfe503ae35335469abc8552073f2d5c5)
May 20 13:13:43 finley cib: [4403]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.evigjM (digest: /var/lib/heartbeat/crm/cib.nPszLM)
May 20 13:13:43 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6050, ref=pe_calc-dc-1305890023-6404, seq=1748, quorate=1
May 20 13:13:43 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:13:43 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:13:43 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:13:43 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:13:43 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:13:43 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:13:43 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:13:43 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:13:43 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:43 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:1 on finley to drbd_r1:3 (ORPHAN)
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:13:43 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:43 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:13:43 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:13:43 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:13:43 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:13:43 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:13:43 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:13:43 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:13:43 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6053, version=0.2165.1): ok (rc=0)
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:13:43 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:13:43 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3629: 0 actions in 0 synapses
May 20 13:13:43 finley crmd: [25840]: info: do_te_invoke: Processing graph 3629 (ref=pe_calc-dc-1305890023-6404) derived from /var/lib/pengine/pe-input-4788.bz2
May 20 13:13:43 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:13:43 finley crmd: [25840]: notice: run_graph: Transition 3629 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4788.bz2): Complete
May 20 13:13:43 finley crmd: [25840]: info: te_graph_trigger: Transition 3629 is now complete
May 20 13:13:43 finley crmd: [25840]: info: notify_crmd: Transition 3629 status: done - <null>
May 20 13:13:43 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:13:43 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:13:43 finley pengine: [25839]: info: process_pe_message: Transition 3629: PEngine Input stored in: /var/lib/pengine/pe-input-4788.bz2
May 20 13:13:43 finley cibadmin: [4405]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:43 finley crm_resource: [4407]: info: Invoked: crm_resource -C -r drbd_r1:1 -H finley 
May 20 13:13:43 finley crm_resource: [4407]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4407]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4407]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4407]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4407]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4407]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4407]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4407]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley crmd: [25840]: info: do_lrm_invoke: Removing resource drbd_r1:1 from the LRM
May 20 13:13:43 finley crmd: [25840]: info: do_lrm_invoke: Resource 'drbd_r1:1' deleted for 4407_crm_resource on finley
May 20 13:13:43 finley crmd: [25840]: info: notify_deleted: Notifying 4407_crm_resource on finley that drbd_r1:1 was deleted
May 20 13:13:43 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op drbd_r1:1_delete_60000 from 0:0:crm-resource-4407: lrm_invoke-lrmd-1305890023-6406
May 20 13:13:43 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='drbd_r1:1'] (origin=local/crmd/6054, version=0.2165.2): ok (rc=0)
May 20 13:13:43 finley cibadmin: [4409]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:43 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:1_start_0, magic=0:0;63:459:0:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2165.2) : Resource op removal
May 20 13:13:43 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:13:43 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 20 13:13:43 finley crmd: [25840]: info: do_pe_invoke: Query 6057: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2165" num_updates="2" >
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305890022" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2166" num_updates="1" >
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305890023" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:13:43 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:13:43 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:13:43 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:13:43 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6056, version=0.2166.1): ok (rc=0)
May 20 13:13:43 finley crmd: [25840]: info: do_pe_invoke: Query 6058: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:43 finley cib: [4410]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-67.raw
May 20 13:13:43 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6058, ref=pe_calc-dc-1305890023-6407, seq=1748, quorate=1
May 20 13:13:43 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:13:43 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:13:43 finley crmd: [25840]: info: ais_dispatch: Membership 1748: quorum retained
May 20 13:13:43 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:13:43 finley cib: [4410]: info: write_cib_contents: Wrote version 0.2166.0 of the CIB to disk (digest: b2eaae40e14073a285eb29b9a805650d)
May 20 13:13:43 finley cibadmin: [4412]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:13:43 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:13:43 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:13:43 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:13:43 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:13:43 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:43 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:13:43 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:13:43 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:13:43 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:43 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:13:43 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:13:43 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:13:43 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:43 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:13:43 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:13:43 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:13:43 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 13:13:43 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:43 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:43 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:43 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:43 finley cib: [4410]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.ZXZCiN (digest: /var/lib/heartbeat/crm/cib.tBMiKO)
May 20 13:13:43 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6061, version=0.2166.1): ok (rc=0)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:13:43 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:13:43 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:13:43 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3630: 0 actions in 0 synapses
May 20 13:13:43 finley crmd: [25840]: info: do_te_invoke: Processing graph 3630 (ref=pe_calc-dc-1305890023-6407) derived from /var/lib/pengine/pe-input-4789.bz2
May 20 13:13:43 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:13:43 finley crmd: [25840]: notice: run_graph: Transition 3630 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4789.bz2): Complete
May 20 13:13:43 finley crmd: [25840]: info: te_graph_trigger: Transition 3630 is now complete
May 20 13:13:43 finley crmd: [25840]: info: notify_crmd: Transition 3630 status: done - <null>
May 20 13:13:43 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:13:43 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:13:43 finley pengine: [25839]: info: process_pe_message: Transition 3630: PEngine Input stored in: /var/lib/pengine/pe-input-4789.bz2
May 20 13:13:43 finley crm_resource: [4416]: info: Invoked: crm_resource -C -r drbd_r1:1 -H ebony 
May 20 13:13:43 finley crm_resource: [4416]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4416]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4416]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4416]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4416]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4416]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4416]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:43 finley crm_resource: [4416]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 1752: memb=2, new=0, lost=0
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: finley 186165440
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: memb: godfrey 270051520
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 1752: memb=3, new=1, lost=0
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: update_member: Node 18393280/ebony is now: member
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: NEW:  ebony 18393280
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: ebony 18393280
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: finley 186165440
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: pcmk_peer_update: MEMB: godfrey 270051520
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1752 to 2 children
May 20 13:13:56 finley corosync[25820]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
May 20 13:13:56 finley crmd: [25840]: info: ais_dispatch: Membership 1752: quorum retained
May 20 13:13:56 finley crmd: [25840]: info: ais_status_callback: status: ebony is now member (was lost)
May 20 13:13:56 finley crmd: [25840]: info: crm_update_peer: Node ebony: id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=1 born=1744 seen=1752 proc=00000000000000000000000000000002
May 20 13:13:56 finley cib: [25836]: info: ais_dispatch: Membership 1752: quorum retained
May 20 13:13:56 finley cib: [25836]: info: crm_update_peer: Node ebony: id=18393280 state=member (new) addr=r(0) ip(192.168.24.1)  votes=1 born=1744 seen=1752 proc=00000000000000000000000000000002
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: update_member: 0x7ffe78021dd0 Node 18393280 (ebony) born on: 1752
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: update_member: Node ebony now has process list: 00000000000000000000000000013312 (78610)
May 20 13:13:56 finley corosync[25820]:   [pcmk  ] info: send_member_notification: Sending membership update 1752 to 2 children
May 20 13:13:56 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/lrm (origin=local/crmd/6062, version=0.2166.2): ok (rc=0)
May 20 13:13:56 finley corosync[25820]:   [MAIN  ] Completed service synchronization, ready to provide service.
May 20 13:13:56 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/transient_attributes (origin=local/crmd/6063, version=0.2166.3): ok (rc=0)
May 20 13:13:56 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6064, version=0.2166.3): ok (rc=0)
May 20 13:13:56 finley cib: [25836]: info: ais_dispatch: Membership 1752: quorum retained
May 20 13:13:56 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:13:56 finley cib: [25836]: info: crm_update_peer: Node ebony: id=18393280 state=member addr=r(0) ip(192.168.24.1)  votes=1 born=1752 seen=1752 proc=00000000000000000000000000013312 (new)
May 20 13:13:56 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;6:3600:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.2) : Resource op removal
May 20 13:13:56 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='ebony']/lrm": ok (rc=0)
May 20 13:13:56 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=1, tag=transient_attributes, id=ebony, magic=NA, cib=0.2166.3) : Transient attribute: removal
May 20 13:13:56 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='ebony']/transient_attributes": ok (rc=0)
May 20 13:13:56 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:13:56 finley crmd: [25840]: info: do_state_transition: Membership changed: 1748 -> 1752 - join restart
May 20 13:13:56 finley crmd: [25840]: info: do_pe_invoke: Query 6068: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:56 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_FSA_INTERNAL origin=do_state_transition ]
May 20 13:13:56 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 13:13:56 finley crmd: [25840]: info: join_make_offer: Making join offers based on membership 1752
May 20 13:13:56 finley crmd: [25840]: info: join_make_offer: Peer process on ebony is not active (yet?): 00000002 3
May 20 13:13:56 finley crmd: [25840]: info: do_dc_join_offer_all: join-39: Waiting on 2 outstanding join acks
May 20 13:13:56 finley crmd: [25840]: info: ais_dispatch: Membership 1752: quorum retained
May 20 13:13:56 finley crmd: [25840]: info: crm_update_peer: Node ebony: id=18393280 state=member addr=r(0) ip(192.168.24.1)  votes=1 born=1752 seen=1752 proc=00000000000000000000000000013312 (new)
May 20 13:13:56 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6067, version=0.2166.4): ok (rc=0)
May 20 13:13:56 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6069, version=0.2166.4): ok (rc=0)
May 20 13:13:56 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:13:56 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 13:13:57 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6072, version=0.2166.5): ok (rc=0)
May 20 13:13:57 finley crmd: [25840]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:13:57 finley crmd: [25840]: info: do_state_transition: All 2 cluster nodes responded to the join offer.
May 20 13:13:57 finley crmd: [25840]: info: do_dc_join_finalize: join-39: Syncing the CIB from finley to the rest of the cluster
May 20 13:13:57 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/6074, version=0.2166.5): ok (rc=0)
May 20 13:13:57 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6075, version=0.2166.5): ok (rc=0)
May 20 13:13:57 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6076, version=0.2166.5): ok (rc=0)
May 20 13:13:57 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync_one for section 'all' (origin=ebony/ebony/(null), version=0.2166.5): ok (rc=0)
May 20 13:13:57 finley crmd: [25840]: info: do_dc_join_ack: join-39: Updating node state to member for finley
May 20 13:13:57 finley crmd: [25840]: info: do_dc_join_ack: join-39: Updating node state to member for godfrey
May 20 13:13:57 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']/lrm (origin=local/crmd/6077, version=0.2166.6): ok (rc=0)
May 20 13:13:57 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='finley']/lrm": ok (rc=0)
May 20 13:13:58 finley crmd: [25840]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:13:58 finley crmd: [25840]: WARN: do_state_transition: Only 2 of 3 cluster nodes are eligible to run resources - continue 0
May 20 13:13:58 finley crmd: [25840]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
May 20 13:13:58 finley crmd: [25840]: info: crm_update_quorum: Updating quorum status to true (call=6083)
May 20 13:13:58 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
May 20 13:13:58 finley crmd: [25840]: info: do_pe_invoke: Query 6084: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:58 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']/lrm (origin=local/crmd/6079, version=0.2166.8): ok (rc=0)
May 20 13:13:58 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:0;16:3515:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.8) : Resource op removal
May 20 13:13:58 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='godfrey']/lrm": ok (rc=0)
May 20 13:13:58 finley crmd: [25840]: info: do_pe_invoke: Query 6085: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:58 finley crmd: [25840]: info: te_update_diff: Detected LRM refresh - 12 resources updated: Skipping all resource events
May 20 13:13:58 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:227 - Triggered transition abort (complete=1, tag=diff, id=(null), magic=NA, cib=0.2166.9) : LRM Refresh
May 20 13:13:58 finley crmd: [25840]: info: do_pe_invoke: Query 6086: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:13:58 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6081, version=0.2166.9): ok (rc=0)
May 20 13:13:58 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/6083, version=0.2166.10): ok (rc=0)
May 20 13:13:58 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6086, ref=pe_calc-dc-1305890038-6417, seq=1752, quorate=1
May 20 13:13:58 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:13:58 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:13:58 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:13:58 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:13:58 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:13:58 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:13:58 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:13:58 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:13:58 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:13:58 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:13:58 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:13:58 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:13:58 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:13:58 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:13:58 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:58 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:13:58 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:13:58 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:13:58 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:13:58 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:58 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:13:58 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:13:58 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:13:58 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:13:58 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:13:58 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:13:58 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:13:58 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:13:58 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:13:58 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:13:58 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:58 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:13:58 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:58 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:13:58 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:13:58 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:13:58 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:13:58 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:13:58 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 13:13:58 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:13:58 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:13:58 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:13:58 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:13:58 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:13:58 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:13:58 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:13:58 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:13:58 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:13:58 finley pengine: [25839]: info: native_color: Resource ping_nodes:2 cannot run anywhere
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:58 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:13:58 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Stopped)
May 20 13:13:58 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:13:58 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3631: 0 actions in 0 synapses
May 20 13:13:58 finley crmd: [25840]: info: do_te_invoke: Processing graph 3631 (ref=pe_calc-dc-1305890038-6417) derived from /var/lib/pengine/pe-input-4790.bz2
May 20 13:13:58 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:13:58 finley crmd: [25840]: notice: run_graph: Transition 3631 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4790.bz2): Complete
May 20 13:13:58 finley crmd: [25840]: info: te_graph_trigger: Transition 3631 is now complete
May 20 13:13:58 finley crmd: [25840]: info: notify_crmd: Transition 3631 status: done - <null>
May 20 13:13:58 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:13:58 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:13:58 finley pengine: [25839]: info: process_pe_message: Transition 3631: PEngine Input stored in: /var/lib/pengine/pe-input-4790.bz2
May 20 13:13:59 finley attrd: [25838]: info: attrd_local_callback: Sending full refresh (origin=crmd)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:13:59 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (20)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:14:00 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_INTEGRATION [ input=I_NODE_JOIN cause=C_HA_MESSAGE origin=route_message ]
May 20 13:14:00 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:199 - Triggered transition abort (complete=1) : Peer Halt
May 20 13:14:00 finley crmd: [25840]: info: update_dc: Unset DC finley
May 20 13:14:00 finley crmd: [25840]: info: do_dc_join_offer_all: A new node joined the cluster
May 20 13:14:00 finley crmd: [25840]: info: do_dc_join_offer_all: join-40: Waiting on 3 outstanding join acks
May 20 13:14:00 finley crmd: [25840]: info: update_dc: Set DC to finley (3.0.1)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:14:00 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:14:00 finley crmd: [25840]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:14:00 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes responded to the join offer.
May 20 13:14:00 finley crmd: [25840]: info: do_dc_join_finalize: join-40: Syncing the CIB from finley to the rest of the cluster
May 20 13:14:00 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_sync for section 'all' (origin=local/crmd/6088, version=0.2166.10): ok (rc=0)
May 20 13:14:01 finley crmd: [25840]: info: do_dc_join_ack: join-40: Updating node state to member for godfrey
May 20 13:14:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6089, version=0.2166.10): ok (rc=0)
May 20 13:14:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6090, version=0.2166.10): ok (rc=0)
May 20 13:14:01 finley crmd: [25840]: info: do_dc_join_ack: join-40: Updating node state to member for finley
May 20 13:14:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6091, version=0.2166.10): ok (rc=0)
May 20 13:14:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']/lrm (origin=local/crmd/6092, version=0.2166.11): ok (rc=0)
May 20 13:14:01 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='godfrey']/lrm": ok (rc=0)
May 20 13:14:01 finley crmd: [25840]: info: do_dc_join_ack: join-40: Updating node state to member for ebony
May 20 13:14:01 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/transient_attributes (origin=ebony/crmd/6, version=0.2166.12): ok (rc=0)
May 20 13:14:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']/lrm (origin=local/crmd/6094, version=0.2166.13): ok (rc=0)
May 20 13:14:03 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='finley']/lrm": ok (rc=0)
May 20 13:14:03 finley crmd: [25840]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
May 20 13:14:03 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:14:03 finley crmd: [25840]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
May 20 13:14:03 finley crmd: [25840]: info: crm_update_quorum: Updating quorum status to true (call=6100)
May 20 13:14:03 finley crmd: [25840]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
May 20 13:14:03 finley crmd: [25840]: info: do_pe_invoke: Query 6101: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:14:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']/lrm (origin=local/crmd/6096, version=0.2166.14): ok (rc=0)
May 20 13:14:03 finley crmd: [25840]: info: erase_xpath_callback: Deletion of "//node_state[@uname='ebony']/lrm": ok (rc=0)
May 20 13:14:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/6098, version=0.2166.15): ok (rc=0)
May 20 13:14:03 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/6100, version=0.2166.15): ok (rc=0)
May 20 13:14:03 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6101, ref=pe_calc-dc-1305890043-6426, seq=1752, quorate=1
May 20 13:14:03 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:14:03 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:14:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:14:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:14:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:14:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:14:03 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:14:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:14:03 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:14:03 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:14:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:14:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:14:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:14:03 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:14:03 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:14:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:14:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:14:03 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:14:03 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:03 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:14:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:14:03 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:03 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:14:03 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:14:03 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:03 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:14:03 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:14:03 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:14:03 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:14:03 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:03 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:14:03 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:14:03 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:03 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:14:03 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:03 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:14:03 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:14:03 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:14:03 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 13:14:03 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:03 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:14:03 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:14:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:14:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:14:03 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:14:03 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:14:03 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:14:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:14:03 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:14:03 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:14:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:14:03 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:14:03 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:14:03 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:14:03 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:14:03 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:14:03 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:14:03 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:14:03 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:14:03 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:14:03 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:14:03 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:03 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:03 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:2 on ebony
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:14:03 finley pengine: [25839]: notice: LogActions: Start ping_nodes:2#011(ebony)
May 20 13:14:03 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:14:03 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3632: 15 actions in 15 synapses
May 20 13:14:03 finley crmd: [25840]: info: do_te_invoke: Processing graph 3632 (ref=pe_calc-dc-1305890043-6426) derived from /var/lib/pengine/pe-input-4791.bz2
May 20 13:14:03 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: monitor ip_virtual0_monitor_0 on ebony
May 20 13:14:03 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: monitor iscsi0_target_monitor_0 on ebony
May 20 13:14:03 finley crmd: [25840]: info: te_rsc_command: Initiating action 10: monitor iscsi0_lun0_monitor_0 on ebony
May 20 13:14:03 finley crmd: [25840]: info: te_rsc_command: Initiating action 11: monitor iscsi0_lun1_monitor_0 on ebony
May 20 13:14:03 finley crmd: [25840]: info: te_rsc_command: Initiating action 12: monitor iscsi0_lun2_monitor_0 on ebony
May 20 13:14:03 finley crmd: [25840]: info: te_rsc_command: Initiating action 13: monitor drbd_r0:0_monitor_0 on ebony
May 20 13:14:03 finley crmd: [25840]: info: te_rsc_command: Initiating action 14: monitor drbd_r1:0_monitor_0 on ebony
May 20 13:14:03 finley crmd: [25840]: info: te_rsc_command: Initiating action 15: monitor drbd_r2:0_monitor_0 on ebony
May 20 13:14:03 finley crmd: [25840]: info: te_rsc_command: Initiating action 16: monitor ping_nodes:2_monitor_0 on ebony
May 20 13:14:03 finley pengine: [25839]: info: process_pe_message: Transition 3632: PEngine Input stored in: /var/lib/pengine/pe-input-4791.bz2
May 20 13:14:04 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (8) confirmed on ebony (rc=0)
May 20 13:14:04 finley crmd: [25840]: WARN: status_from_rc: Action 9 (iscsi0_target_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:14:04 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:5;9:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.17) : Event failed
May 20 13:14:04 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1
May 20 13:14:04 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 13:14:04 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (9) confirmed on ebony (rc=4)
May 20 13:14:05 finley crmd: [25840]: WARN: status_from_rc: Action 13 (drbd_r0:0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:14:05 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r0:0_monitor_0, magic=0:5;13:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.18) : Event failed
May 20 13:14:05 finley crmd: [25840]: info: match_graph_event: Action drbd_r0:0_monitor_0 (13) confirmed on ebony (rc=4)
May 20 13:14:05 finley crmd: [25840]: WARN: status_from_rc: Action 11 (iscsi0_lun1_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:14:05 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:5;11:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.19) : Event failed
May 20 13:14:05 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (11) confirmed on ebony (rc=4)
May 20 13:14:05 finley crmd: [25840]: WARN: status_from_rc: Action 10 (iscsi0_lun0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:14:05 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:5;10:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.20) : Event failed
May 20 13:14:05 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (10) confirmed on ebony (rc=4)
May 20 13:14:06 finley crmd: [25840]: WARN: status_from_rc: Action 14 (drbd_r1:0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:14:06 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r1:0_monitor_0, magic=0:5;14:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.21) : Event failed
May 20 13:14:06 finley crmd: [25840]: info: match_graph_event: Action drbd_r1:0_monitor_0 (14) confirmed on ebony (rc=4)
May 20 13:14:06 finley crmd: [25840]: WARN: status_from_rc: Action 15 (drbd_r2:0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:14:06 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd_r2:0_monitor_0, magic=0:5;15:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.22) : Event failed
May 20 13:14:06 finley crmd: [25840]: info: match_graph_event: Action drbd_r2:0_monitor_0 (15) confirmed on ebony (rc=4)
May 20 13:14:06 finley attrd: [25838]: info: attrd_local_callback: Sending full refresh (origin=crmd)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_target (<null>)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:0 (10000)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r1:1 (<null>)
May 20 13:14:06 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:2_monitor_0 (16) confirmed on ebony (rc=0)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:0 (INFINITY)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r2:1 (<null>)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun0 (1304204891)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun1 (1304204345)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_lun2 (1304204850)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun0 (<null>)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun1 (<null>)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun2 (<null>)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-iscsi0_lun3 (<null>)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:0 (10000)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r0:1 (<null>)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-ip_virtual0 (<null>)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-iscsi0_target (1304204891)
May 20 13:14:06 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-ip_virtual0 (1304204891)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r3:0 (<null>)
May 20 13:14:07 finley crmd: [25840]: WARN: status_from_rc: Action 12 (iscsi0_lun2_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:14:07 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:5;12:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.24) : Event failed
May 20 13:14:07 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (12) confirmed on ebony (rc=4)
May 20 13:14:07 finley crmd: [25840]: info: te_rsc_command: Initiating action 7: probe_complete probe_complete on ebony - no waiting
May 20 13:14:07 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:14:07 finley crmd: [25840]: notice: run_graph: Transition 3632 (Complete=10, Pending=0, Fired=0, Skipped=4, Incomplete=1, Source=/var/lib/pengine/pe-input-4791.bz2): Stopped
May 20 13:14:07 finley crmd: [25840]: info: te_graph_trigger: Transition 3632 is now complete
May 20 13:14:07 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:14:07 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:14:07 finley crmd: [25840]: info: do_pe_invoke: Query 6102: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:1 (<null>)
May 20 13:14:07 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6102, ref=pe_calc-dc-1305890047-6437, seq=1752, quorate=1
May 20 13:14:07 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=ebony, magic=NA, cib=0.2166.25) : Transient attribute: update
May 20 13:14:07 finley crmd: [25840]: info: do_pe_invoke: Query 6103: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:14:07 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:14:07 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:14:07 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:14:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:14:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:14:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:14:07 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:14:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:14:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:14:07 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:2 on ebony
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Start ping_nodes:2#011(ebony)
May 20 13:14:07 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305890047-6437 is obsolete
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r1:0 (INFINITY)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:0 (1305887962)
May 20 13:14:07 finley pengine: [25839]: info: process_pe_message: Transition 3633: PEngine Input stored in: /var/lib/pengine/pe-input-4792.bz2
May 20 13:14:07 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6103, ref=pe_calc-dc-1305890047-6438, seq=1752, quorate=1
May 20 13:14:07 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:14:07 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:14:07 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:14:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:14:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:14:07 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:07 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:14:07 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:14:07 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:14:07 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:14:07 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:14:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:14:07 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:14:07 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ]
May 20 13:14:07 finley pengine: [25839]: notice: short_print:      Stopped: [ ping_nodes:2 ]
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:07 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:07 finley pengine: [25839]: notice: RecurringOp:  Start recurring monitor (1s) for ping_nodes:2 on ebony
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:14:07 finley pengine: [25839]: notice: LogActions: Start ping_nodes:2#011(ebony)
May 20 13:14:07 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:14:07 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3634: 4 actions in 4 synapses
May 20 13:14:07 finley crmd: [25840]: info: do_te_invoke: Processing graph 3634 (ref=pe_calc-dc-1305890047-6438) derived from /var/lib/pengine/pe-input-4793.bz2
May 20 13:14:07 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 105 fired and confirmed
May 20 13:14:07 finley crmd: [25840]: info: te_rsc_command: Initiating action 103: start ping_nodes:2_start_0 on ebony
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r2:1 (<null>)
May 20 13:14:07 finley pengine: [25839]: info: process_pe_message: Transition 3634: PEngine Input stored in: /var/lib/pengine/pe-input-4793.bz2
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:0 (<null>)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:0 (INFINITY)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r3:1 (<null>)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r0:1 (<null>)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: pingd (20)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:0 (1305887962)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r1:1 (<null>)
May 20 13:14:07 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:0 (10000)
May 20 13:14:08 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd_r2:1 (<null>)
May 20 13:14:08 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-drbd_r3:0 (<null>)
May 20 13:14:08 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:0 (1305887962)
May 20 13:14:08 finley attrd: [25838]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-drbd_r0:1 (<null>)
May 20 13:14:08 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:2_start_0 (103) confirmed on ebony (rc=0)
May 20 13:14:08 finley crmd: [25840]: info: te_rsc_command: Initiating action 104: monitor ping_nodes:2_monitor_1000 on ebony
May 20 13:14:08 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 106 fired and confirmed
May 20 13:14:09 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=ebony, magic=NA, cib=0.2166.27) : Transient attribute: update
May 20 13:14:09 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 13:14:09 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 13:14:10 finley crmd: [25840]: info: match_graph_event: Action ping_nodes:2_monitor_1000 (104) confirmed on ebony (rc=0)
May 20 13:14:10 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:14:10 finley crmd: [25840]: notice: run_graph: Transition 3634 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4793.bz2): Complete
May 20 13:14:10 finley crmd: [25840]: info: te_graph_trigger: Transition 3634 is now complete
May 20 13:14:10 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:14:10 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:14:10 finley crmd: [25840]: info: do_pe_invoke: Query 6104: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:14:10 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6104, ref=pe_calc-dc-1305890050-6441, seq=1752, quorate=1
May 20 13:14:10 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:14:10 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:14:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:14:10 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:14:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:14:10 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:14:10 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:14:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:14:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:14:10 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:14:10 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:14:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:14:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:14:10 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:14:10 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:14:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:14:10 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:10 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:14:10 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:14:10 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:14:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:14:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:14:10 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:14:10 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:14:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:14:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:14:10 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:14:10 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:14:10 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:14:10 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:14:10 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:14:10 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:10 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:14:10 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:14:10 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:14:10 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:14:10 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:14:10 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:14:10 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:14:10 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:14:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:14:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:14:10 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:14:10 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:14:10 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:14:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:14:10 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:14:10 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:14:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:14:10 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:14:10 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:14:10 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:14:10 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:14:10 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:14:10 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:14:10 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:14:10 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:14:10 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:14:10 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:14:10 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:10 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:14:10 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 13:14:10 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:14:10 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3635: 0 actions in 0 synapses
May 20 13:14:10 finley crmd: [25840]: info: do_te_invoke: Processing graph 3635 (ref=pe_calc-dc-1305890050-6441) derived from /var/lib/pengine/pe-input-4794.bz2
May 20 13:14:10 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:14:10 finley crmd: [25840]: notice: run_graph: Transition 3635 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4794.bz2): Complete
May 20 13:14:10 finley crmd: [25840]: info: te_graph_trigger: Transition 3635 is now complete
May 20 13:14:10 finley crmd: [25840]: info: notify_crmd: Transition 3635 status: done - <null>
May 20 13:14:10 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:14:10 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:14:10 finley pengine: [25839]: info: process_pe_message: Transition 3635: PEngine Input stored in: /var/lib/pengine/pe-input-4794.bz2
May 20 13:14:56 finley cibadmin: [4904]: info: Invoked: cibadmin -Ql -o nodes 
May 20 13:14:56 finley cibadmin: [4906]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:14:56 finley cibadmin: [4908]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:14:56 finley crm_resource: [4910]: info: Invoked: crm_resource -C -r rg_isci -H godfrey 
May 20 13:14:56 finley crm_resource: [4910]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4910]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4910]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4910]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4910]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4910]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4910]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4910]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:56 finley cibadmin: [4912]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:14:56 finley cibadmin: [4914]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:14:56 finley crm_resource: [4916]: info: Invoked: crm_resource -C -r rg_isci -H finley 
May 20 13:14:56 finley crm_resource: [4916]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4916]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4916]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4916]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4916]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4916]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4916]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4916]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:56 finley cibadmin: [4918]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:14:56 finley cibadmin: [4920]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:14:56 finley crm_resource: [4922]: info: Invoked: crm_resource -C -r rg_isci -H ebony 
May 20 13:14:56 finley crm_resource: [4922]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4922]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4922]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4922]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4922]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4922]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4922]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:14:56 finley crm_resource: [4922]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:01 finley /USR/SBIN/CRON[4950]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 20 13:15:26 finley cibadmin: [5128]: info: Invoked: cibadmin -Ql -o nodes 
May 20 13:15:26 finley cibadmin: [5130]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:15:26 finley cibadmin: [5132]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:15:27 finley crm_resource: [5134]: info: Invoked: crm_resource -C -r rg_iscsi -H godfrey 
May 20 13:15:27 finley crm_resource: [5134]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:27 finley crm_resource: [5134]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:27 finley crm_resource: [5134]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:27 finley crm_resource: [5134]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:27 finley crm_resource: [5134]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:27 finley crm_resource: [5134]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:27 finley crm_resource: [5134]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:27 finley crm_resource: [5134]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='ip_virtual0'] (origin=godfrey/crmd/144, version=0.2166.29): ok (rc=0)
May 20 13:15:27 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;4:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2166.29) : Resource op removal
May 20 13:15:27 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:15:27 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:15:27 finley crmd: [25840]: info: do_pe_invoke: Query 6105: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:27 finley cibadmin: [5136]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2166" num_updates="29" >
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305890023" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2167" num_updates="1" >
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:15:27 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:27 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305890127" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:15:27 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:15:27 finley crmd: [25840]: info: do_pe_invoke: Query 6106: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/146, version=0.2167.1): ok (rc=0)
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_target'] (origin=godfrey/crmd/147, version=0.2167.2): ok (rc=0)
May 20 13:15:27 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:7;5:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2167.2) : Resource op removal
May 20 13:15:27 finley crmd: [25840]: info: do_pe_invoke: Query 6108: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/149, version=0.2167.2): ok (rc=0)
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun0'] (origin=godfrey/crmd/150, version=0.2167.3): ok (rc=0)
May 20 13:15:27 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:7;6:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2167.3) : Resource op removal
May 20 13:15:27 finley crmd: [25840]: info: do_pe_invoke: Query 6109: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/152, version=0.2167.3): ok (rc=0)
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun1'] (origin=godfrey/crmd/153, version=0.2167.4): ok (rc=0)
May 20 13:15:27 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:7;7:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2167.4) : Resource op removal
May 20 13:15:27 finley crmd: [25840]: info: do_pe_invoke: Query 6110: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/155, version=0.2167.4): ok (rc=0)
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='godfrey']//lrm_resource[@id='iscsi0_lun2'] (origin=godfrey/crmd/156, version=0.2167.5): ok (rc=0)
May 20 13:15:27 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:7;8:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2167.5) : Resource op removal
May 20 13:15:27 finley crmd: [25840]: info: do_pe_invoke: Query 6111: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=godfrey/crmd/158, version=0.2167.5): ok (rc=0)
May 20 13:15:27 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:15:27 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:15:27 finley crmd: [25840]: info: ais_dispatch: Membership 1752: quorum retained
May 20 13:15:27 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:15:27 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6113, version=0.2167.5): ok (rc=0)
May 20 13:15:27 finley cib: [5139]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-68.raw
May 20 13:15:28 finley cibadmin: [5141]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:15:28 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6111, ref=pe_calc-dc-1305890127-6446, seq=1752, quorate=1
May 20 13:15:28 finley cib: [5139]: info: write_cib_contents: Wrote version 0.2167.0 of the CIB to disk (digest: 7294bfb8d222107c4d89c1b966722ec1)
May 20 13:15:28 finley cib: [5139]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.Q7giYQ (digest: /var/lib/heartbeat/crm/cib.7vjD5V)
May 20 13:15:28 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:15:28 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:15:28 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:15:28 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:15:28 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:15:28 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:15:28 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:15:28 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:15:28 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:15:28 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:15:28 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:15:28 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:15:28 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:15:28 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:15:28 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:15:28 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:15:28 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:28 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:15:28 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:15:28 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:28 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:15:28 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:15:28 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:15:28 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:15:28 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:15:28 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:15:28 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:15:28 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:15:28 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:28 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:28 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:15:28 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:28 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:15:28 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:28 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:28 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:15:28 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:15:28 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:28 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:28 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:15:28 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:15:28 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:28 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:28 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:15:28 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:15:28 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:28 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:28 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:15:28 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:15:28 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:28 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:15:28 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:15:28 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:15:28 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:15:28 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:15:28 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:15:28 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:15:28 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:28 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:28 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:28 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:15:28 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 13:15:28 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:15:28 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3636: 7 actions in 7 synapses
May 20 13:15:28 finley crmd: [25840]: info: do_te_invoke: Processing graph 3636 (ref=pe_calc-dc-1305890127-6446) derived from /var/lib/pengine/pe-input-4795.bz2
May 20 13:15:28 finley crmd: [25840]: info: te_rsc_command: Initiating action 7: monitor ip_virtual0_monitor_0 on godfrey
May 20 13:15:28 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: monitor iscsi0_target_monitor_0 on godfrey
May 20 13:15:28 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: monitor iscsi0_lun0_monitor_0 on godfrey
May 20 13:15:28 finley crmd: [25840]: info: te_rsc_command: Initiating action 10: monitor iscsi0_lun1_monitor_0 on godfrey
May 20 13:15:28 finley crmd: [25840]: info: te_rsc_command: Initiating action 11: monitor iscsi0_lun2_monitor_0 on godfrey
May 20 13:15:28 finley pengine: [25839]: info: process_pe_message: Transition 3636: PEngine Input stored in: /var/lib/pengine/pe-input-4795.bz2
May 20 13:15:28 finley crm_resource: [5143]: info: Invoked: crm_resource -C -r rg_iscsi -H finley 
May 20 13:15:28 finley crm_resource: [5143]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:28 finley crm_resource: [5143]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:28 finley crm_resource: [5143]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:28 finley crm_resource: [5143]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:28 finley crm_resource: [5143]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:28 finley crm_resource: [5143]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:28 finley crm_resource: [5143]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:28 finley crm_resource: [5143]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Removing resource ip_virtual0 from the LRM
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Resource 'ip_virtual0' deleted for 5143_crm_resource on finley
May 20 13:15:28 finley crmd: [25840]: info: notify_deleted: Notifying 5143_crm_resource on finley that ip_virtual0 was deleted
May 20 13:15:28 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op ip_virtual0_delete_60000 from 0:0:crm-resource-5143: lrm_invoke-lrmd-1305890128-6453
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='ip_virtual0'] (origin=local/crmd/6114, version=0.2167.6): ok (rc=0)
May 20 13:15:28 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;10:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2167.6) : Resource op removal
May 20 13:15:28 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 13:15:28 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_target from the LRM
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_target' deleted for 5143_crm_resource on finley
May 20 13:15:28 finley crmd: [25840]: info: notify_deleted: Notifying 5143_crm_resource on finley that iscsi0_target was deleted
May 20 13:15:28 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_target_delete_60000 from 0:0:crm-resource-5143: lrm_invoke-lrmd-1305890128-6454
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2167" num_updates="6" >
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305890127" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2168" num_updates="1" >
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305890128" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:15:28 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6116, version=0.2168.1): ok (rc=0)
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_target'] (origin=local/crmd/6117, version=0.2168.2): ok (rc=0)
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun0 from the LRM
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun0' deleted for 5143_crm_resource on finley
May 20 13:15:28 finley crmd: [25840]: info: notify_deleted: Notifying 5143_crm_resource on finley that iscsi0_lun0 was deleted
May 20 13:15:28 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun0_delete_60000 from 0:0:crm-resource-5143: lrm_invoke-lrmd-1305890128-6455
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6119, version=0.2168.5): ok (rc=0)
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun0'] (origin=local/crmd/6120, version=0.2168.6): ok (rc=0)
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun1 from the LRM
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun1' deleted for 5143_crm_resource on finley
May 20 13:15:28 finley crmd: [25840]: info: notify_deleted: Notifying 5143_crm_resource on finley that iscsi0_lun1 was deleted
May 20 13:15:28 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun1_delete_60000 from 0:0:crm-resource-5143: lrm_invoke-lrmd-1305890128-6456
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6122, version=0.2168.6): ok (rc=0)
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun1'] (origin=local/crmd/6123, version=0.2168.7): ok (rc=0)
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Removing resource iscsi0_lun2 from the LRM
May 20 13:15:28 finley crmd: [25840]: info: do_lrm_invoke: Resource 'iscsi0_lun2' deleted for 5143_crm_resource on finley
May 20 13:15:28 finley crmd: [25840]: info: notify_deleted: Notifying 5143_crm_resource on finley that iscsi0_lun2 was deleted
May 20 13:15:28 finley crmd: [25840]: info: send_direct_ack: ACK'ing resource op iscsi0_lun2_delete_60000 from 0:0:crm-resource-5143: lrm_invoke-lrmd-1305890128-6457
May 20 13:15:28 finley cibadmin: [5155]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6125, version=0.2168.7): ok (rc=0)
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='finley']//lrm_resource[@id='iscsi0_lun2'] (origin=local/crmd/6126, version=0.2168.8): ok (rc=0)
May 20 13:15:28 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=0) : Non-status change
May 20 13:15:28 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:15:28 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:7;11:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2168.2) : Resource op removal
May 20 13:15:28 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (7) confirmed on godfrey (rc=0)
May 20 13:15:28 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (8) confirmed on godfrey (rc=0)
May 20 13:15:28 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (9) confirmed on godfrey (rc=0)
May 20 13:15:28 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:7;12:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2168.6) : Resource op removal
May 20 13:15:28 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:7;13:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2168.7) : Resource op removal
May 20 13:15:28 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:7;14:3623:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2168.8) : Resource op removal
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6128, version=0.2168.8): ok (rc=0)
May 20 13:15:28 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:15:28 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:15:28 finley crmd: [25840]: info: ais_dispatch: Membership 1752: quorum retained
May 20 13:15:28 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:15:28 finley cib: [5156]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-69.raw
May 20 13:15:28 finley cib: [5156]: info: write_cib_contents: Wrote version 0.2168.0 of the CIB to disk (digest: e50a6b5a771982a2d632f01b5cb36e6c)
May 20 13:15:28 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6131, version=0.2168.8): ok (rc=0)
May 20 13:15:28 finley cib: [5156]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.VnORzS (digest: /var/lib/heartbeat/crm/cib.VHnMiZ)
May 20 13:15:28 finley cibadmin: [5158]: info: Invoked: cibadmin -Ql -o resources 
May 20 13:15:29 finley crm_resource: [5160]: info: Invoked: crm_resource -C -r rg_iscsi -H ebony 
May 20 13:15:29 finley crm_resource: [5160]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:29 finley crm_resource: [5160]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:29 finley crm_resource: [5160]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:29 finley crm_resource: [5160]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:29 finley crm_resource: [5160]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:29 finley crm_resource: [5160]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:29 finley crm_resource: [5160]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:29 finley crm_resource: [5160]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:29 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (10) confirmed on godfrey (rc=0)
May 20 13:15:29 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (11) confirmed on godfrey (rc=0)
May 20 13:15:29 finley crmd: [25840]: info: te_rsc_command: Initiating action 6: probe_complete probe_complete on godfrey - no waiting
May 20 13:15:29 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:15:29 finley crmd: [25840]: notice: run_graph: Transition 3636 (Complete=6, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pengine/pe-input-4795.bz2): Stopped
May 20 13:15:29 finley crmd: [25840]: info: te_graph_trigger: Transition 3636 is now complete
May 20 13:15:29 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:15:29 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:15:29 finley crmd: [25840]: info: do_pe_invoke: Query 6132: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:29 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6132, ref=pe_calc-dc-1305890129-6460, seq=1752, quorate=1
May 20 13:15:29 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:15:29 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:15:29 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:15:29 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:15:29 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:15:29 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:15:29 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:15:29 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:15:29 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:15:29 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:15:29 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:15:29 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:15:29 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:15:29 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:15:29 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:15:29 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:15:29 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:29 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:15:29 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:15:29 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:29 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:15:29 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:15:29 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:15:29 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:15:29 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:15:29 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:15:29 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:15:29 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:15:29 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:29 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:29 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:15:29 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:29 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:15:29 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:29 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:29 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:15:29 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:15:29 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:29 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:29 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:15:29 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:15:29 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:29 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:29 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:15:29 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:15:29 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:29 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:29 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:15:29 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:15:29 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:29 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:15:29 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:15:29 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:15:29 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:15:29 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:15:29 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:15:29 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:15:29 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:29 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:29 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:29 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:15:29 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 13:15:29 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:15:29 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3637: 7 actions in 7 synapses
May 20 13:15:29 finley crmd: [25840]: info: do_te_invoke: Processing graph 3637 (ref=pe_calc-dc-1305890129-6460) derived from /var/lib/pengine/pe-input-4796.bz2
May 20 13:15:29 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: monitor ip_virtual0_monitor_0 on finley (local)
May 20 13:15:29 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=8:3637:7:8f399f14-fe26-4279-b701-1947eb7b322d op=ip_virtual0_monitor_0 )
May 20 13:15:29 finley lrmd: [25837]: info: rsc:ip_virtual0:1170: probe
May 20 13:15:29 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: monitor iscsi0_target_monitor_0 on finley (local)
May 20 13:15:29 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=9:3637:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_target_monitor_0 )
May 20 13:15:29 finley lrmd: [25837]: info: rsc:iscsi0_target:1171: probe
May 20 13:15:29 finley crmd: [25840]: info: te_rsc_command: Initiating action 10: monitor iscsi0_lun0_monitor_0 on finley (local)
May 20 13:15:29 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=10:3637:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun0_monitor_0 )
May 20 13:15:29 finley lrmd: [25837]: info: rsc:iscsi0_lun0:1172: probe
May 20 13:15:29 finley crmd: [25840]: info: te_rsc_command: Initiating action 11: monitor iscsi0_lun1_monitor_0 on finley (local)
May 20 13:15:29 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=11:3637:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun1_monitor_0 )
May 20 13:15:29 finley lrmd: [25837]: info: rsc:iscsi0_lun1:1173: probe
May 20 13:15:29 finley crmd: [25840]: info: te_rsc_command: Initiating action 12: monitor iscsi0_lun2_monitor_0 on finley (local)
May 20 13:15:29 finley crmd: [25840]: info: do_lrm_rsc_op: Performing key=12:3637:7:8f399f14-fe26-4279-b701-1947eb7b322d op=iscsi0_lun2_monitor_0 )
May 20 13:15:29 finley pengine: [25839]: info: process_pe_message: Transition 3637: PEngine Input stored in: /var/lib/pengine/pe-input-4796.bz2
May 20 13:15:29 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun0_monitor_0 (call=1172, rc=7, cib-update=6133, confirmed=true) not running
May 20 13:15:29 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun1_monitor_0 (call=1173, rc=7, cib-update=6134, confirmed=true) not running
May 20 13:15:29 finley crmd: [25840]: info: process_lrm_event: LRM operation ip_virtual0_monitor_0 (call=1170, rc=7, cib-update=6135, confirmed=true) not running
May 20 13:15:29 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (10) confirmed on finley (rc=0)
May 20 13:15:29 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (11) confirmed on finley (rc=0)
May 20 13:15:29 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (8) confirmed on finley (rc=0)
May 20 13:15:29 finley iSCSITarget[5164]: WARNING: Configuration parameter "portals" is not supported by the iSCSI implementation and will be ignored.
May 20 13:15:29 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_target_monitor_0 (call=1171, rc=7, cib-update=6136, confirmed=true) not running
May 20 13:15:29 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (9) confirmed on finley (rc=0)
May 20 13:15:30 finley lrmd: [25837]: info: rsc:iscsi0_lun2:1174: probe
May 20 13:15:30 finley crmd: [25840]: info: process_lrm_event: LRM operation iscsi0_lun2_monitor_0 (call=1174, rc=7, cib-update=6137, confirmed=true) not running
May 20 13:15:30 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (12) confirmed on finley (rc=0)
May 20 13:15:30 finley crmd: [25840]: info: te_rsc_command: Initiating action 7: probe_complete probe_complete on finley (local) - no waiting
May 20 13:15:30 finley crmd: [25840]: info: te_pseudo_action: Pseudo action 5 fired and confirmed
May 20 13:15:30 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:15:30 finley crmd: [25840]: notice: run_graph: Transition 3637 (Complete=7, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4796.bz2): Complete
May 20 13:15:30 finley crmd: [25840]: info: te_graph_trigger: Transition 3637 is now complete
May 20 13:15:30 finley crmd: [25840]: info: notify_crmd: Transition 3637 status: done - <null>
May 20 13:15:30 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:15:30 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:15:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='ip_virtual0'] (origin=ebony/crmd/18, version=0.2168.16): ok (rc=0)
May 20 13:15:32 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=ip_virtual0_monitor_0, magic=0:7;8:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2168.16) : Resource op removal
May 20 13:15:32 finley crmd: [25840]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 20 13:15:32 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:15:32 finley crmd: [25840]: info: do_pe_invoke: Query 6138: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2168" num_updates="16" >
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305890128" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2169" num_updates="1" >
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305890130" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:15:32 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:15:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/20, version=0.2169.1): ok (rc=0)
May 20 13:15:32 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6138, ref=pe_calc-dc-1305890132-6467, seq=1752, quorate=1
May 20 13:15:32 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 20 13:15:32 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:15:32 finley crmd: [25840]: info: do_pe_invoke: Query 6139: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:32 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:15:32 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:15:32 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:15:32 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:15:32 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:15:32 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:15:32 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:15:32 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:15:32 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:15:32 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:15:32 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 13:15:32 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6139, ref=pe_calc-dc-1305890132-6468, seq=1752, quorate=1
May 20 13:15:32 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:15:32 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:15:32 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305890132-6467 is obsolete
May 20 13:15:32 finley cib: [5309]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-70.raw
May 20 13:15:32 finley crmd: [25840]: info: ais_dispatch: Membership 1752: quorum retained
May 20 13:15:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='iscsi0_target'] (origin=ebony/crmd/21, version=0.2169.2): ok (rc=0)
May 20 13:15:32 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:15:32 finley pengine: [25839]: info: process_pe_message: Transition 3638: PEngine Input stored in: /var/lib/pengine/pe-input-4797.bz2
May 20 13:15:32 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:5;9:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2169.2) : Resource op removal
May 20 13:15:32 finley crmd: [25840]: info: do_pe_invoke: Query 6143: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:32 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:15:32 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:15:32 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:15:32 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:15:32 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:15:32 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:32 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:15:32 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:15:32 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:15:32 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:15:32 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:32 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:15:32 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:15:32 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:32 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:15:32 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:15:32 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:32 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:15:32 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 13:15:32 finley crmd: [25840]: info: handle_response: pe_calc calculation pe_calc-dc-1305890132-6468 is obsolete
May 20 13:15:32 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6142, version=0.2169.2): ok (rc=0)
May 20 13:15:33 finley cib: [5309]: info: write_cib_contents: Wrote version 0.2169.0 of the CIB to disk (digest: 9a6234bda2595b5e9030fe291a0c9488)
May 20 13:15:33 finley pengine: [25839]: info: process_pe_message: Transition 3639: PEngine Input stored in: /var/lib/pengine/pe-input-4798.bz2
May 20 13:15:33 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6143, ref=pe_calc-dc-1305890133-6469, seq=1752, quorate=1
May 20 13:15:33 finley cib: [5309]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.aFigVZ (digest: /var/lib/heartbeat/crm/cib.3mvzZd)
May 20 13:15:33 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:15:33 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:15:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:15:33 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:15:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:15:33 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:15:33 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:15:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:15:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:15:33 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:15:33 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:15:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:15:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:15:33 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:15:33 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:15:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:15:33 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:33 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:15:33 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:15:33 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:15:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:15:33 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:15:33 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:15:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:15:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:15:33 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:15:33 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:15:33 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:33 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:33 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:15:33 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:33 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:15:33 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:33 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:33 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:15:33 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:15:33 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:33 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:33 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:15:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:15:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:33 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:33 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:15:33 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:15:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:33 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:33 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:15:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:15:33 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:33 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:15:33 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:15:33 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:15:33 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:15:33 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:15:33 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:15:33 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:15:33 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:33 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:33 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:33 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:15:33 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 13:15:33 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:15:33 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3640: 4 actions in 4 synapses
May 20 13:15:33 finley crmd: [25840]: info: do_te_invoke: Processing graph 3640 (ref=pe_calc-dc-1305890133-6469) derived from /var/lib/pengine/pe-input-4799.bz2
May 20 13:15:33 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: monitor ip_virtual0_monitor_0 on ebony
May 20 13:15:33 finley crmd: [25840]: info: te_rsc_command: Initiating action 10: monitor iscsi0_target_monitor_0 on ebony
May 20 13:15:33 finley pengine: [25839]: info: process_pe_message: Transition 3640: PEngine Input stored in: /var/lib/pengine/pe-input-4799.bz2
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2169" num_updates="2" >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305890130" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2170" num_updates="1" >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305890132" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:15:33 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/23, version=0.2170.1): ok (rc=0)
May 20 13:15:33 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=0) : Non-status change
May 20 13:15:33 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
May 20 13:15:33 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 13:15:33 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:15:33 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='iscsi0_lun0'] (origin=ebony/crmd/24, version=0.2170.2): ok (rc=0)
May 20 13:15:33 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:5;10:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2170.2) : Resource op removal
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: - <cib admin_epoch="0" epoch="2170" num_updates="2" >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -   <configuration >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -     <crm_config >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -         <nvpair value="1305890132" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -       </cluster_property_set>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -     </crm_config>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: -   </configuration>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: - </cib>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: + <cib admin_epoch="0" epoch="2171" num_updates="1" >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +   <configuration >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +     <crm_config >
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +       <cluster_property_set id="cib-bootstrap-options" >
May 20 13:15:33 finley crmd: [25840]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=0) : Non-status change
May 20 13:15:33 finley crmd: [25840]: info: need_abort: Aborting on change to admin_epoch
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +         <nvpair value="1305890133" id="cib-bootstrap-options-last-lrm-refresh" />
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +       </cluster_property_set>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +     </crm_config>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: +   </configuration>
May 20 13:15:33 finley cib: [25836]: info: log_data_element: cib:diff: + </cib>
May 20 13:15:33 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/26, version=0.2171.1): ok (rc=0)
May 20 13:15:33 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='iscsi0_lun1'] (origin=ebony/crmd/27, version=0.2171.2): ok (rc=0)
May 20 13:15:33 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:5;11:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2171.2) : Resource op removal
May 20 13:15:33 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/29, version=0.2171.2): ok (rc=0)
May 20 13:15:33 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='ebony']//lrm_resource[@id='iscsi0_lun2'] (origin=ebony/crmd/30, version=0.2171.3): ok (rc=0)
May 20 13:15:33 finley crmd: [25840]: info: abort_transition_graph: te_update_diff:267 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:5;12:3632:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2171.3) : Resource op removal
May 20 13:15:33 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=ebony/crmd/32, version=0.2171.3): ok (rc=0)
May 20 13:15:33 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:15:33 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:15:33 finley crmd: [25840]: info: config_query_callback: Checking for expired actions every 900000ms
May 20 13:15:33 finley crmd: [25840]: info: config_query_callback: Sending expected-votes=3 to corosync
May 20 13:15:33 finley crmd: [25840]: info: ais_dispatch: Membership 1752: quorum retained
May 20 13:15:33 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:15:33 finley crmd: [25840]: info: ais_dispatch: Membership 1752: quorum retained
May 20 13:15:33 finley cib: [5312]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-71.raw
May 20 13:15:33 finley cib: [5312]: info: write_cib_contents: Wrote version 0.2171.0 of the CIB to disk (digest: be7d3fb453503583168670950d4f771e)
May 20 13:15:33 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6147, version=0.2171.3): ok (rc=0)
May 20 13:15:33 finley crmd: [25840]: info: crm_ais_dispatch: Setting expected votes to 3
May 20 13:15:33 finley cib: [25836]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/6149, version=0.2171.3): ok (rc=0)
May 20 13:15:33 finley cib: [5312]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.RKL0u1 (digest: /var/lib/heartbeat/crm/cib.T4l48g)
May 20 13:15:35 finley crmd: [25840]: info: match_graph_event: Action ip_virtual0_monitor_0 (9) confirmed on ebony (rc=0)
May 20 13:15:35 finley crmd: [25840]: WARN: status_from_rc: Action 10 (iscsi0_target_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:15:35 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_target_monitor_0, magic=0:5;10:3640:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2171.5) : Event failed
May 20 13:15:35 finley crmd: [25840]: info: match_graph_event: Action iscsi0_target_monitor_0 (10) confirmed on ebony (rc=4)
May 20 13:15:35 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: probe_complete probe_complete on ebony - no waiting
May 20 13:15:35 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:15:35 finley crmd: [25840]: notice: run_graph: Transition 3640 (Complete=3, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pengine/pe-input-4799.bz2): Stopped
May 20 13:15:35 finley crmd: [25840]: info: te_graph_trigger: Transition 3640 is now complete
May 20 13:15:35 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:15:35 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:15:35 finley crmd: [25840]: info: do_pe_invoke: Query 6150: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:35 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6150, ref=pe_calc-dc-1305890135-6473, seq=1752, quorate=1
May 20 13:15:35 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:15:35 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:15:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:15:35 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:15:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:15:35 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:15:35 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:15:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:15:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:15:35 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:15:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:15:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:15:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:15:35 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:15:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:15:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:15:35 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:35 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:15:35 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:15:35 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:15:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:15:35 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:15:35 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:15:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:15:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:15:35 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:15:35 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:15:35 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:15:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:15:35 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:35 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:35 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:15:35 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:15:35 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:35 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:35 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:15:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:15:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:35 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:35 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:15:35 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:15:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:35 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:35 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:15:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:15:35 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:35 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:15:35 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:15:35 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:15:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:15:35 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:15:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:15:35 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:15:35 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:35 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:35 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:35 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:15:35 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 13:15:35 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:15:35 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3641: 5 actions in 5 synapses
May 20 13:15:35 finley crmd: [25840]: info: do_te_invoke: Processing graph 3641 (ref=pe_calc-dc-1305890135-6473) derived from /var/lib/pengine/pe-input-4800.bz2
May 20 13:15:35 finley crmd: [25840]: info: te_rsc_command: Initiating action 9: monitor iscsi0_lun0_monitor_0 on ebony
May 20 13:15:35 finley pengine: [25839]: info: process_pe_message: Transition 3641: PEngine Input stored in: /var/lib/pengine/pe-input-4800.bz2
May 20 13:15:35 finley crmd: [25840]: info: te_rsc_command: Initiating action 10: monitor iscsi0_lun1_monitor_0 on ebony
May 20 13:15:35 finley crmd: [25840]: info: te_rsc_command: Initiating action 11: monitor iscsi0_lun2_monitor_0 on ebony
May 20 13:15:36 finley crmd: [25840]: WARN: status_from_rc: Action 11 (iscsi0_lun2_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:15:36 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun2_monitor_0, magic=0:5;11:3641:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2171.6) : Event failed
May 20 13:15:36 finley crmd: [25840]: info: update_abort_priority: Abort priority upgraded from 0 to 1
May 20 13:15:36 finley crmd: [25840]: info: update_abort_priority: Abort action done superceeded by restart
May 20 13:15:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun2_monitor_0 (11) confirmed on ebony (rc=4)
May 20 13:15:36 finley crmd: [25840]: WARN: status_from_rc: Action 10 (iscsi0_lun1_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:15:36 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun1_monitor_0, magic=0:5;10:3641:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2171.7) : Event failed
May 20 13:15:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun1_monitor_0 (10) confirmed on ebony (rc=4)
May 20 13:15:36 finley crmd: [25840]: WARN: status_from_rc: Action 9 (iscsi0_lun0_monitor_0) on ebony failed (target: 7 vs. rc: 5): Error
May 20 13:15:36 finley crmd: [25840]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=iscsi0_lun0_monitor_0, magic=0:5;9:3641:7:8f399f14-fe26-4279-b701-1947eb7b322d, cib=0.2171.8) : Event failed
May 20 13:15:36 finley crmd: [25840]: info: match_graph_event: Action iscsi0_lun0_monitor_0 (9) confirmed on ebony (rc=4)
May 20 13:15:36 finley crmd: [25840]: info: te_rsc_command: Initiating action 8: probe_complete probe_complete on ebony - no waiting
May 20 13:15:36 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:15:36 finley crmd: [25840]: notice: run_graph: Transition 3641 (Complete=4, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pengine/pe-input-4800.bz2): Stopped
May 20 13:15:36 finley crmd: [25840]: info: te_graph_trigger: Transition 3641 is now complete
May 20 13:15:36 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:15:36 finley crmd: [25840]: info: do_state_transition: All 3 cluster nodes are eligible to run resources.
May 20 13:15:36 finley crmd: [25840]: info: do_pe_invoke: Query 6151: Requesting the current CIB: S_POLICY_ENGINE
May 20 13:15:37 finley crmd: [25840]: info: do_pe_invoke_callback: Invoking the PE: query=6151, ref=pe_calc-dc-1305890136-6478, seq=1752, quorate=1
May 20 13:15:37 finley pengine: [25839]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
May 20 13:15:37 finley pengine: [25839]: info: determine_online_status: Node godfrey is online
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on godfrey
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on godfrey
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on godfrey
May 20 13:15:37 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:1_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:1_stop_0 on godfrey: not configured (6)
May 20 13:15:37 finley pengine: [25839]: info: native_add_running: resource drbd_r0:1 isnt managed
May 20 13:15:37 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:1_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:1_stop_0 on godfrey: not configured (6)
May 20 13:15:37 finley pengine: [25839]: info: native_add_running: resource drbd_r2:1 isnt managed
May 20 13:15:37 finley pengine: [25839]: info: determine_online_status: Node finley is online
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r1:0_monitor_0 found resource drbd_r1:0 active on finley
May 20 13:15:37 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_demote_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_demote_0 on finley: not configured (6)
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r1:0 to stop after a failed demote action
May 20 13:15:37 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r1:0_stop_0 failed with rc=6: Preventing ms_drbd_r1 from re-starting anywhere in the cluster
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r1:0_stop_0 on finley: not configured (6)
May 20 13:15:37 finley pengine: [25839]: info: native_add_running: resource drbd_r1:0 isnt managed
May 20 13:15:37 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r1:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r0:0_monitor_0 found resource drbd_r0:0 active on finley
May 20 13:15:37 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_demote_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_demote_0 on finley: not configured (6)
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r0:0 to stop after a failed demote action
May 20 13:15:37 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r0:0_stop_0 failed with rc=6: Preventing ms_drbd_r0 from re-starting anywhere in the cluster
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r0:0_stop_0 on finley: not configured (6)
May 20 13:15:37 finley pengine: [25839]: info: native_add_running: resource drbd_r0:0 isnt managed
May 20 13:15:37 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r0:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Operation drbd_r2:0_monitor_0 found resource drbd_r2:0 active on finley
May 20 13:15:37 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_demote_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_demote_0 on finley: not configured (6)
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Forcing drbd_r2:0 to stop after a failed demote action
May 20 13:15:37 finley pengine: [25839]: ERROR: unpack_rsc_op: Hard error - drbd_r2:0_stop_0 failed with rc=6: Preventing ms_drbd_r2 from re-starting anywhere in the cluster
May 20 13:15:37 finley pengine: [25839]: WARN: unpack_rsc_op: Processing failed op drbd_r2:0_stop_0 on finley: not configured (6)
May 20 13:15:37 finley pengine: [25839]: info: native_add_running: resource drbd_r2:0 isnt managed
May 20 13:15:37 finley pengine: [25839]: info: unpack_lrm_rsc_state: drbd_r2:0: Not overwriting calculated next role Stopped with requested next role Master
May 20 13:15:37 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:1 on finley to drbd_r0:3 (ORPHAN)
May 20 13:15:37 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:1 on finley to drbd_r2:3 (ORPHAN)
May 20 13:15:37 finley pengine: [25839]: info: find_clone: Internally renamed ping_nodes:1 on finley to ping_nodes:3 (ORPHAN)
May 20 13:15:37 finley pengine: [25839]: info: determine_online_status: Node ebony is online
May 20 13:15:37 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r0:0 on ebony to drbd_r0:2
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r0:0_monitor_0 failed with rc=5: Preventing ms_drbd_r0 from re-starting on ebony
May 20 13:15:37 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r1:0 on ebony to drbd_r1:1
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r1:0_monitor_0 failed with rc=5: Preventing ms_drbd_r1 from re-starting on ebony
May 20 13:15:37 finley pengine: [25839]: info: find_clone: Internally renamed drbd_r2:0 on ebony to drbd_r2:2
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - drbd_r2:0_monitor_0 failed with rc=5: Preventing ms_drbd_r2 from re-starting on ebony
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_target_monitor_0 failed with rc=5: Preventing iscsi0_target from re-starting on ebony
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun2_monitor_0 failed with rc=5: Preventing iscsi0_lun2 from re-starting on ebony
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun1_monitor_0 failed with rc=5: Preventing iscsi0_lun1 from re-starting on ebony
May 20 13:15:37 finley pengine: [25839]: notice: unpack_rsc_op: Hard error - iscsi0_lun0_monitor_0 failed with rc=5: Preventing iscsi0_lun0 from re-starting on ebony
May 20 13:15:37 finley pengine: [25839]: notice: group_print:  Resource Group: rg_iscsi
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      ip_virtual0#011(ocf::heartbeat:IPaddr2):#011Stopped 
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      iscsi0_target#011(ocf::heartbeat:iSCSITarget):#011Stopped 
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      iscsi0_lun0#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      iscsi0_lun1#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      iscsi0_lun2#011(ocf::heartbeat:iSCSILogicalUnit):#011Stopped 
May 20 13:15:37 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r0
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      drbd_r0:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      drbd_r0:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:37 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r0:2 ]
May 20 13:15:37 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r1
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      drbd_r1:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:37 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r1:1 drbd_r1:2 ]
May 20 13:15:37 finley pengine: [25839]: notice: clone_print:  Master/Slave Set: ms_drbd_r2
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      drbd_r2:0#011(ocf::linbit:drbd):#011Slave finley (unmanaged) FAILED
May 20 13:15:37 finley pengine: [25839]: notice: native_print:      drbd_r2:1#011(ocf::linbit:drbd):#011Slave godfrey (unmanaged) FAILED
May 20 13:15:37 finley pengine: [25839]: notice: short_print:      Stopped: [ drbd_r2:2 ]
May 20 13:15:37 finley pengine: [25839]: notice: clone_print:  Clone Set: ping_clone
May 20 13:15:37 finley pengine: [25839]: notice: short_print:      Started: [ finley godfrey ebony ]
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on godfrey
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on godfrey
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from godfrey after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r0 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r0 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r1 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r1 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: get_failcount: ms_drbd_r2 has failed INFINITY times on finley
May 20 13:15:37 finley pengine: [25839]: WARN: common_apply_stickiness: Forcing ms_drbd_r2 away from finley after 1000000 failures (max=1000000)
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:37 finley pengine: [25839]: info: native_color: Resource drbd_r0:2 cannot run anywhere
May 20 13:15:37 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:0 allocated to 'nowhere': failed
May 20 13:15:37 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r0:1 allocated to 'nowhere': failed
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r0: Rolling back scores from ip_virtual0
May 20 13:15:37 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:37 finley pengine: [25839]: info: native_color: Resource drbd_r1:1 cannot run anywhere
May 20 13:15:37 finley pengine: [25839]: info: native_color: Resource drbd_r1:2 cannot run anywhere
May 20 13:15:37 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r1:0 allocated to 'nowhere': failed
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r1: Rolling back scores from ip_virtual0
May 20 13:15:37 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:37 finley pengine: [25839]: info: native_color: Resource drbd_r2:2 cannot run anywhere
May 20 13:15:37 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:0 allocated to 'nowhere': failed
May 20 13:15:37 finley pengine: [25839]: info: native_color: Unmanaged resource drbd_r2:1 allocated to 'nowhere': failed
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: ms_drbd_r2: Rolling back scores from ip_virtual0
May 20 13:15:37 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: ip_virtual0: Rolling back scores from iscsi0_target
May 20 13:15:37 finley pengine: [25839]: info: native_color: Resource ip_virtual0 cannot run anywhere
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: iscsi0_target: Rolling back scores from iscsi0_lun0
May 20 13:15:37 finley pengine: [25839]: info: native_color: Resource iscsi0_target cannot run anywhere
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun0: Rolling back scores from iscsi0_lun1
May 20 13:15:37 finley pengine: [25839]: info: native_color: Resource iscsi0_lun0 cannot run anywhere
May 20 13:15:37 finley pengine: [25839]: info: native_merge_weights: iscsi0_lun1: Rolling back scores from iscsi0_lun2
May 20 13:15:37 finley pengine: [25839]: info: native_color: Resource iscsi0_lun1 cannot run anywhere
May 20 13:15:37 finley pengine: [25839]: info: native_color: Resource iscsi0_lun2 cannot run anywhere
May 20 13:15:37 finley pengine: [25839]: info: master_color: ms_drbd_r0: Promoted 0 instances of a possible 1 to master
May 20 13:15:37 finley pengine: [25839]: info: master_color: ms_drbd_r1: Promoted 0 instances of a possible 1 to master
May 20 13:15:37 finley pengine: [25839]: info: master_color: ms_drbd_r2: Promoted 0 instances of a possible 1 to master
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r0
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r1
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:37 finley pengine: [25839]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd_r2
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource ip_virtual0#011(Stopped)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_target#011(Stopped)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun0#011(Stopped)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun1#011(Stopped)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource iscsi0_lun2#011(Stopped)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:0#011(Slave unmanaged)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:1#011(Slave unmanaged)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r0:2#011(Stopped)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:0#011(Slave unmanaged)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:1#011(Stopped)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r1:2#011(Stopped)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:0#011(Slave unmanaged)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:1#011(Slave unmanaged)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource drbd_r2:2#011(Stopped)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:0#011(Started finley)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:1#011(Started godfrey)
May 20 13:15:37 finley pengine: [25839]: notice: LogActions: Leave resource ping_nodes:2#011(Started ebony)
May 20 13:15:37 finley crmd: [25840]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 20 13:15:37 finley crmd: [25840]: info: unpack_graph: Unpacked transition 3642: 0 actions in 0 synapses
May 20 13:15:37 finley crmd: [25840]: info: do_te_invoke: Processing graph 3642 (ref=pe_calc-dc-1305890136-6478) derived from /var/lib/pengine/pe-input-4801.bz2
May 20 13:15:37 finley crmd: [25840]: info: run_graph: ====================================================
May 20 13:15:37 finley crmd: [25840]: notice: run_graph: Transition 3642 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-4801.bz2): Complete
May 20 13:15:37 finley crmd: [25840]: info: te_graph_trigger: Transition 3642 is now complete
May 20 13:15:37 finley crmd: [25840]: info: notify_crmd: Transition 3642 status: done - <null>
May 20 13:15:37 finley crmd: [25840]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 20 13:15:37 finley crmd: [25840]: info: do_state_transition: Starting PEngine Recheck Timer
May 20 13:15:37 finley pengine: [25839]: info: process_pe_message: Transition 3642: PEngine Input stored in: /var/lib/pengine/pe-input-4801.bz2
