<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
Here are the logs<br>
1: corosync log<br>
2. /warn log<br>
3 messages log<br>
----------------------------------------------------------------------------------------------------------------------------------------<br>
1.<br>
Mar 17 07:05:25 corosync [MAIN ] Corosync Cluster Engine
('1.2.0'): started and ready to provide service. <br>
Mar 16 07:05:25 corosync [MAIN ] Corosync built-in features: nss rdma <br>
Mar 16 07:05:25 corosync [MAIN ] Successfully read main configuration
file '/etc/corosync/corosync.conf'. <br>
Mar 16 07:05:25 corosync [TOTEM ] Initializing transport (UDP/IP). <br>
Mar 16 07:05:25 corosync [TOTEM ] Initializing transmit/receive
security: libtomcrypt SOBER128/SHA1HMAC (mode 0). <br>
Mar 16 07:05:25 corosync [MAIN ] Compatibility mode set to whitetank.
Using V1 and V2 of the synchronization engine. <br>
Mar 16 07:05:25 corosync [TOTEM ] The network interface [192.168.1.21]
is now up. <br>
Mar 16 07:05:25 corosync [pcmk ] info: process_ais_conf: Reading
configure <br>
Mar 16 07:05:25 corosync [pcmk ] info: config_find_init: Local handle:
5650605097994944514 for logging <br>
Mar 16 07:05:25 corosync [pcmk ] info: config_find_next: Processing
additional logging options... <br>
Mar 16 07:05:25 corosync [pcmk ] info: get_config_opt: Found 'off' for
option: debug <br>
Mar 16 07:05:25 corosync [pcmk ] info: get_config_opt: Defaulting to
'off' for option: to_file <br>
Mar 16 07:05:25 corosync [pcmk ] info: get_config_opt: Defaulting to
'daemon' for option: syslog_facility <br>
Mar 16 07:05:25 corosync [pcmk ] info: config_find_init: Local handle:
2730409743423111171 for service <br>
Mar 16 07:05:25 corosync [pcmk ] info: config_find_next: Processing
additional service options... <br>
Mar 16 07:05:25 corosync [pcmk ] info: get_config_opt: Defaulting to
'pcmk' for option: clustername <br>
Mar 16 07:05:25 corosync [pcmk ] info: get_config_opt: Found 'yes' for
option: use_logd <br>
Mar 16 07:05:25 corosync [pcmk ] info: get_config_opt: Found 'yes' for
option: use_mgmtd <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_startup: CRM: Initialized <br>
Mar 16 07:05:25 corosync [pcmk ] Logging: Initialized pcmk_startup <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_startup: Maximum core file
size is: 18446744073709551615 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_startup: Service: 9 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_startup: Local hostname:
vmstore1 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_update_nodeid: Local node
id: 352430272 <br>
Mar 16 07:05:25 corosync [pcmk ] info: update_member: Creating entry
for node 352430272 born on 0 <br>
Mar 16 07:05:25 corosync [pcmk ] info: update_member: 0x63d2a0 Node
352430272 now known as vmstore1 (was: (null)) <br>
Mar 16 07:05:25 corosync [pcmk ] info: update_member: Node vmstore1
now has 1 quorum votes (was 0) <br>
Mar 16 07:05:25 corosync [pcmk ] info: update_member: Node
352430272/vmstore1 is now: member <br>
Mar 16 07:05:25 corosync [pcmk ] info: spawn_child: Forked child 21696
for process stonithd <br>
Mar 16 07:05:25 corosync [pcmk ] info: spawn_child: Forked child 21697
for process cib <br>
Mar 16 07:05:25 corosync [pcmk ] info: spawn_child: Forked child 21698
for process lrmd <br>
Mar 16 07:05:25 corosync [pcmk ] info: spawn_child: Forked child 21700
for process attrd <br>
Mar 16 07:05:25 corosync [pcmk ] info: spawn_child: Forked child 21701
for process pengine <br>
Mar 16 07:05:25 corosync [pcmk ] info: spawn_child: Forked child 21702
for process crmd <br>
Mar 16 07:05:25 corosync [pcmk ] info: spawn_child: Forked child 21703
for process mgmtd <br>
Mar 16 07:05:25 corosync [SERV ] Service engine loaded: Pacemaker
Cluster Manager 1.0.7 <br>
Mar 16 07:05:25 corosync [SERV ] Service engine loaded: corosync
extended virtual synchrony service <br>
Mar 16 07:05:25 corosync [SERV ] Service engine loaded: corosync
configuration service <br>
Mar 16 07:05:25 corosync [SERV ] Service engine loaded: corosync
cluster closed process group service v1.01 <br>
Mar 16 07:05:25 corosync [SERV ] Service engine loaded: corosync
cluster config database access v1.01 <br>
Mar 16 07:05:25 corosync [SERV ] Service engine loaded: corosync
profile loading service <br>
Mar 16 07:05:25 corosync [SERV ] Service engine loaded: corosync
cluster quorum service v0.1 <br>
Mar 16 07:05:25 corosync [pcmk ] notice: pcmk_peer_update:
Transitional membership event on ring 11508: memb=0, new=0, lost=0 <br>
Mar 16 07:05:25 corosync [pcmk ] notice: pcmk_peer_update: Stable
membership event on ring 11508: memb=1, new=1, lost=0 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_peer_update: NEW:
vmstore1 352430272 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_peer_update: MEMB:
vmstore1 352430272 <br>
Mar 16 07:05:25 corosync [pcmk ] info: update_member: Node vmstore1
now has process list: 00000000000000000000000000053312 (340754) <br>
Mar 16 07:05:25 corosync [TOTEM ] A processor joined or left the
membership and a new membership was formed. <br>
Mar 16 07:05:25 corosync [MAIN ] Completed service synchronization,
ready to provide service. <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_ipc: Recorded connection
0x6744e0 for stonithd/21696 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_ipc: Recorded connection
0x676380 for attrd/21700 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_ipc: Recorded connection
0x676ff0 for cib/21697 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_ipc: Sending membership
update 11508 to cib <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_ipc: Recorded connection
0x677ce0 for crmd/21702 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_ipc: Sending membership
update 11508 to crmd <br>
Mar 16 07:05:25 corosync [pcmk ] info: update_expected_votes: Expected
quorum votes 1024 -> 2 <br>
Mar 16 07:05:25 corosync [pcmk ] notice: pcmk_peer_update:
Transitional membership event on ring 11512: memb=1, new=0, lost=0 <br>
Mar 16 07:05:25 corosync [pcmk ] info: pcmk_peer_update: memb:
vmstore1 352430272 <br>
----------------------------------------------------------------------------------------<br>
2 warn log<br>
----<br>
<meta http-equiv="CONTENT-TYPE" content="text/html; charset=ISO-8859-1">
<title></title>
<meta name="GENERATOR" content="OpenOffice.org 2.4 (Win32)">
<style type="text/css">
<!--
@page { size: 21cm 29.7cm; margin: 2cm }
P { margin-bottom: 0.21cm }
-->
</style>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
WARN: send_ipc_message: IPC Channel to 15745 is not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
WARN: send_via_callback_channel: Delivery of reply to client
15745/5a3d0106-376a-400b-b3b1-6fe2b6e96fac failed </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
WARN: do_local_notify: A-Sync reply to crmd failed: reply failed </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [MAIN ] Corosync Cluster Engine exiting with
status -1 at main.c:158. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
WARN: cib_diff_notify: Local-only Change (client:crmd, call: 114):
0.0.0 (Application of an update diff failed, requesting a full
refresh) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
WARN: cib_server_process_diff: Not applying diff 0.101.2 ->
0.101.3 (sync in progress) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
WARN: cib_server_process_diff: Not applying diff 0.101.3 ->
0.101.4 (sync in progress) </p>
<p
style="border-style: none none solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0); border-width: medium medium 1px; padding: 0cm 0cm 0.07cm; margin-bottom: 0cm;">
Mar 16 07:05:25 vmstore1 cib: [21697]: WARN: cib_server_process_diff:
Not applying diff 0.101.4 -> 0.102.1 (sync in progress) </p>
-----------------------------------------------------------------------------------------------------------------------------------------------------------<br>
3 message log<br>
<meta http-equiv="CONTENT-TYPE" content="text/html; charset=ISO-8859-1">
<title></title>
<meta name="GENERATOR" content="OpenOffice.org 2.4 (Win32)">
<style type="text/css">
<!--
@page { size: 21cm 29.7cm; margin: 2cm }
P { margin-bottom: 0.21cm }
-->
</style>
<p style="margin-bottom: 0cm;">Mar 16 07:02:12 vmstore1 cibadmin:
[21660]: info: Invoked: cibadmin -C -o resources -x resourceIP.xml </p>
<p style="margin-bottom: 0cm;">Mar 16 07:02:38 vmstore1 cibadmin:
[21662]: info: Invoked: cibadmin -Q </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [SERV ] Unloading all Corosync service engines. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: pcmk_shutdown: Shuting down
Pacemaker </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: stop_child: Sent -15 to mgmtd:
[15746] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: pcmk_shutdown: mgmtd confirmed
stopped </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: stop_child: Sent -15 to crmd:
[15745] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 mgmtd:
[15746]: info: mgmtd is shutting down </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
</p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 mgmtd:
[15746]: debug: [mgmtd] stopped </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: crm_shutdown: Requesting shutdown </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: do_shutdown_req: Sending shutdown request to DC: vmstore2 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 attrd:
[15741]: info: attrd_ais_dispatch: Update relayed from vmstore2 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 attrd:
[15741]: info: attrd_trigger_update: Sending flush op to all hosts
for: shutdown (1268719524) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 attrd:
[15741]: info: attrd_perform_update: Sent update 11:
shutdown=1268719524 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: pcmk_shutdown: crmd confirmed
stopped </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: stop_child: Sent -15 to pengine:
[15742] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: pcmk_shutdown: pengine confirmed
stopped </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: stop_child: Sent -15 to attrd:
[15741] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: pcmk_shutdown: attrd confirmed
stopped </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: stop_child: Sent -15 to lrmd:
[15740] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 pengine:
[15742]: info: crm_signal_dispatch: Invoking handler for signal 15:
Terminated </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: pcmk_shutdown: lrmd confirmed
stopped </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: stop_child: Sent -15 to cib:
[15739] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
WARN: send_ipc_message: IPC Channel to 15745 is not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 attrd:
[15741]: info: crm_signal_dispatch: Invoking handler for signal 15:
Terminated </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: handle_request: Shutting down </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
WARN: send_via_callback_channel: Delivery of reply to client
15745/5a3d0106-376a-400b-b3b1-6fe2b6e96fac failed </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 attrd:
[15741]: info: attrd_shutdown: Exiting </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: do_state_transition: State transition S_NOT_DC -> S_STOPPING
[ input=I_STOP cause=C_HA_MESSAGE origin=route_message ] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
WARN: do_local_notify: A-Sync reply to crmd failed: reply failed </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 attrd:
[15741]: info: main: Exiting... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: do_lrm_control: Disconnected from the LRM </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 attrd:
[15741]: info: attrd_cib_connection_destroy: Connection to the CIB
terminated... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: pcmk_shutdown: cib confirmed
stopped </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: do_ha_control: Disconnected from OpenAIS </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: stop_child: Sent -15 to stonithd:
[15738] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 lrmd: [15740]:
info: lrmd is shutting down </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] info: pcmk_ipc_exit: Client stonithd
(conn=0x674240, async-conn=0x674240) left </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: do_cib_control: Disconnecting CIB </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: crmd_cib_connection_destroy: Connection to the CIB
terminated... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: free_mem: Dropping I_TERMINATE: [ state=S_STOPPING
cause=C_FSA_INTERNAL origin=do_stop ] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 crmd: [15745]:
info: do_exit: [crmd] stopped (0) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
</p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
info: cib_shutdown: Disconnected 0 clients </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
info: cib_process_disconnect: All clients disconnected... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
info: initiate_exit: Sending disconnect notification to 2 peers... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
info: cib_process_shutdown_req: Shutdown ACK from vmstore2 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
info: cib_ha_connection_destroy: Heartbeat disconnection complete...
exiting </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
info: cib_ha_connection_destroy: Exiting... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
info: cib_process_request: Operation complete: op cib_shutdown_req
for section 'all' (origin=vmstore2/vmstore2/(null), version=0.0.0):
ok (rc=0) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 cib: [15739]:
info: main: Done </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1 stonithd:
[15738]: notice: /usr/lib64/heartbeat/stonithd normally quit. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: pcmk_shutdown: stonithd confirmed
stopped </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] info: update_member: Node vmstore1 now
has process list: 00000000000000000000000000000002 (2) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [pcmk ] notice: pcmk_shutdown: Shutdown complete </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [SERV ] Service engine unloaded: Pacemaker
Cluster Manager 1.0.7 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [SERV ] Service engine unloaded: corosync
extended virtual synchrony service </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [SERV ] Service engine unloaded: corosync
configuration service </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [SERV ] Service engine unloaded: corosync cluster
closed process group service v1.01 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [SERV ] Service engine unloaded: corosync cluster
config database access v1.01 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [SERV ] Service engine unloaded: corosync profile
loading service </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [SERV ] Service engine unloaded: corosync cluster
quorum service v0.1 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:24 vmstore1
corosync[15730]: [MAIN ] Corosync Cluster Engine exiting with
status -1 at main.c:158. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [MAIN ] Corosync Cluster Engine ('1.2.0'):
started and ready to provide service. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [MAIN ] Corosync built-in features: nss rdma </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [MAIN ] Successfully read main configuration file
'/etc/corosync/corosync.conf'. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [TOTEM ] Initializing transport (UDP/IP). </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [TOTEM ] Initializing transmit/receive security:
libtomcrypt SOBER128/SHA1HMAC (mode 0). </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [MAIN ] Compatibility mode set to whitetank. Using V1
and V2 of the synchronization engine. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [TOTEM ] The network interface [192.168.1.21] is
now up. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: process_ais_conf: Reading configure
</p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: config_find_init: Local handle:
5650605097994944514 for logging </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: config_find_next: Processing
additional logging options... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: get_config_opt: Found 'off' for
option: debug </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: get_config_opt: Defaulting to 'off'
for option: to_file </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: get_config_opt: Defaulting to
'daemon' for option: syslog_facility </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: config_find_init: Local handle:
2730409743423111171 for service </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: config_find_next: Processing
additional service options... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: get_config_opt: Defaulting to
'pcmk' for option: clustername </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: get_config_opt: Found 'yes' for
option: use_logd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: get_config_opt: Found 'yes' for
option: use_mgmtd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_startup: CRM: Initialized </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] Logging: Initialized pcmk_startup </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_startup: Maximum core file
size is: 18446744073709551615 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_startup: Service: 9 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_startup: Local hostname:
vmstore1 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_update_nodeid: Local node id:
352430272 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: Creating entry for
node 352430272 born on 0 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: 0x63d2a0 Node
352430272 now known as vmstore1 (was: (null)) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: Node vmstore1 now
has 1 quorum votes (was 0) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: Node
352430272/vmstore1 is now: member </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: spawn_child: Forked child 21696 for
process stonithd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: spawn_child: Forked child 21697 for
process cib </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: spawn_child: Forked child 21698 for
process lrmd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: G_main_add_SignalHandler: Added signal handler for
signal 10 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 lrmd: [21698]:
info: G_main_add_SignalHandler: Added signal handler for signal 15 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: G_main_add_SignalHandler: Added signal handler for
signal 12 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: Stack hogger failed 0xffffffff </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: crm_cluster_connect: Connecting to OpenAIS </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: init_ais_connection: Creating connection to our AIS
plugin </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: spawn_child: Forked child 21700 for
process attrd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: Invoked: /usr/lib64/heartbeat/cib </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: G_main_add_TriggerHandler: Added signal manual handler </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: G_main_add_SignalHandler: Added signal handler for signal 17 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 lrmd: [21698]:
info: G_main_add_SignalHandler: Added signal handler for signal 17 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: spawn_child: Forked child 21701 for
process pengine </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 pengine:
[21701]: info: Invoked: /usr/lib64/heartbeat/pengine </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 pengine:
[21701]: info: main: Starting pengine </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 lrmd: [21698]:
info: G_main_add_SignalHandler: Added signal handler for signal 10 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 lrmd: [21698]:
info: G_main_add_SignalHandler: Added signal handler for signal 12 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 lrmd: [21698]:
info: Started. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: spawn_child: Forked child 21702 for
process crmd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: spawn_child: Forked child 21703 for
process mgmtd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [SERV ] Service engine loaded: Pacemaker Cluster
Manager 1.0.7 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [SERV ] Service engine loaded: corosync extended
virtual synchrony service </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [SERV ] Service engine loaded: corosync
configuration service </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [SERV ] Service engine loaded: corosync cluster
closed process group service v1.01 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [SERV ] Service engine loaded: corosync cluster
config database access v1.01 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [SERV ] Service engine loaded: corosync profile
loading service </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [SERV ] Service engine loaded: corosync cluster
quorum service v0.1 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] notice: pcmk_peer_update: Transitional
membership event on ring 11508: memb=0, new=0, lost=0 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] notice: pcmk_peer_update: Stable
membership event on ring 11508: memb=1, new=1, lost=0 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_peer_update: NEW: vmstore1
352430272 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 mgmtd:
[21703]: info: G_main_add_SignalHandler: Added signal handler for
signal 15 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_peer_update: MEMB: vmstore1
352430272 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 mgmtd:
[21703]: debug: Enabling coredumps </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: Node vmstore1 now
has process list: 00000000000000000000000000053312 (340754) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: init_ais_connection: AIS connection established </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [TOTEM ] A processor joined or left the membership
and a new membership was formed. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: get_ais_nodeid: Server details: id=352430272
uname=vmstore1 cname=pcmk </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [MAIN ] Completed service synchronization, ready
to provide service. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: crm_new_peer: Node vmstore1 now has id: 352430272 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_ipc: Recorded connection
0x6744e0 for stonithd/21696 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: crm_new_peer: Node 352430272 is now known as vmstore1 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
</p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 stonithd:
[21696]: info: G_main_add_SignalHandler: Added signal handler for
signal 17 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_ipc: Recorded connection
0x676380 for attrd/21700 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: Invoked: /usr/lib64/heartbeat/attrd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: main: Starting up </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: crm_cluster_connect: Connecting to OpenAIS </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: init_ais_connection: Creating connection to our AIS
plugin </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: init_ais_connection: AIS connection established </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: get_ais_nodeid: Server details: id=352430272
uname=vmstore1 cname=pcmk </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: crm_new_peer: Node vmstore1 now has id: 352430272 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: crm_new_peer: Node 352430272 is now known as vmstore1 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: main: Cluster connection active </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: main: Accepting attribute updates </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 attrd:
[21700]: info: main: Starting mainloop... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 mgmtd:
[21703]: info: G_main_add_SignalHandler: Added signal handler for
signal 10 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: Invoked: /usr/lib64/heartbeat/crmd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 mgmtd:
[21703]: info: G_main_add_SignalHandler: Added signal handler for
signal 12 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: main: CRM Hg Version: d3fa20fc76c7947d6de66db7e52526dc6bd7d782 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 mgmtd:
[21703]: info: init_crm </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: retrieveCib: Reading cluster configuration from:
/var/lib/heartbeat/crm/cib.xml (digest:
/var/lib/heartbeat/crm/cib.xml.sig) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 mgmtd:
[21703]: info: login to cib: 0, ret:-10 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: startCib: CIB Initialization completed successfully </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: crm_cluster_connect: Connecting to OpenAIS </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_ipc: Recorded connection
0x676ff0 for cib/21697 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_ipc: Sending membership update
11508 to cib </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: init_ais_connection: Creating connection to our AIS plugin </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: init_ais_connection: AIS connection established </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: get_ais_nodeid: Server details: id=352430272 uname=vmstore1
cname=pcmk </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: crm_new_peer: Node vmstore1 now has id: 352430272 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: crm_new_peer: Node 352430272 is now known as vmstore1 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: cib_init: Starting cib mainloop </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: ais_dispatch: Membership 11508: quorum still lost </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: crm_update_peer: Node vmstore1: id=352430272 state=member (new)
addr=r(0) ip(192.168.1.21) (new) votes=1 (new) born=0 seen=11508
proc=00000000000000000000000000053312 (new) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: crmd_init: Starting crmd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: G_main_add_SignalHandler: Added signal handler for signal 17 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_ipc: Recorded connection
0x677ce0 for crmd/21702 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: do_cib_control: CIB connection established </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: crm_cluster_connect: Connecting to OpenAIS </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: init_ais_connection: Creating connection to our AIS plugin </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: init_ais_connection: AIS connection established </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: get_ais_nodeid: Server details: id=352430272 uname=vmstore1
cname=pcmk </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: crm_new_peer: Node vmstore1 now has id: 352430272 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: crm_new_peer: Node 352430272 is now known as vmstore1 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: do_ha_control: Connected to the cluster </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: do_started: Delaying start, CCM (0000000000100000) not
connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: crmd_init: Starting crmd's mainloop </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: config_query_callback: Checking for expired actions every
900000ms </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: ais_dispatch: Membership 11508: quorum still lost </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: crm_update_peer: Node vmstore1: id=352430272 state=member (new)
addr=r(0) ip(192.168.1.21) (new) votes=1 (new) born=0 seen=11508
proc=00000000000000000000000000053312 (new) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_ipc: Sending membership update
11508 to crmd </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_expected_votes: Expected
quorum votes 1024 -> 2 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: do_started: The local CRM is operational </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 crmd: [21702]:
info: do_state_transition: State transition S_STARTING ->
S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21708]:
info: write_cib_contents: Archived previous version as
/var/lib/heartbeat/crm/cib-2.raw </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21708]:
info: write_cib_contents: Wrote version 0.100.0 of the CIB to disk
(digest: eda82ffa55c5172f7b86363fd9031e6c) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21708]:
info: retrieveCib: Reading cluster configuration from:
/var/lib/heartbeat/crm/cib.yYxNE3 (digest:
/var/lib/heartbeat/crm/cib.WDLFgi) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] notice: pcmk_peer_update: Transitional
membership event on ring 11512: memb=1, new=0, lost=0 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_peer_update: memb: vmstore1
352430272 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] notice: pcmk_peer_update: Stable
membership event on ring 11512: memb=2, new=1, lost=0 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: Creating entry for
node 369207488 born on 11512 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: Node
369207488/unknown is now: member </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_peer_update: NEW: .pending.
369207488 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_peer_update: MEMB: vmstore1
352430272 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: pcmk_peer_update: MEMB: .pending.
369207488 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: send_member_notification: Sending
membership update 11512 to 2 children </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: 0x63d2a0 Node
352430272 ((null)) born on: 11512 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [TOTEM ] A processor joined or left the membership
and a new membership was formed. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
notice: ais_dispatch: Membership 11512: quorum acquired </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: crm_new_peer: Node <null> now has id: 369207488 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: crm_update_peer: Node (null): id=369207488 state=member (new)
addr=r(0) ip(192.168.1.22) votes=0 born=0 seen=11512
proc=00000000000000000000000000000000 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: 0x6399b0 Node
369207488 (vmstore2) born on: 11492 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: 0x6399b0 Node
369207488 now known as vmstore2 (was: (null)) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: Node vmstore2 now
has process list: 00000000000000000000000000053312 (340754) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: update_member: Node vmstore2 now
has 1 quorum votes (was 0) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [pcmk ] info: send_member_notification: Sending
membership update 11512 to 2 children </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: ais_dispatch: Membership 11512: quorum retained </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: crm_get_peer: Node 369207488 is now known as vmstore2 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: crm_update_peer: Node vmstore2: id=369207488 state=member
addr=r(0) ip(192.168.1.22) votes=1 (new) born=11492 seen=11512
proc=00000000000000000000000000053312 (new) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: cib_process_diff: Diff 0.101.1 -> 0.101.2 not applied to
0.100.0: current "epoch" is less than required </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: cib_server_process_diff: Requesting re-sync from peer </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
WARN: cib_diff_notify: Local-only Change (client:crmd, call: 114):
0.0.0 (Application of an update diff failed, requesting a full
refresh) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
WARN: cib_server_process_diff: Not applying diff 0.101.2 ->
0.101.3 (sync in progress) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
WARN: cib_server_process_diff: Not applying diff 0.101.3 ->
0.101.4 (sync in progress) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
WARN: cib_server_process_diff: Not applying diff 0.101.4 ->
0.102.1 (sync in progress) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21697]:
info: cib_replace_notify: Replaced: 0.100.0 -> 0.102.1 from
vmstore2 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21710]:
info: write_cib_contents: Archived previous version as
/var/lib/heartbeat/crm/cib-3.raw </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21710]:
info: write_cib_contents: Wrote version 0.102.0 of the CIB to disk
(digest: d8b60f5febb5d2520c7391a739ff58d0) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1 cib: [21710]:
info: retrieveCib: Reading cluster configuration from:
/var/lib/heartbeat/crm/cib.1BUB03 (digest:
/var/lib/heartbeat/crm/cib.VWmiYi) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:25 vmstore1
corosync[21689]: [MAIN ] Completed service synchronization, ready
to provide service. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: ais_dispatch: Membership 11508: quorum still lost </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
notice: ais_dispatch: Membership 11512: quorum acquired </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: crm_new_peer: Node <null> now has id: 369207488 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: crm_update_peer: Node (null): id=369207488 state=member (new)
addr=r(0) ip(192.168.1.22) votes=0 born=0 seen=11512
proc=00000000000000000000000000000000 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: ais_dispatch: Membership 11512: quorum retained </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: crm_get_peer: Node 369207488 is now known as vmstore2 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: crm_update_peer: Node vmstore2: id=369207488 state=member
addr=r(0) ip(192.168.1.22) votes=1 (new) born=11492 seen=11512
proc=00000000000000000000000000053312 (new) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: update_dc: Set DC to vmstore2 (3.0.1) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: find_hash_entry: Creating hash entry for terminate </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: update_attrd: Connecting to attrd... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: find_hash_entry: Creating hash entry for shutdown </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: do_state_transition: State transition S_PENDING -> S_NOT_DC
[ input=I_NOT_DC cause=C_HA_MESSAGE
origin=do_cl_join_finalize_respond ] </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_local_callback: Sending full refresh
(origin=crmd) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_trigger_update: Sending flush op to all hosts
for: shutdown (<null>) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_perform_update: Delaying operation
shutdown=<null>: cib not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_trigger_update: Sending flush op to all hosts
for: terminate (<null>) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_perform_update: Delaying operation
terminate=<null>: cib not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_perform_update: Delaying operation
shutdown=<null>: cib not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_perform_update: Delaying operation
terminate=<null>: cib not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: erase_xpath_callback: Deletion of
"//node_state[@uname='vmstore1']/transient_attributes": ok
(rc=0) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 crmd: [21702]:
info: erase_xpath_callback: Deletion of
"//node_state[@uname='vmstore1']/lrm": ok (rc=0) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: crm_new_peer: Node vmstore2 now has id: 369207488 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: crm_new_peer: Node 369207488 is now known as vmstore2 </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_perform_update: Delaying operation
shutdown=<null>: cib not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: find_hash_entry: Creating hash entry for
probe_complete </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_trigger_update: Sending flush op to all hosts
for: probe_complete (true) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_perform_update: Delaying operation
probe_complete=true: cib not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_perform_update: Delaying operation
terminate=<null>: cib not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:26 vmstore1 attrd:
[21700]: info: attrd_perform_update: Delaying operation
probe_complete=true: cib not connected </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:27 vmstore1 mgmtd:
[21703]: debug: main: run the loop... </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:27 vmstore1 mgmtd:
[21703]: info: Started. </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:30 vmstore1 attrd:
[21700]: info: cib_connect: Connected to the CIB after 1 signon
attempts </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:30 vmstore1 attrd:
[21700]: info: cib_connect: Sending full refresh </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:30 vmstore1 attrd:
[21700]: info: attrd_trigger_update: Sending flush op to all hosts
for: shutdown (<null>) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:30 vmstore1 attrd:
[21700]: info: attrd_trigger_update: Sending flush op to all hosts
for: terminate (<null>) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:30 vmstore1 attrd:
[21700]: info: attrd_trigger_update: Sending flush op to all hosts
for: probe_complete (true) </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:30 vmstore1 attrd:
[21700]: info: attrd_perform_update: Sent update 6:
probe_complete=true </p>
<p style="margin-bottom: 0cm;">Mar 16 07:05:43 vmstore1 cibadmin:
[21715]: info: Invoked: cibadmin -C -o resources -x resourceIP.xml </p>
<p
style="border-style: none none solid; border-color: -moz-use-text-color -moz-use-text-color rgb(0, 0, 0); border-width: medium medium 1px; padding: 0cm 0cm 0.07cm; margin-bottom: 0cm;">
Mar 16 07:05:55 vmstore1 cibadmin: [21716]: info: Invoked: cibadmin
-Q ~</p>
<br>
<br>
</body>
</html>