[Pacemaker] Peers see each other, but never successfully elect a DC.
D. J. Draper
draperd7772 at hotmail.com
Fri Jan 29 00:28:57 EST 2010
Apologies; how about enough of /var/log/messages to see the entire startup and shutdown...
Jan 28 22:58:16 node01 corosync[19324]: [MAIN ] Corosync Cluster Engine ('1.2.0'): started and ready to provide service.
Jan 28 22:58:16 node01 corosync[19324]: [MAIN ] Corosync built-in features: nss rdma
Jan 28 22:58:16 node01 corosync[19324]: [MAIN ] Successfully configured openais services to load
Jan 28 22:58:16 node01 corosync[19324]: [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'.
Jan 28 22:58:16 node01 corosync[19324]: [TOTEM ] Initializing transport (UDP/IP).
Jan 28 22:58:16 node01 corosync[19324]: [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
Jan 28 22:58:16 node01 corosync[19324]: [TOTEM ] Initializing transport (UDP/IP).
Jan 28 22:58:16 node01 corosync[19324]: [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
Jan 28 22:58:16 node01 corosync[19324]: [MAIN ] Compatibility mode set to whitetank. Using V1 and V2 of the synchronization engine.
Jan 28 22:58:16 node01 corosync[19324]: [TOTEM ] The network interface [192.168.67.11] is now up.
Jan 28 22:58:16 node01 corosync[19324]: [SERV ] Service engine loaded: openais cluster membership service B.01.01
Jan 28 22:58:16 node01 corosync[19324]: [SERV ] Service engine loaded: openais event service B.01.01
Jan 28 22:58:16 node01 corosync[19324]: [SERV ] Service engine loaded: openais checkpoint service B.01.01
Jan 28 22:58:16 node01 corosync[19324]: [SERV ] Service engine loaded: openais availability management framework B.01.01
Jan 28 22:58:16 node01 corosync[19324]: [SERV ] Service engine loaded: openais message service B.03.01
Jan 28 22:58:16 node01 stonithd: [19331]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Jan 28 22:58:16 node01 cib: [19332]: info: Invoked: /usr/lib/heartbeat/cib
Jan 28 22:58:16 node01 lrmd: [19333]: info: Signal sent to pid=19279, waiting for process to exit
Jan 28 22:58:16 node01 attrd: [19334]: info: Invoked: /usr/lib/heartbeat/attrd
Jan 28 22:58:16 node01 pengine: [19335]: info: Invoked: /usr/lib/heartbeat/pengine
Jan 28 22:58:16 node01 crmd: [19336]: info: Invoked: /usr/lib/heartbeat/crmd
Jan 28 22:58:16 node01 lrmd: [19279]: info: lrmd is shutting down
Jan 28 22:58:16 node01 corosync[19324]: [SERV ] Service engine loaded: openais distributed locking service B.03.01
Jan 28 22:58:16 node01 stonithd: [19331]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Jan 28 22:58:16 node01 cib: [19332]: info: G_main_add_TriggerHandler: Added signal manual handler
Jan 28 22:58:16 node01 attrd: [19334]: info: main: Starting up
Jan 28 22:58:16 node01 crmd: [19336]: info: main: CRM Hg Version: d3fa20fc76c7947d6de66db7e52526dc6bd7d782
Jan 28 22:58:16 node01 corosync[19324]: [SERV ] Service engine loaded: openais timer service A.01.01
Jan 28 22:58:16 node01 cib: [19332]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Jan 28 22:58:16 node01 attrd: [19334]: info: crm_cluster_connect: Connecting to OpenAIS
Jan 28 22:58:16 node01 crmd: [19336]: info: crmd_init: Starting crmd
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: process_ais_conf: Reading configure
Jan 28 22:58:16 node01 cib: [19332]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Jan 28 22:58:16 node01 attrd: [19334]: info: init_ais_connection: Creating connection to our AIS plugin
Jan 28 22:58:16 node01 pengine: [19335]: WARN: main: Terminating previous PE instance
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: config_find_init: Local handle: 7685269064754659331 for logging
Jan 28 22:58:16 node01 attrd: [19334]: info: init_ais_connection: AIS connection established
Jan 28 22:58:16 node01 pengine: [19281]: WARN: process_pe_message: Received quit message, terminating
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: config_find_next: Processing additional logging options...
Jan 28 22:58:16 node01 attrd: [19334]: info: get_ais_nodeid: Server details: id=188983488 uname=node01.houseofdraper.org cname=pcmk
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: get_config_opt: Found 'on' for option: debug
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: get_config_opt: Defaulting to 'off' for option: to_file
Jan 28 22:58:16 node01 attrd: [19334]: info: crm_new_peer: Node node01.houseofdraper.org now has id: 188983488
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: get_config_opt: Found 'daemon' for option: syslog_facility
Jan 28 22:58:16 node01 attrd: [19334]: info: crm_new_peer: Node 188983488 is now known as node01.houseofdraper.org
Jan 28 22:58:16 node01 crmd: [19336]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: config_find_init: Local handle: 8535092201842016260 for service
Jan 28 22:58:16 node01 attrd: [19334]: info: main: Cluster connection active
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: config_find_next: Processing additional service options...
Jan 28 22:58:16 node01 attrd: [19334]: info: main: Accepting attribute updates
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: config_find_next: Processing additional service options...
Jan 28 22:58:16 node01 attrd: [19334]: info: main: Starting mainloop...
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: config_find_next: Processing additional service options...
Jan 28 22:58:16 node01 corosync[19324]: [pcmk ] info: config_find_next: Processing additional service options...
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: config_find_next: Processing additional service options...
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: config_find_next: Processing additional service options...
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: config_find_next: Processing additional service options...
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: config_find_next: Processing additional service options...
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: get_config_opt: Defaulting to 'pcmk' for option: clustername
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: get_config_opt: Defaulting to 'no' for option: use_logd
Jan 28 22:58:17 node01 cib: [19332]: info: startCib: CIB Initialization completed successfully
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: get_config_opt: Found 'yes' for option: use_mgmtd
Jan 28 22:58:17 node01 cib: [19332]: info: crm_cluster_connect: Connecting to OpenAIS
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_startup: CRM: Initialized
Jan 28 22:58:17 node01 cib: [19332]: info: init_ais_connection: Creating connection to our AIS plugin
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] Logging: Initialized pcmk_startup
Jan 28 22:58:17 node01 cib: [19332]: info: init_ais_connection: AIS connection established
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_startup: Maximum core file size is: 4294967295
Jan 28 22:58:17 node01 cib: [19332]: info: get_ais_nodeid: Server details: id=188983488 uname=node01.houseofdraper.org cname=pcmk
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_startup: Service: 9
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_startup: Local hostname: node01.houseofdraper.org
Jan 28 22:58:17 node01 cib: [19332]: info: crm_new_peer: Node node01.houseofdraper.org now has id: 188983488
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_update_nodeid: Local node id: 188983488
Jan 28 22:58:17 node01 cib: [19332]: info: crm_new_peer: Node 188983488 is now known as node01.houseofdraper.org
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: update_member: Creating entry for node 188983488 born on 0
Jan 28 22:58:17 node01 cib: [19332]: info: cib_init: Starting cib mainloop
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: update_member: 0x86cf0 Node 188983488 now known as node01.houseofdraper.org (was: (null))
Jan 28 22:58:17 node01 cib: [19332]: info: ais_dispatch: Membership 28: quorum still lost
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: update_member: Node node01.houseofdraper.org now has 1 quorum votes (was 0)
Jan 28 22:58:17 node01 cib: [19332]: info: crm_update_peer: Node node01.houseofdraper.org: id=188983488 state=member (new) addr=r(0) ip(192.168.67.11) r(1) ip(192.168.2.11) (new) votes=1 (new) born=0 seen=28 proc=00000000000000000000000000053312 (new)
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: update_member: Node 188983488/node01.houseofdraper.org is now: member
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: spawn_child: Forked child 19331 for process stonithd
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: spawn_child: Forked child 19332 for process cib
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: spawn_child: Forked child 19333 for process lrmd
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: spawn_child: Forked child 19334 for process attrd
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: spawn_child: Forked child 19335 for process pengine
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: spawn_child: Forked child 19336 for process crmd
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: spawn_child: Forked child 19337 for process mgmtd
Jan 28 22:58:17 node01 corosync[19324]: [SERV ] Service engine loaded: Pacemaker Cluster Manager 1.0.7
Jan 28 22:58:17 node01 corosync[19324]: [SERV ] Service engine loaded: corosync extended virtual synchrony service
Jan 28 22:58:17 node01 corosync[19324]: [SERV ] Service engine loaded: corosync configuration service
Jan 28 22:58:17 node01 corosync[19324]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01
Jan 28 22:58:17 node01 corosync[19324]: [SERV ] Service engine loaded: corosync cluster config database access v1.01
Jan 28 22:58:17 node01 corosync[19324]: [SERV ] Service engine loaded: corosync profile loading service
Jan 28 22:58:17 node01 corosync[19324]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1
Jan 28 22:58:17 node01 corosync[19324]: [TOTEM ] The network interface [192.168.2.11] is now up.
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] CLM CONFIGURATION CHANGE
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] New Configuration:
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] Members Left:
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] Members Joined:
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 28: memb=0, new=0, lost=0
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] CLM CONFIGURATION CHANGE
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] New Configuration:
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] #011r(0) ip(192.168.67.11) r(1) ip(192.168.2.11)
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] Members Left:
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] Members Joined:
Jan 28 22:58:17 node01 corosync[19324]: [CLM ] #011r(0) ip(192.168.67.11) r(1) ip(192.168.2.11)
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 28: memb=1, new=1, lost=0
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_peer_update: NEW: node01.houseofdraper.org 188983488
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_peer_update: MEMB: node01.houseofdraper.org 188983488
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: update_member: Node node01.houseofdraper.org now has process list: 00000000000000000000000000053312 (340754)
Jan 28 22:58:17 node01 corosync[19324]: [TOTEM ] A processor joined or left the membership and a new membership was formed.
Jan 28 22:58:17 node01 cib: [19340]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-3.raw
Jan 28 22:58:17 node01 stonithd: [19331]: info: crm_cluster_connect: Connecting to OpenAIS
Jan 28 22:58:17 node01 stonithd: [19331]: info: init_ais_connection: Creating connection to our AIS plugin
Jan 28 22:58:17 node01 corosync[19324]: [MAIN ] Completed service synchronization, ready to provide service.
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_ipc: Recorded connection 0x8afc0 for attrd/19334
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_ipc: Recorded connection 0x8a980 for cib/19332
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_ipc: Sending membership update 28 to cib
Jan 28 22:58:17 node01 cib: [19340]: info: write_cib_contents: Wrote version 0.3.0 of the CIB to disk (digest: 23b1a50d5be7437a7127b780da8ef0ef)
Jan 28 22:58:17 node01 stonithd: [19331]: info: init_ais_connection: AIS connection established
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: pcmk_ipc: Recorded connection 0x8c1a0 for stonithd/19331
Jan 28 22:58:17 node01 stonithd: [19331]: info: get_ais_nodeid: Server details: id=188983488 uname=node01.houseofdraper.org cname=pcmk
Jan 28 22:58:17 node01 stonithd: [19331]: info: crm_new_peer: Node node01.houseofdraper.org now has id: 188983488
Jan 28 22:58:17 node01 stonithd: [19331]: info: crm_new_peer: Node 188983488 is now known as node01.houseofdraper.org
Jan 28 22:58:17 node01 stonithd: [19331]: notice: /usr/lib/heartbeat/stonithd start up successfully.
Jan 28 22:58:17 node01 stonithd: [19331]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Jan 28 22:58:17 node01 cib: [19340]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.FJ4WEw (digest: /var/lib/heartbeat/crm/cib.w6rtPF)
Jan 28 22:58:17 node01 cib: [19332]: info: Managed write_cib_contents process 19340 exited with return code 0.
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] ERROR: pcmk_wait_dispatch: Child process mgmtd exited (pid=19337, rc=100)
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] notice: pcmk_wait_dispatch: Child process mgmtd no longer wishes to be respawned
Jan 28 22:58:17 node01 corosync[19324]: [pcmk ] info: update_member: Node node01.houseofdraper.org now has process list: 00000000000000000000000000013312 (78610)
Jan 28 22:58:17 node01 lrmd: [19333]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Jan 28 22:58:17 node01 lrmd: [19333]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Jan 28 22:58:17 node01 lrmd: [19333]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Jan 28 22:58:17 node01 lrmd: [19333]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Jan 28 22:58:17 node01 lrmd: [19333]: info: Started.
Jan 28 22:58:18 node01 crmd: [19336]: info: do_cib_control: CIB connection established
Jan 28 22:58:18 node01 crmd: [19336]: info: crm_cluster_connect: Connecting to OpenAIS
Jan 28 22:58:18 node01 crmd: [19336]: info: init_ais_connection: Creating connection to our AIS plugin
Jan 28 22:58:18 node01 crmd: [19336]: info: init_ais_connection: AIS connection established
Jan 28 22:58:18 node01 corosync[19324]: [pcmk ] info: pcmk_ipc: Recorded connection 0x8b510 for crmd/19336
Jan 28 22:58:18 node01 corosync[19324]: [pcmk ] info: pcmk_ipc: Sending membership update 28 to crmd
Jan 28 22:58:18 node01 crmd: [19336]: info: get_ais_nodeid: Server details: id=188983488 uname=node01.houseofdraper.org cname=pcmk
Jan 28 22:58:18 node01 crmd: [19336]: info: crm_new_peer: Node node01.houseofdraper.org now has id: 188983488
Jan 28 22:58:18 node01 crmd: [19336]: info: crm_new_peer: Node 188983488 is now known as node01.houseofdraper.org
Jan 28 22:58:18 node01 crmd: [19336]: info: do_ha_control: Connected to the cluster
Jan 28 22:58:18 node01 crmd: [19336]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Jan 28 22:58:18 node01 crmd: [19336]: info: crmd_init: Starting crmd's mainloop
Jan 28 22:58:18 node01 crmd: [19336]: info: ais_dispatch: Membership 28: quorum still lost
Jan 28 22:58:18 node01 crmd: [19336]: info: crm_update_peer: Node node01.houseofdraper.org: id=188983488 state=member (new) addr=r(0) ip(192.168.67.11) r(1) ip(192.168.2.11) (new) votes=1 (new) born=0 seen=28 proc=00000000000000000000000000013312 (new)
Jan 28 22:58:18 node01 crmd: [19336]: info: do_started: Delaying start, Config not read (0000000000000040)
Jan 28 22:58:18 node01 crmd: [19336]: info: config_query_callback: Checking for expired actions every 900000ms
Jan 28 22:58:18 node01 crmd: [19336]: WARN: check_message_sanity: Message payload size is incorrect: expected 178, got 4063410
Jan 28 22:58:18 node01 corosync[19324]: [pcmk ] info: update_expected_votes: Expected quorum votes 1024 -> 2
Jan 28 22:58:18 node01 crmd: [19336]: info: crm_get_peer: Node node01.houseofdraper.org now has id: 43200
Jan 28 22:58:18 node01 crmd: [19336]: info: do_started: The local CRM is operational
Jan 28 22:58:18 node01 crmd: [19336]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Jan 28 22:58:18 node01 pengine: [19335]: info: main: Starting pengine
Jan 28 22:58:19 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:58:19 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:58:19 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:58:19 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:58:19 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:58:19 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:58:21 node01 attrd: [19334]: info: cib_connect: Connected to the CIB after 1 signon attempts
Jan 28 22:58:21 node01 attrd: [19334]: info: cib_connect: Sending full refresh
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] CLM CONFIGURATION CHANGE
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] New Configuration:
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] #011r(0) ip(192.168.67.11) r(1) ip(192.168.2.11)
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] Members Left:
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] Members Joined:
Jan 28 22:58:32 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:58:32 node01 cib: [19332]: WARN: check_message_sanity: Message payload size is incorrect: expected 128, got 4092288
Jan 28 22:58:32 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:58:32 node01 cib: [19332]: WARN: check_message_sanity: Message payload is corrupted: expected 128 bytes, got 384
Jan 28 22:58:32 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:58:32 node01 cib: [19332]: ERROR: check_message_sanity: Invalid message 5: (dest=<all>:unknown, from=node01.houseofdraper.org:ais.188983296, compressed=0, size=128, total=4092880)
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] notice: pcmk_peer_update: Transitional membership event on ring 32: memb=1, new=0, lost=0
Jan 28 22:58:32 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:58:32 node01 cib: [19332]: ERROR: ais_dispatch: Invalid message (id=5, dest=<all>:unknown, from=node01.houseofdraper.org:ais.188983296): min=592, total=4092880, size=128, bz2_size=256
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: pcmk_peer_update: memb: node01.houseofdraper.org 188983488
Jan 28 22:58:32 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:58:32 node01 cib: [19332]: WARN: check_message_sanity: Message with no size
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] CLM CONFIGURATION CHANGE
Jan 28 22:58:32 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:58:32 node01 cib: [19332]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] New Configuration:
Jan 28 22:58:32 node01 cib: [19332]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] #011r(0) ip(192.168.67.11) r(1) ip(192.168.2.11)
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] #011r(0) ip(192.168.67.12) r(1) ip(192.168.2.12)
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] Members Left:
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] Members Joined:
Jan 28 22:58:32 node01 corosync[19324]: [CLM ] #011r(0) ip(192.168.67.12) r(1) ip(192.168.2.12)
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] notice: pcmk_peer_update: Stable membership event on ring 32: memb=2, new=1, lost=0
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: update_member: Creating entry for node 205760704 born on 32
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: update_member: Node 205760704/unknown is now: member
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: pcmk_peer_update: NEW: .pending. 205760704
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: pcmk_peer_update: MEMB: node01.houseofdraper.org 188983488
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: pcmk_peer_update: MEMB: .pending. 205760704
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: send_member_notification: Sending membership update 32 to 2 children
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: update_member: 0x86cf0 Node 188983488 ((null)) born on: 32
Jan 28 22:58:32 node01 corosync[19324]: [TOTEM ] A processor joined or left the membership and a new membership was formed.
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: update_member: 0x8bb90 Node 205760704 (node02.houseofdraper.org) born on: 32
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: update_member: 0x8bb90 Node 205760704 now known as node02.houseofdraper.org (was: (null))
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: update_member: Node node02.houseofdraper.org now has process list: 00000000000000000000000000053312 (340754)
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: update_member: Node node02.houseofdraper.org now has 1 quorum votes (was 0)
Jan 28 22:58:32 node01 corosync[19324]: [pcmk ] info: send_member_notification: Sending membership update 32 to 2 children
Jan 28 22:58:32 node01 corosync[19324]: [MAIN ] Completed service synchronization, ready to provide service.
Jan 28 22:58:33 node01 corosync[19324]: [pcmk ] info: update_member: Node node02.houseofdraper.org now has process list: 00000000000000000000000000013312 (78610)
Jan 28 22:58:33 node01 corosync[19324]: [pcmk ] info: send_member_notification: Sending membership update 32 to 2 children
Jan 28 22:58:33 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:58:33 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:58:33 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:58:33 node01 cib: [19332]: WARN: check_message_sanity: Message with no size
Jan 28 22:58:33 node01 cib: [19332]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:58:33 node01 cib: [19332]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:58:33 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:58:33 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:58:33 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:58:34 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:58:34 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:58:34 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:59:19 node01 crmd: [19336]: info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped!
Jan 28 22:59:19 node01 crmd: [19336]: WARN: do_log: FSA: Input I_DC_TIMEOUT from crm_timer_popped() received in state S_PENDING
Jan 28 22:59:19 node01 crmd: [19336]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
Jan 28 22:59:19 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:59:19 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:59:19 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:59:34 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:59:34 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:59:34 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:59:46 node01 corosync[19324]: [SERV ] Unloading all Corosync service engines.
Jan 28 22:59:46 node01 corosync[19324]: [pcmk ] notice: pcmk_shutdown: Shuting down Pacemaker
Jan 28 22:59:46 node01 corosync[19324]: [pcmk ] notice: pcmk_shutdown: mgmtd confirmed stopped
Jan 28 22:59:46 node01 corosync[19324]: [pcmk ] notice: stop_child: Sent -15 to crmd: [19336]
Jan 28 22:59:46 node01 crmd: [19336]: info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
Jan 28 22:59:46 node01 crmd: [19336]: info: crm_shutdown: Requesting shutdown
Jan 28 22:59:46 node01 crmd: [19336]: info: do_shutdown_req: Sending shutdown request to DC: <null>
Jan 28 22:59:46 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:59:46 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:59:46 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:59:46 node01 crmd: [19336]: WARN: check_message_sanity: Message with no size
Jan 28 22:59:46 node01 crmd: [19336]: ERROR: check_message_sanity: Invalid message 0: (dest=<all>:unknown, from=<all>:unknown.0, compressed=0, size=0, total=0)
Jan 28 22:59:46 node01 crmd: [19336]: ERROR: ais_dispatch: Invalid message (id=0, dest=<all>:unknown, from=<all>:unknown.0): min=592, total=0, size=0, bz2_size=0
Jan 28 22:59:50 node01 attrd: [19334]: ERROR: ais_dispatch: Receiving message body failed: (2) Library error: Resource temporarily unavailable (11)
Jan 28 22:59:50 node01 attrd: [19334]: ERROR: ais_dispatch: AIS connection failed
Jan 28 22:59:50 node01 attrd: [19334]: CRIT: attrd_ais_destroy: Lost connection to OpenAIS service!
Jan 28 22:59:50 node01 attrd: [19334]: info: main: Exiting...
Jan 28 22:59:50 node01 attrd: [19334]: ERROR: attrd_cib_connection_destroy: Connection to the CIB terminated...
Jan 28 22:59:50 node01 cib: [19332]: ERROR: ais_dispatch: Receiving message body failed: (2) Library error: Resource temporarily unavailable (11)
Jan 28 22:59:50 node01 cib: [19332]: ERROR: ais_dispatch: AIS connection failed
Jan 28 22:59:50 node01 cib: [19332]: ERROR: cib_ais_destroy: AIS connection terminated
Jan 28 22:59:50 node01 crmd: [19336]: info: cib_native_msgready: Lost connection to the CIB service [19332].
Jan 28 22:59:50 node01 crmd: [19336]: CRIT: cib_native_dispatch: Lost connection to the CIB service [19332/callback].
Jan 28 22:59:50 node01 crmd: [19336]: CRIT: cib_native_dispatch: Lost connection to the CIB service [19332/command].
Jan 28 22:59:50 node01 crmd: [19336]: ERROR: crmd_cib_connection_destroy: Connection to the CIB terminated...
Jan 28 22:59:50 node01 crmd: [19336]: ERROR: ais_dispatch: Receiving message body failed: (2) Library error: Invalid argument (22)
Jan 28 22:59:50 node01 crmd: [19336]: ERROR: ais_dispatch: AIS connection failed
Jan 28 22:59:50 node01 crmd: [19336]: ERROR: crm_ais_destroy: AIS connection terminated
Jan 28 22:59:50 node01 stonithd: [19331]: ERROR: ais_dispatch: Receiving message body failed: (2) Library error: Success (0)
Jan 28 22:59:50 node01 stonithd: [19331]: ERROR: ais_dispatch: AIS connection failed
Jan 28 22:59:50 node01 stonithd: [19331]: ERROR: AIS connection terminated
_________________________________________________________________
Hotmail: Free, trusted and rich email service.
http://clk.atdmt.com/GBL/go/196390708/direct/01/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.clusterlabs.org/pipermail/pacemaker/attachments/20100128/1bb745b2/attachment-0001.html>
More information about the Pacemaker
mailing list