[Pacemaker] PM 1.1.5- make errors

Thu Nov 24 16:07:28 UTC 2011

Hi Andrew,

it did't help: I've  #ifdef'd out. the reference to `terminate_ais_connection' i 
the file Pacemaker-1-1-c86cb93c5a57/crmd/control.c, succesfully compiled & 
installed PM, but after start of heartbeat am I faced with following errors:
heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14270 
exited with return code 126
ERROR: Respawning client "/usr/lib64/heartbeat/attrd": and so on for other 
demons/programms  too: crmd, ccm, cib.

- see ha-log attached

Interesting :
on the second server runs all like a charm ...

OS: SLES11/SP1

ha.cf:
logfile /var/log/ha-log
debugfile /var/log/ha-debug
debug 0
cluster HLUG708
logfacility local1
udpport 708
ucast eth0 hlugl9
ucast eth1 hlugl9
ucast eth2 hlugl9
coredumps true
auto_failback on
keepalive 5
warntime 10
deadtime 15
initdead 120
node hlugl8
node hlugl9
crm respawn
autojoin other

Any ideas ?

TIA!

Nikita Michalko     

Am Freitag, 21. Oktober 2011 03:12:31 schrieb Andrew Beekhof:
> Looks like do_ha_control() is calling corosync specific functions when
> only support for heartbeat is being built.
> They'd just need to be #ifdef'd out.
> 

> On Thu, Oct 20, 2011 at 9:54 PM, Nikita Michalko
> 
> <michalko.system at a-i-p.com> wrote:
> > Hi all,
> >
> > the next problem I need help ;-(
> > PM Version: 1.1.5 (Pacemaker-1-1-c86cb93c5a57.tar.bz2)
> > - configured with:
> > configure --prefix=$PREFIX --localstatedir=/var --sysconfdir=/etc --with-
> > heartbeat --with-stonith --with-pacemaker
> > --with-daemon-user=$CLUSTER_USER -- with-daemon-group=$CLUSTER_GROUP
> >  --enable-fatal-warnings=no --with-ras- set=linux-ha
> >
> > After "make" I get the following error:
> > ...
> > gcc -std=gnu99 -DHAVE_CONFIG_H -I. -I../include -I../include -I../include
> > - I../libltdl   -I../libltdl  -I/usr/include/glib-2.0 -
> > I/usr/lib64/glib-2.0/include   -I/usr/include/libxml2  -g -O2
> > -I/usr/include - I/usr/include/heartbeat -ggdb3 -O0  -fgnu89-inline
> > -fstack-protector-all -Wall - Waggregate-return -Wbad-function-cast
> > -Wcast-align -Wdeclaration-after-statement -Wendif-labels -Wfloat-equal
> > -Wformat=2 -Wformat-security -Wformat-nonliteral - Winline
> > -Wmissing-prototypes -Wmissing-declarations -Wnested-externs -Wno-long-
> > long -Wno-strict-aliasing -Wpointer-arith -Wstrict-prototypes
> > -Wwrite-strings - MT te_callbacks.o -MD -MP -MF .deps/te_callbacks.Tpo -c
> > -o te_callbacks.o te_callbacks.c
> > mv -f .deps/te_callbacks.Tpo .deps/te_callbacks.Po
> > /bin/sh ../libtool --tag=CC  --tag=CC   --mode=link gcc -std=gnu99  -g
> > -O2 - I/usr/include -I/usr/include/heartbeat -ggdb3 -O0  -fgnu89-inline
> > -fstack- protector-all -Wall -Waggregate-return -Wbad-function-cast
> > -Wcast-align - Wdeclaration-after-statement -Wendif-labels -Wfloat-equal
> > -Wformat=2 -Wformat- security -Wformat-nonliteral -Winline
> > -Wmissing-prototypes -Wmissing- declarations -Wnested-externs
> > -Wno-long-long -Wno-strict-aliasing -Wpointer- arith -Wstrict-prototypes
> > -Wwrite-strings   -o crmd main.o crmd.o corosync.o fsa.o control.o
> > messages.o ccm.o callbacks.o election.o join_client.o join_dc.o
> > subsystems.o cib.o pengine.o tengine.o lrm.o utils.o misc.o te_events.o
> > te_actions.o te_utils.o te_callbacks.o -lhbclient -lccmclient -llrm
> > ../lib/fencing/libstonithd.la ../lib/transition/libtransitioner.la
> > ../lib/pengine/libpe_rules.la ../lib/cib/libcib.la
> > ../lib/common/libcrmcluster.la ../lib/common/libcrmcommon.la -lplumb
> > -lpils - lbz2 -lxslt -lxml2 -lc -lglib-2.0 -luuid -lrt -ldl  -lglib-2.0  
> > -lltdl libtool: link: gcc -std=gnu99 -g -O2 -I/usr/include
> > -I/usr/include/heartbeat - ggdb3 -O0 -fgnu89-inline -fstack-protector-all
> > -Wall -Waggregate-return -Wbad- function-cast -Wcast-align
> > -Wdeclaration-after-statement -Wendif-labels -Wfloat- equal -Wformat=2
> > -Wformat-security -Wformat-nonliteral -Winline -Wmissing- prototypes
> > -Wmissing-declarations -Wnested-externs -Wno-long-long -Wno-strict-
> > aliasing -Wpointer-arith -Wstrict-prototypes -Wwrite-strings -o
> > .libs/crmd main.o crmd.o corosync.o fsa.o control.o messages.o ccm.o
> > callbacks.o election.o join_client.o join_dc.o subsystems.o cib.o
> > pengine.o tengine.o lrm.o utils.o misc.o te_events.o te_actions.o
> > te_utils.o te_callbacks.o  /usr/lib64/liblrm.so
> > ../lib/fencing/.libs/libstonithd.so -L/usr/lib64 -L/lib64
> > /usr/lib64/libstonith.so ../lib/transition/.libs/libtransitioner.so
> > ../lib/pengine/.libs/libpe_rules.so ../lib/cib/.libs/libcib.so
> > /opt/HA/sourc/Pacemaker-1-1-c86cb93c5a57/lib/pengine/.libs/libpe_rules.so
> > ../lib/common/.libs/libcrmcluster.so /usr/lib64/libhbclient.so
> > /usr/lib64/libccmclient.so /opt/HA/sourc/Pacemaker-1-1-
> > c86cb93c5a57/lib/common/.libs/libcrmcommon.so
> > ../lib/common/.libs/libcrmcommon.so -lgnutls -lgcrypt -lgpg-error
> > /usr/lib64/libplumb.so /usr/lib64/libpils.so -lbz2 /usr/lib64/libxslt.so
> > /usr/lib64/libxml2.so -lz -lm -lc -luuid -lrt -lglib-2.0
> > /usr/lib64/libltdl.so - ldl
> > control.o: In function `do_ha_control':
> > /opt/HA/sourc/Pacemaker-1-1-c86cb93c5a57/crmd/control.c:69: undefined
> > reference to `terminate_ais_connection'
> > collect2: ld returned 1 exit status
> > gmake[1]: *** [crmd] Fehler 1
> > gmake[1]: Leaving directory
> > `/opt/HA/sourc/Pacemaker-1-1-c86cb93c5a57/crmd' make: *** [all-recursive]
> > Fehler 1
> >
> > What is wrong with it?
> >
> >
> > Nikita Michalko
> >
> >
> > _______________________________________________
> > Pacemaker mailing list: Pacemaker at oss.clusterlabs.org
> > http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> >
> > Project Home: http://www.clusterlabs.org
> > Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
> > Bugs:
> > http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker
> 
> _______________________________________________
> Pacemaker mailing list: Pacemaker at oss.clusterlabs.org
> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
> 
> Project Home: http://www.clusterlabs.org
> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
> Bugs:
>  http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker
> 
-------------- next part --------------
Nov 24 16:33:05 hlugl8 heartbeat: [14006]: info: Pacemaker support: respawn
Nov 24 16:33:07 hlugl8 heartbeat: [14006]: WARN: Logging daemon is disabled --enabling logging daemon is recommended
Nov 24 16:33:07 hlugl8 heartbeat: [14006]: info: **************************
Nov 24 16:33:07 hlugl8 heartbeat: [14006]: info: Configuration validated. Starting heartbeat 3.0.5
Nov 24 16:33:07 hlugl8 heartbeat: [14007]: info: heartbeat: version 3.0.5
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: Heartbeat generation: 1322050709
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: Creating FIFO /var/lib/heartbeat/fifo.
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: write socket priority set to IPTOS_LOWDELAY on eth0
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: bound send socket to device: eth0
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: bound receive socket to device: eth0
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: started on port 708 interface eth0 to 10.171.141.36
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: write socket priority set to IPTOS_LOWDELAY on eth1
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: bound send socket to device: eth1
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: bound receive socket to device: eth1
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: started on port 708 interface eth1 to 10.171.141.36
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: write socket priority set to IPTOS_LOWDELAY on eth2
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: bound send socket to device: eth2
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: bound receive socket to device: eth2
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: glib: ucast: started on port 708 interface eth2 to 10.171.141.36
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: Local status now set to: 'up'
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: Link hlugl9:eth0 up.
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: Link hlugl9:eth1 up.
Nov 24 16:33:09 hlugl8 heartbeat: [14007]: info: Link hlugl9:eth2 up.
Nov 24 16:33:10 hlugl8 heartbeat: [14007]: info: Status update for node hlugl9: status active
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Comm_now_up(): updating status to active
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Local status now set to: 'active'
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:10 hlugl8 heartbeat: [14244]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14244)
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/lrmd -r" (0,0)
Nov 24 16:35:10 hlugl8 heartbeat: [14245]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14245)
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/stonithd" (0,0)
Nov 24 16:35:10 hlugl8 heartbeat: [14246]: info: Starting "/usr/lib64/heartbeat/lrmd -r" as uid 0  gid 0 (pid 14246)
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:10 hlugl8 heartbeat: [14247]: info: Starting "/usr/lib64/heartbeat/stonithd" as uid 0  gid 0 (pid 14247)
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:10 hlugl8 heartbeat: [14248]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14248)
Nov 24 16:35:10 hlugl8 heartbeat: [14249]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14249)
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14244 exited with return code 126.
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14245 exited with return code 126.
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14248 exited with return code 126.
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14249 exited with return code 126.
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:10 hlugl8 stonith-ng: [14247]: info: Invoked: /usr/lib64/heartbeat/stonithd 
Nov 24 16:35:10 hlugl8 stonith-ng: [14247]: info: crm_log_init_worker: Changed active directory to /var/lib/heartbeat/cores/root
Nov 24 16:35:10 hlugl8 stonith-ng: [14247]: info: crm_cluster_connect: Connecting to cluster infrastructure: heartbeat
Nov 24 16:35:10 hlugl8 lrmd: [14246]: info: enabling coredumps
Nov 24 16:35:10 hlugl8 lrmd: [14246]: info: Started.
Nov 24 16:35:10 hlugl8 stonith-ng: [14247]: info: register_heartbeat_conn: Hostname: hlugl8
Nov 24 16:35:10 hlugl8 stonith-ng: [14247]: info: register_heartbeat_conn: UUID: f5119551-a1de-4d34-8d21-5c2b3e6b6b4e
Nov 24 16:35:10 hlugl8 stonith-ng: [14247]: info: main: Starting stonith-ng mainloop
Nov 24 16:35:10 hlugl8 heartbeat: [14007]: info: the send queue length from heartbeat to client stonith-ng is set to 1024
Nov 24 16:35:11 hlugl8 heartbeat: [14252]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14252)
Nov 24 16:35:11 hlugl8 heartbeat: [14253]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14253)
Nov 24 16:35:11 hlugl8 heartbeat: [14254]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14254)
Nov 24 16:35:11 hlugl8 heartbeat: [14255]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14255)
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14252 exited with return code 126.
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14253 exited with return code 126.
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14254 exited with return code 126.
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14255 exited with return code 126.
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:11 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:12 hlugl8 heartbeat: [14258]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14258)
Nov 24 16:35:12 hlugl8 heartbeat: [14259]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14259)
Nov 24 16:35:12 hlugl8 heartbeat: [14260]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14260)
Nov 24 16:35:12 hlugl8 heartbeat: [14261]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14261)
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14258 exited with return code 126.
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14259 exited with return code 126.
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14260 exited with return code 126.
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14261 exited with return code 126.
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:12 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:13 hlugl8 heartbeat: [14263]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14263)
Nov 24 16:35:13 hlugl8 heartbeat: [14264]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14264)
Nov 24 16:35:13 hlugl8 heartbeat: [14265]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14265)
Nov 24 16:35:13 hlugl8 heartbeat: [14266]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14266)
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14263 exited with return code 126.
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14264 exited with return code 126.
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14265 exited with return code 126.
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14266 exited with return code 126.
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:13 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:14 hlugl8 heartbeat: [14268]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14268)
Nov 24 16:35:14 hlugl8 heartbeat: [14269]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14269)
Nov 24 16:35:14 hlugl8 heartbeat: [14270]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14270)
Nov 24 16:35:14 hlugl8 heartbeat: [14271]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14271)
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14268 exited with return code 126.
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14269 exited with return code 126.
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14270 exited with return code 126.
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14271 exited with return code 126.
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:14 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:15 hlugl8 heartbeat: [14273]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14273)
Nov 24 16:35:15 hlugl8 heartbeat: [14272]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14272)
Nov 24 16:35:15 hlugl8 heartbeat: [14274]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14274)
Nov 24 16:35:15 hlugl8 heartbeat: [14275]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14275)
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14273 exited with return code 126.
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14272 exited with return code 126.
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14274 exited with return code 126.
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14275 exited with return code 126.
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:15 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:16 hlugl8 heartbeat: [14277]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14277)
Nov 24 16:35:16 hlugl8 heartbeat: [14278]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14278)
Nov 24 16:35:16 hlugl8 heartbeat: [14279]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14279)
Nov 24 16:35:16 hlugl8 heartbeat: [14280]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14280)
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14277 exited with return code 126.
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14278 exited with return code 126.
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14279 exited with return code 126.
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14280 exited with return code 126.
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:16 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:17 hlugl8 heartbeat: [14282]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14282)
Nov 24 16:35:17 hlugl8 heartbeat: [14283]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14283)
Nov 24 16:35:17 hlugl8 heartbeat: [14284]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14284)
Nov 24 16:35:17 hlugl8 heartbeat: [14285]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14285)
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14282 exited with return code 126.
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14284 exited with return code 126.
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14283 exited with return code 126.
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14285 exited with return code 126.
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:17 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:18 hlugl8 heartbeat: [14287]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14287)
Nov 24 16:35:18 hlugl8 heartbeat: [14288]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14288)
Nov 24 16:35:18 hlugl8 heartbeat: [14289]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14289)
Nov 24 16:35:18 hlugl8 heartbeat: [14290]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14290)
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14287 exited with return code 126.
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14288 exited with return code 126.
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14289 exited with return code 126.
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14290 exited with return code 126.
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:18 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:19 hlugl8 heartbeat: [14291]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14291)
Nov 24 16:35:19 hlugl8 heartbeat: [14292]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14292)
Nov 24 16:35:19 hlugl8 heartbeat: [14293]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14293)
Nov 24 16:35:19 hlugl8 heartbeat: [14294]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14294)
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14291 exited with return code 126.
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/cib":
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/cib" (90,90)
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14292 exited with return code 126.
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/attrd":
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/attrd" (90,90)
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14293 exited with return code 126.
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/ccm":
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/ccm" (90,90)
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14294 exited with return code 126.
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: ERROR: Respawning client "/usr/lib64/heartbeat/crmd":
Nov 24 16:35:19 hlugl8 heartbeat: [14007]: info: Starting child client "/usr/lib64/heartbeat/crmd" (90,90)
Nov 24 16:35:20 hlugl8 heartbeat: [14297]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 90  gid 90 (pid 14297)
Nov 24 16:35:20 hlugl8 heartbeat: [14296]: info: Starting "/usr/lib64/heartbeat/cib" as uid 90  gid 90 (pid 14296)
Nov 24 16:35:20 hlugl8 heartbeat: [14298]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 90  gid 90 (pid 14298)
Nov 24 16:35:20 hlugl8 heartbeat: [14299]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 90  gid 90 (pid 14299)
Nov 24 16:35:20 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/attrd process 14297 exited with return code 126.
Nov 24 16:35:20 hlugl8 heartbeat: [14007]: ERROR: Client /usr/lib64/heartbeat/attrd "respawning too fast"
Nov 24 16:35:20 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/cib process 14296 exited with return code 126.
Nov 24 16:35:20 hlugl8 heartbeat: [14007]: ERROR: Client /usr/lib64/heartbeat/cib "respawning too fast"
Nov 24 16:35:20 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/ccm process 14298 exited with return code 126.
Nov 24 16:35:20 hlugl8 heartbeat: [14007]: ERROR: Client /usr/lib64/heartbeat/ccm "respawning too fast"
Nov 24 16:35:20 hlugl8 heartbeat: [14007]: WARN: Managed /usr/lib64/heartbeat/crmd process 14299 exited with return code 126.
Nov 24 16:35:20 hlugl8 heartbeat: [14007]: ERROR: Client /usr/lib64/heartbeat/crmd "respawning too fast"
Nov 24 16:48:21 hlugl8 heartbeat: [14007]: info: client [/usr/lib64/heartbeat/crmd] is not running.
Nov 24 16:48:21 hlugl8 heartbeat: [14007]: info: client [/usr/lib64/heartbeat/attrd] is not running.
Nov 24 16:48:21 hlugl8 heartbeat: [14007]: info: killing /usr/lib64/heartbeat/stonithd process group 14247 with signal 15
Nov 24 16:48:21 hlugl8 stonith-ng: [14247]: info: crm_signal_dispatch: Invoking handler for signal 15: Terminated
Nov 24 16:48:21 hlugl8 stonith-ng: [14247]: info: stonith_shutdown: Terminating with  0 clients
Nov 24 16:48:21 hlugl8 heartbeat: [14007]: info: killing /usr/lib64/heartbeat/lrmd -r process group 14246 with signal 15
Nov 24 16:48:21 hlugl8 lrmd: [14246]: info: lrmd is shutting down
Nov 24 16:48:21 hlugl8 heartbeat: [14007]: info: client [/usr/lib64/heartbeat/cib] is not running.
Nov 24 16:48:21 hlugl8 heartbeat: [14007]: info: client [/usr/lib64/heartbeat/ccm] is not running.
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: killing HBFIFO process 14015 with signal 15
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: killing HBWRITE process 14016 with signal 15
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: killing HBREAD process 14017 with signal 15
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: killing HBWRITE process 14018 with signal 15
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: killing HBREAD process 14019 with signal 15
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: killing HBWRITE process 14020 with signal 15
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: killing HBREAD process 14021 with signal 15
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: Core process 14017 exited. 7 remaining
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: Core process 14019 exited. 6 remaining
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: Core process 14021 exited. 5 remaining
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: Core process 14015 exited. 4 remaining
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: Core process 14016 exited. 3 remaining
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: Core process 14018 exited. 2 remaining
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: Core process 14020 exited. 1 remaining
Nov 24 16:48:22 hlugl8 heartbeat: [14007]: info: hlugl8 Heartbeat shutdown complete.