[ClusterLabs] Never join a list without a problem...

[Jeffrey Westgate]

Thanks, Ken. 

Our late guru was the admin who set all this up, and it's been rock solid until recent oddities started cropping up.  They still function fine - they've just developed some... quirks.

I found the solution before I got your reply, which was essentially what we did; update all but pacemaker, reboot, stop pacemaker, update pacemaker, reboot.  That process was necessary because they've been running sooo long, pacemaker would not stop.  it would try, then seemingly stall after several minutes.

We're good now, up-to-date-wise, and stuck only with the initial issue we were hoping to eliminate by updating/patching EVERYthing.  And we honestly don't know what may be causing it.

We use Nagios to monitor, and once every 20 to 40 hours - sometimes longer, and we cannot set a clock by it - while the machine is 95% idle (or more according to 'top'), the host load shoots up to 50 or 60%.  It takes about 20 minutes to peak, and another 30 to 45 minutes to come back down to baseline, which is mostly 0.00.  (attached hostload.pdf)  This happens to both machines, randomly, and is concerning, as we'd like to find what's causing it and resolve it.

We were hoping "uptime kernel bug", but patching has not helped.  There seems to be no increase in the number of processes running, and the processes running do not take any more cpu time.  They are DNS forwarding resolvers, but there is no correlation between dns requests and load increase - sometimes (like this morning) it rises around 1 AM when the dns load is minimal.

The oddity is - these are the only two boxes with this issue, and we have a couple dozen at the same OS and level.  Only these two, with this role and this particular package set have the issue.

--
Jeff

-------------- next part --------------
A non-text attachment was scrubbed...
Name: hostload.pdf
Type: application/pdf
Size: 32748 bytes
Desc: hostload.pdf
URL: <https://lists.clusterlabs.org/pipermail/users/attachments/20170227/5f468b78/attachment-0003.pdf>