<div dir="ltr"><div><div>Hi Ulrich,</div><div><br></div><div>thank you for your answer, </div><div><br></div><div>what about which limits do you talk?</div><div><br></div><div>The pacemaker software runs by root user, so limits should be increased for root. </div><div>There is output from one of my server:</div></div><div><br></div><div><div>-bash-4.1# id</div><div>uid=0(root) gid=0(root) groups=0(root)</div><div><br></div><div>-bash-4.1# ulimit -a</div><div>core file size (blocks, -c) 0</div><div>data seg size (kbytes, -d) unlimited</div><div>scheduling priority (-e) 0</div><div>file size (blocks, -f) unlimited</div><div>pending signals (-i) 124801</div><div>max locked memory (kbytes, -l) 64</div><div>max memory size (kbytes, -m) unlimited</div><div>open files (-n) 4096</div><div>pipe size (512 bytes, -p) 8</div><div>POSIX message queues (bytes, -q) 819200</div><div>real-time priority (-r) 0</div><div>stack size (kbytes, -s) 10240</div><div>cpu time (seconds, -t) unlimited</div><div>max user processes (-u) 124801</div><div>virtual memory (kbytes, -v) unlimited</div><div>file locks (-x) unlimited</div><div><br></div><div>-bash-4.1# ps -ef |grep pacemaker</div><div>root 17947 1 0 Dec11 ? 00:00:09 pacemakerd</div><div>189 17953 17947 0 Dec11 ? 00:00:11 /usr/libexec/pacemaker/cib</div><div>root 17954 17947 0 Dec11 ? 00:00:14 /usr/libexec/pacemaker/stonithd</div><div>root 17955 17947 0 Dec11 ? 00:00:11 /usr/libexec/pacemaker/lrmd</div><div>189 17956 17947 0 Dec11 ? 00:00:09 /usr/libexec/pacemaker/attrd</div><div>189 17957 17947 0 Dec11 ? 00:00:09 /usr/libexec/pacemaker/pengine</div><div>root 17958 17947 0 Dec11 ? 00:00:16 /usr/libexec/pacemaker/crmd</div></div><div><br></div><div><br></div><div>With settings in pacemaker or system can be changed for start heavy application ( java ) at the same time?</div><div><br></div><div><br></div><div><br></div><div class="gmail_extra"><br><div class="gmail_quote">2015-12-14 16:29 GMT+09:00 Ulrich Windl <span dir="ltr"><<a href="mailto:Ulrich.Windl@rz.uni-regensburg.de" target="_blank">Ulrich.Windl@rz.uni-regensburg.de</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi!<br>
<br>
There is one feature in Linux that may affect you: If processes block on I/O (NFS also), the load increases, and the load is the _sum_, and not the _average_ of all CPUs. So if you have many CPUs, your abservable load will typically increase. Recently we had a load of 60, but nobody actually noticed ;-)<br>
<br>
So maybe you just need to adjust the limits for pacemaker...<br>
<br>
Regards,<br>
Ulrich<br>
<br>
>>> Oleg Ilyin <<a href="mailto:on.ilyin@gmail.com">on.ilyin@gmail.com</a>> schrieb am 13.12.2015 um 15:00 in Nachricht<br>
<CANLWoXrpvLAbcgCOE073iAOJz3zL7RAUB4UQC=<a href="mailto:0iPfGyTvnidw@mail.gmail.com">0iPfGyTvnidw@mail.gmail.com</a>>:<br>
<div><div class="h5">> There are errors in my /var/log/messages<br>
><br>
><br>
> grep -e crmd\\[ -e crmd: /var/log/messages<br>
> Dec 13 00:01:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.290000<br>
> Dec 13 00:01:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.430000<br>
> Dec 13 00:02:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.900000<br>
> Dec 13 00:02:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.810000<br>
> Dec 13 00:04:25 server_name_1 crmd[9941]: notice: do_state_transition:<br>
> State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_<br>
> TIMER_POPPED origin=crm_timer_popped ]<br>
> Dec 13 00:04:26 server_name_1 crmd[9941]: notice: run_graph: Transition<br>
> 185166 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Sou<br>
> rce=/var/lib/pacemaker/pengine/pe-input-656.bz2):<br>
> Complete<br>
> Dec 13 00:04:26 server_name_1 crmd[9941]: notice: do_state_transition:<br>
> State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS c<br>
> ause=C_FSA_INTERNAL origin=notify_crmd ]<br>
> Dec 13 00:08:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.480000<br>
> Dec 13 00:09:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 5.820000<br>
> Dec 13 00:09:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.130000<br>
> Dec 13 00:10:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.650000<br>
> Dec 13 00:10:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 6.000000<br>
> Dec 13 00:11:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 5.270000<br>
> Dec 13 00:11:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.260000<br>
> Dec 13 00:12:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.600000<br>
> Dec 13 00:12:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.970000<br>
> Dec 13 00:13:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.930000<br>
> Dec 13 00:14:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.590000<br>
> Dec 13 00:17:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.350000<br>
> Dec 13 00:18:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.220000<br>
> Dec 13 00:18:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.830000<br>
> Dec 13 00:19:26 server_name_1 crmd[9941]: notice: do_state_transition:<br>
> State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_<br>
> TIMER_POPPED origin=crm_timer_popped ]<br>
> Dec 13 00:19:26 server_name_1 crmd[9941]: notice: run_graph: Transition<br>
> 185167 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Sou<br>
> rce=/var/lib/pacemaker/pengine/pe-input-656.bz2):<br>
> Complete<br>
> Dec 13 00:19:26 server_name_1 crmd[9941]: notice: do_state_transition:<br>
> State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS c<br>
> ause=C_FSA_INTERNAL origin=notify_crmd ]<br>
> Dec 13 00:24:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.770000<br>
> Dec 13 00:24:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.360000<br>
> Dec 13 00:25:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.790000<br>
> Dec 13 00:26:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.470000<br>
> Dec 13 00:27:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.890000<br>
> Dec 13 00:27:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.290000<br>
> Dec 13 00:28:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.040000<br>
> Dec 13 00:29:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.340000<br>
> Dec 13 00:29:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.250000<br>
> Dec 13 00:30:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.310000<br>
> Dec 13 00:31:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.880000<br>
> Dec 13 00:31:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.890000<br>
> Dec 13 00:32:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 5.320000<br>
> Dec 13 00:32:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.380000<br>
> Dec 13 00:33:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.430000<br>
> Dec 13 00:33:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.480000<br>
> Dec 13 00:34:26 server_name_1 crmd[9941]: notice: do_state_transition:<br>
> State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_<br>
> TIMER_POPPED origin=crm_timer_popped ]<br>
> Dec 13 00:34:26 server_name_1 crmd[9941]: notice: run_graph: Transition<br>
> 185168 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Sou<br>
> rce=/var/lib/pacemaker/pengine/pe-input-656.bz2):<br>
> Complete<br>
> Dec 13 00:34:26 server_name_1 crmd[9941]: notice: do_state_transition:<br>
> State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS c<br>
> ause=C_FSA_INTERNAL origin=notify_crmd ]<br>
> Dec 13 00:34:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.580000<br>
> Dec 13 00:35:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.350000<br>
> Dec 13 00:37:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.380000<br>
> Dec 13 00:38:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.400000<br>
> Dec 13 00:38:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 5.020000<br>
> Dec 13 00:39:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.080000<br>
> Dec 13 00:40:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.410000<br>
> Dec 13 00:40:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.490000<br>
> Dec 13 00:41:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.410000<br>
> Dec 13 00:41:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 5.120000<br>
> Dec 13 00:42:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 8.120000<br>
> Dec 13 00:42:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 9.040000<br>
> Dec 13 00:43:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 6.900000<br>
> Dec 13 00:43:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 5.830000<br>
> Dec 13 00:44:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 6.280000<br>
> Dec 13 00:44:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.540000<br>
> Dec 13 00:45:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 5.050000<br>
> Dec 13 00:45:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.170000<br>
> Dec 13 00:46:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.930000<br>
> Dec 13 00:46:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.520000<br>
> Dec 13 00:47:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 5.680000<br>
> Dec 13 00:47:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 5.050000<br>
> Dec 13 00:48:09 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 4.750000<br>
> Dec 13 00:48:39 server_name_1 crmd[9941]: notice: throttle_handle_load:<br>
> High CPU load detected: 3.370000<br>
> Dec 13 00:49:26 server_name_1 crmd[9941]: notice: do_state_transition:<br>
> State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_<br>
> TIMER_POPPED origin=crm_timer_popped ]<br>
> Dec 13 00:49:26 server_name_1 crmd[9941]: notice: run_graph: Transition<br>
> 185169 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Sou<br>
> rce=/var/lib/pacemaker/pengine/pe-input-656.bz2):<br>
> Complete<br>
> Dec 13 00:49:26 server_name_1 crmd[9941]: notice: do_state_transition:<br>
> State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS c<br>
> ause=C_FSA_INTERNAL origin=notify_crmd ]<br>
><br>
><br>
> 2015-12-13 21:11 GMT+09:00 Oleg Ilyin <<a href="mailto:on.ilyin@gmail.com">on.ilyin@gmail.com</a>>:<br>
><br>
>> Hello,<br>
>> could you help please with issue on my environment<br>
>> RHEL 6.6<br>
>> corosync-1.4.7<br>
>> pacemaker-1.1.12<br>
>><br>
>> When I start several resources in the same time by " pcs resource enable "<br>
>> command,<br>
>> resource doesn't start parralel, they start serial.<br>
>><br>
>> If I start resources by one, thay start parralel. I didn't do any special<br>
>> settings.<br>
>><br>
>> Please,<br>
>> which parameters can affect to this behavior of cluster?<br>
>><br>
<br>
<br>
<br>
<br>
</div></div>_______________________________________________<br>
Users mailing list: <a href="mailto:Users@clusterlabs.org">Users@clusterlabs.org</a><br>
<a href="http://clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://clusterlabs.org/mailman/listinfo/users</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" rel="noreferrer" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" rel="noreferrer" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://bugs.clusterlabs.org" rel="noreferrer" target="_blank">http://bugs.clusterlabs.org</a><br>
</blockquote></div><br></div></div>