<div dir="ltr"><div>What I would like to understand is how much total shared memory (approximately) would Pacemaker need so that accordingly I can define the partition size. Currently it is 300 MB in our system. I recently ran into insufficient shared memory issue because of improper clean-up. So would like to understand how much Pacemaker would need for a 6-node cluster so that accordingly I can increase it.</div><div><br></div><div># df -kh<br></div><div>tmpfs 300.0M 27.5M 272.5M 9% /dev/shm<br></div><div><br></div><div>Thanks</div><div>Nikhil</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 17, 2016 at 12:09 PM, Ulrich Windl <span dir="ltr"><<a href="mailto:Ulrich.Windl@rz.uni-regensburg.de" target="_blank">Ulrich.Windl@rz.uni-regensburg.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi!<br>
<br>
One of the main problems I identified with POSIX shared memory (/dev/shm) in Linux is that changes to the shared memory don't affect the i-node, so you cannot tell from a "ls -rtl" which segments are still active and which are not. You can only see the creation time.<br>
<br>
Maybe there should be a tool that identifies and cleans up obsolete shared memory.<br>
I don't understand the part talking about the size of /dev/shm: It's shared memory. See "kernel.shmmax" and "kernel.shmall" in you sysctl settings (/etc/sysctl.conf).<br>
<br>
Regards,<br>
Ulrich<br>
<br>
>>> Nikhil Utane <<a href="mailto:nikhil.subscribed@gmail.com">nikhil.subscribed@gmail.com</a>> schrieb am 16.05.2016 um 14:31 in<br>
Nachricht<br>
<CAGNWmJVSye5PJgkdbFAi5AzO+Qq-j=<a href="mailto:2fS1c%2B0rGnqS994vV48w@mail.gmail.com">2fS1c+0rGnqS994vV48w@mail.gmail.com</a>>:<br>
<div class="HOEnZb"><div class="h5">> Thanks Ken.<br>
><br>
> Could you also respond on the second question?<br>
><br>
>> Also, in /dev/shm I see that it created around 300+ files of around<br>
>> 250 MB.<br>
>><br>
>> For e.g.<br>
>> -rw-rw---- 1 hacluste hacluste 8232 May 6 13:03<br>
>> qb-cib_rw-response-25035-25038-10-header<br>
>> -rw-rw---- 1 hacluste hacluste 540672 May 6 13:03<br>
>> qb-cib_rw-response-25035-25038-10-data<br>
>> -rw------- 1 hacluste hacluste 8232 May 6 13:03<br>
>> qb-cib_rw-response-25035-25036-12-header<br>
>> -rw------- 1 hacluste hacluste 540672 May 6 13:03<br>
>> qb-cib_rw-response-25035-25036-12-data<br>
>> And many more..<br>
>><br>
>> We have limited space in /dev/shm and all these files are filling it<br>
>> up. Are these all needed? Any way to limit? Do we need to do any<br>
>> clean-up if pacemaker termination was not graceful? What's the<br>
> recommended size for this folder for Pacemaker? Our cluster will have<br>
> maximum 6 nodes.<br>
><br>
> -Regards<br>
> Nikhil<br>
><br>
> On Sat, May 14, 2016 at 3:11 AM, Ken Gaillot <<a href="mailto:kgaillot@redhat.com">kgaillot@redhat.com</a>> wrote:<br>
><br>
>> On 05/08/2016 11:19 PM, Nikhil Utane wrote:<br>
>> > Moving these questions to a different thread.<br>
>> ><br>
>> > Hi,<br>
>> ><br>
>> > We have limited storage capacity in our system for different folders.<br>
>> > How can I configure to use a different folder for /var/lib/pacemaker?<br>
>><br>
>> ./configure --localstatedir=/wherever (defaults to /var or ${prefix}/var)<br>
>><br>
>> That will change everything that normally is placed or looked for under<br>
>> /var (/var/lib/pacemaker, /var/lib/heartbeat, /var/run, etc.).<br>
>><br>
>> Note that while ./configure lets you change the location of nearly<br>
>> everything, /usr/lib/ocf/resource.d is an exception, because it is<br>
>> specified in the OCF standard.<br>
>><br>
>> ><br>
>> ><br>
>> > Also, in /dev/shm I see that it created around 300+ files of around<br>
>> > 250 MB.<br>
>> ><br>
>> > For e.g.<br>
>> > -rw-rw---- 1 hacluste hacluste 8232 May 6 13:03<br>
>> > qb-cib_rw-response-25035-25038-10-header<br>
>> > -rw-rw---- 1 hacluste hacluste 540672 May 6 13:03<br>
>> > qb-cib_rw-response-25035-25038-10-data<br>
>> > -rw------- 1 hacluste hacluste 8232 May 6 13:03<br>
>> > qb-cib_rw-response-25035-25036-12-header<br>
>> > -rw------- 1 hacluste hacluste 540672 May 6 13:03<br>
>> > qb-cib_rw-response-25035-25036-12-data<br>
>> > And many more..<br>
>> ><br>
>> > We have limited space in /dev/shm and all these files are filling it<br>
>> > up. Are these all needed? Any way to limit? Do we need to do any<br>
>> > clean-up if pacemaker termination was not graceful?<br>
>> ><br>
>> > -Thanks<br>
>> > Nikhil<br>
>> ><br>
>> ><br>
>> ><br>
>> ><br>
>> > _______________________________________________<br>
>> > Users mailing list: <a href="mailto:Users@clusterlabs.org">Users@clusterlabs.org</a><br>
>> > <a href="http://clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://clusterlabs.org/mailman/listinfo/users</a><br>
>> ><br>
>> > Project Home: <a href="http://www.clusterlabs.org" rel="noreferrer" target="_blank">http://www.clusterlabs.org</a><br>
>> > Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" rel="noreferrer" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
>> > Bugs: <a href="http://bugs.clusterlabs.org" rel="noreferrer" target="_blank">http://bugs.clusterlabs.org</a><br>
>> ><br>
>><br>
>><br>
>> _______________________________________________<br>
>> Users mailing list: <a href="mailto:Users@clusterlabs.org">Users@clusterlabs.org</a><br>
>> <a href="http://clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://clusterlabs.org/mailman/listinfo/users</a><br>
>><br>
>> Project Home: <a href="http://www.clusterlabs.org" rel="noreferrer" target="_blank">http://www.clusterlabs.org</a><br>
>> Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" rel="noreferrer" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
>> Bugs: <a href="http://bugs.clusterlabs.org" rel="noreferrer" target="_blank">http://bugs.clusterlabs.org</a><br>
>><br>
<br>
<br>
<br>
<br>
<br>
_______________________________________________<br>
Users mailing list: <a href="mailto:Users@clusterlabs.org">Users@clusterlabs.org</a><br>
<a href="http://clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://clusterlabs.org/mailman/listinfo/users</a><br>
<br>
Project Home: <a href="http://www.clusterlabs.org" rel="noreferrer" target="_blank">http://www.clusterlabs.org</a><br>
Getting started: <a href="http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf" rel="noreferrer" target="_blank">http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf</a><br>
Bugs: <a href="http://bugs.clusterlabs.org" rel="noreferrer" target="_blank">http://bugs.clusterlabs.org</a><br>
</div></div></blockquote></div><br></div>