[Pacemaker] Multiple thread after rebooting server: the node doesn't go online

Giovanni Di Milia gdimilia at cfa.harvard.edu
Tue Nov 17 17:07:05 UTC 2009


Disabling syslog the problem disappears.

Thank you very much,
Giovanni



On Nov 16, 2009, at 4:51 PM, hj lee wrote:

> Hi,
>
> Please disable syslog in openais.conf, and try it again. It seems  
> this issue is related to fork() call and syslog().
>
> hj
>
> On Fri, Nov 13, 2009 at 1:08 PM, Giovanni Di Milia <gdimilia at cfa.harvard.edu 
> > wrote:
> Thank you very much for your response.
>
> The only thing I really don't understand is: why this problem  
> doesn't appear in all my simulations?
> I configured at least 7 couple of virtual servers with vmware 2 and  
> CentOS 5.3 and 5.4 (32 and 64 bits) and I never had this kind of  
> problems!
>
> The only difference in the configuration is that I used private IPs  
> for the simulations and public IPs for the real servers, but I don't  
> think it is important.
>
> Thanks for your patience,
> Giovanni
>
>
>
> On Nov 13, 2009, at 1:36 PM, hj lee wrote:
>
>> Hi,
>>
>> I have the same problem in CentOS 5.3 with pacemaker-1.0.5 and  
>> openais-0.80.5. This is openais bug! Two problems.
>> 1. Starting openais service gets seg fault sometime. It more likely  
>> happens if openais service get started before syslog.
>> 2. The seg fault handler of openais calls syslog(). The syslog is  
>> one of UNSAFE function that must not be called from signal handler  
>> because it is non-reentrent function.
>>
>> To fix this issue: get the openais source, find sigsegv_handler  
>> function exec/main.c and just comment out log_flush(), shown below.  
>> Then recompile and isntall it(make and make install). The log_flush  
>> should be removed from all signal handlers in openais code base. I  
>> am still not sure where seg fault occurs, but commenting out  
>> log_flush prevents seg fault.
>>
>>
>> -------------------------------------------------------------------------
>> static void sigsegv_handler (int num)
>> {
>>         signal (SIGSEGV, SIG_DFL);
>> //      log_flush ();
>>         raise (SIGSEGV);
>> }
>>
>> Thanks
>> hj
>>
>> On Thu, Nov 12, 2009 at 4:21 PM, Giovanni Di Milia <gdimilia at cfa.harvard.edu 
>> > wrote:
>> I set up a cluster of two servers CentOS 5.4 x86_64 with pacemaker  
>> 1.06 and corosync 1.1.2
>>
>> I only installed the x86_64 packages (yum install pacemaker try to  
>> install also the 32 bits one).
>>
>> I configured a shared cluster IP (it's a public ip) and a cluster  
>> website.
>>
>> Everything work fine if i try to stop corosync on one of the two  
>> servers (the services pass from one machine to the other without  
>> problems), but if I reboot one server, when it returns alive it  
>> cannot go online in the cluster.
>> I also noticed that there are several thread of corosync and if I  
>> kill all of them and then I start again corosync, everything work  
>> fine again.
>>
>> I don't know what is happening and I'm not able to reproduce the  
>> same situation on some virtual servers!
>>
>> Thanks,
>> Giovanni
>>
>>
>>
>> the configuration of corosync is the following:
>>
>> ##############################################
>> # Please read the corosync.conf.5 manual page
>> compatibility: whitetank
>>
>> aisexec {
>>        # Run as root - this is necessary to be able to manage  
>> resources with Pacemaker
>>        user:   root
>>        group:  root
>> }
>>
>> service {
>>        # Load the Pacemaker Cluster Resource Manager
>>        ver:       0
>>        name:      pacemaker
>>        use_mgmtd: yes
>>        use_logd:  yes
>> }
>>
>> totem {
>>        version: 2
>>
>>        # How long before declaring a token lost (ms)
>>        token:          5000
>>
>>        # How many token retransmits before forming a new  
>> configuration
>>        token_retransmits_before_loss_const: 10
>>
>>        # How long to wait for join messages in the membership  
>> protocol (ms)
>>        join:           1000
>>
>>        # How long to wait for consensus to be achieved before  
>> starting a new round of membership configuration (ms)
>>        consensus:      2500
>>
>>        # Turn off the virtual synchrony filter
>>        vsftype:        none
>>
>>        # Number of messages that may be sent by one processor on  
>> receipt of the token
>>        max_messages:   20
>>
>>        # Stagger sending the node join messages by 1..send_join ms
>>        send_join: 45
>>
>>        # Limit generated nodeids to 31-bits (positive signed  
>> integers)
>>        clear_node_high_bit: yes
>>
>>        # Disable encryption
>>        secauth:        off
>>
>>        # How many threads to use for encryption/decryption
>>        threads:        0
>>
>>        # Optionally assign a fixed node id (integer)
>>        # nodeid:         1234
>>
>>        interface {
>>                ringnumber: 0
>>
>>                # The following values need to be set based on your  
>> environment
>> bindnetaddr: XXX.XXX.XXX.0 #here I put the right ip for my  
>> configuration
>> mcastaddr: 226.94.1.1
>> mcastport: 4000
>>        }
>> }
>>
>> logging {
>>        fileline: off
>>        to_stderr: yes
>>        to_logfile: yes
>>        to_syslog: yes
>>        logfile: /tmp/corosync.log
>>        debug: off
>>        timestamp: on
>>        logger_subsys {
>>                subsys: AMF
>>                debug: off
>>        }
>> }
>>
>> amf {
>>        mode: disabled
>> }
>>
>> ##################################################
>>
>>
>>
>> _______________________________________________
>> Pacemaker mailing list
>> Pacemaker at oss.clusterlabs.org
>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
>>
>>
>>
>> -- 
>> Dream with longterm vision!
>> kerdosa
>> _______________________________________________
>> Pacemaker mailing list
>> Pacemaker at oss.clusterlabs.org
>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
>
>
> _______________________________________________
> Pacemaker mailing list
> Pacemaker at oss.clusterlabs.org
> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
>
>
>
>
> -- 
> Dream with longterm vision!
> kerdosa
> _______________________________________________
> Pacemaker mailing list
> Pacemaker at oss.clusterlabs.org
> http://oss.clusterlabs.org/mailman/listinfo/pacemaker

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.clusterlabs.org/pipermail/pacemaker/attachments/20091117/cec79f40/attachment-0002.htm>


More information about the Pacemaker mailing list