[Pacemaker] "crm resource restart" does not work on the DC node with crmd-transtion-delay="2s"
NAKAHIRA Kazutomo
nakahira.kazutomo at oss.ntt.co.jp
Mon Aug 22 22:09:58 EDT 2011
Hi Dejan,
Thank you for reviewing my patches.
If you prefer, could you please commit patches to the latest repository?
Best regards,
(2011/08/17 17:37), Dejan Muhamedagic wrote:
> Hi Kazutomo-san,
>
> On Tue, Aug 02, 2011 at 06:12:12PM +0900, NAKAHIRA Kazutomo wrote:
>> Hi, Andrew
>>
>> (2011/08/01 12:13), Andrew Beekhof wrote:
>>> 2011/7/27 NAKAHIRA Kazutomo<nakahira.kazutomo at oss.ntt.co.jp>:
>>>> Hi, all
>>>>
>>>> I configured crmd-transition-delay="2s" to address the following problem.
>>>>
>>>> http://www.gossamer-threads.com/lists/linuxha/pacemaker/68504
>>>> http://developerbugs.linux-foundation.org/show_bug.cgi?id=2528
>>>>
>>>> And then, "crm resource restart" command get become less able to
>>>> restart any resources on the DC node.
>>>> # "crm resource restart" works fine on the non-DC node.
>>>> # Please see attached hb_report generated on the simple environment.
>>>>
>>>> How can I use "crm resource restart" command on the DC node
>>>> with crmd-transtion-delay="2s"?
>>>
>>> Sounds like the shell isn't waiting long enough.
>>
>> I understood that it is hard to resolve this problem by the
>> configuration and we need to fix crm shell. Would that be about
>> right?
>>
>> If so, I made a patch for crm shell that wait a
>> crmd-transition-delay before checking DC node status.
>>
>> Please see attached patch.
>
> The patches look fine to me.
>
> Cheers,
>
> Dejan
>
>> Best regards,
>>
>>>
>>>>
>>>> I confirmed that I can avoid this problem by the following procedure
>>>> 1. "crm resource stop rsc-ID"
>>>> 2. wait crmd-transtion-delay(2) scond
>>>> 3. "crm resource start rsc-ID"
>>>> but this behavior(restart does not works on the DC node)
>>>> may be confuse users.
>>>>
>>>> Best regards,
>>>>
>>>> --
>>>> NAKAHIRA Kazutomo
>>>> Infrastructure Software Technology Unit
>>>> NTT Open Source Software Center
>>>>
>>>> _______________________________________________
>>>> Pacemaker mailing list: Pacemaker at oss.clusterlabs.org
>>>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
>>>>
>>>> Project Home: http://www.clusterlabs.org
>>>> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
>>>> Bugs: http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Pacemaker mailing list: Pacemaker at oss.clusterlabs.org
>>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
>>>
>>> Project Home: http://www.clusterlabs.org
>>> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
>>> Bugs: http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker
>>>
>>>
>>
>>
>> --
>> NAKAHIRA Kazutomo
>> Infrastructure Software Technology Unit
>> NTT Open Source Software Center
>
>> # HG changeset patch
>> # User NAKAHIRA Kazutomo<nakahira.kazutomo at oss.ntt.co.jp>
>> # Date 1312274729 -32400
>> # Branch stable-1.0
>> # Node ID 2b4a64c1bb737cfce61b1eaef0dca31d903d9b2e
>> # Parent db98485d06ed3fe0fe236509f023e1bd4a5566f1
>> shell: crm_msec is deemed desirable to be located in the utils.py
>>
>> diff -r db98485d06ed -r 2b4a64c1bb73 shell/modules/ra.py.in
>> --- a/shell/modules/ra.py.in Fri May 06 13:47:43 2011 +0200
>> +++ b/shell/modules/ra.py.in Tue Aug 02 17:45:29 2011 +0900
>> @@ -224,37 +224,6 @@
>> depth = find_value(pl, "depth") or '0'
>> role = find_value(pl, "role")
>> return mk_monitor_name(role,depth)
>> -def crm_msec(t):
>> - '''
>> - See lib/common/utils.c:crm_get_msec().
>> - '''
>> - convtab = {
>> - 'ms': (1,1),
>> - 'msec': (1,1),
>> - 'us': (1,1000),
>> - 'usec': (1,1000),
>> - '': (1000,1),
>> - 's': (1000,1),
>> - 'sec': (1000,1),
>> - 'm': (60*1000,1),
>> - 'min': (60*1000,1),
>> - 'h': (60*60*1000,1),
>> - 'hr': (60*60*1000,1),
>> - }
>> - if not t:
>> - return -1
>> - r = re.match("\s*(\d+)\s*([a-zA-Z]+)?", t)
>> - if not r:
>> - return -1
>> - if not r.group(2):
>> - q = ''
>> - else:
>> - q = r.group(2).lower()
>> - try:
>> - mult,div = convtab[q]
>> - except:
>> - return -1
>> - return (int(r.group(1))*mult)/div
>> def crm_time_cmp(a, b):
>> return crm_msec(a) - crm_msec(b)
>>
>> diff -r db98485d06ed -r 2b4a64c1bb73 shell/modules/utils.py
>> --- a/shell/modules/utils.py Fri May 06 13:47:43 2011 +0200
>> +++ b/shell/modules/utils.py Tue Aug 02 17:45:29 2011 +0900
>> @@ -199,6 +199,38 @@
>> s = get_stdout(add_sudo(cmd), stderr_on)
>> return s.split('\n')
>>
>> +def crm_msec(t):
>> + '''
>> + See lib/common/utils.c:crm_get_msec().
>> + '''
>> + convtab = {
>> + 'ms': (1,1),
>> + 'msec': (1,1),
>> + 'us': (1,1000),
>> + 'usec': (1,1000),
>> + '': (1000,1),
>> + 's': (1000,1),
>> + 'sec': (1000,1),
>> + 'm': (60*1000,1),
>> + 'min': (60*1000,1),
>> + 'h': (60*60*1000,1),
>> + 'hr': (60*60*1000,1),
>> + }
>> + if not t:
>> + return -1
>> + r = re.match("\s*(\d+)\s*([a-zA-Z]+)?", t)
>> + if not r:
>> + return -1
>> + if not r.group(2):
>> + q = ''
>> + else:
>> + q = r.group(2).lower()
>> + try:
>> + mult,div = convtab[q]
>> + except:
>> + return -1
>> + return (int(r.group(1))*mult)/div
>> +
>> def wait4dc(what = "", show_progress = True):
>> '''
>> Wait for the DC to get into the S_IDLE state. This should be
>
>> # HG changeset patch
>> # User NAKAHIRA Kazutomo<nakahira.kazutomo at oss.ntt.co.jp>
>> # Date 1312275597 -32400
>> # Branch stable-1.0
>> # Node ID 422551903526667c380e39f1712b38f3c2b8f0a6
>> # Parent 2b4a64c1bb737cfce61b1eaef0dca31d903d9b2e
>> shell: waits crmd-transition-delay before DC status checking
>>
>> diff -r 2b4a64c1bb73 -r 422551903526 shell/modules/utils.py
>> --- a/shell/modules/utils.py Tue Aug 02 17:45:29 2011 +0900
>> +++ b/shell/modules/utils.py Tue Aug 02 17:59:57 2011 +0900
>> @@ -263,6 +263,13 @@
>> if not dc:
>> common_warn("can't find DC in: %s" % s)
>> return False
>> + cmd = "crm_attribute -Gq -t crm_config -n crmd-transition-delay 2> /dev/null"
>> + delay = get_stdout(add_sudo(cmd))
>> + if delay:
>> + delaymsec = crm_msec(delay)
>> + if 0< delaymsec:
>> + common_info("The crmd-transition-delay is configured. Waiting %d msec before check DC status." % delaymsec)
>> + time.sleep(delaymsec / 1000)
>> cmd = "crmadmin -S %s" % dc
>> cnt = 0
>> output_started = 0
>
>> _______________________________________________
>> Pacemaker mailing list: Pacemaker at oss.clusterlabs.org
>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
>>
>> Project Home: http://www.clusterlabs.org
>> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
>> Bugs: http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker
>
>
> _______________________________________________
> Pacemaker mailing list: Pacemaker at oss.clusterlabs.org
> http://oss.clusterlabs.org/mailman/listinfo/pacemaker
>
> Project Home: http://www.clusterlabs.org
> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
> Bugs: http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker
>
>
--
NAKAHIRA Kazutomo
Infrastructure Software Technology Unit
NTT Open Source Software Center
More information about the Pacemaker
mailing list