[Pacemaker] CTS outputs Single search timed out.
nozawat
nozawat at gmail.com
Fri Jan 21 01:00:49 EST 2011
Hi
I changed a parameter and carried it out again.
Then the CTS seems to have been completed.
However, the error of "Audit LogAudit FAILED" occurs as ever.
I dont know log as a result of right CTS.
Would you pass the test in this log?
-----
$ python /usr/share/pacemaker/tests/cts/CTSlab.py --nodes "cts0101 cts0102"
--at-boot 1 --logfile /share/ha/logs/ha-log-local7 --syslog-facility local7
Jan 21 14:16:40 Random seed is: 1295587000
Jan 21 14:16:40 >>>>>>>>>>>>>>>> BEGINNING 0 TESTS
Jan 21 14:16:40 Stack: openais (whitetank)
Jan 21 14:16:40 Schema: pacemaker-1.0
Jan 21 14:16:40 Scenario: Random Test Execution
Jan 21 14:16:40 Random Seed: 1295587000
Jan 21 14:16:40 System log files: /share/ha/logs/ha-log-local7
Jan 21 14:16:40 Cluster nodes:
Jan 21 14:16:40 * cts0101
Jan 21 14:16:40 * cts0102
Jan 21 14:16:43 Testing for syslog logs
Jan 21 14:16:43 Testing for remote logs
Jan 21 14:17:48 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:19:21 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:21:54 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:25:26 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:29:26 ERROR: Cluster logging unrecoverable.
Jan 21 14:29:26 Audit LogAudit FAILED.
Jan 21 14:29:29 Stopping Cluster Manager on all nodes
Jan 21 14:29:29 Stopping crm-whitetank on node cts0101
Jan 21 14:29:29 Could not stop crm-whitetank on node cts0101
Jan 21 14:29:29 Stopping crm-whitetank on node cts0102
Jan 21 14:29:29 Could not stop crm-whitetank on node cts0102
Jan 21 14:29:29 Starting Cluster Manager on all nodes.
Jan 21 14:30:04 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:31:36 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:34:09 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:37:42 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:41:42 ERROR: Cluster logging unrecoverable.
Jan 21 14:41:42 Audit LogAudit FAILED.
Jan 21 14:41:43 Stopping Cluster Manager on all nodes
Jan 21 14:41:43 Stopping crm-whitetank on node cts0101
Jan 21 14:41:43 Could not stop crm-whitetank on node cts0101
Jan 21 14:41:43 Stopping crm-whitetank on node cts0102
Jan 21 14:41:43 Could not stop crm-whitetank on node cts0102
Jan 21 14:42:18 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:43:50 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:46:23 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:49:56 Restarting logging on: ['cts0101', 'cts0102']
Jan 21 14:53:56 ERROR: Cluster logging unrecoverable.
Jan 21 14:53:56 Audit LogAudit FAILED.
Jan 21 14:53:57 ****************
Jan 21 14:53:57 Overall Results:{'failure': 0, 'skipped': 0, 'success': 0,
'BadNews': 0}
Jan 21 14:53:57 ****************
Jan 21 14:53:57 Test Summary
Jan 21 14:53:57 Test Flip: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test Restart: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test Stonithd: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test StartOnebyOne: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test SimulStart: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test SimulStop: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test StopOnebyOne: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test RestartOnebyOne: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test PartialStart: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test Standby: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test ResourceRecover: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test ComponentFail: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test Reattach: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test SpecialTest1: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 Test NearQuorumPoint: {'auditfail': 0, 'failure': 0,
'skipped': 0, 'calls': 0}
Jan 21 14:53:57 <<<<<<<<<<<<<<<< TESTS COMPLETED
-----
2011/1/21 nozawat <nozawat at gmail.com>
> Hi
>
> I ran CTS in the following environment.
> * OS:RHEL5.5-x86_64
> * pacemaker-1.0.9.1-1.15.el5
> * TDN(bbs01)
> * TNNs(cts0101 cts0102)
>
> Probably it is a phenomenon like the following.
> http://www.gossamer-threads.com/lists/linuxha/pacemaker/69322
>
> SSH login without password -> OK.
> Syslog Message transfer by syslog-ng -> OK.
>
> -------
> $ python /usr/share/pacemaker/tests/cts/CTSlab.py --nodes "cts0101 cts0102"
> --at-boot 1 --stack heartbeat --stonith no --logfile
> /share/ha/logs/ha-log-local7 --syslog-facility local7 1
> Jan 21 13:23:08 Random seed is: 1295583788
> Jan 21 13:23:08 >>>>>>>>>>>>>>>> BEGINNING 1 TESTS
> Jan 21 13:23:08 Stack: heartbeat
> Jan 21 13:23:08 Schema: pacemaker-1.0
> Jan 21 13:23:08 Scenario: Random Test Execution
> Jan 21 13:23:08 Random Seed: 1295583788
> Jan 21 13:23:08 System log files: /share/ha/logs/ha-log-local7
> Jan 21 13:23:08 Cluster nodes:
> Jan 21 13:23:08 * cts0101
> Jan 21 13:23:08 * cts0102
> Jan 21 13:23:12 Testing for syslog logs
> Jan 21 13:23:12 Testing for remote logs
> Jan 21 13:24:16 Restarting logging on: ['cts0101', 'cts0102']
> Jan 21 13:25:49 Restarting logging on: ['cts0101', 'cts0102']
> Jan 21 13:28:21 Restarting logging on: ['cts0101', 'cts0102']
> Jan 21 13:31:54 Restarting logging on: ['cts0101', 'cts0102']
> Jan 21 13:35:54 ERROR: Cluster logging unrecoverable.
> Jan 21 13:35:54 Audit LogAudit FAILED.
> -----
>
> I run it in heartbeat, but a similar error occurs in corosync.
> I become the error in "Single search timed out" in the log and seem to
> retry.
> -----
> Jan 21 13:23:11 bbs01 CTS: debug: Audit DiskspaceAudit passed.
> Jan 21 13:23:12 bbs01 CTS: Testing for syslog logs
> Jan 21 13:23:12 bbs01 CTS: Testing for remote logs
> Jan 21 13:23:12 bbs01 CTS: debug: lw: cts0101:/share/ha/logs/ha-log-local7:
> Installing /tmp/cts_log_watcher.py on cts0101
> Jan 21 13:23:12 bbs01 CTS: debug: lw: cts0102:/share/ha/logs/ha-log-local7:
> Installing /tmp/cts_log_watcher.py on cts0102
> Jan 21 13:23:13 cts0102 logger: Test message from cts0102
> Jan 21 13:23:13 cts0101 logger: Test message from cts0101
> Jan 21 13:23:44 bbs01 CTS: debug: lw: LogAudit: Single search timed out:
> timeout=30, start=1295583793, limit=1295583824, now=1295583824
> Jan 21 13:24:16 bbs01 CTS: debug: lw: LogAudit: Single search timed out:
> timeout=30, start=1295583824, limit=1295583855, now=1295583856
> Jan 21 13:24:16 bbs01 CTS: Restarting logging on: ['cts0101', 'cts0102']
> Jan 21 13:24:16 bbs01 CTS: debug: cmd: async: target=cts0101, rc=22203:
> /etc/init.d/syslog-ng restart 2>&1 > /dev/null
> Jan 21 13:24:16 bbs01 CTS: debug: cmd: async: target=cts0102, rc=22204:
> /etc/init.d/syslog-ng restart 2>&1 > /dev/null
> Jan 21 13:25:17 cts0102 logger: Test message from cts0102
> Jan 21 13:25:17 cts0101 logger: Test message from cts0101
> -----
>
> The test case seems to be carried out after this error.
> However, the script is finished by an error. It is because "Audit LogAudit
> FAILED" occurs.
> Is it right that how becomes the result of the CTS?
>
> Regards,
> Tomo
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.clusterlabs.org/pipermail/pacemaker/attachments/20110121/6419fc11/attachment-0001.html>
More information about the Pacemaker
mailing list