Commit 5b2f0832 authored by rniwa@webkit.org's avatar rniwa@webkit.org

Buildbot marks a nrwt bot red when tests are missing results

https://bugs.webkit.org/show_bug.cgi?id=64812

Reviewed by Tony Chang.

Added "missing results" label for tests that are missing results.

buildbot Now reports shows a label "X missing results" on a run when X tests were missing
expected results on that run.

Also rephrased "X failed" and "X were flaky" to "X failures" and "X flakes".

* BuildSlaveSupport/build.webkit.org-config/master.cfg:


git-svn-id: http://svn.webkit.org/repository/webkit/trunk@91273 268f45cc-cd09-0410-ab3c-d52691b4dbfc
parent c5f501f2
......@@ -234,9 +234,10 @@ class RunWebKitTests(shell.Test):
def _parseNewRunWebKitTestsOutput(self, logText):
incorrectLayoutLines = []
expressions = {
'failed': re.compile(r'Regressions: Unexpected.+:?\s*\((\d+)\)'),
'were flaky': re.compile(r'Unexpected flakiness.+:?\s*\((\d+)\)'),
'failures': re.compile(r'Regressions: Unexpected.+:?\s*\((\d+)\)'),
'flakes': re.compile(r'Unexpected flakiness.+:?\s*\((\d+)\)'),
'new passes': re.compile(r'Expected to .+, but passed:\s+\((\d+)\)'),
'missing results': re.compile(r'no expected results found\s*:\s+\((\d+)\)'),
}
testFailures = {}
......@@ -312,10 +313,10 @@ class NewRunWebKitTests(RunWebKitTests):
result = SUCCESS
if self.incorrectLayoutLines:
for line in self.incorrectLayoutLines:
if result != FAILURE and (line.find('were flaky') >= 0 or line.find('new passes') >= 0):
if line.find('flakes') >= 0 or line.find('new passes') >= 0 or line.find('missing results') >= 0:
result = WARNINGS
else:
result = FAILURE
return FAILURE
return result
......
2011-07-19 Ryosuke Niwa <rniwa@webkit.org>
Buildbot marks a nrwt bot red when tests are missing results
https://bugs.webkit.org/show_bug.cgi?id=64812
Reviewed by Tony Chang.
Added "missing results" label for tests that are missing results.
buildbot Now reports shows a label "X missing results" on a run when X tests were missing
expected results on that run.
Also rephrased "X failed" and "X were flaky" to "X failures" and "X flakes".
* BuildSlaveSupport/build.webkit.org-config/master.cfg:
2011-07-19 Adam Roben <aroben@apple.com>
Extract some of FailingTestsBugForm's code into a base class
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment