summaryrefslogtreecommitdiff
path: root/testsuite/driver/testlib.py
Commit message (Collapse)AuthorAgeFilesLines
...
* Summarily skip compiler_perf tests when DEBUG is onJoachim Breitner2013-11-281-0/+3
| | | | by ensuring this in the test runner.
* Flag to test suite: SKIP_PERF_TESTSJoachim Breitner2013-10-051-0/+6
| | | | | | More often than not the output of the performance tests is in the way, rather than helping. This allows the use of `make SKIP_PERF_TESTS=YES` to skip these tests. Fixes #8413
* Driver: Fix % operator typoJoachim Breitner2013-09-231-1/+1
|
* Test driver: Implement different verbositiesJoachim Breitner2013-09-201-18/+20
| | | | | | | | | Select verbosity with "make VERBOSE=n". Options so far: n=0: No per-test output n=1: Only failing test results n=2: As above, plus progress information (names of all tests) n=3: As aobve, plus commands called. Default currently is n=3, although n=2 might be a nicer default.
* Test driver: Print total time spent at the endJoachim Breitner2013-09-201-1/+6
|
* Make test cleaning a little more consistentIan Lynagh2013-05-171-4/+6
|
* Add a multi_cpu_race helperIan Lynagh2013-04-171-0/+5
| | | | | This makes the test run alone, to increase the chance of a multi-CPU race happening.
* Fix tests for dynamic ghcIan Lynagh2013-03-151-1/+1
|
* Remove composeIan Lynagh2013-02-171-3/+0
|
* Remove uses of compose(s) in tests, and change how composition is handledIan Lynagh2013-02-141-13/+10
| | | | The driver now also supports nested lists of setup functions
* Reorder some functions to group themIan Lynagh2013-02-131-18/+17
| | | | Predicates now match the order they are documented on the wiki
* Tweak the brokens list to include the directory the test is inIan Lynagh2013-02-111-4/+4
|
* More conversionsIan Lynagh2013-02-111-6/+3
|
* More helper conversionsIan Lynagh2013-02-111-6/+3
|
* Convert more helpersIan Lynagh2013-02-111-11/+2
|
* Convert more helper functionsIan Lynagh2013-02-111-61/+22
|
* Convert more helper functions to the new schemeIan Lynagh2013-02-111-33/+6
|
* Convert more helpers to the new schemeIan Lynagh2013-02-111-21/+6
|
* Change '{if,unless}_arch' to 'arch'Ian Lynagh2013-02-111-11/+2
|
* Handle duplicates in the brokens listIan Lynagh2013-02-111-4/+8
|
* expect_broken_for should also be added to the list of brokensIan Lynagh2013-02-111-8/+10
|
* Replace 'if_os' and 'unless_os' with 'opsys'Ian Lynagh2013-02-111-11/+2
| | | | The name 'os' clashes with a python library
* Add 'make list_brokens'Ian Lynagh2013-02-111-1/+5
| | | | | | Gives a list of tickets that the testsuite thinks are broken, and what bug it thinks is the reason. This can then be pasted into trac and 'previewed', which will show any closed tickets with strikeout.
* Rearrange the summary outputIan Lynagh2013-02-101-16/+18
| | | | | | In particular, the 3 values you most need to care about (framework failures, unexpected passes, unexpected failures) are now together in a block.
* Remove unused helper functionsIan Lynagh2013-02-081-6/+0
|
* Replace 'if_platform' and 'unless_platform' with 'platform'Ian Lynagh2013-02-081-11/+2
|
* Allow a simpler form of stats_num_field where all platforms use the same valueIan Lynagh2013-02-071-5/+9
|
* Add a different sort of stats_num_field helper functionIan Lynagh2013-02-071-7/+29
| | | | | | | | | | | | | | | | Uses look like stats_num_field('bytes allocated', [(wordsize(32), 45648, 5), (wordsize(64), 49400, 5)]) where the first matching triple will be used. e.g. we could override the Win32 expected values with: [(platform('i386-unknown-mingw32'), 41000, 5), (wordsize(32), 45648, 5), (wordsize(64), 49400, 5)]) with other 32-bit platforms falling through to the wordsize(32) case. This makes it easier to give different values for different platforms, while being sure that all platforms are covered.
* Pass the test name to the test optionsIan Lynagh2013-02-071-93/+90
| | | | | | | | This allows them to give framework failures. I also had to change how setTestOpts works. Now, rather than applying the options to the directory's "default options", it just stores the options to be applied for each test (i.e. once we know the test name).
* Change how the testsuite driver handles copying the test optionsIan Lynagh2013-02-071-5/+3
| | | | | We now deepcopy the options for each test, which means that the test helpers don't need to worry about sharing.
* Rename some argumentsIan Lynagh2013-02-071-4/+4
|
* Define 'when' and 'unless' helpersIan Lynagh2013-02-071-11/+11
| | | | This will reduce the number of helper functions that we need
* Simplify driver code slightlyIan Lynagh2013-02-071-2/+1
|
* Add a TEST="..." line to testsuite outputIan Lynagh2013-02-071-0/+13
| | | | | This gives hte list of tests with unexpected results, so that you can easily run them again.
* Make failing perf test output easier to readIan Lynagh2013-02-061-10/+23
|
* Eliminate *_num_fieldIan Lynagh2013-02-061-49/+11
| | | | We now use *_range_field everywhere instead
* Fix cabal01 on WindowsIan Lynagh2013-02-051-1/+1
| | | | | | | We were getting a Creating library file: dist\build\libHStest-1.0-ghc7.7.20130205.dll.a message on stderr. We can't turn it off, so now the test just normalises it away.
* Handle ^C better when threads are being used tooIan Lynagh2013-02-021-5/+15
|
* When the testsuite is ^Ced, print the summary anywayIan Lynagh2013-02-021-1/+14
|
* Make numeric-only test names a framework failureIan Lynagh2013-01-251-1/+1
|
* Make do_test catch and re-raise KeyboardInterruptIan Lynagh2013-01-251-0/+2
| | | | | This means that hitting ^C now stops the testsuite from running, rather than just killing the current test.
* Clean the .hpc directoriesIan Lynagh2013-01-241-0/+5
|
* Use .hpc.<testname> for the hpc directoryIan Lynagh2013-01-241-4/+4
| | | | | All tests used to use .hpc, which caused failures when running in parallel.
* Don't allow '/' characters in test namesIan Lynagh2013-01-241-1/+1
|
* Add a (currently very permissive) test name checkIan Lynagh2013-01-221-0/+2
| | | | | We now get a framework failure if a test name doesn't match ^[a-zA-Z0-9][a-zA-Z0-9._/-]*$
* Remove a stray colon from the framework fail messagesIan Lynagh2013-01-221-1/+1
|
* Add better support for .cmm test files.Austin Seipp2013-01-171-1/+7
| | | | | | Fixes Trac #7573. Signed-off-by: Austin Seipp <mad.one@gmail.com>
* Add a test for #7563Ian Lynagh2013-01-121-0/+12
|
* Fix Word2Float# test on 32-bitJohan Tibell2013-01-071-0/+6
|
* Only run dynamicToo001 if we have both vanilla and dynamic librariesIan Lynagh2012-12-141-0/+36
|
View Lorry Controller Status