diff options
| author | Reid Barton <rwbarton@gmail.com> | 2017-03-02 16:39:16 -0500 |
|---|---|---|
| committer | Ben Gamari <ben@smart-cactus.org> | 2017-03-02 19:58:01 -0500 |
| commit | 6421c6f2bb56bcdf2415e8556180821eedd77d2d (patch) | |
| tree | 3920fb3a3a59059fdd7d70c42badbf58424f1af9 /testsuite/README.md | |
| parent | 488a9daa8246e0dd364dc44b8b6b8650fa6f3822 (diff) | |
| download | haskell-6421c6f2bb56bcdf2415e8556180821eedd77d2d.tar.gz | |
testsuite: Move echoing commands in make invocations to VERBOSE=5
D2894 added a new verbosity level VERBOSE=4 to strip -s/--silent
flags from make invocations in test commands. This will probably
cause the test to fail of course, but is useful for seeing what
a test that's already failing is doing.
However there was already an undocumented meaning of VERBOSE=4,
added in commit cfeededf, that causes the results of performance
tests to be printed unconditionally (even when they are within the
expected range). nomeata's ghc builder uses these figures to
collect historical data on performance test figures. The new
meaning of VERBOSE=4 added in D2894 means that any test that uses
make now fails on the builder.
This commit moves the new behavior of D2894 to the level VERBOSE=5
so that nomeata's ghc builder again produces useful results on
failing tests. It also adds documentation for both settings.
Test Plan: did some manual testing
Reviewers: austin, bgamari, Phyx, nomeata
Reviewed By: bgamari, Phyx
Subscribers: nomeata, thomie, Phyx
Differential Revision: https://phabricator.haskell.org/D3141
Diffstat (limited to 'testsuite/README.md')
| -rw-r--r-- | testsuite/README.md | 4 |
1 files changed, 3 insertions, 1 deletions
diff --git a/testsuite/README.md b/testsuite/README.md index 31193d61ce..5ab6dafb34 100644 --- a/testsuite/README.md +++ b/testsuite/README.md @@ -18,7 +18,9 @@ Commands to run testsuite: * Skip performance tests: `make SKIP_PERF_TESTS=YES` * Set verbosity: `make VERBOSE=n` where n=0: No per-test ouput, n=1: Only failures, - n=2: Progress output, n=3: Include commands called (default) + n=2: Progress output, n=3: Include commands called (default), + n=4: Include perf test results unconditionally, + n=5: Echo commands in subsidiary make invocations * Pass in extra GHC options: `make EXTRA_HC_OPTS=-fvectorize` You can also change directory to a specific test folder to run that |