diff options
| author | Matthew Pickering <matthewtpickering@gmail.com> | 2022-05-27 09:41:58 +0100 |
|---|---|---|
| committer | Marge Bot <ben+marge-bot@smart-cactus.org> | 2022-05-28 21:00:45 -0400 |
| commit | 0704295ceafaf0f531b90689569c0492d11f4725 (patch) | |
| tree | 569bcc8210a881ffb6165d1215bf4fadba8f6ea4 | |
| parent | b54f6c4fefaca8ca043cccbf474fb0da3d1c66b5 (diff) | |
| download | haskell-0704295ceafaf0f531b90689569c0492d11f4725.tar.gz | |
T16875: Stabilise (temporarily) by increasing acceptance threshold
The theory is that on windows there is some difference in the
environment between pipelines on master and merge requests which affects
all tests equally but because T16875 barely allocates anything it is the
test which is affected the most.
See #21557
| -rw-r--r-- | testsuite/tests/perf/compiler/all.T | 4 |
1 files changed, 3 insertions, 1 deletions
diff --git a/testsuite/tests/perf/compiler/all.T b/testsuite/tests/perf/compiler/all.T index 3d0796564e..cac2ebd48f 100644 --- a/testsuite/tests/perf/compiler/all.T +++ b/testsuite/tests/perf/compiler/all.T @@ -634,7 +634,9 @@ test('hard_hole_fits', # Testing multiple hole-fits with lots in scope for #1687 compile, ['-fdefer-type-errors -fno-max-valid-hole-fits -package ghc']) test('T16875', # Testing one hole-fit with a lot in scope for #16875 - collect_compiler_stats('bytes allocated', 2), + # This test is very sensitive to environmental differences.. we should fix + # that but for now the failure threshold is 4% (see #21557) + collect_compiler_stats('bytes allocated', 4), compile, ['-fdefer-type-errors -fno-max-valid-hole-fits -package ghc']) test ('T20261', |