diff options
| author | Vladislav Zavialov <vlad.z.4096@gmail.com> | 2019-02-26 16:54:07 +0300 |
|---|---|---|
| committer | Vladislav Zavialov <vlad.z.4096@gmail.com> | 2019-02-26 16:54:07 +0300 |
| commit | 1aa0fc97715ba1dd0234c3b7eb1bf3a676546955 (patch) | |
| tree | b242b9eb55574666063bd97365aac11039187124 | |
| parent | 14586f5d737ec5dc828633267b50dcf0d47e1696 (diff) | |
| download | haskell-wip/hie002-stabilize.tar.gz | |
Fix intermittent hie002 failurewip/hie002-stabilize
hie002 is a performance test that used to fail unpredictably:
max_bytes_used Decrease from x86_64-linux-deb9-debug baseline @ HEAD~2:
Expected hie002 (normal) max_bytes_used: 1190923992.0 +/-20%
Lower bound hie002 (normal) max_bytes_used: 952739193
Upper bound hie002 (normal) max_bytes_used: 1429108791
Actual hie002 (normal) max_bytes_used: 726270784
Deviation hie002 (normal) max_bytes_used: -39.0 %
peak_megabytes_allocated Decrease from x86_64-linux-deb9-debug baseline @ HEAD~2:
Expected hie002 (normal) peak_megabytes_allocated: 2538.0 +/-20%
Lower bound hie002 (normal) peak_megabytes_allocated: 2030
Upper bound hie002 (normal) peak_megabytes_allocated: 3046
Actual hie002 (normal) peak_megabytes_allocated: 1587
Deviation hie002 (normal) peak_megabytes_allocated: -37.5 %
*** unexpected stat test failure for hie002(normal)
'max_bytes_used' and 'peak_megabytes_allocated' are too unstable without careful
control of the runtime configuration. We fix this by using a more predictable
metric, 'bytes allocated'.
| -rw-r--r-- | testsuite/tests/hiefile/should_compile/all.T | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/testsuite/tests/hiefile/should_compile/all.T b/testsuite/tests/hiefile/should_compile/all.T index 9770bae587..fb8092df95 100644 --- a/testsuite/tests/hiefile/should_compile/all.T +++ b/testsuite/tests/hiefile/should_compile/all.T @@ -1,5 +1,6 @@ test('hie001', normal, compile, ['-fno-code -fwrite-ide-info -fvalidate-ide-info']) -test('hie002', collect_compiler_stats(), compile, ['-fno-code -fwrite-ide-info']) +test('hie002', collect_compiler_stats('bytes allocated',10), + compile, ['-fno-code -fwrite-ide-info']) test('hie003', normal, compile, ['-fno-code -fwrite-ide-info -fvalidate-ide-info']) test('hie004', normal, compile, ['-fno-code -fwrite-ide-info -fvalidate-ide-info']) test('hie005', normal, compile, ['-fno-code -fwrite-ide-info -fvalidate-ide-info']) |