tests: Autogenerate test matrix

Several tests have alternative wrappers that just set some feature
flags. For instance to switch between user and system and with or
without deltas. This change makes those wrappers automatically
generated from a simple description of the features.

For example the test-run.sh test goes from:
-       tests/test-run.sh \
-       tests/test-run-system.sh \
-       tests/test-run-deltas.sh \
-       tests/test-run-system-deltas.sh \
to
+       tests/test-run.sh{{user+system},{nodeltas+deltas}} \

There is some complexity here because the TESTS variable in automake
can't be runtime generated, so we rewrite it during "make
update-test-matrix" and commit the result to git.

The way it works is that make update-test-matrix takes the
TEST_MATRIX_SOURCE list, passes it to tests/expand-test-matrix.sh
which generates all the combinations in tests/Makefile-test-matrix.am.inc
where a test like tests/test-foo.sh{user+system} will get
converted to tests/test-foo.sh@user.wrap and tests/test-foo.sh@system.wrap.

We then have a pattern rule matchin tests/*.wrap which will generate
a wrapper that sets the right environment flags based on $0 and then
spawns the wrapper.

Closes: #2170
Approved by: alexlarsson

1 files changed, 4 insertions, 0 deletions

diff --git a/.gitignore b/.gitignore
index d1f57cd3..1bed96b9 100644
--- a/.gitignore
+++ b/.gitignore
@@ -99,6 +99,10 @@ Flatpak-1.0.*
 /tests/*.sh.log
 /tests/*.sh.test
 /tests/*.sh.trs
+/tests/*.wrap.log
+/tests/*.wrap.test
+/tests/*.wrap.trs
+/tests/*.wrap
 po/.intltool-merge-cache
 po/Makefile.in.in
 po/POTFILES