diff options
author | Stefano Lattarini <stefano.lattarini@gmail.com> | 2012-04-06 13:12:25 +0200 |
---|---|---|
committer | Stefano Lattarini <stefano.lattarini@gmail.com> | 2012-04-06 21:29:30 +0200 |
commit | 8a5096d150cf9803b8963768b7366cd68edcce03 (patch) | |
tree | a49c0e54876b8b9877d7ca2df386377e7b6037d1 /t/tap-basic.sh | |
parent | f8e822bbc197f01fc722aa6def7cddb4182e3c66 (diff) | |
download | automake-8a5096d150cf9803b8963768b7366cd68edcce03.tar.gz |
tests: rename 'tests/' => 't/', '*.test' => '*.sh'
When we (soon) convert the Automake testsuite to a non-recursive
make setup, we'll have to fix the entries of $(TESTS) to be
prepended with the subdirectory they are in; this will increase
the length of $(TESTS), and thus increase the possibility of
exceeding the command-line length limits on some systems (most
notably, MinGW/MSYS). See automake bug#7868 for more information.
Thus we rename the 'tests/' subdirectory to 't/', and each 'x.test'
script in there to 'x.sh'; this way, the $(TESTS) entry 'foo.test'
will become 't/foo.sh', which have the same number of characters.
* tests/: Rename ...
* t/: ... to this.
* t/*.test: Rename ...
* t/*.sh: ... to this.
* t/.gitignore: Removed as obsolete.
* t/defs: Adjust.
* t/gen-testsuite-part: Likewise.
* t/list-of-tests.mk: Likewise.
* t/ccnoco.sh: Likewise.
* t/ccnoco3.sh: Likewise.
* t/self-check-cleanup.tap: Likewise.
* t/self-check-dir.tap: Likewise.
* t/self-check-me.tap: Likewise.
* t/self-check-reexec.tap: Likewise.
* README: Likewise.
* bootstrap: Likewise
* configure.ac: Likewise.
* Makefile.am: Likewise.
* .gitignore: Likewise.
* syntax-check.mk: Likewise.
Signed-off-by: Stefano Lattarini <stefano.lattarini@gmail.com>
Diffstat (limited to 't/tap-basic.sh')
-rwxr-xr-x | t/tap-basic.sh | 175 |
1 files changed, 175 insertions, 0 deletions
diff --git a/t/tap-basic.sh b/t/tap-basic.sh new file mode 100755 index 000000000..3d6d8fe23 --- /dev/null +++ b/t/tap-basic.sh @@ -0,0 +1,175 @@ +#! /bin/sh +# Copyright (C) 2011-2012 Free Software Foundation, Inc. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2, or (at your option) +# any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +# Basic TAP support: +# - LOG_COMPILER support; +# - basic support for TODO and SKIP directives, and "Bail out!" magic; +# - testsuite progress output on console; +# - runtime overriding of TESTS and TEST_LOGS; +# - correct counts of test results (both in summary and in progress +# output on console). +# Note that some of the features checked here are checked in other +# test cases too, usually in a more thorough and detailed way. + +am_parallel_tests=yes +. ./defs || Exit 1 + +fetch_tap_driver + +cat >> configure.ac <<END +AC_OUTPUT +END + +cat > Makefile.am << 'END' +TEST_LOG_DRIVER = $(srcdir)/tap-driver +## Defining LOG_COMPILER should work and not intefere with the +## tap-driver script. +TEST_LOG_COMPILER = cat +TESTS = success.test + +ok.test: + echo '1..3' > $@-t + echo 'ok 1' >> $@-t + echo 'not ok 2 # TODO' >>$@-t + echo 'ok 3 # SKIP' >>$@-t + cat $@-t ;: For debugging. + mv -f $@-t $@ +END + +cat > success.test << 'END' +1..20 +ok 1 +ok 2 two +ok 3 - three +ok 4 four four +not ok 5 +not ok 6 six +not ok 7 - seven +not ok 8 eight eight +ok 9 # TODO +ok 10 ten # TODO +ok 11 - eleven # TODO +ok 12 twelve twelve # TODO +not ok 13 # TODO +not ok 14 fourteen # TODO +not ok 15 - fifteen # TODO +not ok 16 sixteen sixteen # TODO +ok 17 # SKIP +ok 18 eighteen # SKIP +ok 19 - nineteen # SKIP +ok 20 twenty twenty # SKIP +END + +$ACLOCAL +$AUTOCONF +$AUTOMAKE + +./configure + +# Basilar usage and testsuite progress output. + +$MAKE check >stdout && { cat stdout; Exit 1; } +cat stdout + +count_test_results total=20 pass=4 fail=4 xpass=4 xfail=4 skip=4 error=0 + +test -f success.log +test -f test-suite.log + +cat > exp << 'END' +PASS: success.test 1 +PASS: success.test 2 two +PASS: success.test 3 - three +PASS: success.test 4 four four +FAIL: success.test 5 +FAIL: success.test 6 six +FAIL: success.test 7 - seven +FAIL: success.test 8 eight eight +XPASS: success.test 9 # TODO +XPASS: success.test 10 ten # TODO +XPASS: success.test 11 - eleven # TODO +XPASS: success.test 12 twelve twelve # TODO +XFAIL: success.test 13 # TODO +XFAIL: success.test 14 fourteen # TODO +XFAIL: success.test 15 - fifteen # TODO +XFAIL: success.test 16 sixteen sixteen # TODO +SKIP: success.test 17 # SKIP +SKIP: success.test 18 eighteen # SKIP +SKIP: success.test 19 - nineteen # SKIP +SKIP: success.test 20 twenty twenty # SKIP +END + +$FGREP ': success.test' stdout > got + +cat exp +cat got +diff exp got + +# Override TESTS from the command line. + +rm -f *.log *.test + +cat > bail.test <<'END' +1..1 +Bail out! +ok 1 +END + +TESTS=bail.test $MAKE -e check >stdout && { cat stdout; Exit 1; } +cat stdout + +count_test_results total=1 pass=0 fail=0 xpass=0 xfail=0 skip=0 error=1 + +test ! -f success.log +test -f bail.log +test -f test-suite.log + +grep '^ERROR: bail\.test - Bail out!' stdout +grep '^PASS:' stdout && Exit 1 +test `$FGREP -c ': bail.test' stdout` -eq 1 +$FGREP 'success.test' stdout && Exit 1 + +# Override TEST_LOGS from the command line, making it point to a test +# (ok.test) that has to be generated at make time. + +rm -f *.log *.test + +TEST_LOGS=ok.log $MAKE -e check >stdout || { cat stdout; Exit 1; } +cat stdout + +count_test_results total=3 pass=1 fail=0 xpass=0 xfail=1 skip=1 error=0 + +test -f ok.test +test -f ok.log +test ! -f success.log +test ! -f bail.log +test -f test-suite.log + +$EGREP '(bail|success)\.test' stdout && Exit 1 + +cat > exp << 'END' +PASS: ok.test 1 +XFAIL: ok.test 2 # TODO +SKIP: ok.test 3 # SKIP +END + +$FGREP ': ok.test' stdout > got + +cat exp +cat got +diff exp got + +: |