summaryrefslogtreecommitdiff
path: root/run-tests.php
Commit message (Collapse)AuthorAgeFilesLines
* Put Xdebug 3 into 'off' mode for run-tests.phpDerick Rethans2020-05-181-1/+1
|
* Pass worker ID to clean scriptsChristoph M. Becker2020-04-291-4/+1
| | | | | | | On Windows, reusing/sharing of OPcache instances with different configuration is not necessarily supported, so we have to make that it does not happen for the clean scripts, by using `$orig_ini_settings` instead of `$clean_params`.
* Create a new console for each test worker on WindowsChristoph M. Becker2020-02-171-1/+2
| | | | | | | | | | | The primary motivation to have each test worker running its own console is to allow the windows_mb_path tests to run in parallel. A nice side effect is that this also prevents changing the code page of the tester's console window (which can even cause its font to be changed). To be able to do so, we introduce the `create_new_console` option for `proc_open()`, which might occasionally be useful for other purposes than testing.
* Apply tidy formattingNikita Popov2020-02-031-3086/+3086
| | | | Mostly reindent PHP scripts to spaces.
* Add WHITESPACE_SENSITIVE run-tests sectionNikita Popov2020-02-031-1/+1
| | | | | This is used to indicate that the test should not be changed by automated formatting changes.
* Don't use CRLF when generating diffsNikita Popov2020-01-241-1/+1
|
* Avoid some @count() suppressions in run-tests.phpNikita Popov2020-01-211-4/+4
|
* Set zend.exception_ignore_args=0 in run-tests.phpNikita Popov2019-12-101-0/+1
| | | | Any existing tests are going to be written under this assumption...
* Make test runner runnable without argumentsFabien Villepinte2019-11-081-273/+270
| | | | | | The default PHP executable was not set when no args were provided. Closes GH-4894.
* Bail out if JUNIT is not enabledChristoph M. Becker2019-10-071-0/+2
| | | | | | Otherwise we would try to access an array element of `false`, which issues a notice as of PHP 7.4.0. This would happen, for instance, for bug63447_001.phpt if CGI is not available.
* Delete temporary .post files of run-tests.phpChristoph M. Becker2019-10-071-4/+2
| | | | | | | | | Commit 5649267[1] changed run-tests.php to only delete .post files for passing tests. However, that code wouldn't be exercised at all, since `run_test()` already returned, so we move the deletion upwards. [1] <http://git.php.net/?p=php-src.git;a=commit;h=5649267b257c78e46a934434c0bff894e0b5b694>
* Fix reporting of redirect test failures in junitNikita Popov2019-09-071-2/+4
| | | | | These were being reported under the wrong name ... which means that they don't show up as failures on azure :(
* Fix handling of succeeding XFAIL testsChristoph M. Becker2019-08-051-1/+1
| | | | | | | | Due to a typo in commit e1151c9[1], succeeding XFAIL test without an EXPECTF or EXPECTREGEX section have been reported reported as passed instead of warned. [1] <http://git.php.net/?p=php-src.git;a=commit;h=e1151c9549cf5a7235c1609019f79bbb1bbcdbea>
* Merge branch 'PHP-7.3' into PHP-7.4Levi Morrison2019-07-251-1/+4
|\ | | | | | | | | * PHP-7.3: Remove .post files only for passing tests
| * Merge branch 'PHP-7.2' into PHP-7.3Levi Morrison2019-07-251-2/+4
| |\ | | | | | | | | | | | | * PHP-7.2: Remove .post files only for passing tests
| | * Remove .post files only for passing testsLevi Morrison2019-07-251-2/+4
| | | | | | | | | | | | This allows the sh script for failing tests with --POST-- to work
| * | Add CONFLICTS to recognized sectionsNikita Popov2019-07-101-1/+1
| | | | | | | | | | | | | | | It does nothing on 7.3, but this makes it easier to write tests in 3rd party extensions.
* | | Cleanup of remaining E_STRICT in testsGeorge Peter Banyard2019-07-231-2/+2
| | |
* | | Fix failed tests for pharPeter Kokot2019-07-211-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - when $status is boolean, E_NOTICE appears and tests fail - opcache is never enabled on these tests anyway. - Add opcache.revalidate_freq=0 to testing script Instead of checking this in the tests files it can be used directly in the main testing script. Also this fixes failed tests. - Use opcache_invalidate() instead of sleep() delay in some tests. Some delays are still used since the opcache_invalidate seems to be buggy and not working as expected. Closes GH-4392
* | | Deprecate alternative array access syntaxrjhdby2019-07-191-4/+4
| | | | | | | | | | | | RFC: https://wiki.php.net/rfc/deprecate_curly_braces_array_access
* | | Remove remaining lightnings from run-tests.phpChristoph M. Becker2019-07-181-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The classic Windows console only supports the Unicode BMP, so it can't handle the LIGHTNING MOOD character (U+1F5F2). It also seems that common fonts do not support the LIGHTNING (U+2607) character, so a general removal is appropriate. However, Windows is already "ready for the future"[1], but PHP for Windows is not (yet). [1] <https://devblogs.microsoft.com/commandline/windows-command-line-unicode-and-utf-8-output-text-buffer/>
* | | Remove lightningNikita Popov2019-07-181-3/+3
| | | | | | | | | | | | Windows is not quite ready for the future.
* | | Allow multiple cache instances per user/host on WindowsChristoph M. Becker2019-07-171-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Formerly, there was at most a single OPcache instance per user and the so called system ID (which is determined from the PHP version). Sometimes multiple OPcaches might be desired, though, particularly for unrelated CLI scripts, which may even be necessary (e.g. for our test suite in parallel mode). We therefore introduce a new INI directive `opcache.cache_id` which allows to configure independent OPcache instances for the same user. We also use `GetUserNameW()` instead of `php_win32_get_username()`, because the latter retrieves the user name encoded in the `default_charset`, which can obviously yield different results for different charsets, leading to OPcache "incompatibilities". Slightly worse, some characters may not even be encodeable in the `default_charset` and would be replaced by question marks, which could result in different users sharing the same OPcache. We also refactor, and re-use existing APIs to avoid duplicated code.
* | | Remove checks for always enabled spl and pcrePeter Kokot2019-07-131-23/+2
| | | | | | | | | | | | Closes GH-4397
* | | Include test name in JUnit testcase nameNikita Popov2019-07-111-2/+2
| | | | | | | | | | | | | | | Azure does not show the classname attribute in any convenient way, and the file name is the part we usually care about.
* | | Set up asan+ubsan scheduled build on azureNikita Popov2019-06-281-0/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | | Also adds an --asan flag to run-tests.php to setup all the necessary environment variables. Some tests are marked as skipped because they are incompatible with asan or too slow. I'm basing this on the DEBUG_ZTS build, which seems to give us the most mileage.
* | | run-tests: Don't pass --INI-- settings to --SKIPIF--Nikita Popov2019-06-281-7/+9
| | | | | | | | | | | | | | | | | | | | | | | | If we're testing ini settings that cause startup failures, we'll never get to that SKIPIF block... Also change settings2param to return a value instead of modifying (to a different type no less!) in place.
* | | run-tests: Don't die unnecessarilyNikita Popov2019-06-251-5/+3
| | | | | | | | | | | | die/exit leak memory, don't use them if we don't need to.
* | | Don't force USE_ZEND_ALLOC=0 in run-tests.phpNikita Popov2019-06-251-6/+0
| | | | | | | | | | | | | | | USE_ZEND_ALLOC=0 is useful not just for valgrind ... we should not force USE_ZEND_ALLOC=1 if the user explicitly disabled it.
* | | Merge branch 'PHP-7.3' into PHP-7.4Nikita Popov2019-06-131-1/+3
|\ \ \ | |/ /
| * | Merge branch 'PHP-7.2' into PHP-7.3Nikita Popov2019-06-131-1/+3
| |\ \ | | |/
| | * Add test for bug #78106Nikita Popov2019-06-131-1/+3
| | | | | | | | | | | | | | | | | | Also add PHP_TEST_EXTRA_ARGS environment variable, which allows to pass on -c, -d etc flags provided by run-tests.php. Otherwise we won't get the built-in server to run with opcache.
| * | Restore the execute bit for run-tests.phpCraig Duncan2019-05-281-0/+0
| | | | | | | | | | | | It looks like this was accidentally removed in 03f15f705ad30ce2dde7f7b2ab087a132b859ba0
* | | junit testcase classname is used as filename on azureJoe Watkins2019-06-051-1/+1
| | |
* | | only clear when showing in parallel runnerJoe Watkins2019-06-011-2/+8
| | |
* | | Fix NO_INTERACTION handling in parallel test runnerNikita Popov2019-05-311-4/+4
| | | | | | | | | | | | | | | This printing shouldn't depend on NO_INTERACTION, the variable that controls this is SHOW_ONLY_GROUPS.
* | | Add junit support for parallel test runnerNikita Popov2019-05-311-19/+56
| | |
* | | run-tests: Remove redundant 'suites' keyNikita Popov2019-05-311-1/+0
| | | | | | | | | | | | | | | We don't have nestead testsuites or similar, so drop this confusing key.
* | | have parallel test runner respect NO_INTERACTIONJoe Watkins2019-05-301-3/+7
| | |
* | | Run sapi tests when running all testsNikita Popov2019-05-291-1/+1
| | |
* | | fix notice in run-testsJoe Watkins2019-05-231-1/+1
| | |
* | | run-tests improvements:Joe Watkins2019-05-231-14/+48
| | | | | | | | | | | | | | | | | | | | | | | | Add XLEAK section, this is made necessary by the support for valgrind tools other than memcheck. XLEAK is to a leaking test what XFAIL is to a failing test. Tidy up summary a little to exclude Expected Fail and Expected Leak when there are no expected fail/leaks
* | | add support for valgrind tools to run-tests.phpJoe Watkins2019-05-221-8/+17
| | |
* | | Merge branch 'PHP-7.3' into PHP-7.4Christoph M. Becker2019-05-081-3/+2
|\ \ \ | |/ / | | | | | | | | | * PHP-7.3: Add {TMP} placeholder for PHPT INI sections
| * | Merge branch 'PHP-7.2' into PHP-7.3Christoph M. Becker2019-05-081-3/+2
| |\ \ | | |/ | | | | | | | | | * PHP-7.2: Add {TMP} placeholder for PHPT INI sections
| | * Add {TMP} placeholder for PHPT INI sectionsChristoph M. Becker2019-05-081-3/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | Several tests use `/tmp` in the `--INI--` section, but this is not portable. We therefore introduce the `{TMP}` placeholder which evaluates to the system's temporary directory using `sys_get_temp_dir()`. We also remove the doubtful `strpos()` optimization.
| | * Trim trailing whitespace in source code filesPeter Kokot2018-10-131-2/+2
| | |
* | | Add minimum required PHP version to run-tests.phpPeter Kokot2019-03-261-0/+2
| | | | | | | | | | | | | | | This integrates a simple minimum PHP version info in the tool and to also define the minimum version that the tool syntax should support.
* | | Don't use parallel testing with -j1Nikita Popov2019-03-251-0/+4
| | |
* | | Drop lightning for concurrent worker countNikita Popov2019-03-251-1/+1
| | | | | | | | | | | | | | | This looked rather awkward even on terminals that have full unicode support.