summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* doc/source/core_plugins.rst: Add link to bst-plugins-containerchandan/container-pluginsChandan Singh2019-03-081-0/+1
| | | | | | https://gitlab.com/BuildStream/bst-plugins-container has now had its first (and second and third too) release, add it to the list of known external plugins.
* Merge branch 'juerg/remote-execution-cas' into 'master'bst-marge-bot2019-03-081-22/+21
|\ | | | | | | | | | | | | Improve remote execution Closes #935 See merge request BuildStream/buildstream!1192
| * _sandboxremote.py: Add support for embedded stdout and stderrJürg Billeter2019-03-081-2/+9
| | | | | | | | Part of #797.
| * _sandboxremote.py: Process job output for failed commandsJürg Billeter2019-03-081-3/+3
| | | | | | | | | | The sandbox directory should be updated even for commands with non-zero exit code. This allows caching the failed buildtree for debugging.
| * _sandboxremote.py: Request the whole directory tree as outputJürg Billeter2019-03-081-12/+5
| | | | | | | | | | | | process_job_output() currently expects the whole directory tree as output. Match this in the request by asking for the whole directory tree.
| * _sandboxremote.py: Remove support for FileBasedDirectory as sandbox rootJürg Billeter2019-03-081-5/+0
| | | | | | | | Remote execution should always use CasBasedDirectory.
| * _sandboxremote.py: Use CasBasedDirectory as sandbox rootJürg Billeter2019-03-081-0/+4
|/ | | | This allows bypassing the local filesystem.
* Merge branch 'phil/external-plugin-testing' into 'master'bst-marge-bot2019-03-082-2/+122
|\ | | | | | | | | | | | | Make it easy to test BuildStream against external plugins Closes #922 See merge request BuildStream/buildstream!1158
| * Allow testing of external plugins via toxphil/external-plugin-testingPhil Dawson2019-03-082-2/+122
|/
* Merge branch 'chandan/base-git-mirror' into 'master'bst-marge-bot2019-03-072-6/+11
|\ | | | | | | | | Expose _GitMirror as part of plugin author facing API See merge request BuildStream/buildstream!1022
| * _gitsourcebase.py: Make mirror class used by derived plugins overridablePhil Dawson2019-03-071-3/+8
| | | | | | | | | | | | | | | | | | | | We want it to be possible for plugin authors writing git type plugins derrived from _GitSourceBase to be able to make use of custom _GitMirror classes. Add a MirrorClass class variable to _GitSourceBase which can be overriden by derriving classes. This allows plugin authors to specify the use of custom/derrived _GitMirror class.
| * Expose _GitMirror as part of plugin author facing APIChandan Singh2019-03-072-6/+6
|/ | | | | | | | In !1019, we opened up the `_GitSourceBase()` class but forgot to expose the `GitMirror()` class that does most of the heavy lifting around handling the Git repository. So, add it to `__init__.py` as well, but not as a public API.
* Merge branch 'bschubert/tests-behind-proxy' into 'master'bst-marge-bot2019-03-061-0/+7
|\ | | | | | | | | test: Pass proxy and cert env variable to tox environment See merge request BuildStream/buildstream!1207
| * test: Pass proxy and cert env variable to tox environmentbschubert/tests-behind-proxyBenjamin Schubert2019-03-061-0/+7
|/ | | | | | In order to be able to run integration tests behind a proxy, we need to let proxy related environment variable cascade to the tox environment.
* Merge branch 'jennis/compose_backwards' into 'master'bst-marge-bot2019-03-062-6/+13
|\ | | | | | | | | cleanup: Move YAML handling logic in _include.py to _yaml.py See merge request BuildStream/buildstream!1205
| * _include.py: Move yaml related logic to _yaml.pyjennis/compose_backwardsJames Ennis2019-03-062-6/+13
|/
* Merge branch 'juerg/fast-import' into 'master'bst-marge-bot2019-03-0612-103/+183
|\ | | | | | | | | Improve import performance See merge request BuildStream/buildstream!1190
| * filter.py: Set BST_RUN_COMMANDS to FalseJürg Billeter2019-03-061-0/+3
| | | | | | | | Filter elements do not run any commands. This will allow faster staging.
| * filter.py: Set BST_VIRTUAL_DIRECTORYJürg Billeter2019-03-061-0/+3
| | | | | | | | The filter plugin doesn't use Sandbox.get_directory().
| * import.py: Set BST_RUN_COMMANDS to FalseJürg Billeter2019-03-061-0/+3
| | | | | | | | Import elements do not run any commands. This will allow faster staging.
| * element.py: Disable Sandbox.run() for elements that don't need itJürg Billeter2019-03-061-0/+7
| | | | | | | | This will allow faster staging.
| * element.py: Add BST_RUN_COMMANDS flagJürg Billeter2019-03-061-0/+6
| | | | | | | | | | | | This flag indicates whether the plugin may run commands using `Sandbox.run()` and defaults to `True`. This will allow faster staging for plugins that do not need to run any commands in the sandbox.
| * sandbox.py: Add _disable_run() methodJürg Billeter2019-03-061-0/+18
| | | | | | | | | | This enables use of CasBasedDirectory for faster staging when command execution is not required.
| * sandbox.py: Add _use_cas_based_directory() methodJürg Billeter2019-03-061-2/+14
| | | | | | | | | | Allow Sandbox implementations to decide whether to use CasBasedDirectory.
| * _casbaseddirectory.py: Deduplicate os.path.join() calls in _add_file()Jürg Billeter2019-03-061-2/+3
| |
| * _casbaseddirectory.py: Don't set relative_pathname in _check_replacementJürg Billeter2019-03-061-5/+4
| | | | | | | | | | We already have relative_pathname in the caller. Reuse that instead of calling os.path.join().
| * storage: Use variable-length argument list for Directory.descend()Jürg Billeter2019-03-0610-84/+70
| | | | | | | | | | This provides an API in line with, e.g., os.path.join(), and eliminates isinstance checks.
| * _casbaseddirectory.py: Add fast path for CAS-to-CAS importJürg Billeter2019-03-061-10/+52
|/ | | | | | If the destination directory does not exist yet and there is no filter, we can import the whole source directory by digest instead of importing each directory entry individually.
* Merge branch 'tristan/optional-coverage-fixup' into 'master'bst-marge-bot2019-03-052-4/+9
|\ | | | | | | | | Fixes for coverage optionality See merge request BuildStream/buildstream!1206
| * tests/testutils/artifactshare.py: Support optional coverageTristan Van Berkom2019-03-051-2/+7
| | | | | | | | | | | | | | This scaffolding needs to manually tell coverage to cleanup when sigterm happens in the process in order to collect the coverage report, but we need to do this conditionally in case we are running tests without coverage support.
| * requirements/Makefile: Do not depend on the "force" packageTristan Van Berkom2019-03-051-2/+2
|/ | | | Chandan, you silly pony.
* Merge branch 'chandan/always-regen-requirements' into 'master'bst-marge-bot2019-03-041-2/+4
|\ | | | | | | | | requirements/Makefile: Always rebuild requirements files See merge request BuildStream/buildstream!1204
| * requirements/Makefile: Always rebuild requirements filesChandan Singh2019-03-041-2/+4
|/ | | | | | | We always want to update all the requirements files together such that the versions of the common dependencies do not drift between them. Do so by adding a dummy phony target `FORCE` and depend on it from all the `.txt` targets.
* Merge branch 'tristan/optional-coverage' into 'master'bst-marge-bot2019-03-047-22/+43
|\ | | | | | | | | | | | | Make coverage optional Closes #916 See merge request BuildStream/buildstream!1189
| * .gitlab-ci.yml: Use recent toxTristan Van Berkom2019-03-041-2/+2
| | | | | | | | | | | | | | There appears to be multiple versions of tox in the WSL test environment, prepending /root/.local/bin to the PATH while running tests ensures that we are using a recent enough tox to execute the tests.
| * .gitlab-ci.yml: Adding tox --version output to test diagnosticsTristan Van Berkom2019-03-041-0/+2
| | | | | | | | | | This is generally useful to know, since the tox version is not enforced by BuildStream.
| * tox.ini: Support running tests without coverage present at allTristan Van Berkom2019-03-041-7/+13
| | | | | | | | | | | | | | | | | | | | | | This change simply makes it possible to run the tests without coverage and without any coverage related dependencies present in the tox venvs. To run tests without coverage, simply choose the python version and append "-nocover" to the env name, e.g.: tox -e py36-nocover
| * setup.cfg, tox.ini: Moved coverage support to the tox.ini levelTristan Van Berkom2019-03-042-2/+2
| | | | | | | | | | | | | | This disables any attempt to use coverage when running tests directly against installed dependencies with setup.py. This fixes #916
| * tox.ini / requirements: Separated coverage requirementsTristan Van Berkom2019-03-045-14/+27
|/ | | | Since coverage is optional, lets make it really optional.
* Merge branch 'jmac/make_marked_directories' into 'master'bst-marge-bot2019-03-021-0/+8
|\ | | | | | | | | | | | | _sandboxremote.py: Create marked directories before running Closes #851 See merge request BuildStream/buildstream!1056
| * _sandboxremote.py: Create marked directories before runningjmac/make_marked_directoriesJim MacArthur2019-03-021-0/+8
|/ | | | | | | The other two sandboxes (BWrap and chroot) both do this because marked directories may be mount points. _cache_artifact requires install-root to be present, and existing BuildStream projects may rely on these too.
* Merge branch 'bschubert/no-subprocess-decode' into 'master'bst-marge-bot2019-03-016-25/+28
|\ | | | | | | | | refactor: remove the need to decode output from subprocess See merge request BuildStream/buildstream!1199
| * Let subprocess decode stdout based on localebschubert/no-subprocess-decodeBenjamin Schubert2019-03-016-25/+28
|/ | | | | | | | | Subprocesses can return decoded strings if we give them a "universal_newlines=True" argument. We can therefore offload that to them, and not explicitly decode output ourselves. This also fixes multiple bugs where we would not be respecting the locale used by the user, and in some cases force it to "ascii".
* Merge branch 'chandan/remove-redundant-pytest-mark' into 'master'bst-marge-bot2019-03-017-15/+0
|\ | | | | | | | | tests: Remove redundant integration pytest markers See merge request BuildStream/buildstream!1202
| * tests: Remove redundant integration pytest markersChandan Singh2019-03-017-15/+0
|/ | | | | | | | | Remove `pytest.mark.integration` for individual tests that already include it in `pytestmarker` at the top. FWIW the list of such files was found using: git grep --name-only 'pytestmark = pytest.mark.integration' | xargs grep '@pytest.mark.integration'
* Merge branch 'remove-dead-code' into 'master'bst-marge-bot2019-03-0185-361/+265
|\ | | | | | | | | Remove dead code See merge request BuildStream/buildstream!1195
| * tests: Remove unused importsremove-dead-codeBenjamin Schubert2019-03-0143-69/+15
| |
| * tests: Remove unused parameters in functionsBenjamin Schubert2019-03-0154-148/+152
| | | | | | | | | | For parameters that are required as part of an API, prefix them by "_" to make it clear they are unused
| * tests: Remove unused variablesBenjamin Schubert2019-03-0138-144/+98
|/
* Merge branch 'bschubert/more-pythonic-list-concat' into 'master'bst-marge-bot2019-03-0118-34/+37
|\ | | | | | | | | refactor: Use [a, b, *c] instead of [a, b] + c when building list See merge request BuildStream/buildstream!1200