summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* tests: Add tests to ensure that overwriting on later compositions worksjennis/assert_composition_failureJames Ennis2019-03-126-0/+63
|
* Merge branch 'tristan/cleanup-workspace-tests' into 'master'Tristan Van Berkom2019-03-121-19/+13
|\ | | | | | | | | tests/frontend/workspace.py: Remove redundant and pointless tests See merge request BuildStream/buildstream!1212
| * tests/frontend/workspace.py: Remove redundant and pointless testsTristan Van Berkom2019-03-121-19/+13
|/ | | | | | | | | | | | | | | | | The following tests all test core functionalities for which the plugin type cannot possibly have any effects on the result, because none of the tested functionalities in these tests are delegated to plugins in anyway: - test_open_track - test_open_force - test_open_force_open - test_open_force_different_workspace - test_close - test_inconsitent_pipeline_message Reduced these tests to only test with the git plugin, instead of redundantly running these tests against every plugin.
* Merge branch 'tristan/missing-file-errors' into 'master'bst-marge-bot2019-03-1218-5/+121
|\ | | | | | | | | | | | | Improve error reporting when files are not found Closes #947 See merge request BuildStream/buildstream!1216
| * tests/format/junctions.py: Added tests for missing files across junction ↵Tristan Van Berkom2019-03-1211-0/+66
| | | | | | | | | | | | | | boundaries These include assertions for the expected provenance in the errors, protecting against regressions of #947
| * tests/format/project.py: Added tests for missing files and missing junctionsTristan Van Berkom2019-03-125-0/+31
| | | | | | | | | | These also assert that the provenance of the references to missing files are reported, guarding for regressions of issue #947
| * _loader/loader.py: Specify junction name in missing file errors where ↵Tristan Van Berkom2019-03-121-3/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | appropriate When a file is missing in a subproject, it is not particularly meaningful to specify the filesystem path to the elements directory of the subproject, as this temporary staging directory belongs to BuildStream and not the user. Instead, when a file is missing in a subproject, specifying the junction name is more useful. This fixes an aspect of #947
| * _loader/loader.py: Include provenance in missing file errorsTristan Van Berkom2019-03-121-3/+9
| | | | | | | | This fixes issue #947
| * _yaml.py: Report more accurate provenance informationTristan Van Berkom2019-03-121-1/+5
|/ | | | | | | | | When printing the provenance, show the fully qualified element name including the junction prefix in the case that the provenance comes from a subproject. This makes much more sensible error reporting when reporting errors which originate from a subproject.
* Merge branch 'jennis/move_node_get_project_path' into 'master'bst-marge-bot2019-03-113-106/+103
|\ | | | | | | | | Cleanup: Move _yaml.node_get_project_path() to Project._get_path_from_node() See merge request BuildStream/buildstream!1211
| * _yaml.py: Move node_get_project_path to project.pyJames Ennis2019-03-113-106/+103
|/ | | | | | _yaml.node_get_project_path() is currently only used by Project and by Plugin. This function has been moved to Project._get_path_from_node() and no longers requires a project directory as argument.
* .gitlab-ci.yml: Fix "overnight-tests-no-cache" jobJavier Jardón2019-03-101-1/+0
| | | | | | freedesktop-sdk/bootstrap/project.conf doesn't exist anymore This completes d61e058273f45bd0a2fda1722d579cdc39fbc99a
* Merge branch 'jjardon/use_freedesktop-sdk-18.08.28' into 'master'Javier Jardón2019-03-101-1/+1
|\ | | | | | | | | | | | | .gitlab-ci.yml: Use current stable version of freedeskop-sdk: freedesktop-sdk-18.08.28 Closes #954 See merge request BuildStream/buildstream!1219
| * .gitlab-ci.yml: Use current stable version of freedeskop-sdk: ↵Javier Jardón2019-03-091-1/+1
|/ | | | freedesktop-sdk-18.08.28
* Merge branch 'juerg/remote-execution-cas' into 'master'bst-marge-bot2019-03-081-22/+21
|\ | | | | | | | | | | | | Improve remote execution Closes #935 See merge request BuildStream/buildstream!1192
| * _sandboxremote.py: Add support for embedded stdout and stderrJürg Billeter2019-03-081-2/+9
| | | | | | | | Part of #797.
| * _sandboxremote.py: Process job output for failed commandsJürg Billeter2019-03-081-3/+3
| | | | | | | | | | The sandbox directory should be updated even for commands with non-zero exit code. This allows caching the failed buildtree for debugging.
| * _sandboxremote.py: Request the whole directory tree as outputJürg Billeter2019-03-081-12/+5
| | | | | | | | | | | | process_job_output() currently expects the whole directory tree as output. Match this in the request by asking for the whole directory tree.
| * _sandboxremote.py: Remove support for FileBasedDirectory as sandbox rootJürg Billeter2019-03-081-5/+0
| | | | | | | | Remote execution should always use CasBasedDirectory.
| * _sandboxremote.py: Use CasBasedDirectory as sandbox rootJürg Billeter2019-03-081-0/+4
|/ | | | This allows bypassing the local filesystem.
* Merge branch 'phil/external-plugin-testing' into 'master'bst-marge-bot2019-03-082-2/+122
|\ | | | | | | | | | | | | Make it easy to test BuildStream against external plugins Closes #922 See merge request BuildStream/buildstream!1158
| * Allow testing of external plugins via toxphil/external-plugin-testingPhil Dawson2019-03-082-2/+122
|/
* Merge branch 'chandan/base-git-mirror' into 'master'bst-marge-bot2019-03-072-6/+11
|\ | | | | | | | | Expose _GitMirror as part of plugin author facing API See merge request BuildStream/buildstream!1022
| * _gitsourcebase.py: Make mirror class used by derived plugins overridablePhil Dawson2019-03-071-3/+8
| | | | | | | | | | | | | | | | | | | | We want it to be possible for plugin authors writing git type plugins derrived from _GitSourceBase to be able to make use of custom _GitMirror classes. Add a MirrorClass class variable to _GitSourceBase which can be overriden by derriving classes. This allows plugin authors to specify the use of custom/derrived _GitMirror class.
| * Expose _GitMirror as part of plugin author facing APIChandan Singh2019-03-072-6/+6
|/ | | | | | | | In !1019, we opened up the `_GitSourceBase()` class but forgot to expose the `GitMirror()` class that does most of the heavy lifting around handling the Git repository. So, add it to `__init__.py` as well, but not as a public API.
* Merge branch 'bschubert/tests-behind-proxy' into 'master'bst-marge-bot2019-03-061-0/+7
|\ | | | | | | | | test: Pass proxy and cert env variable to tox environment See merge request BuildStream/buildstream!1207
| * test: Pass proxy and cert env variable to tox environmentbschubert/tests-behind-proxyBenjamin Schubert2019-03-061-0/+7
|/ | | | | | In order to be able to run integration tests behind a proxy, we need to let proxy related environment variable cascade to the tox environment.
* Merge branch 'jennis/compose_backwards' into 'master'bst-marge-bot2019-03-062-6/+13
|\ | | | | | | | | cleanup: Move YAML handling logic in _include.py to _yaml.py See merge request BuildStream/buildstream!1205
| * _include.py: Move yaml related logic to _yaml.pyjennis/compose_backwardsJames Ennis2019-03-062-6/+13
|/
* Merge branch 'juerg/fast-import' into 'master'bst-marge-bot2019-03-0612-103/+183
|\ | | | | | | | | Improve import performance See merge request BuildStream/buildstream!1190
| * filter.py: Set BST_RUN_COMMANDS to FalseJürg Billeter2019-03-061-0/+3
| | | | | | | | Filter elements do not run any commands. This will allow faster staging.
| * filter.py: Set BST_VIRTUAL_DIRECTORYJürg Billeter2019-03-061-0/+3
| | | | | | | | The filter plugin doesn't use Sandbox.get_directory().
| * import.py: Set BST_RUN_COMMANDS to FalseJürg Billeter2019-03-061-0/+3
| | | | | | | | Import elements do not run any commands. This will allow faster staging.
| * element.py: Disable Sandbox.run() for elements that don't need itJürg Billeter2019-03-061-0/+7
| | | | | | | | This will allow faster staging.
| * element.py: Add BST_RUN_COMMANDS flagJürg Billeter2019-03-061-0/+6
| | | | | | | | | | | | This flag indicates whether the plugin may run commands using `Sandbox.run()` and defaults to `True`. This will allow faster staging for plugins that do not need to run any commands in the sandbox.
| * sandbox.py: Add _disable_run() methodJürg Billeter2019-03-061-0/+18
| | | | | | | | | | This enables use of CasBasedDirectory for faster staging when command execution is not required.
| * sandbox.py: Add _use_cas_based_directory() methodJürg Billeter2019-03-061-2/+14
| | | | | | | | | | Allow Sandbox implementations to decide whether to use CasBasedDirectory.
| * _casbaseddirectory.py: Deduplicate os.path.join() calls in _add_file()Jürg Billeter2019-03-061-2/+3
| |
| * _casbaseddirectory.py: Don't set relative_pathname in _check_replacementJürg Billeter2019-03-061-5/+4
| | | | | | | | | | We already have relative_pathname in the caller. Reuse that instead of calling os.path.join().
| * storage: Use variable-length argument list for Directory.descend()Jürg Billeter2019-03-0610-84/+70
| | | | | | | | | | This provides an API in line with, e.g., os.path.join(), and eliminates isinstance checks.
| * _casbaseddirectory.py: Add fast path for CAS-to-CAS importJürg Billeter2019-03-061-10/+52
|/ | | | | | If the destination directory does not exist yet and there is no filter, we can import the whole source directory by digest instead of importing each directory entry individually.
* Merge branch 'tristan/optional-coverage-fixup' into 'master'bst-marge-bot2019-03-052-4/+9
|\ | | | | | | | | Fixes for coverage optionality See merge request BuildStream/buildstream!1206
| * tests/testutils/artifactshare.py: Support optional coverageTristan Van Berkom2019-03-051-2/+7
| | | | | | | | | | | | | | This scaffolding needs to manually tell coverage to cleanup when sigterm happens in the process in order to collect the coverage report, but we need to do this conditionally in case we are running tests without coverage support.
| * requirements/Makefile: Do not depend on the "force" packageTristan Van Berkom2019-03-051-2/+2
|/ | | | Chandan, you silly pony.
* Merge branch 'chandan/always-regen-requirements' into 'master'bst-marge-bot2019-03-041-2/+4
|\ | | | | | | | | requirements/Makefile: Always rebuild requirements files See merge request BuildStream/buildstream!1204
| * requirements/Makefile: Always rebuild requirements filesChandan Singh2019-03-041-2/+4
|/ | | | | | | We always want to update all the requirements files together such that the versions of the common dependencies do not drift between them. Do so by adding a dummy phony target `FORCE` and depend on it from all the `.txt` targets.
* Merge branch 'tristan/optional-coverage' into 'master'bst-marge-bot2019-03-047-22/+43
|\ | | | | | | | | | | | | Make coverage optional Closes #916 See merge request BuildStream/buildstream!1189
| * .gitlab-ci.yml: Use recent toxTristan Van Berkom2019-03-041-2/+2
| | | | | | | | | | | | | | There appears to be multiple versions of tox in the WSL test environment, prepending /root/.local/bin to the PATH while running tests ensures that we are using a recent enough tox to execute the tests.
| * .gitlab-ci.yml: Adding tox --version output to test diagnosticsTristan Van Berkom2019-03-041-0/+2
| | | | | | | | | | This is generally useful to know, since the tox version is not enforced by BuildStream.
| * tox.ini: Support running tests without coverage present at allTristan Van Berkom2019-03-041-7/+13
| | | | | | | | | | | | | | | | | | | | | | This change simply makes it possible to run the tests without coverage and without any coverage related dependencies present in the tox venvs. To run tests without coverage, simply choose the python version and append "-nocover" to the env name, e.g.: tox -e py36-nocover