summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Refactor local source to use the shinny newwillsalmon/simpletestWilliam Salmon2019-03-251-22/+0
|
* Merge branch 'mablanch/629-remote-execution-test' into 'master'Jürg Billeter2019-03-2512-7/+371
|\ | | | | | | | | Add remote execution tests to the CI pipeline See merge request BuildStream/buildstream!1239
| * Generate and publish HTML coverage reportMartin Blanchard2019-03-252-3/+9
| | | | | | | | https://gitlab.com/BuildStream/buildstream/issues/629
| * .gitlab-ci.yml: Add a CI test job for remote executionMartin Blanchard2019-03-253-0/+99
| | | | | | | | https://gitlab.com/BuildStream/buildstream/issues/629
| * tests: Add basic remote-execution tests (autotools)Martin Blanchard2019-03-256-0/+111
| | | | | | | | https://gitlab.com/BuildStream/buildstream/issues/629
| * runcli.py: Add a CLI test fixture for remote-executionMartin Blanchard2019-03-253-2/+135
| | | | | | | | https://gitlab.com/BuildStream/buildstream/issues/629
| * tests: Add a --remote-execution CLI optionsMartin Blanchard2019-03-251-2/+17
|/ | | | | | | | Unlike the --integration option that activates additional tests marked with 'integration', this new --remote-execution option deactivates all the tests except those marked with 'remoteexecution'. https://gitlab.com/BuildStream/buildstream/issues/629
* Merge branch 'raoul/440-source-cache-remotes' into 'master'bst-marge-bot2019-03-2526-78/+956
|\ | | | | | | | | | | | | Remote source cache Closes #440 See merge request BuildStream/buildstream!1214
| * PushQueue -> ArtifactPushQueueRaoul Hidalgo Charman2019-03-253-5/+5
| | | | | | | | | | | | Rename to be consistent with SourcePushQueue Part of #440
| * tests: check source push for workspaced elementsRaoul Hidalgo Charman2019-03-251-0/+40
| | | | | | | | | | | | | | Workspaced elements should not push their sources as consistency is marked as cached even if the sources are not necessarily available. Part of #440
| * tests: check sources are pushed even if build failsRaoul Hidalgo Charman2019-03-254-0/+100
| | | | | | | | | | | | | | Adds a plugin build element that always fails. The test tries to build an element of this kind. Part of #440
| * tests: source and artifact cache testRaoul Hidalgo Charman2019-03-251-0/+91
| | | | | | | | | | | | Ensures that remote source cache and artifact caches work fine together. Part of #440
| * using_config.rst: Add source cache documentationRaoul Hidalgo Charman2019-03-251-0/+46
| | | | | | | | Part of #440
| * format_project.rst: Add source cache documentationRaoul Hidalgo Charman2019-03-251-0/+27
| | | | | | | | Part of #440
| * tests: Add source cache push failure testRaoul Hidalgo Charman2019-03-251-0/+42
| | | | | | | | Part of #440
| * tests: Add source cache pull after a push testRaoul Hidalgo Charman2019-03-251-0/+45
| | | | | | | | Part of #440
| * tests: Add source cache push testRaoul Hidalgo Charman2019-03-251-0/+96
| | | | | | | | Part of #440
| * _stream.py: Schedule source push queueRaoul Hidalgo Charman2019-03-251-1/+7
| | | | | | | | Part of #440
| * sourcepushqueue.py: Add queue for pushing sourcesRaoul Hidalgo Charman2019-03-256-6/+49
| | | | | | | | | | | | | | Updates other queues and widget to have consistent naming and display, and tests have been updated to reflect this. Part of #440
| * element.py: Add source push methods to ElementRaoul Hidalgo Charman2019-03-251-0/+19
| | | | | | | | Part of #440
| * _sourcecache.py: Add push methodRaoul Hidalgo Charman2019-03-252-1/+36
| | | | | | | | Part of #440
| * tests: Add source cache fetch failure testRaoul Hidalgo Charman2019-03-251-0/+52
| | | | | | | | Part of #440
| * tests: Add source cache test for fallbackRaoul Hidalgo Charman2019-03-251-0/+59
| | | | | | | | | | | | | | Checks buildstream calls fetch method when remote source cache does not have a source. Part of #440
| * tests: Add source cache fetch testRaoul Hidalgo Charman2019-03-251-0/+111
| | | | | | | | Part of #440
| * element.py: Pull from sourcecache in _fetch()Raoul Hidalgo Charman2019-03-252-9/+17
| | | | | | | | Part of #440
| * element.py: Add source cache as variableRaoul Hidalgo Charman2019-03-251-2/+2
| | | | | | | | Part of #440
| * _sourcecache.py: Add pull methodRaoul Hidalgo Charman2019-03-252-2/+35
| | | | | | | | Part of #440
| * source.py: add _get_brief_display_key methodRaoul Hidalgo Charman2019-03-251-0/+7
| |
| * _stream.py: Add source cache initialisation.Raoul Hidalgo Charman2019-03-252-6/+24
| | | | | | | | | | | | Adds option to set remote for source fetch command. Part of #440
| * _stream.py: Fix doc type mismatchRaoul Hidalgo Charman2019-03-251-1/+1
| |
| * _basecache.py: Moves has remote methodsRaoul Hidalgo Charman2019-03-255-47/+47
|/ | | | | | | Move both `has_push_remotes` and `has_fetch_remotes` from `ArtifactCache`. Part of #440
* Merge branch 'bschubert/fix-double-lookup' into 'master'bst-marge-bot2019-03-251-2/+5
|\ | | | | | | | | plugin.py: Don't make a double lookup in the plugin table to get one See merge request BuildStream/buildstream!1253
| * plugin.py: Don't make a double lookup in the plugin table to get oneBenjamin Schubert2019-03-251-2/+5
|/ | | | | This removes a double lookup done in the Plugin.__TABLE, which should speedup every invocation of this method.
* Merge branch 'juerg/partial-cas' into 'master'bst-marge-bot2019-03-2510-36/+217
|\ | | | | | | | | Initial support for partial local CAS See merge request BuildStream/buildstream!1225
| * _stream.py: Check whether logs are cached in artifact_log()Jürg Billeter2019-03-251-0/+3
| |
| * element.py: Add _cached_logs() methodJürg Billeter2019-03-251-0/+11
| |
| * _artifact.py: Add cached_logs() methodJürg Billeter2019-03-251-0/+20
| |
| * cascache.py: Do not silently ignore missing directories in checkout()Jürg Billeter2019-03-252-6/+6
| | | | | | | | | | | | Outside tests, CASCache.checkout() is used only in CasBasedDirectory.export() and we don't want to silently ignore missing directories when exporting files.
| * tests/frontend/pull.py: Add test for pull completing partial artifactsJürg Billeter2019-03-251-0/+31
| |
| * _artifact.py: Expand cached() to check artifact contentsJürg Billeter2019-03-251-2/+28
| | | | | | | | | | Check whether artifact contents are available instead of only checking the artifact ref. This is in preparation for partial CAS support.
| * _artifactcache.py: Add with_files parameter to contains_subdir_artifactJürg Billeter2019-03-251-2/+3
| |
| * cascache.py: Add with_files parameter to contains_subdir_artifact()Jürg Billeter2019-03-251-5/+4
| |
| * cascache.py: Add contains_directory() methodJürg Billeter2019-03-251-0/+32
| |
| * cascache.py: Drop _fetch_subdir()Jürg Billeter2019-03-251-10/+2
| | | | | | | | | | | | With partial CAS support, we can no longer assume that all files in a directory are in the local cache. Always use _fetch_directory() in pull() to ensure we fetch all blobs that may be missing.
| * _frontend/cli.py: Do not require artifact file contents for `bst show`Jürg Billeter2019-03-251-0/+3
| |
| * _context.py: Add require_artifact_directories variableJürg Billeter2019-03-251-0/+13
| |
| * _context.py: Add require_artifact_files variableJürg Billeter2019-03-251-0/+12
| | | | | | | | | | | | | | | | This variable indicates whether file contents are required to be in the local cache for an artifact to be considered cached. This will allow partial artifacts for remote execution and certain commands such as `bst show`.
| * _artifactcache.py: Raise ArtifactError in get_artifact_directory()Jürg Billeter2019-03-251-3/+7
| |
| * _casbaseddirectory.py: Add _get_child_digest() methodJürg Billeter2019-03-251-0/+14
| |
| * _casbaseddirectory.py: Catch FileNotFoundError in _populate_index()Jürg Billeter2019-03-251-3/+6
| | | | | | | | This is in preparation for partial CAS support.