summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* .gitlab-ci.yml: Use latest fdsdk patches and bst-plugins-experimentaljjardon/overnigth_bst2Javier Jardón2019-10-041-2/+2
| | | | | | This will not fix the CI but at least we can see what is the actual error when trying to build (Rigth now It doesn't build at all because the format version is not compatible)
* Merge branch 'bschubert/ensure-buildbox-alive' into 'master'bst-marge-bot2019-10-022-17/+116
|\ | | | | | | | | Report when Buildbox-casd is not alive at the end of a run See merge request BuildStream/buildstream!1605
| * cascache.py: Send message in case of unclean termination of buildbox-casdBenjamin Schubert2019-10-022-2/+90
| | | | | | | | | | | | | | This adds messages in the various mis-termination of Buildbox-casd, to notify users that something might have gone wrong there. It also adds a few tests to validate the various behaviors.
| * cascache.py: Extract buildbox-casd termination in its own methodBenjamin Schubert2019-10-021-17/+28
|/
* Merge branch 'tlater/fix-casdless-completion' into 'master'bst-marge-bot2019-10-022-3/+9
|\ | | | | | | | | | | | | Do not check for casd in bash completion Closes #1149 See merge request BuildStream/buildstream!1615
| * Do not check for casd in bash completionTristan Maat2019-10-022-3/+9
|/ | | | | | | | | This caused stacktraces when a user didn't have buildbox-casd installed, even though it wasn't required for completion, even for artifacts. It does add a slightly ugly parameter to Context, long-term it might make sense to create a special slimmed-down context for completion.
* Merge branch 'juerg/capture-tree' into 'master'bst-marge-bot2019-10-023-73/+65
|\ | | | | | | | | | | | | Use buildbox-casd CaptureTree() to import directories Closes #1132 See merge request BuildStream/buildstream!1611
| * _casbaseddirectory.py: Use CASCache.import_directory()juerg/capture-treeJürg Billeter2019-10-021-56/+13
| |
| * cascache.py: Add import_directory() methodJürg Billeter2019-10-021-0/+35
| | | | | | | | | | This allows import of a whole directory tree with a single gRPC call to buildbox-casd CaptureTree() instead of importing files one at a time.
| * .gitlab-ci.yml: Update docker images for buildbox-casdJürg Billeter2019-10-021-17/+17
|/
* Merge branch 'chandan/fixup-news' into 'master'bst-marge-bot2019-10-011-3/+8
|\ | | | | | | | | NEWS: Minor fixups See merge request BuildStream/buildstream!1614
| * NEWS: add section for unreleased itemschandan/fixup-newsChandan Singh2019-10-011-0/+5
| | | | | | | | Add a placeholder section to hold newsworthy items for the next release.
| * NEWS: Fix current snapshot versionChandan Singh2019-10-011-3/+3
|/ | | | | Since we decided to release the snapshot version '1.91.0', this patch updates the version information in the NEWS entry accordingly.
* Merge branch 'tpollard/duplicated_messagelines' into 'master'bst-marge-bot2019-09-251-1/+0
|\ | | | | | | | | _context.py: Remove duplicated log_message_lines assign See merge request BuildStream/buildstream!1610
| * _context.py: Remove duplicated log_message_lines assignTom Pollard2019-09-251-1/+0
|/
* Merge branch 'traveltissues/985' into 'master'bst-marge-bot2019-09-2438-113/+271
|\ | | | | | | | | | | | | workspaces via sourcecache 1 Closes #1088 See merge request BuildStream/buildstream!1563
| * tests: Remove xfails from buildbox integration testsDarius Makovsky2019-09-242-6/+0
| | | | | | | | Workspace changes are now detectable when using BuildBox as the sandbox
| * tests: Remove xfails from buildbox integration testsDarius Makovsky2019-09-242-2/+0
| | | | | | | | | | Opening and building workspaces when buildbox is the sandbox is now supported.
| * import.py: assemble the element via `stage_sources`Darius Makovsky2019-09-241-2/+1
| |
| * loader.py: Remove workspace handling in element collectionDarius Makovsky2019-09-241-5/+1
| |
| * Remove workspace mounting for sandboxesDarius Makovsky2019-09-245-41/+14
| | | | | | | | | | | | | | | | Workspaces will be handled via the workspace source plugin methods. This does not currently support reflecting build artifacts in the open workspace. tests: Mark incremental workspace builds as xfail (strict)
| * element.py: always check sources for cachingDarius Makovsky2019-09-2430-46/+52
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Check that sources are cached even if they are workspaced and do not reset workspace cache data partially reverts !1470 closes #1088 element.py: remove workspaces in cache key calc Using the workspace source plugin, workspaces should now be handled like sources for the purpose of calculating element cache keys. partially reverts !1470 works towards #1073 Since the source keys are now calculated using the unique keys of the workspace source, this change will break external tracking for open workspaces. In future attempting to track an open workspace might raise a SourceError. The test is rewritten to close the workspace before tracking.
| * Support loading 'workspace'-kind sourcesDarius Makovsky2019-09-242-7/+43
| | | | | | | | | | Add the workspace-kind source to the sources manually to prevent a user incorrectly loading the source plugin.
| * workspace.py: add workspace source pluginDarius Makovsky2019-09-241-0/+150
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The `workspace.init_workspace()` call should wrap `source._init_workspace` for held sources to support those sources not publishing `BST_VIRTUAL_DIRECTORY` This object owns a directory digest attribute used inplace of the source ref. `track` and `fetch` become noop methods and the workspace is imported into the CAS in the call to `get_unique_key` which also sets the digest attribute and owns that Directory object. The directory is referenced during stage to import directly to the virtual directory object. Importing is expected to be expensive and will be optimised in future. When the unique key is retrieved for the workspace source it will also be commited to the sourcecache. The logic for this source is still a slight variant on other sources since it cannot itself be expected to be in the cache when it's opened. In the source preflight method the preflights of the held sources must be called.
| * cascache.py: Create `CASCache.close_channel()`Darius Makovsky2019-09-241-5/+11
|/
* Merge branch 'coldtom/mark-filter-test-integration' into 'master'bst-marge-bot2019-09-242-0/+6
|\ | | | | | | | | tests: Add some missing integration marks See merge request BuildStream/buildstream!1609
| * tests: Add some missing integration markscoldtom/mark-filter-test-integrationThomas Coldrick2019-09-232-0/+6
|/
* Merge branch 'juerg/casd' into 'master'bst-marge-bot2019-09-196-135/+117
|\ | | | | | | | | Do not directly communicate with CAS server See merge request BuildStream/buildstream!1601
| * _remote.py: Remove unused bytestreamJürg Billeter2019-09-191-5/+0
| |
| * casremote.py: Add missing copyright headerJürg Billeter2019-09-191-0/+17
| |
| * casremote.py: Do not directly communicate with CAS serverJürg Billeter2019-09-191-68/+0
| | | | | | | | | | | | | | | | All communication with CAS servers should be proxied through buildbox-casd to allow connection sharing among job subprocesses. It is no longer needed to query the server capabilities as buildbox-casd already does that, so we can simply remove the code from BuildStream.
| * cascache.py: Use casd in remote_missing_blobs()Jürg Billeter2019-09-191-2/+11
| | | | | | | | Remote CAS servers should not be contacted directly.
| * cascache.py: Create CAS stub for buildbox-casd channelJürg Billeter2019-09-191-2/+21
| |
| * .gitlab-ci.yml: Update docker images for buildbox-casdJürg Billeter2019-09-191-17/+17
| |
| * casremote.py: Drop Status requestJürg Billeter2019-09-191-18/+0
| | | | | | | | | | The push status check is implemented by BuildStream artifact and source services. It's not part of the CAS protocol.
| * _sourcecache.py: Move capabilities check to _check() and extend itJürg Billeter2019-09-191-10/+22
| | | | | | | | | | | | | | It's sufficient to check the capabilities once per bst session. This avoids the extra round trip in remote.init(). This also adds a check for allow_updates for push remotes.
| * _artifactcache.py: Move capabilities check to _check() and extend itJürg Billeter2019-09-191-9/+21
| | | | | | | | | | | | | | It's sufficient to check the capabilities once per bst session. This avoids the extra round trip in remote.init(). This also adds a check for allow_updates for push remotes.
| * _artifactcache.py: Create ArtifactServiceStub in _configure_protocols()Jürg Billeter2019-09-191-7/+11
|/ | | | | There is no need to create a new stub for every request. This also matches what SourceRemote does.
* Merge branch 'juerg/artifactshare' into 'master'1.91.0bst-marge-bot2019-09-171-0/+6
|\ | | | | | | | | tests/testutils/artifactshare.py: Add SIGTERM handler to subprocess See merge request BuildStream/buildstream!1606
| * tests/testutils/artifactshare.py: Add SIGTERM handler to subprocessjuerg/artifactshareJürg Billeter2019-09-161-0/+6
|/ | | | | | | | pytest-cov 2.7 calls os._exit() in its SIGTERM handler, skipping cleanup, unless another SIGTERM handler was already registered. Add our own SIGTERM handler to the subprocess to ensure proper cleanup such as terminating buildbox-casd.
* Merge branch 'jennis/frontend_documentation' into 'master'bst-marge-bot2019-09-163-0/+99
|\ | | | | | | | | Add UI section in CONTRIBUTING See merge request BuildStream/buildstream!1584
| * CONTRIBUTING.rst: Add UI sectionJames Ennis2019-09-162-0/+79
| | | | | | | | | | | | Now that the frontend has been mostly reworked/standardized, this patch attempts to put our some guidelines/information in around UI contributions.
| * using_commands.rst: Add internal X-referencesJames Ennis2019-09-161-0/+6
| | | | | | | | | | This patch adds internal cross references for the artifact and source commands.
| * using_commands.rst: Add show and list-contentsJames Ennis2019-09-161-0/+14
|/ | | | | This patch ensures that we document the recently introduced artifact subcommands "show" and "list-contents".
* Merge branch 'coldtom/filter-element-improvements' into 'master'bst-marge-bot2019-09-1613-1/+158
|\ | | | | | | | | | | | | plugins/elements/filter.py: Allow passing integration commands through, fail if dep is a stack element Closes #1107 and #1104 See merge request BuildStream/buildstream!1593
| * tests/integration: Add test for filter elementcoldtom/filter-element-improvementsThomas Coldrick2019-09-164-4/+73
| | | | | | | | | | Adds an integration test to check the `pass-integration` option for filter elements works.
| * element.py: Abstract not producing artifactsThomas Coldrick2019-09-164-6/+16
| | | | | | | | | | | | | | | | Currently the stack element does not produce an artifact, and sometimes has to be treated differently because of this. It is conceivable that someone will write a plugin that must be treated similarly and doesn't produce an artifact. As a result this commit abstracts this "not producing an artifact" feature of elements.
| * filter.py: Fail if parent element is a stackThomas Coldrick2019-09-164-0/+22
| | | | | | | | | | | | | | | | | | | | | | As stack elements do not provide any artifacts, it is misleading to allow them as dependencies for filter elements. This commit makes a dependency on a stack element a failure with a descriptive error message. Additionally adds a test to make sure this works. Addresses #1104
| * filter.py: Allow passing integration commandsThomas Coldrick2019-09-166-1/+57
|/ | | | | | | | | | | | | It is tedious to manually copy the integration commands of the parent element into a filter element, so this allows it to be done automatically. Here we modify FilterElement.integrate() to allow us to pass through the parent's integration commands, iff an option is set. Also adds a test for the new feature, but this is not as comprehensive as would be idea, as getting to the integration commands which are run is a little more difficult. Addresses #1107
* Merge branch 'jennis/split_contributing' into 'master'bst-marge-bot2019-09-1311-1879/+1915
|\ | | | | | | | | | | | | Split up CONTRIBUTING Closes #1116 See merge request BuildStream/buildstream!1604