summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* cli.py: no fcntl on Windowsaevri/no_win32_fcntlAngelos Evripiotis2019-10-041-8/+21
| | | | | | | | | | | | | Work around the fact that we can't import 'fcntl' on Windows, and confine the workaround to as small a scope as we can. This enables us to run at least these commands on Windows: bst help bst init We can't run any commands that require a Platform object though, which is most commands.
* Merge branch 'aevri/job_sort_imports' into 'master'bst-marge-bot2019-10-041-4/+4
|\ | | | | | | | | _scheduler/jobs/job.py: sort imports See merge request BuildStream/buildstream!1622
| * _scheduler/jobs/job.py: sort importsAngelos Evripiotis2019-10-041-4/+4
|/
* Merge branch 'bschubert/casd-logs' into 'master'bst-marge-bot2019-10-042-3/+83
|\ | | | | | | | | | | | | cascache.py: Save casd logs in a file for retrieval Closes #1156 See merge request BuildStream/buildstream!1616
| * cascache.py: Show path to log file when buildbox-casd doesn't exit normallyBenjamin Schubert2019-10-041-2/+12
| |
| * cascache.py: Save casd logs in a file for retrievalBenjamin Schubert2019-10-042-1/+71
|/ | | | | Save all casd logs in a log file under its cas/ directory, and keep only the last 10 of them.
* Merge branch 'jjardon/overnigth_casd_already' into 'master'bst-marge-bot2019-10-031-3/+0
|\ | | | | | | | | Revert ".gitlab-ci.yml: overnigth tests need buildbox-casd" See merge request BuildStream/buildstream!1619
| * Revert ".gitlab-ci.yml: overnigth tests need buildbox-casd"Javier Jardón2019-10-041-3/+0
|/ | | | | | | The docker image already have this, see commit 23c66d2bd397b84c8905fa16027e0ba163d1b4cd This reverts commit 99b0117a7d5d4b053c91d00f6e7117b007e4f72e.
* Merge branch 'jjardon/overnigth_casd' into 'master'bst-marge-bot2019-10-031-0/+3
|\ | | | | | | | | .gitlab-ci.yml: overnigth tests need buildbox-casd See merge request BuildStream/buildstream!1618
| * .gitlab-ci.yml: overnigth tests need buildbox-casdJavier Jardón2019-10-041-0/+3
|/
* Merge branch 'jjardon/overnigth_bst2' into 'master'bst-marge-bot2019-10-031-2/+2
|\ | | | | | | | | .gitlab-ci.yml: Use latest fdsdk patches and bst-plugins-experimental for overnigth tests See merge request BuildStream/buildstream!1617
| * .gitlab-ci.yml: Use latest fdsdk patches and bst-plugins-experimentalJavier Jardón2019-10-041-2/+2
|/ | | | | | This will not fix the CI but at least we can see what is the actual error when trying to build (Rigth now It doesn't build at all because the format version is not compatible)
* Merge branch 'bschubert/ensure-buildbox-alive' into 'master'bst-marge-bot2019-10-022-17/+116
|\ | | | | | | | | Report when Buildbox-casd is not alive at the end of a run See merge request BuildStream/buildstream!1605
| * cascache.py: Send message in case of unclean termination of buildbox-casdBenjamin Schubert2019-10-022-2/+90
| | | | | | | | | | | | | | This adds messages in the various mis-termination of Buildbox-casd, to notify users that something might have gone wrong there. It also adds a few tests to validate the various behaviors.
| * cascache.py: Extract buildbox-casd termination in its own methodBenjamin Schubert2019-10-021-17/+28
|/
* Merge branch 'tlater/fix-casdless-completion' into 'master'bst-marge-bot2019-10-022-3/+9
|\ | | | | | | | | | | | | Do not check for casd in bash completion Closes #1149 See merge request BuildStream/buildstream!1615
| * Do not check for casd in bash completionTristan Maat2019-10-022-3/+9
|/ | | | | | | | | This caused stacktraces when a user didn't have buildbox-casd installed, even though it wasn't required for completion, even for artifacts. It does add a slightly ugly parameter to Context, long-term it might make sense to create a special slimmed-down context for completion.
* Merge branch 'juerg/capture-tree' into 'master'bst-marge-bot2019-10-023-73/+65
|\ | | | | | | | | | | | | Use buildbox-casd CaptureTree() to import directories Closes #1132 See merge request BuildStream/buildstream!1611
| * _casbaseddirectory.py: Use CASCache.import_directory()juerg/capture-treeJürg Billeter2019-10-021-56/+13
| |
| * cascache.py: Add import_directory() methodJürg Billeter2019-10-021-0/+35
| | | | | | | | | | This allows import of a whole directory tree with a single gRPC call to buildbox-casd CaptureTree() instead of importing files one at a time.
| * .gitlab-ci.yml: Update docker images for buildbox-casdJürg Billeter2019-10-021-17/+17
|/
* Merge branch 'chandan/fixup-news' into 'master'bst-marge-bot2019-10-011-3/+8
|\ | | | | | | | | NEWS: Minor fixups See merge request BuildStream/buildstream!1614
| * NEWS: add section for unreleased itemschandan/fixup-newsChandan Singh2019-10-011-0/+5
| | | | | | | | Add a placeholder section to hold newsworthy items for the next release.
| * NEWS: Fix current snapshot versionChandan Singh2019-10-011-3/+3
|/ | | | | Since we decided to release the snapshot version '1.91.0', this patch updates the version information in the NEWS entry accordingly.
* Merge branch 'tpollard/duplicated_messagelines' into 'master'bst-marge-bot2019-09-251-1/+0
|\ | | | | | | | | _context.py: Remove duplicated log_message_lines assign See merge request BuildStream/buildstream!1610
| * _context.py: Remove duplicated log_message_lines assignTom Pollard2019-09-251-1/+0
|/
* Merge branch 'traveltissues/985' into 'master'bst-marge-bot2019-09-2438-113/+271
|\ | | | | | | | | | | | | workspaces via sourcecache 1 Closes #1088 See merge request BuildStream/buildstream!1563
| * tests: Remove xfails from buildbox integration testsDarius Makovsky2019-09-242-6/+0
| | | | | | | | Workspace changes are now detectable when using BuildBox as the sandbox
| * tests: Remove xfails from buildbox integration testsDarius Makovsky2019-09-242-2/+0
| | | | | | | | | | Opening and building workspaces when buildbox is the sandbox is now supported.
| * import.py: assemble the element via `stage_sources`Darius Makovsky2019-09-241-2/+1
| |
| * loader.py: Remove workspace handling in element collectionDarius Makovsky2019-09-241-5/+1
| |
| * Remove workspace mounting for sandboxesDarius Makovsky2019-09-245-41/+14
| | | | | | | | | | | | | | | | Workspaces will be handled via the workspace source plugin methods. This does not currently support reflecting build artifacts in the open workspace. tests: Mark incremental workspace builds as xfail (strict)
| * element.py: always check sources for cachingDarius Makovsky2019-09-2430-46/+52
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Check that sources are cached even if they are workspaced and do not reset workspace cache data partially reverts !1470 closes #1088 element.py: remove workspaces in cache key calc Using the workspace source plugin, workspaces should now be handled like sources for the purpose of calculating element cache keys. partially reverts !1470 works towards #1073 Since the source keys are now calculated using the unique keys of the workspace source, this change will break external tracking for open workspaces. In future attempting to track an open workspace might raise a SourceError. The test is rewritten to close the workspace before tracking.
| * Support loading 'workspace'-kind sourcesDarius Makovsky2019-09-242-7/+43
| | | | | | | | | | Add the workspace-kind source to the sources manually to prevent a user incorrectly loading the source plugin.
| * workspace.py: add workspace source pluginDarius Makovsky2019-09-241-0/+150
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The `workspace.init_workspace()` call should wrap `source._init_workspace` for held sources to support those sources not publishing `BST_VIRTUAL_DIRECTORY` This object owns a directory digest attribute used inplace of the source ref. `track` and `fetch` become noop methods and the workspace is imported into the CAS in the call to `get_unique_key` which also sets the digest attribute and owns that Directory object. The directory is referenced during stage to import directly to the virtual directory object. Importing is expected to be expensive and will be optimised in future. When the unique key is retrieved for the workspace source it will also be commited to the sourcecache. The logic for this source is still a slight variant on other sources since it cannot itself be expected to be in the cache when it's opened. In the source preflight method the preflights of the held sources must be called.
| * cascache.py: Create `CASCache.close_channel()`Darius Makovsky2019-09-241-5/+11
|/
* Merge branch 'coldtom/mark-filter-test-integration' into 'master'bst-marge-bot2019-09-242-0/+6
|\ | | | | | | | | tests: Add some missing integration marks See merge request BuildStream/buildstream!1609
| * tests: Add some missing integration markscoldtom/mark-filter-test-integrationThomas Coldrick2019-09-232-0/+6
|/
* Merge branch 'juerg/casd' into 'master'bst-marge-bot2019-09-196-135/+117
|\ | | | | | | | | Do not directly communicate with CAS server See merge request BuildStream/buildstream!1601
| * _remote.py: Remove unused bytestreamJürg Billeter2019-09-191-5/+0
| |
| * casremote.py: Add missing copyright headerJürg Billeter2019-09-191-0/+17
| |
| * casremote.py: Do not directly communicate with CAS serverJürg Billeter2019-09-191-68/+0
| | | | | | | | | | | | | | | | All communication with CAS servers should be proxied through buildbox-casd to allow connection sharing among job subprocesses. It is no longer needed to query the server capabilities as buildbox-casd already does that, so we can simply remove the code from BuildStream.
| * cascache.py: Use casd in remote_missing_blobs()Jürg Billeter2019-09-191-2/+11
| | | | | | | | Remote CAS servers should not be contacted directly.
| * cascache.py: Create CAS stub for buildbox-casd channelJürg Billeter2019-09-191-2/+21
| |
| * .gitlab-ci.yml: Update docker images for buildbox-casdJürg Billeter2019-09-191-17/+17
| |
| * casremote.py: Drop Status requestJürg Billeter2019-09-191-18/+0
| | | | | | | | | | The push status check is implemented by BuildStream artifact and source services. It's not part of the CAS protocol.
| * _sourcecache.py: Move capabilities check to _check() and extend itJürg Billeter2019-09-191-10/+22
| | | | | | | | | | | | | | It's sufficient to check the capabilities once per bst session. This avoids the extra round trip in remote.init(). This also adds a check for allow_updates for push remotes.
| * _artifactcache.py: Move capabilities check to _check() and extend itJürg Billeter2019-09-191-9/+21
| | | | | | | | | | | | | | It's sufficient to check the capabilities once per bst session. This avoids the extra round trip in remote.init(). This also adds a check for allow_updates for push remotes.
| * _artifactcache.py: Create ArtifactServiceStub in _configure_protocols()Jürg Billeter2019-09-191-7/+11
|/ | | | | There is no need to create a new stub for every request. This also matches what SourceRemote does.
* Merge branch 'juerg/artifactshare' into 'master'1.91.0bst-marge-bot2019-09-171-0/+6
|\ | | | | | | | | tests/testutils/artifactshare.py: Add SIGTERM handler to subprocess See merge request BuildStream/buildstream!1606