| Commit message (Collapse) | Author | Age | Files | Lines |
| |
|
|
|
|
|
|
|
|
|
| |
With the previous attempt, storing files in the cache worked OK but
restoring from the cache did not. The symlink workaround wasn't enough
as the symlink gets created /after/ the cache is restored.
Now the whole /builds tree is on a separate Docker volume, so we should
be able to really store the cache inside the build directory.
|
|
|
|
|
|
|
|
|
|
| |
It turns out that downloaded sources have never been shared between
builds. Each container running a build has a `/cache` volume, but
a new volume is created for each container so nothing is shared.
We listed certain paths inside `/cache` to be saved by GitLab CI
between runs using the "distributed runners cache" feature, but
because the paths were outside the build directory it would just ignore
them.
|
|
|
|
|
| |
These are still needed, but are set correctly in the Docker image now so
we don't need to repeat them here.
|
|
|
|
| |
This should give a massive performance improvement.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This is possible since this change: https://gitlab.com/BuildStream/buildstream/commit/00e08459c4
Older versions of BuildStream will fail to parse the project.conf file
with this change; I think it's acceptable to force everyone to update
as we are still in the development stage of the BuildStream migration.
If you want to override the configuration for whatever reason you'll
now need to put this in your ~/.config/buildstream.conf file:
projects:
baserock:
artifacts:
pull-url: ...
push-url: ...
If you set a "global" artifacts configuration by doing this...
artifacts:
pull-url: ...
... it'll be ignored because the project-specific config from this
project.conf file will take precedence.
Overriding seems to be done for the whole config block, so if you
only set push-url in your buildstream.conf file it will be interpreted
to mean "set push-url, and unset pull-url" rather than "set push-url
and use the existing value of pull-url."
|
|
|
|
|
|
|
|
|
|
|
| |
In order to bypass:
Cloning repository...
Cloning into '/builds/gitlab/omnibus-gitlab'...
error: RPC failed; curl 56 SSL read: error:00000000:lib(0):func(0):reason(0), errno 104
fatal: The remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed
|
|
|
|
|
| |
We don't want to error out here, otherwise builds will only pass on
protected branches.
|
|
|
|
|
|
|
|
|
|
|
| |
We shouldn't download artifacts to the CI workers every time somebody
pushes just to throw them away again. This should speed up no-op builds.
The functionality is implemented in two shell scripts. Context is here:
https://gitlab.com/BuildStream/buildstream/issues/77
It would be possible to do this with a single script, but I wanted to
avoid doing any argument parsing code in shell.
|
|
|
|
|
|
| |
This is a Fedora 26 image which has BuildStream's dependencies
pre-installed, which saves us waiting to `dnf install` everything
at the start of every CI job.
|
| |
|
| |
|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
This is how a runner looks like:
$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/docker-252:1-262208-36eaa91b86966a7afa39fbdbe717bdec58bc10efc52e09accd3e8e9ee4038658 10G 144M 9.9G 2% /
tmpfs 3.9G 0 3.9G 0% /dev
tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup
/dev/vda1 79G 1.2G 75G 2% /cache
shm 64M 0 64M 0% /dev/shm
|
|
|
|
|
| |
This way we can offer an up-to-date rootfs of a build system
that can be used in a chroot to build another systems
|
|
|
|
|
|
| |
python:2.7-slim install python in /usr/local/bin instead /usr/bin,
which is making deployment extensions to fail as they expect python
to be in /usr/bin/python
|
| |
|
|
|
|
| |
Branches that follow the pattern "staging/fromybd/$1" will `git checkout ybd -b $1`
|
|
|
|
|
| |
So we have more runners available if we have serveral users using
the ci system
|
| |
|
|
|
|
|
|
| |
And remove the build of openstack.
Change-Id: I62d028000ce4e446d1722fd486bf192dbc724265
|
|
|
|
|
|
|
| |
To avoid this error:
Could not open requirements file: [Errno 2] No such file or directory: 'requirements.txt'
Change-Id: I2edbf766ac161d34773a55b5591be03db0945409
|
|
|
|
|
|
| |
system
Change-Id: Idcbb01f93eaaafe6658baf37ecab86a817814abd
|
|
|
|
| |
Change-Id: I95008108fd9e8aa6c9d3157fc748e6edc00c3802
|
|
|
|
|
|
| |
systems/weston-qt5-system-x86_64.morph
Change-Id: I2792d794d6fb9148d256d0e4db696a27750d4644
|
|
|
|
|
|
|
| |
This is the build log failing to clone glibc:
https://gitlab.com/baserock/definitions/builds/5601838
Change-Id: I3ecdee9a77ad90488bc741c60ae49d610dbb8014
|
|
|
|
|
|
|
| |
Until we know why It is failing:
https://gitlab.com/baserock/definitions/builds/5576416
Change-Id: Ib2f00d340677899e934c32d2943f0ee22624284c
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
branches
In this way, individual developers can test specific system changing
the .gitlab-co.yml file in their own branches without the need of
building the whole set of system
Everything should be built when sending a branch for merge (in a staging/ branch)
and in when it gets actually merged (master)
Change-Id: I94a60daa05b768be72eb0bc69070694939638dab
|
|
|
|
| |
Change-Id: Ice1d5513a44667ec314ed0fcb7a583b4bbfdfd98
|
|
|
|
| |
Change-Id: Ifda0f9615b9c876d93691fb08d6715eea65e4e58
|
|
|
|
| |
Change-Id: Ibd3cfb1728423f6b7c5e96d08bf7f7073d5d56d8
|
|
|
|
|
|
| |
This reverts commit fc72e0f9ec501e986839dbb0bf10dff0675e6604.
Change-Id: I1a47c123ed26a5503bce9b60024aed796821029d
|
|
|
|
| |
Change-Id: I7229e8e4b91feff9e14927c8b508be636c657fa2
|
|
|
|
| |
Change-Id: I7acae4cdb9f56d7ef6d30e82018bfe3c16785500
|
|
|
|
| |
Change-Id: If2f3d130d713b72d67a0437450bec76a83f48e20
|
|
|
|
|
|
| |
ybd is not python3 yet
Change-Id: I94e1cb24324a89a5928f92df0bbbb990ee74ade7
|
|
|
|
| |
Change-Id: Ida60053a112c349fe678f5a42134962c60698e80
|
|
|
|
| |
Change-Id: I8718a0d814eaca10f88a46502b7a35c64c7940f3
|
|
|
|
| |
Change-Id: Iab0b351035ec24da207230f32cb0e1bc87fff0ca
|
|
|
|
| |
Change-Id: I5ee6b99a93fc933fc873076c81a038a8c0adcfa1
|
|
|
|
| |
Change-Id: I54f761e0f03e0266c8a742e4ac1ce4fbe588e8c6
|
|
|
|
|
|
| |
This is ybd issue https://gitlab.com/baserock/ybd/issues/241
Change-Id: If4a3795d9eb8bfbf53a9af0082fb638b426b59c6
|
|
|
|
| |
Change-Id: Ie3b42b0d19d7b1c788e1a5b068bd26711c44741e
|
|
|
|
| |
Change-Id: I7efbc571b655e345dd5c51440e51d77d61a5a2a8
|
|
|
|
| |
Change-Id: I4b5a636a7a517fd61551133aa167068642364f64
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This fix Python encoding errors like:
16-07-22 02:09:00 [43/290/290] [ca-certificates] ERROR: surprise exception in sandbox
Traceback (most recent call last):
File "/builds/baserock/definitions/ybd/ybd/sandbox.py", line 59, in setup
yield
File "/builds/baserock/definitions/ybd/ybd/assembly.py", line 74, in compose
build(dn) # bring in 'build-depends', and run make
File "/builds/baserock/definitions/ybd/ybd/assembly.py", line 154, in build
write_metadata(dn)
File "/builds/baserock/definitions/ybd/ybd/splitting.py", line 184, in write_metadata
write_chunk_metafile(dn)
File "/builds/baserock/definitions/ybd/ybd/splitting.py", line 206, in write_chunk_metafile
for path in files:
File "/usr/local/lib/python2.7/dist-packages/fs/base.py", line 1068, in walkfiles
for path, files in self.walk(normpath(path), wildcard=wildcard, dir_wildcard=dir_wildcard, search=search, ignore_errors=ignore_errors):
File "/usr/local/lib/python2.7/dist-packages/fs/base.py", line 1037, in walk
for p in recurse(path):
File "/usr/local/lib/python2.7/dist-packages/fs/base.py", line 1030, in recurse
for p in recurse(path):
File "/usr/local/lib/python2.7/dist-packages/fs/base.py", line 1030, in recurse
for p in recurse(path):
File "/usr/local/lib/python2.7/dist-packages/fs/base.py", line 1030, in recurse
for p in recurse(path):
File "/usr/local/lib/python2.7/dist-packages/fs/base.py", line 1029, in recurse
for path in listdir(recurse_path, wildcard=dir_wildcard, full=True, dirs_only=True):
File "/usr/local/lib/python2.7/dist-packages/fs/base.py", line 987, in listdir
return self.listdir(path, *args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/fs/errors.py", line 257, in wrapper
return func(self,*args,**kwds)
File "/usr/local/lib/python2.7/dist-packages/fs/osfs/__init__.py", line 268, in listdir
return self._listdir_helper(path, paths, wildcard, full, absolute, dirs_only, files_only)
File "/usr/local/lib/python2.7/dist-packages/fs/base.py", line 570, in _listdir_helper
entries = [p for p in entries if isdir(pathcombine(path, p))]
File "/usr/local/lib/python2.7/dist-packages/fs/errors.py", line 257, in wrapper
return func(self,*args,**kwds)
File "/usr/local/lib/python2.7/dist-packages/fs/osfs/__init__.py", line 254, in isdir
return _isdir(self.getsyspath(path))
File "/usr/lib/python2.7/genericpath.py", line 41, in isdir
st = os.stat(s)
UnicodeEncodeError: 'ascii' codec can't encode character u'\u011f' in position 113: ordinal not in range(128)
Change-Id: I4bb449753c8edda6275de36e000888ad734993c5
|
|
|
|
| |
Change-Id: I718cd939c8ad3914e82747caf6498ddd2643c3ee
|
|
|
|
|
|
| |
clusters/minimal-system-deploy.morph is for x86_32
Change-Id: I48d3e05464e0f19657bee2929683521c46e750cc
|
|
This will not affect the current ci system in baserock, but it will
allow to provide ci/cd for _free_ through the mirror of definitions
I have in gitlab.com
As an example, take a look to the pipelines generated here:
https://gitlab.com/baserock/definitions/pipelines
Change-Id: I3a23ef9e828c6c4bf625145b6f6f8d180b22ca3c
|