delta/buildstream.git, branch valentindavid/cache_server_fill_up

Lock cache cleanup in cas server

2018-11-28T14:29:52+00:00

Cleaning up in parallel might slow down the cleaning process

Cleanup cache in cas server more agressively

2018-11-28T14:29:52+00:00

When there is less than 2GB left, it cleans up have 10GB available.
These values are configurable.

Move cas server from ref-based to object-based garbage collection.

2018-11-28T14:29:52+00:00

Update mtimes of objects for requested references.

2018-11-28T14:29:52+00:00

This also remove references when some objects are missing. This is in
preparation for the move from reference to object garbage collection.

"Fallocate" object disk space to avoid getting NOSPC error when writing

2018-11-28T14:29:52+00:00

This locks the temporary object file so that cleanup does not need to
be done for every write.

Avoid copying temporary file when adding object to CAS in server.

2018-11-28T14:29:52+00:00

The file is already a temporary file and does not need copy.  ENOSPC
is thrown during that copy in issue #609.

Fixes #678.

Fix type error in RPC messages

2018-11-28T14:29:52+00:00

Make cache clients not fail when a blob is not available.

2018-11-28T14:29:52+00:00

We plan to make cache incomplete. That is some blobs are missing.  For
most of cases we will delete references when requested if they are
incomplete. But there will be corner cases where objects are removed
after the reference is requested.

Use f_bavail to query available space. Not f_bfree.

2018-11-28T14:29:52+00:00

f_bfree space might not be usable. In practice we see failures in big
disks because f_bfree is over 2GB and f_bavail is 0. We get ENOSPC if
writing on disk then.

Merge branch 'valentindavid/ruamel_0_15_41' into 'master'

2018-11-28T14:02:32+00:00

setup.py: require ruamel.yaml >= 0.15.41 < 0.15.52

See merge request BuildStream/buildstream!975