diff options
author | Tim Burke <tim.burke@gmail.com> | 2020-07-01 21:59:45 -0700 |
---|---|---|
committer | Tim Burke <tim.burke@gmail.com> | 2020-09-30 16:38:11 -0700 |
commit | 5626cd5791bd35279594e067c10581e89ae66abc (patch) | |
tree | dc097ab19dd71e9b4866ed792373d673e900b808 /src | |
parent | fb13b37506088aec05013dc05e7fc0e6aee49f09 (diff) | |
download | liberasurecode-5626cd5791bd35279594e067c10581e89ae66abc.tar.gz |
Be willing to write fragments with legacy crc
...if users *really* want to. They opt-in at run time by setting
LIBERASURECODE_WRITE_LEGACY_CRC=1
in the environment; leaving it unset, set to an empty string, or set to
the string "0" continues to write zlib crcs.
UpgradeImpact
=============
This option is intended to allow a smooth upgrade from liberasurecode
1.5.0 and earlier in a system with multiple readers and writers:
* Before upgrade, ensure the environment variable is set on all nodes.
This will be ignored by earlier versions.
* Upgrade liberasurecode on each node in the system, restarting any
services that use it. Every node continues writing CRCs that are
still usable by nodes that have not yet upgraded.
* Now that every node is capable of reading zlib CRCs, remove the
environment variable from each node to start writing new CRCs.
If you are already using 1.6.0 or later, just upgrade normally.
Closes-Bug: #1886088
Closes-Bug: #1867937
Related-Bug: #1666320
Needed-By: https://review.opendev.org/#/c/739164/
Change-Id: I9adfbe631a2dddc592fd08f8a325f3e8331b92f1
Diffstat (limited to 'src')
-rw-r--r-- | src/erasurecode_helpers.c | 8 | ||||
-rw-r--r-- | src/erasurecode_postprocessing.c | 11 |
2 files changed, 16 insertions, 3 deletions
diff --git a/src/erasurecode_helpers.c b/src/erasurecode_helpers.c index 4be2634..84b114c 100644 --- a/src/erasurecode_helpers.c +++ b/src/erasurecode_helpers.c @@ -463,6 +463,7 @@ inline int set_checksum(ec_checksum_type_t ct, char *buf, int blocksize) { fragment_header_t* header = (fragment_header_t*) buf; char *data = get_data_ptr_from_fragment(buf); + char *flag; assert(NULL != header); if (header->magic != LIBERASURECODE_FRAG_HEADER_MAGIC) { @@ -475,7 +476,12 @@ inline int set_checksum(ec_checksum_type_t ct, char *buf, int blocksize) switch(header->meta.chksum_type) { case CHKSUM_CRC32: - header->meta.chksum[0] = crc32(0, (unsigned char *) data, blocksize); + flag = getenv("LIBERASURECODE_WRITE_LEGACY_CRC"); + if (flag && !(flag[0] == '\0' || (flag[0] == '0' && flag[1] == '\0'))) { + header->meta.chksum[0] = liberasurecode_crc32_alt(0, data, blocksize); + } else { + header->meta.chksum[0] = crc32(0, (unsigned char *) data, blocksize); + } break; case CHKSUM_MD5: break; diff --git a/src/erasurecode_postprocessing.c b/src/erasurecode_postprocessing.c index 07c08f5..f665e60 100644 --- a/src/erasurecode_postprocessing.c +++ b/src/erasurecode_postprocessing.c @@ -32,6 +32,7 @@ #include "erasurecode_helpers_ext.h" #include "erasurecode_log.h" #include "erasurecode_stdinc.h" +#include "alg_sig.h" void add_fragment_metadata(ec_backend_t be, char *fragment, int idx, uint64_t orig_data_size, int blocksize, @@ -59,8 +60,14 @@ void add_fragment_metadata(ec_backend_t be, char *fragment, return; } - header->metadata_chksum = crc32(0, (unsigned char *) &header->meta, - sizeof(fragment_metadata_t)); + char *flag = getenv("LIBERASURECODE_WRITE_LEGACY_CRC"); + if (flag && !(flag[0] == '\0' || (flag[0] == '0' && flag[1] == '\0'))) { + header->metadata_chksum = liberasurecode_crc32_alt( + 0, &header->meta, sizeof(fragment_metadata_t)); + } else { + header->metadata_chksum = crc32(0, (unsigned char *) &header->meta, + sizeof(fragment_metadata_t)); + } } int finalize_fragments_after_encode(ec_backend_t instance, |