summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Use {restart_tx, false} option in view index builder changes feeduse-transactional-changes-in-indexer-feedNick Vatamaniuc2020-02-151-1/+2
| | | | | Index builder performs writes in the same transaction as the changes feed so we can't use iterators as they disable writes.
* Implement mult-transactional iterators for _changes feedsNick Vatamaniuc2020-02-145-70/+364
| | | | | | | | | | | | | | | | | | Previously changes feeds would fail if they streamed data for more than five seconds. This was because of the FoundationDB's transaction time limit. After the timeout fired, an 1007 (transaction_too_long) error was raised, and transaction was retried. The emitted changes feed would often crash or simple hang because the HTTP state would be garbled as response data was re-sent over the same socket stream again. To fix the issue introduce a new `{restart_tx, true}` option for `fold_range/4`. This option sets up a new transaction to continue iterating over the range from where the last one left off. To avoid data being resent in the response stream, user callback functions must first read all the data they plan on sending during that callback, send it out, and then after that it must not do any more db reads so as not to trigger a `transaction_too_old` error.
* Support `GET /_dbs_info` endpointPaul J. Davis2020-02-131-1/+48
| | | | | Previously only `POST` with a list of keys was supported. The new `GET` support just dumps all database info blobs in a single ordered response.
* Implement `fabric2_db:list_dbs_info/1,2,3`Paul J. Davis2020-02-133-16/+126
| | | | | | This API allows for listing all database info blobs in a single request. It accepts the same parameters as `_all_dbs` for controlling pagination of results and so on.
* Implement async API for `fabric2_fdb:get_info/1`Paul J. Davis2020-02-131-0/+9
|
* Track a database level view size rollupPaul J. Davis2020-02-132-20/+33
| | | | | This way we can expose the total view size for a database in the dbinfo JSON blob.
* Fix doc attachment testsPaul J. Davis2020-02-131-2/+2
| | | | Attachment names should be binaries
* Encode startkey/endkey for all_docs (#2538)garren smith2020-02-133-16/+60
| | | | | | | * Encode startkey/endkey for all_docs Encodes the startkey/endkey so that if a startkey is not binary it will return the expected results.
* Merge pull request #2519 from cloudant/fix-b3-headeriilyak2020-02-046-112/+121
|\ | | | | Fix b3 header
| * Add basic test case for b3 fixILYA Khlopotov2020-02-042-0/+103
| |
| * fix b3 - Headers suppose to be stringsILYA Khlopotov2020-02-041-1/+1
| |
| * Support setting base_url in Couch test helperILYA Khlopotov2020-02-041-7/+14
| |
| * Update httpotion to 3.1.3ILYA Khlopotov2020-02-043-104/+3
|/ | | | | | | | There were couple of hacks in test/elixir/lib/couch.ex We've got changes needed to remove them into httpotion 3.1.3. The changes were introduced in: - https://github.com/myfreeweb/httpotion/pull/118 - https://github.com/myfreeweb/httpotion/pull/130
* Merge pull request #2494 from cloudant/add-http-reporteriilyak2020-01-304-16/+56
|\ | | | | Add http reporter
| * Support jaeger http reporterILYA Khlopotov2020-01-304-16/+56
|/
* Merge pull request #2503 from apache/reserve-search-namespaceRobert Newson2020-01-291-0/+1
|\ | | | | reserve search namespace
| * reserve search namespacereserve-search-namespaceRobert Newson2020-01-291-0/+1
|/
* Merge pull request #2499 from apache/expiring-cache-cleanupJay Doane2020-01-281-1/+0
|\ | | | | Delete unused ets table creation
| * Delete unused ets table creationexpiring-cache-cleanupJay Doane2020-01-281-1/+0
|/ | | | | | This ets table was a holdover from when couch_expiring_cache was a non- library OTP application. It is unused, and would prevent multiple users of the library in the same project.
* Merge pull request #2495 from apache/prototype/fdb-layer-bump-ioqEric Avdey2020-01-281-1/+1
|\ | | | | Bump ioq to 2.1.3
| * Bump ioq to 2.1.3prototype/fdb-layer-bump-ioqEric Avdey2020-01-281-1/+1
|/
* Change map indexes to be stored in one rowGarren Smith2020-01-223-114/+17
| | | | | Changes map indexes to store the original key and value in a single FDB row.
* Merge pull request #2451 from cloudant/tracing-externaliilyak2020-01-212-5/+10
|\ | | | | Add `external` tag to opentrace events
| * Add `external` tag to opentrace eventsILYA Khlopotov2020-01-142-5/+10
|/ | | | | | | | | | | | | | | | | | | | | | | | | This PR adds an ability to selectively enable opentracing for HTTP requests with X-B3-... headers. This is helpful in following cases: - tracing all requests with X-B3-... headers `all = (#{external := E}) when E == true -> true` - tracing all requests to specific database with X-B3-... headers ``` all = (#{external := E, 'db.name' := Db}) when E == true andalso Db == <<"foo">> -> true ``` - tracing requests to specific endpoint with X-B3-... headers ``` db.design.view.read = (#{external := E, 'design.id' := Name}) when E == true andalso Name == <<"bar">> -> true ``` I want to remind that we support following X-B3-... headers: - X-B3-TraceId - X-B3-SpanId - X-B3-ParentSpanId - B3 which is in the following format <TraceId>-<SpanId>-<1 | 0>-<ParentSpanId>
* Improve transaction name setting when tracing FDB transactionsNick Vatamaniuc2019-12-181-1/+4
| | | | | | | | | Previously the per-request nonce value was set as the transaction name and so in the trace logs multiple transactions ended up having the same `TransactionID` which was pretty confusing. To fix the issue, append a transaction ID to the name. The ID is guaranteed to be unique for the life of the VM node.
* Merge pull request #2331 from cloudant/expiring-cacheJay Doane2019-12-109-0/+507
|\ | | | | Expiring cache
| * Expiring cacheexpiring-cacheJay Doane2019-12-109-0/+507
|/ | | | | | | | | | This is a library for creating an FDB backed key value cache, where each entry has a `stale` and `expires` time associated with it. Once the current time exceeds the `expires` time, the entry is automatically removed. The `stale` time can be used to indicate that a refresh is necessary, while still returning a non-expired value. It is potentially useful for implementing e.g. caches to external systems of record, such as OAuth 2.
* Delete attachments when no longer referencedPaul J. Davis2019-12-105-20/+428
| | | | | | | | | | | | | This fixes attachment handling to properly remove attachment data when it is no longer referenced by the document's revision tree. As implemented this accounts for the possibility that multiple revisions may reference a given attachment id. However, due to how the current revision tree removes revisions aggressively it's not currently possible for multiple leaf revisions to share an underlying attachment. This is because when attempting to use a stub attachment when replicating in a conflict we will encounter the `missing_stub` error because the previous shared revision has already been removed.
* Silence test suite warning message about cryptoPaul J. Davis2019-12-101-0/+4
|
* Normalize fabric2 test suitePaul J. Davis2019-12-0517-209/+214
| | | | | This change ensures that all test names are visible and follows a single unified pattern for each test module.
* Retry for failed indexes buildsGarren Smith2019-12-023-6/+103
| | | | | Retry building a failing index for a set number of retries. If it never completes, then return the error to the user.
* Optimize view read latency when the view readyGarren Smith2019-11-261-20/+26
| | | | | If the view is already built, read the view status and view in the same transaction. This will improve view read latency.
* Change end-point /_up to check fdb connectivityEric Avdey2019-11-222-6/+11
|
* Add operation names for all HTTP endpointsPaul J. Davis2019-11-227-27/+540
| | | | | | This adds operation names to all valid HTTP end points. This covers all of `make elixir` except for seven requests that are testing specific error conditions in URL and Methods for various endpoints.
* Implement node typesNick Vatamaniuc2019-11-216-18/+163
| | | | | | The implementation follows the RFC [1] [1]: https://github.com/apache/couchdb-documentation/blob/master/rfcs/013-node-types.md
* Trace fdb transactionsILYA Khlopotov2019-11-203-11/+39
|
* Trace http endpointsILYA Khlopotov2019-11-204-6/+146
|
* Add ctrace applicationILYA Khlopotov2019-11-2016-9/+1757
|
* Implement fabric2_server:fdb_cluster/0ILYA Khlopotov2019-11-201-12/+23
|
* Support regexp based blacklist in configILYA Khlopotov2019-11-201-16/+19
|
* Check membership when calling get_security/1 in fabric2_dbNick Vatamaniuc2019-11-182-73/+64
| | | | | | | | | | | | | | Previously, membership check was disabled when fetching the security doc. That was not correct, as membership should be checked before every db operation, including when fetching the security doc itself. Also, most of the security tests relied on patching the user context in the `Db` handle then calling `check_*` functions. Those functions however call `get_security/1` before doing the actual check, and in some cases, like when checking for admin, the failure was coming from the membership check in `get_security/1` instead. Also some tests were going through the regular request path of opening a new db by name. In order, make the tests more uniform, switch all the tests to apply the tested `UserCtx` in the open call.
* Assert Db handle field existence in `load_config/1` in fabric2_fdbNick Vatamaniuc2019-11-141-3/+5
| | | | | | Forgot to push this in the previous PR so made a new commit. https://github.com/apache/couchdb/pull/2300#discussion_r346592418
* Update fabric2_fdb's set_config to take un-encoding valuesNick Vatamaniuc2019-11-142-34/+26
| | | | | | | | | | | Previously `set_config/3` needed keys and values to be transalted to binaries, now that is done inside the function. It's a bit more consistent as binary config values and encodings are better encapsulated in the `fabric2_fdb` module. Since `set_config` does, it made sense to update get_config as well. There, it turns out it was used only to load configuration setting after a db open, so the function was renamed to `load_config` and was made private.
* Before starting a db transanction, refresh the db handle from the cacheNick Vatamaniuc2019-11-142-21/+50
| | | | | | | | | Previously, a stale db handle could be re-used across a few separate transactions. That would result in the database getting re-opened before every one of those operations. To prevent that from happening, check the cache before the transaction starts, and if there is a newer version of the db handle and use that.
* Check security properties in the main transactionNick Vatamaniuc2019-11-145-56/+71
| | | | | | | | | | | Previously we checked security properties in a separate transaction, after opening the db or fetching it from the cache. To avoid running an extra transaction move the check inside the main transaction right after the metadata check runs. That ensure it will be consistent and it won't be accidentally missed as all operations run the `ensure_current` metadata check. Also remove the special `get_config/2` function in `fabric2_fdb` for getting revs limit and security properties and just read them directly from the db map.
* Ensure we can create partitioned design docs with FDBNick Vatamaniuc2019-11-042-12/+20
| | | | Users should be able to replicate their partitioned dbs to the new environment.
* Merge pull request #2279 from cloudant/refactor-user-ctx-handlingiilyak2019-10-311-61/+42
|\ | | | | Pass contexts to fabric2_db functions
| * Pass contexts to fabric2_db functionsILYA Khlopotov2019-10-241-61/+42
| | | | | | | | | | | | | | | | | | | | Since the db structure returned from fabric2_db:open and fabric2_db:create includes `user_ctx` there is no need to pass it explicitly in every `fabric2_db` call. This means we can simplify few things: - Don't pass user_ctx in `chttpd_db:db_req/2` since we pass db already - Don't have to use `db_open_options` in `chttpd_changes` - Don't have to pass `user_ctx` to `fabric2_db:open_doc` and `fabric2_db:update_doc`
* | Abandon a view job if the db or ddoc is deletedPaul J. Davis2019-10-301-2/+21
| | | | | | | | | | If we don't explicitly bail out of running the job it will loop indefinitely in the couch_jobs retry logic.
* | Use "\xFF/metadataVersion" key for checking metadataNick Vatamaniuc2019-10-302-15/+3
| | | | | | | | | | | | | | | | Need to use FDB version 6.1+ and erlfdb version that has this commit: https://github.com/cloudant-labs/couchdb-erlfdb/commit/7718a3d7e1994e1384c56d39fae5cad3d8c6c4b3 Since fabric2.hrl is a public include now, use that in couch_jobs to avoid redefining a bunch of things.
View Lorry Controller Status