summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* fix race condition (#3150)3.x-re-monitor-compaction-pidTony Sun2020-11-072-1/+10
| | | | | | | | This fixes a94e693f32672e4613bce0d80d0b9660f85275ea because a race condition exisited where the 'DOWN' message could be received before the compactor pid is spawned. Adding a synchronous call to get the compactor pid guarantees that the couch_db_updater process handling of finish_compaction has occurred.
* add remonitor code to DOWN message (#3144)Tony Sun2020-11-071-6/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | Smoosh monitors the compactor pid to determine when the compaction jobs finishes, and uses this for its idea of concurrency. However, this isn't accurate in the case where the compaction job has to re-spawn to catch up on intervening changes since the same logical compaction job continues with another pid and smoosh is not aware. In such cases, a smoosh channel with concurrency one can start arbitrarily many additional database compaction jobs. To solve this problem, we added a check to see if a compaction PID exists for a db in `start_compact`. But wee need to add another check because this check is only for shard that comes off the queue. So the following can still occur: 1. Enqueue a bunch of stuff into channel with concurrency 1 2. Begin highest priority job, Shard1, in channel 3. Compaction finishes, discovers compaction file is behind main file 4. Smoosh-monitored PID for Shard1 exits, a new one starts to finish the job 5. Smoosh receives the 'DOWN' message, begins the next highest priority job, Shard2 6. Channel concurrency is now 2, not 1 This change adds another check into the 'DOWN' message so that it checks for that specific shard. If the compaction PID exists then it means a new process was spawned and we just monitor that one and add it back to the queue. The length of the queue does not change and therefore we won’t spawn new compaction jobs.
* Merge pull request #3249 from apache/changes_filter_all_docs_oom_3.xRobert Newson2020-11-062-1/+68
|\ | | | | Retry filter_docs sequentially if the patch exceeds couchjs stack
| * Add test for splitting filter batchesPaul J. Davis2020-11-061-0/+55
| |
| * Retry filter_docs sequentially if the patch exceeds couchjs stackchanges_filter_all_docs_oom_3.xRobert Newson2020-11-051-1/+13
|/ | | | | | | | | | | | | | A document with lots of conflicts can blow up couchjs if the user calls _changes with a javascript filter and with `style=all_docs` as this option causes up to fetch all the conflicts. All leaf revisions of the document are then passed in a single call to ddoc_prompt, which can fail if there's a lot of them. In that event, we simply try them sequentially and assemble the response from each call. Should be backported to 3.x
* Jenkins: do not alwaysPull true (#3233)Joan Touzet2020-10-292-14/+0
|
* Fix apache/couchdb#1988 - Validate attachment namesJuanjo Rodriguez2020-10-222-0/+16
|
* Fix boolean POST to view-like endpointsBessenyei Balázs Donát2020-10-133-4/+34
|
* Properly combine base and extra headers when making replicator requestsNick Vatamaniuc2020-10-121-2/+26
| | | | | | | | | | | | Previously we subtly relied on one set of headers being sorted, then sorted the other set of headers, and ran `lists:ukeymerge/3`. That function, however, needs both arguments to be sorted in order for it to work as expected. If one argument wasn't sorted we could get duplicate headers easily, which is what was observed in testing. A better fix than just sorting both sets of keys, is to use an actual header processing library to combine them so we can account for case insensitivity as well.
* minor INSTALL.Unix.md patches (#2536) (#3207)Joan Touzet2020-10-091-20/+22
|
* Remove JS tests + support for harness (#3197) (#3203)Joan Touzet2020-10-07141-18463/+30
|
* Remove javascript tests from main build processJuanjo Rodriguez2020-10-072-2/+0
|
* port users_db_security tests to elixirJuanjo Rodriguez2020-10-074-7/+540
|
* simplify max_document_size commentRobert Newson2020-10-061-4/+2
|
* Complete the port of security_validation tests to ElixirJuanjo Rodriguez2020-10-012-132/+118
|
* Port show_documents and list_views to ElixirJuanjo Rodriguez2020-10-015-4/+1033
|
* port rewrite and rewrite_js tests into elixirJuanjo Rodriguez2020-10-017-116/+691
|
* Preserve query string rewrite when the request contains a bodyJuanjo Rodriguez2020-10-012-1/+18
|
* Port view_conflicts.js, view_errors.js and view_include_docs.js into elixir·Juanjo Rodriguez2020-09-247-3/+643
|
* Update Makefile.win to Include locad configs and clean configs in devcleanJuanjo Rodriguez2020-09-242-2/+7
|
* Workaround dirty schedulers in run_queue stats (#3161)Russell Branca2020-09-231-2/+15
|
* feat(auth): Allow a custom JWT claim for roles (#3166)Robert Newson2020-09-212-1/+2
| | | Co-authored-by: mauroporras <mauroporrasc@gmail.com>
* allow configurability of JWT claims that require a value (#3165)Robert Newson2020-09-214-6/+96
| | | | | | e.g; [jwt] required_claims = {iss, "https://example.com/issuer"}
* Prep for 3.1.1-RC2 (#3148) (#3152)Joan Touzet2020-09-151-44/+48
|
* Prep for 3.1.1-RC2 (#3148)3.1.1-RC23.1.1Joan Touzet2020-09-112-1/+2
|
* Fix buffer_response=true (#3145) (#3147)Robert Newson2020-09-102-10/+14
| | | We need to call StartFun as it might add headers, etc.
* bump version to 3.1.1 (#3143)3.1.1-RC1Joan Touzet2020-09-102-2/+2
|
* Bump fauxton, docs for 3.1.1 release (#3122)Joan Touzet2020-09-101-2/+2
|
* Handle malformed URLs when stripping URL creds in couch_replicatorNick Vatamaniuc2020-09-091-2/+26
| | | | | | Previously there was an error thrown which prevented emitting _scheduler/docs responses. Instead of throwing an error, return `null` if the URL cannot be parsed.
* Merge pull request #3132 from apache/delay_until_end_3.xRobert Newson2020-09-073-9/+125
|\ | | | | Add option to delay responses until the end
| * Add option to delay responses until the enddelay_until_end_3.xRobert Newson2020-09-073-9/+125
|/ | | | | | | | | | | When set, every response is sent once fully generated on the server side. This increases memory usage on the nodes but simplifies error handling for the client as it eliminates the possibility that the response will be deliberately terminated midway through due to a timeout. The config value can be changed at runtime without impacting any in-flight responses.
* Make COPY doc return only one "ok" (#3130)Bessenyei Balázs Donát2020-09-042-1/+13
|
* Report if FIPS mode is enabled (#3121)Joan Touzet2020-09-011-0/+10
| | | | | | This will only report "fips" in the welcome message if FIPS mode was enabled at boot (i.e, in vm.args). Co-authored-by: Robert Newson <rnewson@apache.org>
* Merge pull request #3119 from apache/backport-dreyfus-cleanup-with-invalid-ddocPeng Hui Jiang2020-09-012-6/+35
|\ | | | | 3.x backport: Allow to continue to cleanup search index even if there is invalid ddoc
| * Allow to continue to cleanup search index even if there is invalid ddocjiangph2020-09-012-6/+35
|/ | | | | | | | In some situation where design document for search index created by customer is not valid, the _search_cleanup endpoint will stop to clean up. This will leave some search index orphan. The change is to allow to continue to clean up search index even if there is invalid design document for search.
* bypass partition query limit for mango (#3114)Tony Sun2020-08-283-4/+64
| | | | | | | | | When partition_query_limit is set for couch_mrview, it limits how many docs can be scanned when executing partitioned queries. But this limits mango's doc scans internally. This leads to documents not being scanned to fulfill a query. This fixes: https://github.com/apache/couchdb/issues/2795 Co-authored-by: Joan Touzet <wohali@users.noreply.github.com>
* Make restricted partition search parameters return bad request (#3108)Bessenyei Balázs Donát2020-08-282-8/+50
| | | | | | | | | | | | According to https://docs.couchdb.org/en/master/ddocs/search.html there are parameters for searches that are not allowed for partitioned queries. Those restrictions were not enforced, thus making the software and docs inconsistent. This commit adds them to validation so that the behavior matches the one described in the docs. Co-authored-by: Joan Touzet <wohali@users.noreply.github.com>
* Allow drilldown for search to always be specified as list of lists (#3109)Bessenyei Balázs Donát2020-08-282-0/+203
| | | | | | | | | | | | | | | To use multiple `drilldown` parameters users had to define `drilldown` multiple times to be able supply them. This caused interoperability issues as most languages require defining query parameters and request bodies as associative arrays, maps or dictionaries where the keys are unique. This change enables defining `drilldown` as a list of lists so that other languages can define multiple drilldown keys and values. Co-authored-by: Robert Newson <rnewson@apache.org> Co-authored-by: Robert Newson <rnewson@apache.org> Co-authored-by: Joan Touzet <wohali@users.noreply.github.com>
* Merge pull request #3113 from apache/backport-python-formatTony Sun2020-08-281-1/+4
|\ | | | | update dev/run formatting to adhere to python format checks
| * update dev/run formatting to adhere to python format checksTony Sun2020-08-281-1/+4
|/
* Don't log client disconnects (#3102)Joan Touzet2020-08-251-0/+2
| | | Co-authored-by: Robert Newson <rnewson@apache.org>
* Handle jiffy returning an iolist when encoding atts_since query stringNick Vatamaniuc2020-08-201-1/+1
| | | | | | | | | | | | | | | | If we don't handle it, it throws an error when trying to encode the full URL string, for example: ``` badarg,[ {mochiweb_util,quote_plus,2,[{file,"src/mochiweb_util.erl"},{line,192}]}, {couch_replicator_httpc,query_args_to_string,2,[{file,"src/couch_replicator_httpc.erl"},{line,421}]}, {couch_replicator_httpc,full_url,2,[{file,"src/couch_replicator_httpc.erl"},{line,413}]}, {couch_replicator_api_wrap,open_doc_revs,6,[{file,"src/couch_replicator_api_wrap.erl"},{line,255}]} ] ``` This is also similar to what we did for open_revs encoding: https://github.com/apache/couchdb/commit/a2d0c4290dde2015e5fb6184696fec3f89c81a4b
* Merge pull request #3080 from apache/couch_index_server_crash2-3.xRobert Newson2020-08-141-1/+5
|\ | | | | Don't crash couch_index_server if the db isn't known yet
| * Don't crash couch_index_server if the db isn't known yetcouch_index_server_crash2-3.xRobert Newson2020-08-141-1/+5
|/ | | | | | | If a ddoc is added immediately after database creation (_users and _replicator when couchdb is used in a multi-tenant fashion), we can crash couch_index_server in handle_db_event, as mem3_shards:local throws an error.
* Merge pull request #3078 from apache/validate-db-create-params-3.xEric Avdey2020-08-142-9/+165
|\ | | | | Validate shard specific query params on db create request
| * Validate shard specific query params on db create requestvalidate-db-create-params-3.xEric Avdey2020-08-132-9/+165
|/
* Merge pull request #3071 from apache/couch_index_server_crash-3.xRobert Newson2020-08-121-2/+8
|\ | | | | Unlink index pid and swallow EXIT message if present
| * Unlink index pid and swallow EXIT message if presentRobert Newson2020-08-121-2/+8
|/ | | | | | | | | This should prevent unexpected exit messages arriving which crash couch_index_server. Patch suggested by davisp. Closes #3061.
* Fix/csp 3.x (#3069)Joan Touzet2020-08-102-2/+2
| | | | | | | * fix: send CSP header to make Fauxotn work fully Co-authored-by: Robert Newson <rnewson@apache.org> * Remove accidental chttpd_auth.erl.orig commit
* Windows: provide full path to epmdJoan Touzet2020-08-031-0/+1
|