summaryrefslogtreecommitdiff
path: root/kafka/coordinator/consumer.py
Commit message (Collapse)AuthorAgeFilesLines
* KIP-54: Implement sticky partition assignment strategy (#2057)Valeria Chernenko2020-09-291-1/+4
|
* Optionally return OffsetAndMetadata from consumer.committed(tp) (#1979)Dana Powers2019-12-291-3/+3
|
* Fix typosCarson Ip2019-11-081-1/+1
|
* Issue #1780 - Consumer hang indefinitely in fetcher._retrieve_offsets() due ↵Commander Dishwasher2019-09-301-1/+5
| | | | to topic deletion while rebalancing (#1782)
* Allow the coordinator to auto-commit for all api_version.Jay Chan2019-06-201-1/+1
|
* Ignore lookup_coordinator result in commit_offsets_async (#1712)Faqa2019-03-121-1/+2
|
* Be explicit with tuples for %s formattingJeff Widman2018-11-181-3/+3
| | | | Fix #1633
* Return future from commit_offsets_async (#1560)Mike Lang2018-08-311-1/+6
|
* Don't use `kafka.common` internally1.3.5Jeff Widman2018-06-051-1/+1
| | | | This finishes the split from `kafka.common` to `kafka.errors`/`kafka.structs`.
* Remove old CommitFailed error message from coordinator (#1436)Dana Powers2018-03-101-11/+1
|
* Fix consumer poll stuck error when no available partition (#1375)Yu Kou2018-02-081-1/+1
|
* use absolute imports everywhere (#1362)Kevin Tindall2018-02-061-11/+11
|
* KAFKA-3949: Avoid race condition when subscription changes during rebalance ↵Dana Powers2018-02-021-39/+63
| | | | (#1364)
* Improve KafkaConsumer cleanup (#1339)Dana Powers2018-01-101-0/+1
|
* KAFKA-3888 Use background thread to process consumer heartbeats (#1266)Dana Powers2017-12-211-98/+144
|
* Replace periods (java) with underscores (python)Jeff Widman2017-11-071-2/+2
|
* KAFKA-4034: Avoid unnecessary consumer coordinator lookup (#1254)Dana Powers2017-10-111-4/+24
|
* Explicitly check for `None` rather than FalseJeff Widman2017-10-061-1/+1
| | | | | If the group leader somehow gets in a state that it has an empty partition assignment, then `self._assignment_snapshot` will be `{}` which evaluates to `False`. So `self._subscription.mark_for_reassignment()` will never be triggered, even if `self._assignment_snapshot != self._metadata_snapshot`. Fixes the symptoms of https://github.com/dpkp/kafka-python/issues/1237 although I suspect there's an additional bug in that case that triggers the condition of the the group leader getting an empty partition assignment.
* Initialize metadata_snapshot in group coordinator (#1174)Dana Powers2017-08-131-6/+9
|
* change_subscription called only when necessary (#1132)Petr Šebek2017-07-071-2/+3
| | | | | | When we are using subscription by pattern change subscription is called every metadata update even when nothing changes. This PR ensures that change subscription is called only when set of topics changes.
* Additional docstrings for autocommit close optionDana Powers2017-03-131-0/+8
|
* Optionally skip auto-commit during consumer.close (#1031)Dana Powers2017-03-131-2/+3
|
* Always include an error for logging when the coordinator is marked dead (#890)Dana Powers2016-11-181-2/+2
|
* Treat metric_group_prefix as config in KafkaConsumerDana Powers2016-08-041-6/+4
|
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Add base coordinator metricsDana Powers2016-07-171-4/+7
|
* KAFKA-3486: fix autocommit when partitions assigned manually (#767 / #626)Dana Powers2016-07-171-44/+8
|
* KAFKA-3117: handle metadata updates during consumer rebalance (#766 / #701)Dana Powers2016-07-171-10/+24
|
* KAFKA-2832: Add a consumer config option to exclude internal topics (#765)Dana Powers2016-07-171-4/+8
| | | | Use exclude_internal_topics config in KafkaConsumer to avoid subscribe patterns matching internal topics Raise error during rebalance if subscribed topics are not authorized
* Fix KafkaConsumer autocommit for 0.8 brokers (#756 / #706)Dana Powers2016-07-161-20/+16
| | | | * Dont wait for group join to enable AutoCommitTask if broker version < 0.9 * For zookeeper offset storage, set a "coordinator" with least_loaded_node
* Avoid some exceptions in Coordinator.__del__ (#668)Dana Powers2016-04-251-1/+2
|
* Beginnings of metrics instrumentation in kafka consumer.Zack Dever2016-04-131-41/+30
| | | | | | This adds the parent metrics instance to kafka consumer, which will eventually be used to instrument everything under consumer. To start I ported the java consumer coordinator metrics.
* Use version-indexed lists for request/response protocol structsprotocol_versionsDana Powers2016-04-051-9/+7
|
* KAFKA-3318: clean up consumer logging and error messagesDana Powers2016-04-051-42/+61
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-051-2/+2
|
* Improve auto-commit task handling when group_id is Noneissue_619Dana Powers2016-04-031-20/+22
|
* Check for None returned from least_loaded_node when no brokers are availablenone_least_loaded_nodeDana Powers2016-03-131-0/+4
|
* Mock client.ready() call to test coordinator offset fetch requestDana Powers2016-02-191-1/+2
|
* Some attributes may not exist in __del__ if we failed assertionsDana Powers2016-02-181-1/+1
|
* More friendly warning when offset fetch request returns unknown topic / ↵Dana Powers2016-02-181-1/+2
| | | | partition
* Verify node ready before sending offset fetch request from coordinatorDana Powers2016-02-181-0/+5
|
* break up some circular references and close client wake pipe on __del__aisch2016-02-161-5/+10
|
* Add RangePartitionAssignor (and use as default); add assignor testsrange_assignorDana Powers2016-02-161-2/+3
|
* Fixup: _send_offset_commit_request future should succeed w/ True, not NoneDana Powers2016-02-021-1/+2
|
* Disable offset commits and auto-partition-assignment when group_id is NoneDana Powers2016-01-241-8/+17
|
* KAFKA-2978: consumer stops fetching when consumed and fetch positions get ↵Dana Powers2016-01-101-1/+2
| | | | out of sync
* ConsumerCoordinator cleanupsDana Powers2016-01-101-10/+34
| | | | | | | | | | | | | | - default assignors to RoundRobinPartitionAssignor - check offsets types in commit_offsets_* methods - succeed future in _send_offset_commit_request when no offsets - raise exception if no subscribed topics in group_protocols() - fix _subscription typo in metadata listener callbacks - short circuit if no partitions passed to fetch_committed_offsets - line-wrap comments - return future from commit_offsets_async - return future value from commit_offsets_sync - fix self._failed_request callback partial args - comment out metrics class for now
* Move ConsumerProtocol definition to kafka.coordinator.protocolDana Powers2016-01-101-34/+10
|
* Drop unused method from ConsumerCoordinatorDana Powers2016-01-031-5/+0
|
* Check api_version in ConsumerCoordinatorDana Powers2016-01-031-32/+94
| | | | | | | - Full group support in 0.9 - Kafka-storage offsets w/ GroupCoordinator in 0.8.2 - Zookeeper-storage offsets in 0.8.1 - Assign all partitions locally if < 0.9
View Lorry Controller Status