summaryrefslogtreecommitdiff
path: root/kafka/coordinator/consumer.py
Commit message (Collapse)AuthorAgeFilesLines
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Add base coordinator metricsDana Powers2016-07-171-4/+7
|
* KAFKA-3486: fix autocommit when partitions assigned manually (#767 / #626)Dana Powers2016-07-171-44/+8
|
* KAFKA-3117: handle metadata updates during consumer rebalance (#766 / #701)Dana Powers2016-07-171-10/+24
|
* KAFKA-2832: Add a consumer config option to exclude internal topics (#765)Dana Powers2016-07-171-4/+8
| | | | Use exclude_internal_topics config in KafkaConsumer to avoid subscribe patterns matching internal topics Raise error during rebalance if subscribed topics are not authorized
* Fix KafkaConsumer autocommit for 0.8 brokers (#756 / #706)Dana Powers2016-07-161-20/+16
| | | | * Dont wait for group join to enable AutoCommitTask if broker version < 0.9 * For zookeeper offset storage, set a "coordinator" with least_loaded_node
* Avoid some exceptions in Coordinator.__del__ (#668)Dana Powers2016-04-251-1/+2
|
* Beginnings of metrics instrumentation in kafka consumer.Zack Dever2016-04-131-41/+30
| | | | | | This adds the parent metrics instance to kafka consumer, which will eventually be used to instrument everything under consumer. To start I ported the java consumer coordinator metrics.
* Use version-indexed lists for request/response protocol structsprotocol_versionsDana Powers2016-04-051-9/+7
|
* KAFKA-3318: clean up consumer logging and error messagesDana Powers2016-04-051-42/+61
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-051-2/+2
|
* Improve auto-commit task handling when group_id is Noneissue_619Dana Powers2016-04-031-20/+22
|
* Check for None returned from least_loaded_node when no brokers are availablenone_least_loaded_nodeDana Powers2016-03-131-0/+4
|
* Mock client.ready() call to test coordinator offset fetch requestDana Powers2016-02-191-1/+2
|
* Some attributes may not exist in __del__ if we failed assertionsDana Powers2016-02-181-1/+1
|
* More friendly warning when offset fetch request returns unknown topic / ↵Dana Powers2016-02-181-1/+2
| | | | partition
* Verify node ready before sending offset fetch request from coordinatorDana Powers2016-02-181-0/+5
|
* break up some circular references and close client wake pipe on __del__aisch2016-02-161-5/+10
|
* Add RangePartitionAssignor (and use as default); add assignor testsrange_assignorDana Powers2016-02-161-2/+3
|
* Fixup: _send_offset_commit_request future should succeed w/ True, not NoneDana Powers2016-02-021-1/+2
|
* Disable offset commits and auto-partition-assignment when group_id is NoneDana Powers2016-01-241-8/+17
|
* KAFKA-2978: consumer stops fetching when consumed and fetch positions get ↵Dana Powers2016-01-101-1/+2
| | | | out of sync
* ConsumerCoordinator cleanupsDana Powers2016-01-101-10/+34
| | | | | | | | | | | | | | - default assignors to RoundRobinPartitionAssignor - check offsets types in commit_offsets_* methods - succeed future in _send_offset_commit_request when no offsets - raise exception if no subscribed topics in group_protocols() - fix _subscription typo in metadata listener callbacks - short circuit if no partitions passed to fetch_committed_offsets - line-wrap comments - return future from commit_offsets_async - return future value from commit_offsets_sync - fix self._failed_request callback partial args - comment out metrics class for now
* Move ConsumerProtocol definition to kafka.coordinator.protocolDana Powers2016-01-101-34/+10
|
* Drop unused method from ConsumerCoordinatorDana Powers2016-01-031-5/+0
|
* Check api_version in ConsumerCoordinatorDana Powers2016-01-031-32/+94
| | | | | | | - Full group support in 0.9 - Kafka-storage offsets w/ GroupCoordinator in 0.8.2 - Zookeeper-storage offsets in 0.8.1 - Assign all partitions locally if < 0.9
* Rename AbstractCoordinator -> BaseCoordinator, log as kafka.coordinatorDana Powers2015-12-301-2/+2
|
* Prefer assert or more-specific error to IllegalState / IllegalArgumentDana Powers2015-12-301-14/+5
|
* More Docstring ImprovementsDana Powers2015-12-301-2/+33
|
* Make group_id a Coordinator kwarg (not arg) for consistencyDana Powers2015-12-301-2/+2
|
* Switch configs from attributes to dict to make passing / inspecting easierDana Powers2015-12-291-27/+31
|
* Fix log statement bug (via pylint)Dana Powers2015-12-291-1/+1
|
* Clean more ConsumerCoordinator docstringsDana Powers2015-12-291-16/+19
|
* Dont warn in AutoCommitTask.disable if not previously scheduledDana Powers2015-12-291-1/+1
|
* Improve OffsetCommit error loggingDana Powers2015-12-291-23/+33
| | | | | | Avoid printing full errors because they currently include long descriptions that are generally duplicative of our local error message.
* Improve various docstringsDana Powers2015-12-291-13/+21
|
* Remove extra raise and old TODO comment in coordinatorsDana Powers2015-12-291-1/+1
|
* Remove recursive client.poll call in ConsumerCoordinatorDana Powers2015-12-291-2/+3
|
* Pass auto commit parameters from KafkaConsumer to ConsumerCoordinatorDana Powers2015-12-291-1/+1
|
* ConsumerCoordinator (based on upstream Java client)Dana Powers2015-12-281-0/+605
- Use RoundRobinPartitionAssignor by default - Define AbstractPartitionAssignor for custom assignors - metrics still TODO