Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| * | Add Message.validate_crc() method | Dana Powers | 2015-12-28 | 1 | -0/+7 | |
| | | ||||||
| * | Add OffsetResetStrategy enum class to kafka.protocol.offset | Dana Powers | 2015-12-28 | 1 | -0/+5 | |
| | | ||||||
| * | Use attributes on exception classes to signal retriable and invalid metadata ↵ | Dana Powers | 2015-12-28 | 2 | -13/+33 | |
| | | | | | | | | errors | |||||
| * | Rename TopicAndPartition -> TopicPartition | Dana Powers | 2015-12-28 | 8 | -26/+26 | |
| | | ||||||
| * | New async KafkaClient, based on java NetworkClient and ConsumerClient | Dana Powers | 2015-12-28 | 2 | -0/+510 | |
| | | | | | | | | | | | | | | - Support async client bootstrap retries after exponential backoff - Attempt to finish_connect if still connecting in KafkaClient.ready(node_id) - Run full async loop while waiting for futures in KafkaClient.poll() - Add more fallbacks to KafkaClient.least_loaded_node; worst case, retry boostrap | |||||
| * | Update BrokerConnection for use with async client | Dana Powers | 2015-12-28 | 2 | -39/+78 | |
| | | | | | | | | | | | | | | | | | | - use descriptive names for ConnectionStates enum values - Change default send_buffer_bytes config to 131072 - add can_send_more() and max_in_flight_requests_per_connection config - add blacked_out() and reconnect_backoff_ms config - last_attempt and last_failure are now public attributes - raise TooManyInFlightRequests in conn.send() if cant send more | |||||
| * | Add ClusterMetadata.add_group_coordinator() | Dana Powers | 2015-12-28 | 1 | -0/+39 | |
| | | ||||||
| * | Rename Cluster -> ClusterMetadata; align with upstream Metadata class | Dana Powers | 2015-12-28 | 2 | -66/+125 | |
| | | ||||||
| * | Remove old kafka-bin directory and verify kafka-run-class.sh exists when ↵ | Dana Powers | 2015-12-18 | 1 | -0/+6 | |
| | | | | | | | | installing server artifacts | |||||
| * | Only download/install server artifacts if bin/kafka-run-class.sh not found | Dana Powers | 2015-12-18 | 1 | -5/+6 | |
| | | ||||||
| * | Switch BrokerConnection to (mostly) non-blocking IO. | Dana Powers | 2015-12-17 | 6 | -154/+386 | |
| | | | | | | | | | | | | - return kafka.Future on send() - recv is now non-blocking call that completes futures when possible - update KafkaClient to block on future completion | |||||
| * | new 0.9 error codes plus descriptions. | Zack Dever | 2015-12-15 | 2 | -10/+172 | |
| | | | | | | | | | | reference: https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-ErrorCodes | |||||
| * | Drop bytes encoding of consumer group in consumer integration test | Dana Powers | 2015-12-10 | 1 | -1/+1 | |
| | | ||||||
| * | Remove bytes encoding for topic name in producer integration test | Dana Powers | 2015-12-10 | 1 | -1/+1 | |
| | | ||||||
| * | Check for no in-flight-requests in BrokerConnection.recv | Dana Powers | 2015-12-10 | 1 | -0/+3 | |
| | | ||||||
| * | Only log topic names (and broker metadata) in KafkaClient load_metadata ↵ | Dana Powers | 2015-12-10 | 1 | -1/+1 | |
| | | | | | | | | debug logging | |||||
| * | Move Request / Response logging from KafkaClient to BrokerConnection | Dana Powers | 2015-12-10 | 4 | -25/+4 | |
| | | | | | | | | and reenable kafka.conn debug logging in tests | |||||
| * | pylint fixes | Dana Powers | 2015-12-10 | 6 | -5/+7 | |
| | | | | | | | | | | | | - temporarily ignore kafka/consumer/group.py - temporarily ignore test/test_protocol.py - disable-msg deprecated; use disable= instead | |||||
| * | Remove KafkaProtocol._decode_message | Dana Powers | 2015-12-10 | 2 | -32/+2 | |
| | | ||||||
| * | Fix consumer integration test that assumed a single broker | Dana Powers | 2015-12-10 | 1 | -4/+6 | |
| | | ||||||
| * | Add pylint hints to AbstractType because we cant mark a classmethod as abstract | Dana Powers | 2015-12-10 | 1 | -2/+2 | |
| | | ||||||
| * | Handle python3 in kafka.protocol.pickle | Dana Powers | 2015-12-10 | 1 | -2/+6 | |
| | | ||||||
| * | Fix zk_chroot in consumer integration kafka fixtures | Dana Powers | 2015-12-10 | 1 | -2/+3 | |
| | | ||||||
| * | Drop kafka_bytestring | Dana Powers | 2015-12-10 | 14 | -81/+47 | |
| | | ||||||
| * | Configure consumer group in consumer_integration tests | Dana Powers | 2015-12-10 | 1 | -3/+13 | |
| | | ||||||
| * | Convert OffsetCommit and OffsetFetch protocol encode/decode | Dana Powers | 2015-12-10 | 8 | -105/+69 | |
| | | ||||||
| * | Fix test_consumer generator/list mock, reenable tests | Dana Powers | 2015-12-10 | 1 | -5/+2 | |
| | | ||||||
| * | Update kafka.common imports to Payloads namedtuples in test_protocol | Dana Powers | 2015-12-09 | 1 | -22/+24 | |
| | | ||||||
| * | Add next_correlation_id_recv + send helper methods to BrokerConnection | Dana Powers | 2015-12-09 | 1 | -0/+8 | |
| | | ||||||
| * | Support requests that do not expect a response in BrokerConnection | Dana Powers | 2015-12-09 | 1 | -2/+3 | |
| | | ||||||
| * | Default consumer integration tests should not use offset commits | Dana Powers | 2015-12-09 | 1 | -2/+3 | |
| | | ||||||
| * | Skip protocol tests for now -- need updating | Dana Powers | 2015-12-09 | 1 | -0/+20 | |
| | | ||||||
| * | Update to Payload namedtuples in consumer tests | Dana Powers | 2015-12-09 | 1 | -4/+4 | |
| | | ||||||
| * | Skip consumer tests that cause iterator errors -- needs investigation | Dana Powers | 2015-12-09 | 1 | -0/+3 | |
| | | ||||||
| * | Update client tests for new protocol usage | Dana Powers | 2015-12-09 | 1 | -74/+61 | |
| | | ||||||
| * | Handle PartialMessage / ConsumerFetchSizeTooSmall in SimpleConsumer | Dana Powers | 2015-12-09 | 1 | -21/+24 | |
| | | ||||||
| * | Update references to kafka.common Request/Response (now Payload) | Dana Powers | 2015-12-09 | 9 | -50/+46 | |
| | | ||||||
| * | Refactor KafkaClient to use BrokerConnections and new Request/Response structs | Dana Powers | 2015-12-09 | 1 | -148/+131 | |
| | | ||||||
| * | Exception handling cleanup in BrokerConnection (also catch struct.errors in ↵ | Dana Powers | 2015-12-09 | 1 | -4/+4 | |
| | | | | | | | | recv) | |||||
| * | Add client_id and correlation_id to BrokerConnection constructor kwargs | Dana Powers | 2015-12-09 | 1 | -3/+7 | |
| | | ||||||
| * | Change KafkaProtocol to encode/decode Structs, not bytes | Dana Powers | 2015-12-09 | 2 | -252/+112 | |
| | | | | | | | | | | - add Payload to kafka.common Request/Responses namedtuples - OffsetFetch and OffsetCommit still need to be converted | |||||
| * | Support pickling of Structs -- _encode_self instance method needs some magic | Dana Powers | 2015-12-09 | 2 | -0/+26 | |
| | | ||||||
| * | Return PartialMessage object in MessageSet.decode if message is truncated by ↵ | Dana Powers | 2015-12-09 | 1 | -3/+10 | |
| | | | | | | | | max_bytes | |||||
| * | Fallback to simple repr() in Schema.repr() | Dana Powers | 2015-12-09 | 1 | -7/+10 | |
| | | ||||||
| * | Fix BytesIO import in kafka.protocol.message | Dana Powers | 2015-12-09 | 1 | -1/+3 | |
| | | ||||||
| * | Fix _mp_consume queue variable name conflict | Dana Powers | 2015-12-09 | 1 | -2/+2 | |
| | | ||||||
| * | Handle special __init__ signature in Message decode() | Dana Powers | 2015-12-09 | 1 | -0/+8 | |
| | | ||||||
| * | Handle decoding partial messages in MessageSet - caused by FetchRequest ↵ | Dana Powers | 2015-12-09 | 1 | -6/+24 | |
| | | | | | | | | max_bytes | |||||
| * | Merge branch 'master' into 0.9 | Zack Dever | 2015-12-07 | 22 | -62/+485 | |
| |\ | ||||||
| * | | few small cleanups | Zack Dever | 2015-12-04 | 3 | -8/+2 | |
| | | |