summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| * | Fix: check failed reqs to retry only for positive limitViktor Shlapakov2015-06-031-3/+3
| | |
| * | Fixed compatible issues with testsViktor Shlapakov2015-06-032-15/+16
| | |
| * | Producer _send_upstream fixes, added tests for retriesViktor Shlapakov2015-06-032-6/+157
| | |
| * | Fixed base producer importsViktor Shlapakov2015-06-031-1/+2
| | |
| * | Retries for async batchingViktor Shlapakov2015-06-034-15/+50
|/ /
* | Merge pull request #342 from wting/fix_consumer_falsinessDana Powers2015-05-171-4/+4
|\ \ | |/ |/| | | Remove Consumer falsiness.
| * Check vs None directly.William Ting2015-05-171-4/+4
|/
* Merge pull request #376 from hellais/fix/offsetDana Powers2015-05-141-1/+1
|\ | | | | Fix calling of _offsets
| * Fix calling of _offsetsArturo Filastò2015-05-141-1/+1
|/ | | | | | | | Previously you would see this error: ``` self.offsets._fetch[(topic, partition)], AttributeError: 'function' object has no attribute '_fetch' ```
* Merge pull request #367 from dpkp/clean_metadata_refreshDana Powers2015-04-121-13/+14
|\ | | | | Clear local metadata cache before refresh in client.load_metadata_for_topics()
| * Update debug log messages in client.load_metadata_for_topicsDana Powers2015-04-121-2/+2
| |
| * clean local metadata before requesting refresh in load_metadata_for_topics()Dana Powers2015-04-121-2/+7
| |
| * Simplify client.reset_topic_metadataDana Powers2015-04-121-9/+5
| |
* | Merge pull request #366 from dpkp/failed_payloadsDana Powers2015-04-121-79/+77
|\ \ | |/ |/| Refactor client request/response handling to support better retries
| * Improve send_produce_request docstringDana Powers2015-04-061-6/+17
| |
| * Add debug logging for all broker-aware requests/responsesDana Powers2015-04-061-0/+3
| |
| * Refactor KafkaClient._send_broker_aware_request to return a list of responsesDana Powers2015-04-061-73/+57
| | | | | | | | | | | | and include individual (unraised) FailedPayloadsError instances rather than always raising a FailedPayloadsError. This should allow producers to determine which payloads succeeded and which failed, specifically.
* | Merge pull request #365 from dpkp/kafka_consumer_fixupDana Powers2015-04-061-28/+32
|\ \ | |/ |/| KafkaConsumer topic/partition fixes
| * Use kafka_bytestring when decoding message topics in ↵Dana Powers2015-04-041-18/+22
| | | | | | | | KafkaConsumer.fetch_messages
| * Use list comprehension on _topics in KafkaConsumer.fetch_messagesDana Powers2015-04-041-8/+8
| |
| * call _consume_topic_partition() before storing offsetDana Powers2015-04-041-1/+1
| | | | | | | | in KafkaConsumer.set_topic_partitions((topic, partition, offset))
| * Fix python3 str/bytes bug in KafkaConsumer.set_topic_partitions({(topic, ↵Dana Powers2015-04-041-1/+1
|/ | | | partition): offset, })
* Merge pull request #360 from dpkp/atexit_cleanupDana Powers2015-04-042-4/+51
|\ | | | | Register atexit handlers for consumer and producer thread/multiprocess cleanup
| * Register atexit handlers for consumer and producer thread/multiprocess ↵Dana Powers2015-03-312-4/+51
| | | | | | | | cleanup (not __del__)
* | Merge pull request #361 from kecaps/masterDana Powers2015-04-0411-49/+69
|\ \ | |/ |/| Make external API consistently support python3 strings for topic.
| * Make external API consistently support python3 strings for topic.Space2015-04-0311-49/+69
|/
* Merge pull request #356 from dpkp/always_fetch_offsetsDana Powers2015-03-305-14/+105
|\ | | | | fetch commit offsets in base consumer unless group is None
| * Bulk fetch offset partitions in base consumer -- suggested by ecanzonieriDana Powers2015-03-301-8/+9
| |
| * Fetch previously committed offsets in base consumer class so long asDana Powers2015-03-305-14/+34
| | | | | | | | | | | | | | | | a group is configured (but document that group must be None for old servers). This fixes multiprocessor consumer issue that prevented access to commit offsets if auto_commit is disabled. Also refactor fetch_last_known_offsets based on KafkaConsumer While still setting unknown offsets to 0
| * Skip these tests: no OffsetCommitRequest for 0.8.0Viktor Shlapakov2015-03-301-2/+2
| |
| * Added basic tests for load_initial_offsets optionViktor Shlapakov2015-03-301-0/+35
| |
| * Add test case for MP Consumer auto commitAli-Akber Saifee2015-03-301-0/+35
| | | | | | | | Tweak MP Consumer test to use iterator
* | Merge pull request #355 from dpkp/correlation_id_moduloDana Powers2015-03-302-7/+15
|\ \ | |/ |/| correlation_id modulo
| * Add test for correlation_id rolloverDana Powers2015-03-291-0/+8
| |
| * Rollover KafkaClient correlation ids at 2**31 to keep within int32 protocol ↵Dana Powers2015-03-291-7/+7
| | | | | | | | encoding
* | Merge pull request #357 from dpkp/del_consumer_stopDana Powers2015-03-301-0/+3
|\ \ | | | | | | Stop consumers on delete
| * | Stop consumers on deleteDana Powers2015-03-301-0/+3
| |/
* | Merge pull request #341 from dpkp/kafka_consumer_docsDana Powers2015-03-294-149/+185
|\ \ | |/ |/| KafkaConsumer documentation
| * Use bootstrap_servers interface in testsDana Powers2015-03-291-1/+1
| |
| * Add sphinx_rtd_theme to docs requirements.txtDana Powers2015-03-291-0/+1
| |
| * Updates to KafkaConsumer usage docsDana Powers2015-03-291-42/+26
| |
| * fixup kafka consumer docstringDana Powers2015-03-291-1/+1
| |
| * Move KafkaConsumer usage examples to docs/usage; Put KeyedProducer usage ↵Dana Powers2015-03-291-14/+105
| | | | | | | | right after SimpleProducer
| * Improve KafkaConsumer docstringsDana Powers2015-03-291-134/+94
|/
* Merge pull request #340 from dpkp/deprecate_metadata_broker_listDana Powers2015-03-291-8/+26
|\ | | | | Deprecate metadata_broker_list in favor of bootstrap_servers
| * Deprecate KafkaConsumer config metadata_broker_list in favor of ↵Dana Powers2015-03-231-8/+26
| | | | | | | | bootstrap_servers
* | Merge pull request #336 from scrapinghub/feature-mp-consumer-paramsDana Powers2015-03-295-38/+57
|\ \ | | | | | | Using additional params for MP consumer child process
| * | Manageable queue.put() operation for MPConsumer processesViktor Shlapakov2015-03-252-4/+12
| | |
| * | Added pylint.rc: ignoring SyncManager for pylintViktor Shlapakov2015-03-242-1/+3
| | |
| * | Using mp.manager to solve the issue with join for MPConsumerViktor Shlapakov2015-03-241-6/+7
| | |
View Lorry Controller Status