summaryrefslogtreecommitdiff
path: root/kafka/producer
Commit message (Collapse)AuthorAgeFilesLines
* Fix producerconfigs documentation link (#2226)MandarJKulkarni2021-08-031-1/+1
|
* Fix typo: veriication -> verification (#2207)Dongwook Chan2021-02-211-1/+1
| | | Co-authored-by: will.k <will.k@kakaocorp.com>
* Support configuration of custom kafka client for Admin/Consumer/Producer (#2144)Tincu Gabriel2020-12-021-4/+7
|
* producer/kafka: Disable logging during object destruction (#2043)Gioele2020-09-071-0/+8
|
* Add support for `zstd` compression (#2021)Tincu Gabriel2020-09-071-2/+6
|
* Add `log_start_offset` to message protocol parsing (#2020)Tincu Gabriel2020-03-253-13/+30
| | | This is in preparation for adding `zstd` support.
* Remove some dead codeJeff Widman2020-02-051-179/+0
|
* Do not block on sender thread join after timeout in producer.close() (#1974)Dana Powers2019-12-291-5/+1
|
* Enable SCRAM-SHA-256 and SCRAM-SHA-512 for sasl (#1918)Swen Wenzel2019-12-291-5/+5
|
* Improve docs for reconnect_backoff_max_ms (#1976)Dana Powers2019-12-281-5/+6
|
* Fix typosCarson Ip2019-11-081-1/+1
|
* Remove SimpleClient, Producer, Consumer, Unittest (#1196)Jeff Widman2019-10-114-589/+1
| | | | | | | | | | | | | | | | | | In the 2.0 release, we're removing: * `SimpleClient` * `SimpleConsumer` * `SimpleProducer` * Old partitioners used by `SimpleProducer`; these are superceded by the `DefaultPartitioner` These have been deprecated for several years in favor of `KafkaClient` / `KafkaConsumer` / `KafkaProducer`. Since 2.0 allows breaking changes, we are removing the deprecated classes. Additionally, since the only usage of `unittest` was in tests for these old Simple* clients, this also drops `unittest` from the library. All tests now run under `pytest`.
* Improve/refactor bootstrap_connectedDana Powers2019-09-302-11/+11
|
* Added a function to determine if bootstrap is successfully connected (#1876)PandllCom2019-09-301-7/+14
|
* Rely on socket selector to detect completed connection attempts (#1909)Dana Powers2019-09-281-1/+1
|
* Remove unused/weird comment line (#1813)Jeff Widman2019-05-281-1/+0
|
* Update docs for api_version_auto_timeout_ms (#1812)Jeff Widman2019-05-241-1/+1
| | | | | | | | | The docs for `api_version_auto_timeout_ms` mention setting `api_version='auto'` but that value has been deprecated for years in favor of `api_version=None`. Updating the docs for now, and will remove support for `'auto'` in next major version bump.
* Dont do client wakeup when sending from sender thread (#1761)Dana Powers2019-03-241-2/+3
|
* Update sasl configuration docstringsDana Powers2019-03-231-5/+5
|
* Support SASL OAuthBearer Authentication (#1750)Phong Pham2019-03-221-1/+4
|
* Allow configuration of SSL Ciphers (#1755)Dana Powers2019-03-211-0/+6
|
* Remove unused importJeff Widman2019-01-281-1/+0
|
* #1681 add copy() in metrics() to avoid thread safety issues (#1682)Tosi Émeric2018-12-271-2/+2
|
* Be explicit with tuples for %s formattingJeff Widman2018-11-186-13/+13
| | | | Fix #1633
* raising logging level on messages signalling data loss (#1553)Alexander Sibiryakov2018-11-101-2/+3
|
* set socket timeout for the wake_w (#1577)flaneur2018-11-101-0/+1
|
* Stop using deprecated log.warn()Jeff Widman2018-10-261-3/+3
| | | | I missed this in my previous cleanup back in 9221fcf83528b5c3657e43636cb84c1d18025acd.
* Vendor `six` consistentlyJeff Widman2018-10-221-2/+2
| | | | Use vendored `six`, and also `six.moves.range` rather than `xrange`
* Update remote urls: snappy, https, etcJeff Widman2018-10-221-2/+2
| | | | | Snappy URL was outdated. Similarly, many of these sites now support https.
* Support produce with Kafka record headersHeikki Nousiainen2018-09-273-17/+27
|
* add kerberos domain name config for gssapi sasl mechanism handshake (#1542)the-sea2018-08-311-1/+4
|
* add support for smaller topic metadata fetch during bootstrap (#1541)Ning Xie2018-08-311-0/+1
|
* Document connections_max_idle_msJeff Widman2018-06-261-0/+5
| | | | | This was added in #1068 but never documented. Fix #1497
* Don't use `kafka.common` internally1.3.5Jeff Widman2018-06-053-8/+8
| | | | This finishes the split from `kafka.common` to `kafka.errors`/`kafka.structs`.
* Stop shadowing `ConnectionError`Jeff Widman2018-05-231-1/+0
| | | | | | | | | | In Python3, `ConnectionError` is a native exception. So rename our custom one to `KafkaConnectionError` to prevent accidentally shadowing the native one. Note that there are still valid uses of `ConnectionError` in this code. They already expect a native Python3 `ConnectionError`, and also already handle the Python2 compatibility issues.
* Change SimpleProducer to use async_send (async is reserved in py37) (#1454)Dana Powers2018-03-233-17/+25
|
* Validate that serializers generate bytes-like (or None) data (#1420)Dana Powers2018-03-101-2/+3
|
* Do not validate api_version against known versions (#1434)Dana Powers2018-03-101-2/+1
|
* Fix byte size estimation with kafka producer (#1393)Blake Embrey2018-02-241-1/+1
|
* use absolute imports everywhere (#1362)Kevin Tindall2018-02-068-33/+33
|
* fix reconnect_backoff_max_ms default config bug in KafkaProducer (#1352)C.YAO2018-01-231-1/+1
|
* Read all available socket bytes (#1332)Dana Powers2018-01-101-0/+2
| | | | * Recv all available network bytes before parsing * Add experimental support for configuring socket chunking parameters
* Raise non-API exceptions (#1316)Jeff Widman2017-12-211-5/+1
| | | | | | | | | | | | | The original intent was to catch API exceptions (errors returned by the broker when trying to produce a message) and delegate them to the messages' futures. This is copied from the Java producer. However, we were accidentally catching all exceptions, thereby hiding exceptions from users unless they explicitly check the result of the future. Much better to raise client-side errors directly in the foreground so the user is immediately aware of them and can decide how to handle. Fix #1274
* use python standard max value (#1303)lukeWx2017-12-072-2/+2
|
* Add DefaultRecordBatch implementation aka V2 message format parser/builder. ↵Taras Voinarovskyi2017-10-252-6/+18
| | | | | (#1185) Added bytecode optimization for varint and append/read_msg functions. Mostly based on avoiding LOAD_GLOBAL calls.
* Fix timestamp not passed to RecordMetadata (#1273)Taras Voinarovskyi2017-10-222-7/+8
| | | | | | | | * Fix timestamp not being passed to RecordMetadata properly * Add more tests for LegacyBatch * Fix producer test for recordmetadata
* Fix overriding sasl_kerberos_service_name in KafkaConsumer / KafkaProducer ↵Nathanael Smith2017-10-171-0/+3
| | | | (#1264)
* Added minor fixes for PR reviewTaras2017-10-122-16/+4
|
* Remove the check for timestamp None in producer, as it's done in RecordBatch ↵Taras2017-10-121-2/+0
| | | | | | anyway. Minor abc doc fixes.
* Refactor MessageSet and Message into LegacyRecordBatch to later support v2 ↵Taras2017-10-114-180/+90
| | | | message format