proxystore.stream.shims.kafka¶
Kafka publisher and subscriber shims.
Shims to the
confluent-kafka
package.
KafkaPublisher
¶
Kafka publisher shim.
Parameters:
-
client
(Producer
) –Kafka producer client.
Source code in proxystore/stream/shims/kafka.py
KafkaSubscriber
¶
Kafka subscriber shim.
This shim is an iterable object which will yield bytes
messages from the stream, blocking on the next message, until the stream
is closed.
Parameters:
-
client
(Consumer
) –Kafka consumer client. The
client
must already be subscribed to the relevant topics.