the number of messages batched at the producer
the number of messages batched at the producer
This is for bootstrapping and the producer will only use it for getting metadata (topics, partitions and replicas).
This is for bootstrapping and the producer will only use it for getting metadata (topics, partitions and replicas). The socket connections for sending the actual data will be established based on the broker information returned in the metadata. The format is host1:port1,host2:port2, and the list can be a subset of brokers or a VIP pointing to a subset of brokers.
This parameter allows you to set whether compression should be turned * on for particular topics
This parameter allows you to set whether compression should be turned * on for particular topics
If the compression codec is anything other than NoCompressionCodec,
Enable compression only for specified topics if any
If the list of compressed topics is empty, then enable the specified compression codec for all topics
If the compression codec is NoCompressionCodec, compression is disabled for all topics
This parameter allows you to specify the compression codec for all data generated * by this producer.
This parameter allows you to specify the compression codec for all data generated * by this producer. The default is NoCompressionCodec
the serializer class for keys (defaults to the same as for values)
the serializer class for keys (defaults to the same as for values)
The leader may be unavailable transiently, which can fail the sending of a message.
The leader may be unavailable transiently, which can fail the sending of a message. This property specifies the number of retries when such failures occur.
the partitioner class for partitioning events amongst sub-topics
this parameter specifies whether the messages are sent asynchronously * or not.
this parameter specifies whether the messages are sent asynchronously * or not. Valid values are - async for asynchronous send * sync for synchronous send
the maximum size of the blocking queue for buffering on the producer
the maximum size of the blocking queue for buffering on the producer
Timeout for event enqueue: 0: events will be enqueued immediately or dropped if the queue is full -ve: enqueue will block indefinitely if the queue is full +ve: enqueue will block up to this many milliseconds if the queue is full
Timeout for event enqueue: 0: events will be enqueued immediately or dropped if the queue is full -ve: enqueue will block indefinitely if the queue is full +ve: enqueue will block up to this many milliseconds if the queue is full
Before each retry, the producer refreshes the metadata of relevant topics.
Before each retry, the producer refreshes the metadata of relevant topics. Since leader election takes a bit of time, this property specifies the amount of time that the producer waits before refreshing the metadata.
the serializer class for values
the serializer class for values
The producer generally refreshes the topic metadata from brokers when there is a failure (partition missing, leader not available.
The producer generally refreshes the topic metadata from brokers when there is a failure (partition missing, leader not available...). It will also poll regularly (default: every 10min so 600000ms). If you set this to a negative value, metadata will only get refreshed on failure. If you set this to zero, the metadata will get refreshed after each message sent (not recommended) Important note: the refresh happen only AFTER the message is sent, so if the producer never sends a message the metadata is never refreshed