You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This library wouldn't take on that complexity. zkafka offloads the consumer assignment to confluent-kafka-go (which uses librdkafka. They have a couple of configurable strategies that can be used (see config.md in librdkafka). As of today that includes range, roundrobin, cooperativesticky.
zkafka enables these configs to be specified, but if memory serves, isn't well suited for cooperativesticky. If confluent-kafka-go library adds rackaffinity as a configurable strategy, I'd be happy to look into how to make it available (and work well) with in zkafka.
I'd like to configure my application (currently EKS, but is should be configurable) and use rack-affinity
link to the KIP
https://cwiki.apache.org/confluence/display/KAFKA/KIP-1123:+Rack-aware+partitioning+for+Kafka+Producer
also example of implementation is here
https://github.com/segmentio/kafka-go/blob/main/groupbalancer.go
The text was updated successfully, but these errors were encountered: