What is the suggested cluster size for a Kafka Cluster managed by AWS MKS?

There are many factors/parameters to be considered for sizing the Kafka clusters which include the number of topics, the number of consumers/producers connecting to topics, the number of replicas, how the leader partition for each topic are distributed within the cluster, among other considerations. Nasdaq Data Link currently has 25 Kafka brokers, where each Kafka broker is of R5.xlarge size and 500 GB of storage. We have different incoming/outgoing feed requirements on Nasdaq Data Link than you may have in consuming GIDS and Smart Options. 

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.