AWS introduces support for KRaft mode in Apache Kafka clusters on Amazon MSK

AWS introduces support for KRaft mode in Apache Kafka clusters on Amazon MSK



Amazon Managed Streaming for Apache Kafka (Amazon MSK) has announced support for KRaft (Apache Kafka Raft) mode in Apache Kafka version 3.7. KRaft was developed by the Apache Kafka community to replace Apache ZooKeeper for managing metadata in Kafka clusters. This new mode allows cluster metadata to be propagated within a group of Kafka controllers, rather than between ZooKeeper nodes. With KRaft mode, there are no additional costs or configuration required, making it an easy and seamless transition for users.

Customers can now create clusters in either KRaft or ZooKeeper mode in Apache Kafka version 3.7. In KRaft mode, users can add up to 60 agents to host more partitions per cluster, doubling the previous limit of 30 agents in ZooKeeper-based clusters. Support for Apache Kafka version 3.7 is available in all AWS Regions where Amazon MSK operates.

For more information on KRaft at MSK, users can read the blog launch and Frequent questions provided by Amazon. Additionally, the Amazon MSK Developer Guide offers guidance on getting started with Amazon MSK.

Overall, this update provides Amazon MSK users with more flexibility and efficiency in managing their Kafka clusters. The introduction of KRaft mode allows for easier metadata management without incurring extra costs or complex configurations. With support for Apache Kafka version 3.7 across all AWS Regions, users can take advantage of the latest features and improvements offered by Amazon MSK.

Article Source
https://aws.amazon.com/about-aws/whats-new/2024/05/amazon-msk-kraft-mode-apache-kafka-clusters/