Cruise Control is currently not supported on Kafka 4.0

[scholzj]

PR #11176 adds support for Kafka 4.0.0. But it currently does not work with the latest version of Cruise Control. As a result, bunch of System Tests is disabled when running on Kafka 4.0 or newer. These tests should be reenabled once new Cruise Control version works with Kafka 4.0. The disabled tests should be tracked with this issue number.

[ppatierno]

@ShubhamRwt @kyguy FYI ... I know you are working on enabling CC to work with Kafka 4.0

[kyguy]

Shubham is currently working with upstream Cruise Control maintainers for a fix for this [1]

[1] linkedin/cruise-control#2254

[im-konge]

Triaged on 6.3.2025: This makes sense to have fixed. @ShubhamRwt already opened a PR to fix it on CC side.

[cypres]

FYI linkedin/cruise-control#2254 was merged

[kyguy]

FYI one of the upstream Cruise Control maintainers is talking about reverting a commit [1] which includes some API usage changes needed for Cruise Control compatibility with Kafka 4.0. We may need to contribute more changes in addition to further future-proof upstream Cruise Control for Kafka 4.0. @ShubhamRwt and I are currently investigating the impact and potential fixes.

[1] linkedin/cruise-control#2180

[CCisGG]

Hi @kyguy, thanks for the input here. We discussed internally and we think revert that PR may break some users who already use the latest release. So currently our preference is to fix forward the incompatibilities.