Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kafka: Add batch size histogram #24865

Merged
merged 2 commits into from
Jan 21, 2025
Merged

Conversation

StephanDollberg
Copy link
Member

@StephanDollberg StephanDollberg commented Jan 21, 2025

Adds a batch size histogram. There is no per topic or partition info as
that would cause a metric explosion due to the histogram.

The histogram goes from 128 bytes to 1MiB.

Ref CORE-8570

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v24.3.x
  • v24.2.x
  • v24.1.x

Release Notes

  • none

Rename latency_probe to kafka probe such that we can add other shard
wide kafka related measurements to it.
@travisdowns
Copy link
Member

The histogram goes from 128 bytes to 1MiB.

Let's extend the lower bound to 32 bytes?

Copy link
Member

@travisdowns travisdowns left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The rest looks good but let's discuss the lower bound.

Adds a batch size histogram. There is no per topic or partition info as
that would cause a metric explosion due to the histogram.

The histogram goes from 128 bytes to 1MiB.
@StephanDollberg StephanDollberg force-pushed the stephan/batch-size-histogram branch from 9a65e3f to 09083d0 Compare January 21, 2025 14:05
@StephanDollberg
Copy link
Member Author

Let's extend the lower bound to 32 bytes?

Done

@StephanDollberg StephanDollberg merged commit 3e2d782 into dev Jan 21, 2025
17 checks passed
@StephanDollberg StephanDollberg deleted the stephan/batch-size-histogram branch January 21, 2025 17:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants