Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add flags for QPS and Burst to *-poollet and *-broker #1157

Merged

Conversation

balpert89
Copy link
Contributor

@balpert89 balpert89 commented Nov 18, 2024

Proposed Changes

  • define a common default for client QPS and Burst for broker and poollet components
  • make QPS and Burst client configuration configurable
  • make concurrent max reconciles configurable

Fixes #1154

@balpert89 balpert89 requested a review from a team as a code owner November 18, 2024 16:22
@github-actions github-actions bot added size/L bug Something isn't working labels Nov 18, 2024
@lukas016 lukas016 force-pushed the osc/fix/client-rate-settings branch from a04175c to 7833274 Compare November 25, 2024 12:11
@balpert89
Copy link
Contributor Author

removed the no-op rate limiting configuration.

broker/bucketbroker/cmd/bucketbroker/app/app.go Outdated Show resolved Hide resolved
broker/volumebroker/cmd/volumebroker/app/app.go Outdated Show resolved Hide resolved
broker/machinebroker/cmd/machinebroker/app/app.go Outdated Show resolved Hide resolved
poollet/bucketpoollet/cmd/bucketpoollet/app/app.go Outdated Show resolved Hide resolved
poollet/machinepoollet/cmd/machinepoollet/app/app.go Outdated Show resolved Hide resolved
poollet/volumepoollet/cmd/volumepoollet/app/app.go Outdated Show resolved Hide resolved
@afritzler afritzler added enhancement New feature or request and removed bug Something isn't working labels Nov 25, 2024
@github-actions github-actions bot added the bug Something isn't working label Nov 25, 2024
@afritzler afritzler changed the title feat: expose multiple client configuration to finetune performance Add flags for QPS and Burst to *-poollet and *-broker Nov 25, 2024
@lukas016 lukas016 force-pushed the osc/fix/client-rate-settings branch from 2a6c8a5 to c85ebab Compare November 25, 2024 14:02
@balpert89 balpert89 requested a review from afritzler November 25, 2024 14:24
@afritzler afritzler removed the bug Something isn't working label Nov 25, 2024
@lukas016 lukas016 force-pushed the osc/fix/client-rate-settings branch from c85ebab to afcae77 Compare November 25, 2024 15:41
@github-actions github-actions bot added the bug Something isn't working label Nov 25, 2024
@balpert89 balpert89 removed the bug Something isn't working label Nov 26, 2024
poollet/volumepoollet/cmd/volumepoollet/app/app.go Outdated Show resolved Hide resolved
poollet/common/defaults/defaults.go Outdated Show resolved Hide resolved
@github-actions github-actions bot added the bug Something isn't working label Nov 26, 2024
@balpert89 balpert89 force-pushed the osc/fix/client-rate-settings branch from 8895d51 to c47a97e Compare November 26, 2024 15:30
…ptionsUpdated `Options` struct with `QPS` and `Burst` fields, added corresponding flags in `AddFlags` method, and set these values in the `Run` function for ippoollet, machinepoollet, and volumepoollet controllers. This allows configurable rate limits for Kubernetes client requests and logs the settings on startup.Suggestion: Review the changes to ensure consistency and test the new configuration options.

Signed-off-by: Benjamin Alpert <[email protected]>

change poollet client specific qps and burst opts implementation to common options pattern

change to client config defaults for qps and burst
@lukas016 lukas016 force-pushed the osc/fix/client-rate-settings branch from c47a97e to a203ee6 Compare November 27, 2024 08:42
dependabot bot added 2 commits November 27, 2024 09:42
Bumps [github.com/onsi/gomega](https://github.com/onsi/gomega) from 1.35.1 to 1.36.0.
- [Release notes](https://github.com/onsi/gomega/releases)
- [Changelog](https://github.com/onsi/gomega/blob/master/CHANGELOG.md)
- [Commits](onsi/gomega@v1.35.1...v1.36.0)

---
updated-dependencies:
- dependency-name: github.com/onsi/gomega
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…e-dev#1174)

Bumps [github.com/bits-and-blooms/bitset](https://github.com/bits-and-blooms/bitset) from 1.15.0 to 1.17.0.
- [Release notes](https://github.com/bits-and-blooms/bitset/releases)
- [Commits](bits-and-blooms/bitset@v1.15.0...v1.17.0)

---
updated-dependencies:
- dependency-name: github.com/bits-and-blooms/bitset
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Copy link
Member

@lukasfrank lukasfrank left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lukasfrank lukasfrank merged commit dc782b5 into ironcore-dev:main Nov 27, 2024
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request size/L
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add QPS and Burst configuration for poollet and broker
3 participants