Skip to content

add autoscaler for ingesters #182

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 29, 2021
Merged

add autoscaler for ingesters #182

merged 1 commit into from
Jul 29, 2021

Conversation

kd7lxl
Copy link
Collaborator

@kd7lxl kd7lxl commented Jul 28, 2021

What this PR does:
Adds a HorizontalPodAutoscaler for the ingesters.

https://cortexmetrics.io/docs/guides/capacity-planning/ describes that ingester memory grows as series are added, so this autoscaler tracks memory usage to make scaling decisions.

https://cortexmetrics.io/docs/guides/ingesters-scaling-up-and-down/#scaling-down says that "adding more ingesters to a Cortex cluster is considered a safe operation", so this autoscaler behavior is configured to allow adding one ingester pod at a time, but does not automatically scale down.

Checklist

  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

@kd7lxl kd7lxl force-pushed the hpa branch 2 times, most recently from a86e62e to 835f81d Compare July 29, 2021 14:42
Signed-off-by: Tom Hayward <[email protected]>
@kd7lxl
Copy link
Collaborator Author

kd7lxl commented Jul 29, 2021

Oops, you beat me to the merge/rebase.

@nschad nschad merged commit 49605fe into cortexproject:master Jul 29, 2021
@kd7lxl kd7lxl deleted the hpa branch July 29, 2021 17:31
junkiebev pushed a commit to junkiebev/cortex-helm-chart that referenced this pull request Jul 29, 2021
Signed-off-by: Tom Hayward <[email protected]>
Signed-off-by: Jeff Kolb <[email protected]>
nschad added a commit that referenced this pull request Jul 31, 2021
* adding optional auth-org generation code

Signed-off-by: Jeff Kolb <[email protected]>

* Added documentation

Signed-off-by: Jeff Kolb <[email protected]>

* Bumping version number

Signed-off-by: Jeff Kolb <[email protected]>

* Un-Bumping version number

Signed-off-by: Jeff Kolb <[email protected]>

* Adding changelog description

Signed-off-by: Jeff Kolb <[email protected]>

* added alertmanager-config example, added value attributes (#181)

Signed-off-by: Raphael Grömmer <[email protected]>
Signed-off-by: Jeff Kolb <[email protected]>

* Passing DCO test one hopes

Signed-off-by: Jeff Kolb <[email protected]>

* update docs also in the tmpl file (#186)

Signed-off-by: ShuzZzle <[email protected]>
Signed-off-by: Jeff Kolb <[email protected]>

* add autoscaler for ingesters (#182)

Signed-off-by: Tom Hayward <[email protected]>
Signed-off-by: Jeff Kolb <[email protected]>

* define namespace in templates (#184)

Signed-off-by: Tom Hayward <[email protected]>
Signed-off-by: Jeff Kolb <[email protected]>

* fix: documentation to match helm-docs spec

Signed-off-by: ShuzZzle <[email protected]>

* fix: auth_orgs under wrong section and use %d for http listen port

Signed-off-by: ShuzZzle <[email protected]>

Co-authored-by: Raphael Grömmer <[email protected]>
Co-authored-by: Niclas Schad <[email protected]>
Co-authored-by: Tom Hayward <[email protected]>
@nschad nschad mentioned this pull request Oct 5, 2021
1 task
@eraac eraac mentioned this pull request Nov 5, 2021
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants