Skip to content

helm chart for kueue addon #37

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

haoqing0110
Copy link
Member

@openshift-ci openshift-ci bot requested review from mikeshng and yue9944882 June 5, 2025 10:01
@haoqing0110
Copy link
Member Author

/assign @zhujian7
Could you help to take a look at the addon template part?

agentSpec:
workload:
manifests:
- apiVersion: rbac.authorization.k8s.io/v1
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for the spoke cluster do we need to install the kueue-addon-controller deployment?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no, on the spoke, we just want to use template to deploy some kueue resources.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But without the kueue controller, how would the multikueue resource be handled on the spoke when the hub distributes a workload to the spoke?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This addon requires the user already installed kueue on both hub and spoke. The kueue workload is managed by kueue.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, so can we add some doc/readme to describe the prereq and how to use this?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes! That's a good suggestion. Will update the doc when the image is pushed to quay.io. Today the readme is still TBD https://github.com/open-cluster-management-io/addon-contrib/blob/main/kueue-addon/README.md means it's not ready to use yet.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

readme for this addon #39

@haoqing0110
Copy link
Member Author

/assign @qiujian16

description: A Helm chart for Open Cluster Management Kueue Addon
type: application
version: 0.1.0
appVersion: "1.0.0"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why appversion is 1.0.0?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is just referring to other addons like managed-serviceaccount set to 1.0.0 as the initial version.
Any suggestion for this? like be aligned with the supported kueue version, as well as the kueue addon controller image version?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes align with kueue version would be better.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed.

installStrategy:
type: Placements
placements:
- name: {{ .Values.placement.hub.name }}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do we need a special treatment on hub?

apiVersion: addon.open-cluster-management.io/v1alpha1
kind: AddOnTemplate
metadata:
name: kueue-addon-hub-{{ .Chart.Version }}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is strange, do we need to install this on hub?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The intention here is to manage the lifecycle of kueue addon controller by cma. Will you suggest to install it (deployment, rbac) directly through yamls?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed the kueue-addon-hub template and install them directly by yamls.

@haoqing0110 haoqing0110 force-pushed the br_kueue-helm-chart branch from cebb288 to 0c40ab9 Compare June 20, 2025 10:07
@haoqing0110 haoqing0110 force-pushed the br_kueue-helm-chart branch from 0c40ab9 to a6a1ce0 Compare June 20, 2025 10:12
@qiujian16
Copy link
Member

/approve
/lgtm

@openshift-ci openshift-ci bot added the lgtm label Jun 23, 2025
Copy link

openshift-ci bot commented Jun 23, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: haoqing0110, qiujian16

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-bot openshift-merge-bot bot merged commit 7ab7dff into open-cluster-management-io:main Jun 23, 2025
2 checks passed
@haoqing0110 haoqing0110 deleted the br_kueue-helm-chart branch June 23, 2025 07:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants