You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
KServe supports `RawDeployment` mode to enable `InferenceService` deployment with Kubernetes resources [`Deployment`](https://kubernetes.io/docs/concepts/workloads/controllers/deployment), [`Service`](https://kubernetes.io/docs/concepts/services-networking/service), [`Ingress`](https://kubernetes.io/docs/concepts/services-networking/ingress) and [`Horizontal Pod Autoscaler`](https://kubernetes.io/docs/tasks/run-application/horizontal-pod-autoscale). Comparing to serverless deployment it unlocks Knative limitations such as mounting multiple volumes, on the other hand `Scale down and from Zero` is not supported in `RawDeployment` mode.
3
3
4
-
Kubernetes 1.22 is the minimally required version and please check the following recommended Istio versions for the corresponding
5
-
Kubernetes version.
6
-
7
-
## Recommended Version Matrix
8
-
| Kubernetes Version | Recommended Istio Version |
The minimally required Istio version is 1.13 and you can refer to the [Istio install guide](https://istio.io/latest/docs/setup/install).
17
-
18
-
Once Istio is installed, create `IngressClass` resource for istio.
19
-
```yaml
20
-
apiVersion: networking.k8s.io/v1
21
-
kind: IngressClass
22
-
metadata:
23
-
name: istio
24
-
spec:
25
-
controller: istio.io/ingress-controller
26
-
```
27
-
28
-
29
-
!!! note
30
-
Istio ingress is recommended, but you can choose to install with other [Ingress controllers](https://kubernetes.io/docs/concepts/services-networking/ingress-controllers/) and create `IngressClass` resource for your Ingress option.
31
-
32
-
33
-
34
-
## 2. Install Cert Manager
4
+
## 1. Install Cert Manager
35
5
The minimally required Cert Manager version is 1.9.0 and you can refer to [Cert Manager installation guide](https://cert-manager.io/docs/installation/).
36
6
37
7
!!! note
38
8
Cert manager is required to provision webhook certs for production grade installation, alternatively you can run self signed certs generation script.
39
9
40
-
## 3. Install KServe
10
+
## 2. Install KServe
41
11
!!! note
42
-
The default KServe deployment mode is `Serverless` which depends on Knative. The following step changes the default deployment mode to `RawDeployment` before installing KServe.
43
-
12
+
The default KServe deployment mode is `Serverless` which depends on Knative. The following step changes the default deployment mode to `RawDeployment` before installing KServe and the `RawDeployment` mode does not have any dependecy on Knative.
44
13
45
-
**i. Install KServe**
14
+
**i. Create a yaml file**
15
+
Open an editor of your choice and create `kustomization.yaml` file.
0 commit comments