Skip to content

Commit 7b2ecb7

Browse files
feat: oci genai
Signed-off-by: Anders Swanson <[email protected]>
1 parent e0db804 commit 7b2ecb7

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

docs/reference/providers/backend.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,7 @@ Currently, we have a total of 8 backends available:
1212
- [Google Gemini](https://ai.google.dev/docs/gemini_api_overview)
1313
- [Hugging Face](https://huggingface.co)
1414
- [LocalAI](https://github.com/go-skynet/LocalAI)
15+
- [Oracle Cloud Infrastructure (OCI) Generative AI](https://www.oracle.com/artificial-intelligence/generative-ai/generative-ai-service/)
1516
- FakeAI
1617

1718
## OpenAI
@@ -149,6 +150,23 @@ LocalAI is a local model, which is an OpenAI compatible API. It uses llama.cpp a
149150
k8sgpt analyze --explain --backend localai
150151
```
151152

153+
## Oracle Cloud Infrastructure (OCI) Generative AI
154+
155+
[Oracle Cloud Infrastructure (OCI)](https://www.oracle.com/cloud/) Generative AI s a fully managed OCI service that provides a set of state-of-the-art, customizable large language models.
156+
K8sgpt can be configured to use ready-to-use pretrained models, or create and host your own fine-tuned custom models based on your own data on dedicated AI clusters.
157+
158+
To authenticate with OCI, create a [OCI SDK/CLI](https://docs.oracle.com/en-us/iaas/Content/API/Concepts/sdkconfig.htm) `config` file in your home directory's `.oci/` directory.
159+
160+
Next, configure the OCI backend for a given model within an OCI compartment:
161+
```bash
162+
k8sgpt auth add --backend oci --model <Model OCID> --compartmentId <Compartment OCID>
163+
```
164+
165+
Analyze using the OCI backend:
166+
```bash
167+
k8sgpt anaylze --explain --backend oci
168+
```
169+
152170
## FakeAI
153171
154172
FakeAI or the NoOpAiProvider might be useful in situations where you need to test a new feature or simulate the behaviour of an AI based-system without actually invoking it. It can help you with local development, testing and troubleshooting.

0 commit comments

Comments
 (0)