Skip to content

ADD Chatbot UI example #1424

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed

Conversation

bhubbb
Copy link
Contributor

@bhubbb bhubbb commented May 13, 2023

This example makes use of three projects llama.cpp, gpt-llama.cpp and Chatbot UI to provide a ChatGPT UI like experience with llama.cpp.

Let me know if there are some improvements I can make to the Dockerfile and compose.yaml.

@bhubbb bhubbb force-pushed the chatbot-ui-example branch 2 times, most recently from 0464a1a to 418f4a1 Compare May 13, 2023 03:40
@bhubbb bhubbb force-pushed the chatbot-ui-example branch from 418f4a1 to 098277c Compare May 13, 2023 03:41
@slaren
Copy link
Member

slaren commented May 13, 2023

This looks like an interesting project, but since there is no code here that shows how to use llama.cpp, I am not sure that it should be in this repository as one of the examples. It would make more sense as an example of gpt-llama.cpp, or even as a standalone project. Maybe we could add a "related projects" section to the README or the wiki and link it there?

@bhubbb
Copy link
Contributor Author

bhubbb commented May 13, 2023

If this is the wrong spot for this, I don't mind. I wanted to share this setup as a simpler alternative to the other UIs.

Did you want me to close the PR?

@slaren
Copy link
Member

slaren commented May 13, 2023

Don't close it yet, this is just my opinion.

@ekryski
Copy link

ekryski commented May 13, 2023

I'm working with @keldenl on gpt-llama.cpp. This is awesome that you put up this PR @bhubbb! 🙏

But... I'd hold off merging this. We're doing a major overhaul to accommodate some of the new models and options, clean things up and make stuff a bit more stable, including some native support for chatbot-ui.

Will report back when we've updated things and then I think it would be awesome to highlight how people can get up and running super quick with llama.cpp. 😄

[EDIT]: Would probably be better suited for this section as @slaren suggested:

Maybe we could add a "related projects" section to the README or the wiki and link it there?

@rain-1 rain-1 mentioned this pull request Jul 7, 2023
@ggerganov
Copy link
Member

We now have web UI via the server example

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants