Skip to content

epic: Change Jan API server to use cortex.cpp #3487

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
imtuyethan opened this issue Aug 28, 2024 · 1 comment
Closed

epic: Change Jan API server to use cortex.cpp #3487

imtuyethan opened this issue Aug 28, 2024 · 1 comment
Assignees
@louis-menlo
Labels
category: cortex.cpp Related to cortex.cpp category: local API server Server page UI UX type: epic A major feature or initiative

Comments

@imtuyethan
Copy link
Contributor

imtuyethan commented Aug 28, 2024 •
edited by dan-menlo
Loading

Goal

  • Jan has "always-on" cortex.cpp process
  • Jan's API server screens do not require user to "start server", it should be running as long as Jan is running

Tasklist

  • Designs
  • Eng impact (any changes?)

Original Spec

Specs: https://www.notion.so/jan-ai/API-Server-API-Logs-a105e72c0114434aa566f976c543eb8c?pvs=4

We will need to update the API server UI, to reflect the "always-on" API server in Cortex.
@imtuyethan imtuyethan added this to Menlo Aug 28, 2024
@imtuyethan imtuyethan converted this from a draft issue Aug 28, 2024
@imtuyethan imtuyethan changed the title API Server -> API Logs Change API server to use Cortex Platform API server & show the logs Aug 28, 2024
@imtuyethan imtuyethan moved this from Scheduled to Planning in Menlo Aug 30, 2024
@imtuyethan imtuyethan changed the title Change API server to use Cortex Platform API server & show the logs epic: Change API server to use Cortex Platform API server & show the logs Aug 30, 2024
@imtuyethan imtuyethan added the type: epic A major feature or initiative label Aug 30, 2024
@freelerobot freelerobot changed the title epic: Change API server to use Cortex Platform API server & show the logs epic: Change API server to use cortex.cpp Sep 5, 2024
@freelerobot freelerobot changed the title epic: Change API server to use cortex.cpp epic: Change Jan API server to use cortex.cpp Sep 5, 2024
@dan-menlo dan-menlo moved this from Planning to Scheduled in Menlo Sep 26, 2024
@freelerobot freelerobot added category: cortex.cpp Related to cortex.cpp category: local API server Server page UI UX labels Oct 14, 2024
@dan-menlo
Copy link
Contributor

Merging into #3825

@github-project-automation github-project-automation bot moved this from Scheduled to Review + QA in Menlo Oct 21, 2024
@imtuyethan imtuyethan moved this from Review + QA to Completed in Menlo Oct 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@louis-menlo louis-menlo

Labels
category: cortex.cpp Related to cortex.cpp category: local API server Server page UI UX type: epic A major feature or initiative
Projects
Menlo
Archived in project
Milestone
No milestone
Development

No branches or pull requests
4 participants
@freelerobot @imtuyethan @dan-menlo @louis-menlo