bug: Mistral 7b results in Unexpected end of JSON input

[imtuyethan]

• I have searched the existing issues

Current behavior

https://discord.com/channels/1107178041848909847/1271124876530290760

When attempting to run the Mistral model locally without internet, the user receives an "Unexpected end of JSON input" error message. The app is unable to start the model successfully.

Minimum reproduction step

1. Install Jan version 0.5.2
2. Attempt to run the Mistral 7B model locally (Model ID: mistrala/mistral-7b-instruct-v0.2)
3. Observe the error message in the chat interface

Expected behavior

The Mistral model should load and run successfully without internet connection, allowing the user to interact with it.

Screenshots / Logs

Jan version

0.5.2

In which operating systems have you tested?

• macOS
• Windows
• Linux

Environment details

[Van-QA]

Reproducibl‌e and need investigation from dev tea‌m

[imtuyethan]

Tested on:

• Mac:

Operating System: MacOS Sonoma 14.2
Processor: Apple M2
RAM: 16GB

Operating System: MacOS Ventura 13.3.1
Processor: Apple Intel
RAM: 8GB

• Can't test on Window or Linux as it requires internet to run VMs

Result:

Cannot reproduce the bug, i can run Mistral Instruct 7B perfectly on my machine.

[dan-menlo]

Actually, this issue is quite straightforward - the user was trying to run the base model itself, and not the GGUF needed for llama.cpp