Replies: 1 comment
-
similar #3968 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hello! Trying to launch this mode: https://localai.io/features/distribute/#without-p2p
Started remote worker with
local-ai worker llama-cpp-rpc -- -H 0.0.0.0 -p 25678
Statred local instance with
LLAMACPP_GRPC_SERVERS="?.?.?.?:25678" local-ai run
And local instance still tries to run model only locally. Worker mode don't work.
Beta Was this translation helpful? Give feedback.
All reactions