File tree 1 file changed +19
-2
lines changed
1 file changed +19
-2
lines changed Original file line number Diff line number Diff line change @@ -21,9 +21,26 @@ Command line options:
21
21
- ` --host ` : Set the hostname or ip address to listen. Default ` 127.0.0.1 ` .
22
22
- ` --port ` : Set the port to listen. Default: ` 8080 ` .
23
23
24
- ## Quick Start
24
+ ## Build
25
+
26
+ Build llama.cpp with server from repository root with either make or CMake.
27
+
28
+ - Using ` make ` :
29
+
30
+ ``` bash
31
+ LLAMA_BUILD_SERVER=1 make
32
+ ```
25
33
26
- ** Note:** The server is not built by default. Make sure to add ` LLAMA_BUILD_SERVER=ON ` to your CMake command.
34
+ - Using ` CMake ` :
35
+
36
+ ``` bash
37
+ mkdir build-server
38
+ cd build-server
39
+ cmake -DLLAMA_BUILD_SERVER=ON ..
40
+ cmake --build . --config Release
41
+ ```
42
+
43
+ ## Quick Start
27
44
28
45
To get started right away, run the following command, making sure to use the correct path for the model you have:
29
46
You can’t perform that action at this time.
0 commit comments