Skip to content

Commit e8ba691

Browse files
committed
docs: update readme file.
1 parent f0ced45 commit e8ba691

File tree

1 file changed

+12
-1
lines changed

1 file changed

+12
-1
lines changed

README.md

Lines changed: 12 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22

33
![logo](Assets/LLamaSharpLogo.png)
44

5-
The C#/.NET binding of llama.cpp. It provides APIs to inference the LLaMa Models and deploy it on native environment or Web. It works on
5+
The C#/.NET binding of [llama.cpp](https://github.com/ggerganov/llama.cpp). It provides APIs to inference the LLaMa Models and deploy it on native environment or Web. It works on
66
both Windows and Linux and does NOT require compiling the library yourself.
77

88
- Load and inference LLaMa models
@@ -20,6 +20,17 @@ Just search `LLamaSharp` in nuget package manager and install it!
2020
PM> Install-Package LLamaSharp
2121
```
2222

23+
## Simple Benchmark
24+
25+
Currently it's only a simple benchmark to indicate that the performance of `LLamaSharp` is close to `llama.cpp`. Experiments run on a computer
26+
with Intel i7-12700, 3060Ti with 7B model. Note that the benchmark uses `LLamaModel` instead of `LLamaModelV1`.
27+
28+
#### Windows
29+
30+
- llama.cpp: 2.98 words / second
31+
32+
- LLamaSharp: 2.94 words / second
33+
2334
## Usages
2435

2536
Currently, `LLamaSharp` provides two kinds of model, `LLamaModelV1` and `LLamaModel`. Both of them works but `LLamaModel` is more recommended

0 commit comments

Comments
 (0)