Skip to content

Commit c72a971

Browse files
authored
Update README.md
1 parent b977e4c commit c72a971

File tree

1 file changed

+7
-2
lines changed

1 file changed

+7
-2
lines changed

examples/reranker/README.md

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,8 @@ This implementation adds a new pooling type `LLAMA_POOLING_TYPE_RANK` which enab
1313
## Installation
1414

1515
```bash
16-
# Clone the repository
16+
# Follow instructions to clone repo.
17+
# Navigate to examples reranker
1718
cd examples/reranker
1819

1920
# Build the project
@@ -67,4 +68,8 @@ Not tested others, but anything supported by llama.cpp should work.
6768

6869
## Implementation Details
6970

70-
This is a close Rust implementation of the reranker implementation discussed in [llama.cpp PR #9510](https://github.com/ggerganov/llama.cpp/pull/9510). Key features include:
71+
This is a close Rust implementation of the reranker implementation discussed in [llama.cpp PR #9510](https://github.com/ggerganov/llama.cpp/pull/9510).
72+
73+
## Potential issues
74+
75+
The bos, eos, sep tokens are being hardcoded. We need to ideally get it from the model and build out the prompts based on each specific model.

0 commit comments

Comments
 (0)