Skip to content

[Feature Request]: add rerank support to llama.cpp rerank  #2905

Closed
@ziyu4huang

Description

@ziyu4huang

Is there an existing issue for the same feature request?

  • I have checked the existing issues.

Is your feature request related to a problem?

Recent Llama.cpp support rerank , I want to support it throught OpenAI compatible provider
https://github.com/ggerganov/llama.cpp/pull/9510

Describe the feature you'd like

make RAGflow application use reranker from llama.cpp

Describe implementation you've considered

LLama.cpp support jina API stand , though it seems no standard in score.

There is no openai rerank standard yet, but jina is popular and choose by Llama.cpp

see llama.cpp issues 9510

I will provide my implementation in PR

Documentation, adoption, use case

No response

Additional information

I have test and success full works in Ragflow

Metadata

Metadata

Assignees

No one assigned

    Labels

    💞 featureFeature request, pull request that fullfill a new feature.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions