Skip to content

[FEATURE] How to obtain n generations or generations in different tags? #3052

Open
@junkyul

Description

@junkyul

Feature Area

Agent capabilities

Is your feature request related to a an existing bug? Please link it here.

The Agent class accepts the LLM parameters such as n or logprobs.
How to obtain the completion objects that include the n generations and the tokens and the logprobs for them?
Is there any way to obtain outputs in a different tags like <thinking>?

Describe the solution you'd like

Documentations on how to pass LLM parameters and its usage examples.
For example, sampling n outputs or obtaining logprobs.
In addition, the usage of obtaining text in a separate tag such as <thinking> or others.

If it is not implemented, extend the current code that returns the compleitions.

Describe alternatives you've considered

No response

Additional context

No response

Willingness to Contribute

No, I'm just suggesting the idea

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions