Open
Description
Feature Area
Agent capabilities
Is your feature request related to a an existing bug? Please link it here.
The Agent class accepts the LLM parameters such as n or logprobs.
How to obtain the completion objects that include the n generations and the tokens and the logprobs for them?
Is there any way to obtain outputs in a different tags like <thinking>
?
Describe the solution you'd like
Documentations on how to pass LLM parameters and its usage examples.
For example, sampling n outputs or obtaining logprobs.
In addition, the usage of obtaining text in a separate tag such as <thinking>
or others.
If it is not implemented, extend the current code that returns the compleitions.
Describe alternatives you've considered
No response
Additional context
No response
Willingness to Contribute
No, I'm just suggesting the idea