You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
## Problem
- Want to see the distribution of tools that LLM either used directly
(no acceptance needed) or suggested (user acceptance required)
## Solution
- Add metric `toolUseSuggested`
## Notes
- This only takes into account what tool the LLM uses/suggests. This
does not take into account whether that tool was actually
accepted/rejected.
- This is because a user can accept/reject at a later time, or even
ignore. For example, a generated shell command can be rejected 30
minutes later or dozens of messages later in the conversation.
- The goal is to possibly streamline this, likely with the
`amazonq_interactWithAgenticChat` metric
- For now, we want info in the distribution of tools that LLM
uses/suggests
0 commit comments