Hacky workaround to get token usage from chat completions api response

[singhk97]

I am trying to get the token usage data from the response of a call to the OpenAI's chat completion api but it doesn't seem possible. Here are the details:

IChatCompletion.GetChatCompletionsAsync returns a list of IChatResult objects. It represents the response from OpenAI's chat completion API. The issue is that this interface does not have the ModelResult property which contains token usage data. Hence, there's no way to get the token usage data when using the chat completion api. In contrast, the ITextCompletion.GetCompletionsAsync returns a list of ITextResult objects which do contain the ModelResult property.

Looking deeper into the code, it looks like the concrete object type of IChatResult which is the internal class ChatResult has the ModelResult property. So then I was able to cast the IChatResult to a ITextResult and access that property:

There should be a simple fix for this.

[craigomatic]

@RogerBarreto any thoughts here?

[RogerBarreto]

@singhk97, Addressing the well spotted problem.