Getting usage data for transcription and prompts

[kunjee17]

Debug log shows usage data but I can't find a way to get usage data for prompts , extractions and transcriptions. Only api I found is streaming prompt that provide usage data? How, I can log usage data for other things ?

[joshua-mo-143]

Hi @kunjee17 - you're right, there isn't any way to get usage data currently for extractions and transcriptions.

Currently I believe if you're using agent.prompt() you will need to use extended_details() to be able to augment the prompting request to additionally retrieve the usage.

Like so:

agent.prompt("Hello world!").extended_details() // ... extra stuff here

As for adding usage to extractors etc I'll be setting a ticket up for that 😄

[kunjee17]

Thanks @joshua-mo-143 for reply. Will check it out. This is really helpful when you are transferring token pricing to clients. I am closing the discussion for now.