Caching for Agents #7093
Unanswered
sashanknjs
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I was going through the documentation for Caching in Autogen V0.4 from https://microsoft.github.io/autogen/stable/reference/python/autogen_ext.models.cache.html#autogen_ext.models.cache.ChatCompletionCache
I have observed that this would work for chat completion models. How do I implement caching for agents. I need my agent to provide cached responses for certain repeated inputs.
@ekzhu I had referred to a previous discussion about this in #5792, but the answer was not very clear to me. Could you please explain again?
Beta Was this translation helpful? Give feedback.
All reactions