Use native tool calling instead of injecting tool description in agent context #1517
                  
                    
                      c0dezli
                    
                  
                
                  started this conversation in
                Feature Requests
              
            Replies: 0 comments
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
Uh oh!
There was an error while loading. Please reload this page.
-
Currently, we inject tool descriptions into the agent context for all LLM interactions. While this approach works, it doesn't take advantage of the native tool calling capabilities that modern LLMs like Claude and GPT provide.
I propose for LLMs with native tool calling support (like Claude and GPT), we should use litellm's tool interface to directly register tools and leverage their native function calling formats. This would allow us to remove tool descriptions from the agent context for these models.
For LLMs without native tool support, we can maintain the current approach of injecting tool descriptions in the agent context.
Beta Was this translation helpful? Give feedback.
All reactions