[Bug]: Structured output tool not found on bedrock

[KojoOwusu]

Describe the bug

So this is related to the enhancement to enable structured outputs in bedrock. This issue was closed by this PR but It seems it has not been resolved and now when the agent tries to call the __structued_output tool, an error is thrown saying tool not found.

The approach in the PR seemed to enforce the __structured_output tool in tool_choice which i think has some negative side effects as now the model tries to respond in structured format all the time rather than just at the end.

Steps to reproduce the behavior:

Create ConversableAgent with config params api_type=bedrock and response_format=<BaseModel>
model used is: anthropic.claude-3-7-sonnet-20250219-v1:0

See error:

Input arguments: {}
Output:
Error: Function __structured_output not found.

[DanCorvesor]

@priyansh4320 @marklysze This is quite a serious bug actually. It makes the latest version almost unusable, I'd suggest you might want to yank it.

In the issue you talked about adding integration tests but we didn't see any more commits, did they go in?

[DanCorvesor]

If it's helpful, we can jump on a call/open a private Slack to discuss this further.

[priyansh4320]

@DanCorvesor thanks for pointing this out ,will add a PR, for fixing this bug and fix the behavior of the tool choice. apologies for the trouble.

[DanCorvesor]

Amazing, thanks @priyansh4320 . As I say, if you need any more input, please reach out to @KojoOwusu or I.

I know this is a danger of using OS libraries but I wanted to point out, we are locked in with this as our library of choice for an agent we are deploying to production, so it's critical these things are right!

Thanks again