Skip to content

Conversation

@priyansh4320
Copy link
Collaborator

@priyansh4320 priyansh4320 commented Nov 25, 2025

Why are these changes needed?

This pull removes the bedrock unsupported warning on structured output / response_format param and adds support for response format referanced via beedrock documentation.
https://aws.amazon.com/blogs/machine-learning/structured-data-response-with-amazon-bedrock-prompt-engineering-and-tool-use/

Related issue number

#2225

Checks

@joggrbot
Copy link
Contributor

joggrbot bot commented Nov 25, 2025

📝 Documentation Analysis

All docs are up to date! 🎉


✅ Latest commit analyzed: e4dc1b7 | Powered by Joggr

@priyansh4320 priyansh4320 self-assigned this Nov 25, 2025
@priyansh4320 priyansh4320 linked an issue Nov 25, 2025 that may be closed by this pull request
@marklysze marklysze self-requested a review November 25, 2025 20:40
@KojoOwusu
Copy link

KojoOwusu commented Dec 1, 2025

So Im testing out the new changes here but I seem to be getting an error with my async tool calls not being awaited

Call ID: tooluse_o4Tw0b5bS9mZJTlg5dcs3w
Input arguments: {'query': 'FACULTY SCIENCE LTD technology consultancy Old Street London'}
Output:
<coroutine object web_search at 0x10a823e20>
_Group_Tool_Executor (to chat_manager):

***** Response from calling tool (tooluse_o4Tw0b5bS9mZJTlg5dcs3w) *****
<coroutine object web_search at 0x10a823e20>```

@randombet randombet self-requested a review December 1, 2025 18:38
@priyansh4320
Copy link
Collaborator Author

So Im testing out the new changes here but I seem to be getting an error with my async tool calls not being awaited

Call ID: tooluse_o4Tw0b5bS9mZJTlg5dcs3w
Input arguments: {'query': 'FACULTY SCIENCE LTD technology consultancy Old Street London'}
Output:
<coroutine object web_search at 0x10a823e20>
_Group_Tool_Executor (to chat_manager):

***** Response from calling tool (tooluse_o4Tw0b5bS9mZJTlg5dcs3w) *****
<coroutine object web_search at 0x10a823e20>```

solved in this PR:
#2221

@KojoOwusu
Copy link

KojoOwusu commented Dec 2, 2025

So the changes in 2221 solved the async. Agent runs but when it tries to call structured_output tool i get error:


***** Response from calling tool (tooluse_WcVAwKeaQgyEyO1KAHaTSg) *****
Error: Function __structured_output not found.`

@randombet
Copy link
Collaborator

@priyansh4320 Please add integration tests with real API calls.

@DanCorvesor
Copy link

@priyansh4320 sorry to be impatient but wanted to check in on this

@priyansh4320
Copy link
Collaborator Author

@priyansh4320 sorry to be impatient but wanted to check in on this

@DanCorvesor integration tests should be done by today. and then we will merge bedrock PRs. :) thank you checking.

@DanCorvesor
Copy link

Did you see @KojoOwusu 's above comment tho, seems we've found an issue

Copy link
Collaborator

@marklysze marklysze left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @priyansh4320, nice work!

@marklysze marklysze added this pull request to the merge queue Dec 5, 2025
Merged via the queue into main with commit 2b69f3f Dec 5, 2025
30 of 32 checks passed
@marklysze marklysze deleted the bedrock-client-structured-output branch December 5, 2025 04:06
@codecov
Copy link

codecov bot commented Dec 8, 2025

Codecov Report

❌ Patch coverage is 62.68657% with 25 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
autogen/oai/bedrock.py 62.68% 15 Missing and 10 partials ⚠️
Files with missing lines Coverage Δ
autogen/oai/bedrock.py 62.30% <62.68%> (+15.61%) ⬆️

... and 13 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: Not exposing the structured outputs for Bedrock

6 participants