Skip to content

Docker Model Runner LLM/Agent Provider #4477

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 5 commits into
base: master
Choose a base branch
from
Open

Docker Model Runner LLM/Agent Provider #4477

wants to merge 5 commits into from

Conversation

@shatfield4
Copy link
Collaborator

@shatfield4 shatfield4 commented Oct 2, 2025 •
edited
Loading

Pull Request Type

  • ✨ feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #4391

What is in this change?

  • Add support for Docker Model Runner LLM provider
  • Auto URL detection for DMR LLM provider
  • Add support for Docker Model Runner agent provider (including agent streaming)

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

@shatfield4 shatfield4 linked an issue Oct 2, 2025 that may be closed by this pull request
[FEAT]: Integrate Docker Model Runner as a Local Inferencing provide #4391
Open
@shatfield4 shatfield4 marked this pull request as ready for review October 3, 2025 00:38
@shatfield4 shatfield4 added the PR:needs review Needs review by core team label Oct 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@timothycarambat timothycarambat Awaiting requested review from timothycarambat

Assignees

@timothycarambat timothycarambat

Labels

PR:needs review Needs review by core team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[FEAT]: Integrate Docker Model Runner as a Local Inferencing provide

3 participants

@shatfield4 @timothycarambat