Skip to content

Conversation

@ultmaster
Copy link
Contributor

Summary

  • add a reusable utility for creating, starting, and stopping uvicorn servers in threads or processes
  • switch the LLM proxy and LightningStore server to use the shared uvicorn helper
  • update the tracer integration mock server to rely on the new helper

Testing

  • pytest tests/tracer/test_integration.py -k MockOpenAICompatibleServer -q

https://chatgpt.com/codex/tasks/task_e_68e7f90eddf0832e87b35c7accb5c8d0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant