A build from source Triton Inference Server image with utilities. The image is publicly available as hieupth/tritonserver:[version]-[tag].
| Version | Tag | Device | Backend |
|---|---|---|---|
| 25.04 | none | GPU | OnnxRuntime, TensorRT |
| 25.04 | cpu | CPU | OnnxRuntime |
| 25.04 | vllm | GPU | vLLM |
GNU AGPL v3.0
Copyright © 2025 Hieu Pham. All rights reserved.