Skip to content

hieupth/tritonserver

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Triton Server

A build from source Triton Inference Server image with utilities. The image is publicly available as hieupth/tritonserver:[version]-[tag].

Version Tag Device Backend
25.04 none GPU OnnxRuntime, TensorRT
25.04 cpu CPU OnnxRuntime
25.04 vllm GPU vLLM

Install dependencies

Download models from Huggingface

License

GNU AGPL v3.0
Copyright © 2025 Hieu Pham. All rights reserved.

About

A customized Triton Inference Server image for fast and flexible deployment

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •