Triton server model repo does not reflect MLFlow version #5691
              
                Unanswered
              
          
                  
                    
                      jackroseman
                    
                  
                
                  asked this question in
                Q&A
              
            Replies: 1 comment
-
| 
         CC: @GuanLuo  | 
  
Beta Was this translation helpful? Give feedback.
                  
                    0 replies
                  
                
            
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
I am trying to understand better if there is a requirement for the triton model repository to only have a version "1". What I see is when I use the mlflow-triton plugin, if the model, call it "model1" is versioned as "6" in MLFlow, then I would expect the model repo to look like the following:
Looking at the mlflow-triton plugin code, I see that the model repo will replace the model version in this file structure with "1". This is alright because if I deploy the model by the model version number using the
create_deployment(model_name, model_uri, flavor), themlflow-meta.jsonfile has the mapping to the mlflow model uri, which can tell me the MLFlow version that was deployed. You see, the issue with this is that I am able to specify the model_uri to bemodels:/model1/stagingwhich does not give me traceability to the mlflow model version if the model moves out of staging for some reason.For my use case, I find it both important to not specify the mlflow model version during deployment ('models:/model1/production'). However, once a model is in 'production', it is required for me to ensure full traceability to the mlflow model version.
Is there a requirement on the model repo to always use "1" as the model version in the repository? I am considering either modifying the model repo, or the information in the
mlflow-meta.jsonto preserve the version even when I pass in model stage as the model URI.Thanks
Beta Was this translation helpful? Give feedback.
All reactions