We should move the LLM Tests to a separate CI so that we are not blocked in CI incase there is some issue with the LLM endpoints/deprecated versions