Skip to content

Commit 1542fbb

Browse files
committed
Finalize update of Open WebUI to vLLM inference
1 parent 5a7751b commit 1542fbb

File tree

3 files changed

+5
-4
lines changed

3 files changed

+5
-4
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -84,7 +84,7 @@ The GPU node I am running for model inference is quite different and uses the fo
8484
3. [AMD 9800x3D CPU](https://amzn.to/3K04gQk)
8585
4. [128gb DDR5 Corsair RAM](https://amzn.to/489KtXV)
8686
5. [8TB Western Digital NVMe SSD](https://amzn.to/49OdUju)
87-
6. [Nvidia RTX 6000 Pro Workstation GPU](https://amzn.to/4amKZTJ)
87+
6. [Nvidia RTX 5090 FE GPU](https://www.walmart.com/ip/NVIDIA-GeForce-RTX-5090-Graphic-Card-32GB-GDDR7/15176552726?wmlspartner=wlpa&selectedSellerId=102776342&sourceid=dsn_ad_34ba2672-106a-484b-a996-41cf96423ae3&veh=dsn&wmlspartner=dsn_ad_34ba2672-106a-484b-a996-41cf96423ae3&cn=FY26-MP-PMax-P13N_cnv_dps_dsn_dis_ad_mp_s_n&gclsrc=aw.ds&wl9=pla&wl11=online&gad_source=1&gad_campaignid=22437915517&gbraid=0AAAAADmfBIoWMJ-7ViIpR86Zh1q0Gmlk2&gclid=CjwKCAiAlrXJBhBAEiwA-5pgwrykl7_Y7RNg8jth7acgZtNw2I2QFscKcJaRvuJCTO10Z2nHWsbTmBoCVecQAvD_BwE)
8888
7. [Corsair SF1000 PSU](https://amzn.to/4okJn05)
8989
8. [NZXT Kraken Elite 280mm AIO](https://amzn.to/4okXBxZ)
9090
9. [Noctua 120mm Fans](https://amzn.to/4okXBxZ)

argocd/apps/applications/open-webui/open-webui-app.yaml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,9 +18,10 @@ spec:
1818
syncOptions:
1919
- CreateNamespace=true
2020
- Prune=true
21+
- RespectIgnoreDifferences=true
2122
ignoreDifferences:
2223
- group: apps
2324
kind: StatefulSet
2425
name: open-webui
25-
jqPathExpressions:
26-
- '.spec.template.spec.containers[0].env[] | select(.name == "OLLAMA_BASE_URLS") | .value'
26+
managedFieldsManagers:
27+
- kubectl-set

helm/open-webui/templates/patch-job.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ spec:
4242
kubectl get secrets -n {{ include "open-webui.namespace" . }}
4343
exit 1
4444
fi
45-
VLLM_URL="http://${VLLM_IP}:8000"
45+
VLLM_URL="http://${VLLM_IP}:8000/v1"
4646
echo "vLLM URL: $VLLM_URL"
4747
4848
# Patch the StatefulSet with OPENAI_API_BASE_URL environment variable (using set env to merge, not replace)

0 commit comments

Comments
 (0)