You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: deploy/utils/README.md
+37-31Lines changed: 37 additions & 31 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -19,9 +19,7 @@ This includes:
19
19
-`manifests/`
20
20
-`pvc.yaml` — PVC `dynamo-pvc` for storing profiler results and configurations
21
21
-`pvc-access-pod.yaml` — short‑lived pod for copying profiler results from the PVC
22
-
-`kubernetes.py` — helper used by tooling to apply/read resources (e.g., access pod for PVC downloads)
23
-
-`inject_manifest.py` — utility for injecting deployment configurations into the PVC for profiling
24
-
-`download_pvc_results.py` — utility for downloading benchmark/profiling results from the PVC
22
+
-`kubernetes.py` — helper used by tooling to apply/read resources (e.g., access pod for PVC access)
25
23
-`dynamo_deployment.py` — utilities for working with DynamoGraphDeployment resources
26
24
-`requirements.txt` — Python dependencies for benchmarking utilities
27
25
@@ -70,64 +68,72 @@ After running the setup script, verify the resources by checking:
70
68
kubectl get pvc dynamo-pvc -n $NAMESPACE
71
69
```
72
70
73
-
### PVC Manipulation Scripts
71
+
### Working with the PVC
74
72
75
-
These scripts interact with the Persistent Volume Claim (PVC) that stores configuration files and benchmark/profiling results. They're essential for the Dynamo benchmarking and profiling workflows.
73
+
The Persistent Volume Claim (PVC) stores configuration files and benchmark/profiling results. Use `kubectl cp` to copy files to and from the PVC.
76
74
77
-
#### Why These Scripts Are Needed
75
+
#### Setting Up PVC Access
78
76
79
-
1.**For Pre-Deployment Profiling**: The profiling job needs access to your Dynamo deployment configurations (DGD manifests) to test different parallelization strategies
80
-
2.**For Retrieving Results**: Both benchmarking and profiling jobs write their results to the PVC, which you need to download for analysis
77
+
First, create a temporary access pod to interact with the PVC:
> **Note on Profiling Results**: When using DGDR (DynamoGraphDeploymentRequest) for SLA-driven profiling, profiling data is stored in `/data/` on the PVC. The planner component reads this data directly from the PVC, so downloading is **optional** - only needed if you want to inspect the profiling results locally (e.g., view performance plots, check configurations).
118
120
119
-
#### Path Requirements
121
+
#### Cleanup Access Pod
122
+
123
+
When finished, delete the access pod:
124
+
125
+
```bash
126
+
kubectl delete pod pvc-access-pod -n $NAMESPACE
127
+
```
120
128
121
-
**Important**: The PVC is mounted at `/data` in the access pod for security reasons. All destination paths must start with `/data/`.
-`/data/results/` - Benchmark results (for download after benchmarking jobs)
126
134
-`/data/` - Profiling data (used directly by planner, typically not downloaded)
127
135
-`/data/benchmarking/` - Benchmarking artifacts
128
136
129
-
**User-friendly error messages**: If you forget the `/data/` prefix, the script will show a helpful error message with the correct path and example commands.
130
-
131
137
#### Next Steps
132
138
133
139
For complete benchmarking and profiling workflows:
0 commit comments