Skip to content

2 create plots #77

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
raeesiarya wants to merge 54 commits into
base: main
Choose a base branch
from
Open

2 create plots #77

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
f91e4d0
show num_prefill_tokens and num_decode_tokens in chrome trace
andersvestrum Oct 26, 2025
4faa6ea
small change to gitignore
hannaroed Oct 26, 2025
ff41325
simple llunix global scheduler (no preemtion)
hannaroed Oct 26, 2025
1d426ff
maybe a good start(??)
hannaroed Oct 27, 2025
37250b6
mini print fix
hannaroed Oct 27, 2025
f1456f7
added llumlet scheduler
andersvestrum Oct 27, 2025
36b5679
implemented migration on the llumnets
andersvestrum Oct 29, 2025
50cc71c
added plots
hannaroed Nov 13, 2025
48b6557
change priority from low to high (importance) and also added multi-re…
andersvestrum Nov 13, 2025
8e07df9
Merge pull request #6 from andersvestrum/local_llumlet_scheduler
andersvestrum Nov 13, 2025
4f94b51
500 requests instead of 64
hannaroed Nov 16, 2025
5e29095
Merge remote-tracking branch 'origin/main' into try-diff-replica-sche…
hannaroed Nov 16, 2025
41b1789
migration now finally works - transfer from one replica to another
andersvestrum Nov 16, 2025
676fc1e
Merge pull request #8 from andersvestrum/7-fix-that-migration-says-tr…
andersvestrum Nov 16, 2025
d49cd77
Merge remote-tracking branch 'origin/main' into try-diff-replica-sche…
hannaroed Nov 16, 2025
3c224c1
fixed the llumlet scheduler- can be defined with cli
andersvestrum Nov 19, 2025
75bc38d
fixed colors in chrome trace
andersvestrum Nov 19, 2025
57dcc96
Merge pull request #9 from andersvestrum/7-fix-that-migration-says-tr…
andersvestrum Nov 19, 2025
4c1915c
Added plots for latency
raeesiarya Nov 24, 2025
3517a3a
Merge branch 'main' into try-diff-replica-schedulers
hannaroed Nov 25, 2025
c09c4f8
working version, still need to do more than 1 replica versions
hannaroed Nov 25, 2025
19985c7
Added plots for ttft tbt etc. Created testbench for use in Savio rese…
raeesiarya Nov 25, 2025
3f2516e
Part of last commit lowkey
raeesiarya Nov 25, 2025
7e9897f
Added more tests and made weights & biases logging more clear.
raeesiarya Nov 25, 2025
33ee31c
Merge pull request #10 from andersvestrum/2-create-plots
raeesiarya Nov 25, 2025
4320920
plots plus added a safety guard for not exceeding total number of tokens
hannaroed Nov 26, 2025
d1a83cb
auto-scaling works
andersvestrum Nov 26, 2025
b2006e4
compliance with the paper + docs
andersvestrum Nov 26, 2025
eb43a6e
Merge pull request #11 from andersvestrum/7-fix-that-migration-says-t…
andersvestrum Nov 26, 2025
0da91ba
Merge branch 'main' into try-diff-replica-schedulers
hannaroed Nov 26, 2025
8d69140
made it possible to run other replicas than llumlet under llumnix
andersvestrum Nov 26, 2025
daca071
change algorithm
andersvestrum Nov 26, 2025
bdfc7da
deleted markdown
andersvestrum Nov 26, 2025
28c8312
Merge pull request #12 from andersvestrum/correct_algorithm_freeness
andersvestrum Nov 26, 2025
a95c72f
removed duplace request_enqueue call
andersvestrum Nov 27, 2025
9ff7806
fixed that batch in calculation calculation actually is dynamic and n…
andersvestrum Nov 27, 2025
f120258
added scale out bounded by num_replicas + changed headroom for differ…
andersvestrum Nov 27, 2025
42231eb
change plotting
hannaroed Nov 27, 2025
17e12e7
Merge branch 'correct_algorithm_freeness'
hannaroed Nov 27, 2025
c7b3bb8
Merge branch 'main' into try-diff-replica-schedulers
hannaroed Nov 27, 2025
6db2607
correct plots
hannaroed Nov 27, 2025
725cba4
compare scheduelrs now varies pri levels, fixed at 4 replicas
hannaroed Nov 28, 2025
c975355
compare llumnix vs. RR
hannaroed Nov 28, 2025
dcfa844
more stuff
hannaroed Nov 29, 2025
134ca2b
parallelized plots in savio sever
raeesiarya Nov 26, 2025
e9582be
New test types and matrix config
raeesiarya Nov 26, 2025
e133a70
Added variable request levels to matrix.
raeesiarya Nov 27, 2025
e45cb00
Adding placeholders for cache and logs
raeesiarya Nov 27, 2025
8b0e85b
same
raeesiarya Nov 27, 2025
02b08f6
slurm jobs working well.
raeesiarya Nov 27, 2025
86f4628
Added metrics to run_tests and slurm job.
raeesiarya Nov 28, 2025
b06290f
Added logic for slurm jobs with comparing schedulers + added infaas g…
raeesiarya Nov 28, 2025
739451b
changed for infaas in system metrics
raeesiarya Nov 29, 2025
9e2e9e5
added more shell scripts and wandb logic
raeesiarya Nov 29, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -161,7 +161,6 @@ cython_debug/
#.idea/

# Custom
cache
cache_random_forrest
cache_linear_regression
cache*
Expand Down
1 change: 1 addition & 0 deletions .python-version
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
3.10
Loading