Skip to content

Conversation

@mrariden
Copy link
Collaborator

@mrariden mrariden commented Nov 25, 2025

Add back in support for batches of images as numpy arrays (eg [N, H, W, C]).

Timing results

Using a random numpy array of (50, 1024, 1024, 3) on a RTX 6000, averaged over 10 calls to .eval()

batch_size time (s)
1 10.7
5 9.06
10 8.79
20 9.08
40 8.94
60 8.85

Using a random numpy array of (50, 50, 50, 3) on a RTX 6000, averaged over 10 calls to .eval()

batch_size time (ms)
1 903
10 729
60 713
100 726

Using a stack of 512, 240x240 images on a RTX 6000, no averaging:

batch_size forward pass time (s) total net time (s) total .eval() time (s)
1 0.015 14.0 30.7
4 0.033 5.43 21.0
8 0.0615 5.02 21.1
16 0.120 4.84 20.6
32 0.244 4.82 20.7

@mrariden
Copy link
Collaborator Author

mrariden commented Nov 25, 2025

resolves #1372

@mrariden mrariden merged commit 17fb25f into main Dec 3, 2025
7 of 14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants