Adjust the ntask parameter in the Runmodel module to set the number of parallel tasks. #241
Unanswered
TaeWoong-Jeong
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello, I use the RunModel module to execute third-party software using GNU parallel.
I am exploring how to adjust ntask to calculate the desired number of samples in parallel.
For example, if there are 100 samples and ntask=5 is set, I expect to distribute 20 samples to each of the 5 cores and run them in parallel. This should result in 5 output folders named Model_Runs_~, each containing 20 run_{index} folders.
I tested it, and it seems that whether I set ntask to 5 or any number, all samples are calculated in parallel at once.
Currently, my node has 48 cores, and it seems that as long as ntask is 2 or more, all samples are automatically and evenly distributed across the 48 cores for parallel computation. If I want to use only 10 cores, for example, is there a way to control this?
Thank you.
Beta Was this translation helpful? Give feedback.
All reactions