80 add initial slurm scripts

[EdwinB12]

Two example slurm scripts for running the autoencoder and encoder-processor-decoder setup.

I haven't managed to integrate this with wandb yet but will once I get access to the turing org.

Hopefully the readme explains the rest :)

[EdwinB12]

resolves #80

[sgreenbury]

Looks great, thanks @EdwinB12! I added some small suggestions for the sbatch params, ordering and outputs.

[EdwinB12]

Okay thanks Sam, made changes and it works. The only thing about removing the sbatch flags at the top with the error and output logs is that the jobs now write some incomplete slurm logs to the cwd which could be misleading.

[sgreenbury]

Okay thanks Sam, made changes and it works. The only thing about removing the sbatch flags at the top with the error and output logs is that the jobs now write some incomplete slurm logs to the cwd which could be misleading.

Great and good point about the outputs - would moving the working dir creation and redirection to after the #sbatch lines fix this? If not, could add the sbatch flags back too.